2023-05-17T12:03:57.055 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-17T12:03:57.057 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-05-17_11:52:03-fs-wip-vshankar-testing-20230509.090020-6-testing-default-smithi/7276643 --owner scheduled_vshankar@teuthology --name vshankar-2023-05-17_11:52:03-fs-wip-vshankar-testing-20230509.090020-6-testing-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/vshankar-2023-05-17_11:52:03-fs-wip-vshankar-testing-20230509.090020-6-testing-default-smithi/7276643/orig.config.yaml 2023-05-17T12:03:57.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-17T12:03:57.198 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-05-17_11:52:03-fs-wip-vshankar-testing-20230509.090020-6-testing-default-smithi/7276643 branch: wip-vshankar-testing-20230509.090020-6 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7276643' kernel: flavor: default kdb: true sha1: 2bcb179390319a07fc43480888bd707374860ab3 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-05-17_11:52:03-fs-wip-vshankar-testing-20230509.090020-6-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-20230509.090020-6 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230509.090020-6 sha1: 280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb owner: scheduled_vshankar@teuthology priority: 20 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230509.090020-6 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi088.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDrhp0nTkm95pKMCZ7hkp5EHI74Ae1VK9JN8sJLK2MlewbUx2ytONyEebzyWEoWqUN7WPJZoOmfQacbmnYF1q+e++UG/g9gvdnt7CYS7BTh00UHqDtrSoRB+0mbcCpKnkVPy1+fDXrsOxgsWu2CDlNP+3w23qsv8Lyp1iPZecVeyOWQPIVib+UpvGPWAW4FTMi84RqoO+Dja5c03sTGgvhuuJUs5MEjGEgvw/1hHYI5J7g8NvgPSpVqLa9WfVar3TtIpnQo1KZCj6qFaNQJqibIbVZcvDgbzWG9vrVQh1j0BZCHJN1oLId77hVmVPYaXB5AjiljPT6ztFzF4bear3pcW52lGeDfa1m1Z4+o8LgGbzt/ii6BCDeXANNn/Wa/NJQrryzemLr2GYcdux+f4EATwGQCDGTm4V3vzhbK+LflRnuCGUulsViL/d57VKQAQuN2BuADhAJX2pL9xflmmds0WB1+mcL67kDdSuPyLpvqmLWPklAzDCo0fzlCR7fhGzk= smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiKj4nDshQ3Gd3KQbVlKQ9ypPfCukHCnzSMBf6fJEQtpWQHtZiCmckoOLaIgpslG7IJfDbIuhUc0/aukmaLIIJldyT1FUUDVJ+x+NzFlEaF1rPVeLMRtd7BUCKqodkt3/Q6QdHqjs0rfXeZHlU0Cu7ddlH5ouQncjRBDCK5F1D7RLsB9B9T/On+FSnAnDDlbb/41Ua6X5r+X+OWKnxLa2BKQZoHjD0p86epbBxQ5R4HHGYeVylwIiAs0YE/ilLSeOtVqB4PlcwC2g7hrf5xUwcKpjWbDPPXHyWP2LJE+TQaBVfiHf5BKczvKoakASzabFi4eEEpdqgbBXBecoHejqBPs+gnD1RpavW+TkXctAZwujDfPeA5FKDbpjeFpCguVU+a3LyB7XewuYeuGp2Hkhq7HTDgeL2lnFZn5ppc+BdSESFZz36O9s2MqiKo7BlZzXd1sLK+U+164NCvBSMyiWkV7XJJfW97JckN4nw4e8/uMCeVnvS7ajhROeoJlplVdM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-17_11:52:03 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-17T12:03:57.199 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/qa; will attempt to use it 2023-05-17T12:03:57.200 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/qa/tasks 2023-05-17T12:03:57.200 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-17T12:03:57.202 INFO:teuthology.task.internal:Checking packages... 2023-05-17T12:03:57.231 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb' 2023-05-17T12:03:57.232 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-17T12:03:57.232 INFO:teuthology.packaging:ref: None 2023-05-17T12:03:57.232 INFO:teuthology.packaging:tag: None 2023-05-17T12:03:57.233 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230509.090020-6 2023-05-17T12:03:57.233 INFO:teuthology.packaging:sha1: 280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb 2023-05-17T12:03:57.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230509.090020-6 2023-05-17T12:03:57.367 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3942.g280675bb 2023-05-17T12:03:57.368 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-17T12:03:57.375 INFO:teuthology.task.internal:no buildpackages task found 2023-05-17T12:03:57.375 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-17T12:03:57.390 INFO:teuthology.task.internal:Saving configuration 2023-05-17T12:03:57.415 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-17T12:03:57.422 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-17T12:03:57.449 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-17_11:52:03-fs-wip-vshankar-testing-20230509.090020-6-testing-default-smithi/7276643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-17 11:58:24.954390', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNvj3/MPM/BTpEiuMNDrnQlX8QWndEbRHElbmia9ggGrRuxKdxT+5cNqY0EtWunWXI7yE1oAzMN1UQ6daVEfT7c='} 2023-05-17T12:03:57.472 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-17_11:52:03-fs-wip-vshankar-testing-20230509.090020-6-testing-default-smithi/7276643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-17 11:58:24.955919', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDprIrXmDq4NGT0C7JPfMKgYOnOokLIYU8NE+u3ivEg7yW3eYon5Zj1+i2mbRESt3yEgp3r7vQxOQ2D1mfHD6OY='} 2023-05-17T12:03:57.473 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-17T12:03:57.479 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-17T12:03:57.479 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-17T12:03:57.479 INFO:teuthology.run_tasks:Running task console_log... 2023-05-17T12:03:57.566 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f837fbadee0>, signals=[15]) 2023-05-17T12:03:57.567 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-17T12:03:57.573 INFO:teuthology.task.internal:Opening connections... 2023-05-17T12:03:57.573 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T12:03:57.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:03:57.644 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T12:03:57.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:03:57.715 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-17T12:03:57.722 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-05-17T12:03:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-05-17T12:03:57.745 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-05-17T12:03:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-05-17T12:03:57.806 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2023-05-17T12:03:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-05-17T12:03:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-05-17T12:03:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2023-05-17T12:03:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-05-17T12:03:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-17T12:03:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-05-17T12:03:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-17T12:03:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-05-17T12:03:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-17T12:03:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-17T12:03:57.808 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-17T12:03:57.809 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-05-17T12:03:57.838 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-05-17T12:03:57.861 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-05-17T12:03:57.861 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-05-17T12:03:57.923 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-05-17T12:03:57.923 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2023-05-17T12:03:57.924 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-05-17T12:03:57.924 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-05-17T12:03:57.924 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2023-05-17T12:03:57.924 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-05-17T12:03:57.924 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-17T12:03:57.924 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-05-17T12:03:57.924 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-17T12:03:57.925 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-05-17T12:03:57.925 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-17T12:03:57.925 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-17T12:03:57.925 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-17T12:03:57.925 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-05-17T12:03:57.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-17T12:03:57.955 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-17T12:03:57.961 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-17T12:03:57.962 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-05-17T12:03:57.964 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2023-05-17T12:03:57.984 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-17T12:03:57.991 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-17T12:03:57.992 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-05-17T12:03:58.026 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2023-05-17T12:03:58.057 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-17T12:03:58.117 INFO:teuthology.run_tasks:Running task kernel... 2023-05-17T12:03:58.134 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'} 2023-05-17T12:03:58.135 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'}}, timeout 300 2023-05-17T12:03:58.136 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-17T12:03:58.136 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-17T12:03:58.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T12:03:58.156 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T12:03:58.156 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2bcb179390319a07fc43480888bd707374860ab3"... 2023-05-17T12:03:58.157 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-05-17T12:03:58.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T12:03:58.158 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T12:03:58.159 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2bcb179390319a07fc43480888bd707374860ab3"... 2023-05-17T12:03:58.159 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-05-17T12:03:58.215 INFO:teuthology.orchestra.run.smithi187.stdout:4.18.0-489.el8.x86_64 2023-05-17T12:03:58.216 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T12:03:58.216 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-17T12:03:58.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T12:03:58.221 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-489.el8.x86_64 2023-05-17T12:03:58.221 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T12:03:58.221 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-17T12:03:58.221 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T12:03:58.360 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum upgrade -y linux-firmware 2023-05-17T12:03:58.363 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum upgrade -y linux-firmware 2023-05-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 4.4 MB/s | 29 MB 00:06 2023-05-17T12:04:16.376 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - AppStream 1.9 MB/s | 29 MB 00:15 2023-05-17T12:04:22.095 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 3.7 MB/s | 34 MB 00:09 2023-05-17T12:04:27.578 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 52 kB/s | 18 kB 00:00 2023-05-17T12:04:28.187 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.4 kB 00:00 2023-05-17T12:04:30.872 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-17T12:04:32.441 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - BaseOS 3.2 MB/s | 34 MB 00:10 2023-05-17T12:04:37.725 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras 100 kB/s | 18 kB 00:00 2023-05-17T12:04:38.100 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras common packages 29 kB/s | 6.4 kB 00:00 2023-05-17T12:04:39.323 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 1.7 MB/s | 14 MB 00:08 2023-05-17T12:04:40.727 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-17T12:04:42.720 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 329 kB/s | 24 kB 00:00 2023-05-17T12:04:45.980 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-05-17T12:04:46.090 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-05-17T12:04:46.090 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-05-17T12:04:46.112 INFO:teuthology.task.kernel:Downloading kernel 2bcb179390319a07fc43480888bd707374860ab3 on mon.a... 2023-05-17T12:04:46.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T12:04:46.308 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/centos/8/flavors/default/x86_64/ 2023-05-17T12:04:46.309 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_g2bcb17939031-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-17T12:04:46.311 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi088.front.sepia.ceph.com to complete... 2023-05-17T12:04:47.070 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 2.2 MB/s | 14 MB 00:06 2023-05-17T12:04:50.518 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 559 kB/s | 24 kB 00:00 2023-05-17T12:04:53.861 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-05-17T12:04:53.862 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2023-05-17T12:04:53.862 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-05-17T12:04:54.064 INFO:teuthology.task.kernel:Downloading kernel 2bcb179390319a07fc43480888bd707374860ab3 on mon.b... 2023-05-17T12:04:54.064 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2bcb179390319a07fc43480888bd707374860ab3 2023-05-17T12:04:54.204 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/centos/8/flavors/default/x86_64/ 2023-05-17T12:04:54.205 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_g2bcb17939031-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-17T12:04:54.207 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi187.front.sepia.ceph.com to complete... 2023-05-17T12:05:01.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17 12:05:01 URL:https://4.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/centos/8/flavors/default/x86_64/kernel-6.3.0_g2bcb17939031-1.x86_64.rpm [378546608/378546608] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-17T12:05:01.266 INFO:teuthology.orchestra.run.smithi088.stderr:FINISHED --2023-05-17 12:05:01-- 2023-05-17T12:05:01.266 INFO:teuthology.orchestra.run.smithi088.stderr:Total wall clock time: 15s 2023-05-17T12:05:01.266 INFO:teuthology.orchestra.run.smithi088.stderr:Downloaded: 1 files, 361M in 15s (24.6 MB/s) 2023-05-17T12:05:01.268 INFO:teuthology.task.kernel:Installing kernel 2bcb179390319a07fc43480888bd707374860ab3 on mon.a... 2023-05-17T12:05:01.268 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-17T12:05:03.018 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying... ######################################## 2023-05-17T12:05:03.098 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing... ######################################## 2023-05-17T12:05:03.231 INFO:teuthology.orchestra.run.smithi088.stdout:Updating / installing... 2023-05-17T12:05:11.514 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17 12:05:11 URL:https://4.chacra.ceph.com/r/kernel/testing/2bcb179390319a07fc43480888bd707374860ab3/centos/8/flavors/default/x86_64/kernel-6.3.0_g2bcb17939031-1.x86_64.rpm [378546608/378546608] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-17T12:05:11.514 INFO:teuthology.orchestra.run.smithi187.stderr:FINISHED --2023-05-17 12:05:11-- 2023-05-17T12:05:11.514 INFO:teuthology.orchestra.run.smithi187.stderr:Total wall clock time: 17s 2023-05-17T12:05:11.515 INFO:teuthology.orchestra.run.smithi187.stderr:Downloaded: 1 files, 361M in 17s (21.6 MB/s) 2023-05-17T12:05:11.516 INFO:teuthology.task.kernel:Installing kernel 2bcb179390319a07fc43480888bd707374860ab3 on mon.b... 2023-05-17T12:05:11.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-17T12:05:13.265 INFO:teuthology.orchestra.run.smithi187.stdout:Verifying... ######################################## 2023-05-17T12:05:13.340 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing... ######################################## 2023-05-17T12:05:13.476 INFO:teuthology.orchestra.run.smithi187.stdout:Updating / installing... 2023-05-17T12:05:40.855 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-6.3.0_g2bcb17939031-1 ######################################## 2023-05-17T12:05:51.066 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-6.3.0_g2bcb17939031-1 ######################################## 2023-05-17T12:06:06.191 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-17T12:06:06.192 DEBUG:teuthology.orchestra.run.smithi088:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-17T12:06:06.251 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/System.map-6.3.0-g2bcb17939031 2023-05-17T12:06:06.251 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/config-6.3.0-g2bcb17939031 2023-05-17T12:06:06.252 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/vmlinuz-6.3.0-g2bcb17939031 2023-05-17T12:06:06.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031 2023-05-17T12:06:06.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel 2023-05-17T12:06:06.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch 2023-05-17T12:06:06.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86 2023-05-17T12:06:06.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto 2023-05-17T12:06:06.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-17T12:06:06.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-17T12:06:06.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-17T12:06:06.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-17T12:06:06.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-17T12:06:06.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-17T12:06:06.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-17T12:06:06.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-17T12:06:06.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-17T12:06:06.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-17T12:06:06.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-17T12:06:06.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-17T12:06:06.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-17T12:06:06.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-17T12:06:06.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-17T12:06:06.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-17T12:06:06.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-17T12:06:06.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-17T12:06:06.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-17T12:06:06.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-17T12:06:06.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel 2023-05-17T12:06:06.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu 2023-05-17T12:06:06.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/mce 2023-05-17T12:06:06.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-17T12:06:06.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm 2023-05-17T12:06:06.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-17T12:06:06.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-17T12:06:06.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm.ko 2023-05-17T12:06:06.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto 2023-05-17T12:06:06.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ansi_cprng.ko 2023-05-17T12:06:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/anubis.ko 2023-05-17T12:06:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/arc4.ko 2023-05-17T12:06:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx 2023-05-17T12:06:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_memcpy.ko 2023-05-17T12:06:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_pq.ko 2023-05-17T12:06:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-17T12:06:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_tx.ko 2023-05-17T12:06:06.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_xor.ko 2023-05-17T12:06:06.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/raid6test.ko 2023-05-17T12:06:06.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/authenc.ko 2023-05-17T12:06:06.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/authencesn.ko 2023-05-17T12:06:06.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blake2b_generic.ko 2023-05-17T12:06:06.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blowfish_common.ko 2023-05-17T12:06:06.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blowfish_generic.ko 2023-05-17T12:06:06.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/camellia_generic.ko 2023-05-17T12:06:06.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast5_generic.ko 2023-05-17T12:06:06.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast6_generic.ko 2023-05-17T12:06:06.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast_common.ko 2023-05-17T12:06:06.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ccm.ko 2023-05-17T12:06:06.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cmac.ko 2023-05-17T12:06:06.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crc32_generic.ko 2023-05-17T12:06:06.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_engine.ko 2023-05-17T12:06:06.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_user.ko 2023-05-17T12:06:06.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cts.ko 2023-05-17T12:06:06.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/des_generic.ko 2023-05-17T12:06:06.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/dh_generic.ko 2023-05-17T12:06:06.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/echainiv.ko 2023-05-17T12:06:06.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/essiv.ko 2023-05-17T12:06:06.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/fcrypt.ko 2023-05-17T12:06:06.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/khazad.ko 2023-05-17T12:06:06.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lz4.ko 2023-05-17T12:06:06.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lz4hc.ko 2023-05-17T12:06:06.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/md4.ko 2023-05-17T12:06:06.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/michael_mic.ko 2023-05-17T12:06:06.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/pcbc.ko 2023-05-17T12:06:06.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/pcrypt.ko 2023-05-17T12:06:06.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/rmd160.ko 2023-05-17T12:06:06.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/seed.ko 2023-05-17T12:06:06.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/serpent_generic.ko 2023-05-17T12:06:06.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/tcrypt.ko 2023-05-17T12:06:06.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/tea.ko 2023-05-17T12:06:06.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/twofish_common.ko 2023-05-17T12:06:06.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/twofish_generic.ko 2023-05-17T12:06:06.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/vmac.ko 2023-05-17T12:06:06.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/wp512.ko 2023-05-17T12:06:06.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xcbc.ko 2023-05-17T12:06:06.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xor.ko 2023-05-17T12:06:06.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xxhash_generic.ko 2023-05-17T12:06:06.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers 2023-05-17T12:06:06.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi 2023-05-17T12:06:06.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-17T12:06:06.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_pad.ko 2023-05-17T12:06:06.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/custom_method.ko 2023-05-17T12:06:06.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/ec_sys.ko 2023-05-17T12:06:06.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/platform_profile.ko 2023-05-17T12:06:06.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/sbs.ko 2023-05-17T12:06:06.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/sbshc.ko 2023-05-17T12:06:06.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/video.ko 2023-05-17T12:06:06.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata 2023-05-17T12:06:06.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/acard-ahci.ko 2023-05-17T12:06:06.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ahci_platform.ko 2023-05-17T12:06:06.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ata_generic.ko 2023-05-17T12:06:06.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/libahci_platform.ko 2023-05-17T12:06:06.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_acpi.ko 2023-05-17T12:06:06.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ali.ko 2023-05-17T12:06:06.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_amd.ko 2023-05-17T12:06:06.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_artop.ko 2023-05-17T12:06:06.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_atiixp.ko 2023-05-17T12:06:06.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_atp867x.ko 2023-05-17T12:06:06.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cmd640.ko 2023-05-17T12:06:06.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cmd64x.ko 2023-05-17T12:06:06.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cypress.ko 2023-05-17T12:06:06.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_efar.ko 2023-05-17T12:06:06.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt366.ko 2023-05-17T12:06:06.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt37x.ko 2023-05-17T12:06:06.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-17T12:06:06.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-17T12:06:06.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_it8213.ko 2023-05-17T12:06:06.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_it821x.ko 2023-05-17T12:06:06.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_jmicron.ko 2023-05-17T12:06:06.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_marvell.ko 2023-05-17T12:06:06.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_mpiix.ko 2023-05-17T12:06:06.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_netcell.ko 2023-05-17T12:06:06.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ninja32.ko 2023-05-17T12:06:06.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ns87410.ko 2023-05-17T12:06:06.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ns87415.ko 2023-05-17T12:06:06.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_oldpiix.ko 2023-05-17T12:06:06.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_opti.ko 2023-05-17T12:06:06.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_optidma.ko 2023-05-17T12:06:06.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pcmcia.ko 2023-05-17T12:06:06.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-17T12:06:06.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-17T12:06:06.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_piccolo.ko 2023-05-17T12:06:06.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_rdc.ko 2023-05-17T12:06:06.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sch.ko 2023-05-17T12:06:06.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_serverworks.ko 2023-05-17T12:06:06.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sil680.ko 2023-05-17T12:06:06.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sis.ko 2023-05-17T12:06:06.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sl82c105.ko 2023-05-17T12:06:06.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_triflex.ko 2023-05-17T12:06:06.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_via.ko 2023-05-17T12:06:06.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pdc_adma.ko 2023-05-17T12:06:06.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_inic162x.ko 2023-05-17T12:06:06.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_mv.ko 2023-05-17T12:06:06.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_nv.ko 2023-05-17T12:06:06.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_promise.ko 2023-05-17T12:06:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_qstor.ko 2023-05-17T12:06:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sil.ko 2023-05-17T12:06:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sil24.ko 2023-05-17T12:06:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sis.ko 2023-05-17T12:06:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_svw.ko 2023-05-17T12:06:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sx4.ko 2023-05-17T12:06:06.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_uli.ko 2023-05-17T12:06:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_via.ko 2023-05-17T12:06:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_vsc.ko 2023-05-17T12:06:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/auxdisplay 2023-05-17T12:06:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/auxdisplay/ks0108.ko 2023-05-17T12:06:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/base 2023-05-17T12:06:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/base/regmap 2023-05-17T12:06:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-17T12:06:06.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/bcma 2023-05-17T12:06:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/bcma/bcma.ko 2023-05-17T12:06:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block 2023-05-17T12:06:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/aoe 2023-05-17T12:06:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/aoe/aoe.ko 2023-05-17T12:06:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/brd.ko 2023-05-17T12:06:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/drbd 2023-05-17T12:06:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/drbd/drbd.ko 2023-05-17T12:06:06.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/floppy.ko 2023-05-17T12:06:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/loop.ko 2023-05-17T12:06:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/mtip32xx 2023-05-17T12:06:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-17T12:06:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/nbd.ko 2023-05-17T12:06:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/null_blk 2023-05-17T12:06:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/null_blk/null_blk.ko 2023-05-17T12:06:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/pktcdvd.ko 2023-05-17T12:06:06.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/rbd.ko 2023-05-17T12:06:06.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/virtio_blk.ko 2023-05-17T12:06:06.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkback 2023-05-17T12:06:06.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-17T12:06:06.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkfront.ko 2023-05-17T12:06:06.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/zram 2023-05-17T12:06:06.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/zram/zram.ko 2023-05-17T12:06:06.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char 2023-05-17T12:06:06.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hangcheck-timer.ko 2023-05-17T12:06:06.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random 2023-05-17T12:06:06.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-17T12:06:06.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-17T12:06:06.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-17T12:06:06.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/via-rng.ko 2023-05-17T12:06:06.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-17T12:06:06.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi 2023-05-17T12:06:06.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-17T12:06:06.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-17T12:06:06.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-17T12:06:06.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-17T12:06:06.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-17T12:06:06.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-17T12:06:06.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/lp.ko 2023-05-17T12:06:06.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/mwave 2023-05-17T12:06:06.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/mwave/mwave.ko 2023-05-17T12:06:06.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia 2023-05-17T12:06:06.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-17T12:06:06.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-17T12:06:06.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ppdev.ko 2023-05-17T12:06:06.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tlclk.ko 2023-05-17T12:06:06.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm 2023-05-17T12:06:06.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm.ko 2023-05-17T12:06:06.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-17T12:06:06.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-17T12:06:06.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-17T12:06:06.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-17T12:06:06.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-17T12:06:06.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/uv_mmtimer.ko 2023-05-17T12:06:06.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/virtio_console.ko 2023-05-17T12:06:06.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq 2023-05-17T12:06:06.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-17T12:06:06.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-17T12:06:06.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-17T12:06:06.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-17T12:06:06.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-17T12:06:06.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-17T12:06:06.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto 2023-05-17T12:06:06.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp 2023-05-17T12:06:06.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-17T12:06:06.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ccp.ko 2023-05-17T12:06:06.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/padlock-aes.ko 2023-05-17T12:06:06.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/padlock-sha.ko 2023-05-17T12:06:06.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat 2023-05-17T12:06:06.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_common 2023-05-17T12:06:06.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-17T12:06:06.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-17T12:06:06.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-17T12:06:06.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/virtio 2023-05-17T12:06:06.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-17T12:06:06.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dca 2023-05-17T12:06:06.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dca/dca.ko 2023-05-17T12:06:06.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/devfreq 2023-05-17T12:06:06.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-17T12:06:06.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma 2023-05-17T12:06:06.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/dw 2023-05-17T12:06:06.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-17T12:06:06.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ioat 2023-05-17T12:06:06.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-17T12:06:06.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac 2023-05-17T12:06:06.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/amd64_edac.ko 2023-05-17T12:06:06.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/e752x_edac.ko 2023-05-17T12:06:06.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/edac_mce_amd.ko 2023-05-17T12:06:06.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i3000_edac.ko 2023-05-17T12:06:06.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i3200_edac.ko 2023-05-17T12:06:06.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i5100_edac.ko 2023-05-17T12:06:06.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i5400_edac.ko 2023-05-17T12:06:06.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i7300_edac.ko 2023-05-17T12:06:06.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i7core_edac.ko 2023-05-17T12:06:06.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i82975x_edac.ko 2023-05-17T12:06:06.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/ie31200_edac.ko 2023-05-17T12:06:06.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/sb_edac.ko 2023-05-17T12:06:06.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/x38_edac.ko 2023-05-17T12:06:06.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware 2023-05-17T12:06:06.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/edd.ko 2023-05-17T12:06:06.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-17T12:06:06.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio 2023-05-17T12:06:06.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-ich.ko 2023-05-17T12:06:06.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-17T12:06:06.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid 2023-05-17T12:06:06.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-appleir.ko 2023-05-17T12:06:06.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-aureal.ko 2023-05-17T12:06:06.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-axff.ko 2023-05-17T12:06:06.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-dr.ko 2023-05-17T12:06:06.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-elecom.ko 2023-05-17T12:06:06.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-elo.ko 2023-05-17T12:06:06.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-emsff.ko 2023-05-17T12:06:06.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gaff.ko 2023-05-17T12:06:06.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gt683r.ko 2023-05-17T12:06:06.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gyration.ko 2023-05-17T12:06:06.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-17T12:06:06.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-17T12:06:06.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtekff.ko 2023-05-17T12:06:06.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-hyperv.ko 2023-05-17T12:06:06.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-icade.ko 2023-05-17T12:06:06.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-keytouch.ko 2023-05-17T12:06:06.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-kye.ko 2023-05-17T12:06:06.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lcpower.ko 2023-05-17T12:06:06.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-led.ko 2023-05-17T12:06:06.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lenovo.ko 2023-05-17T12:06:06.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-17T12:06:06.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-17T12:06:06.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-multitouch.ko 2023-05-17T12:06:06.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-ortek.ko 2023-05-17T12:06:06.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-penmount.ko 2023-05-17T12:06:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-petalynx.ko 2023-05-17T12:06:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-picolcd.ko 2023-05-17T12:06:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-pl.ko 2023-05-17T12:06:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-plantronics.ko 2023-05-17T12:06:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-primax.ko 2023-05-17T12:06:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-rmi.ko 2023-05-17T12:06:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-17T12:06:06.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-common.ko 2023-05-17T12:06:06.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-17T12:06:06.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-17T12:06:06.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-17T12:06:06.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-17T12:06:06.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-17T12:06:06.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-17T12:06:06.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-17T12:06:06.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-17T12:06:06.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-17T12:06:06.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat.ko 2023-05-17T12:06:06.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-saitek.ko 2023-05-17T12:06:06.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-samsung.ko 2023-05-17T12:06:06.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-17T12:06:06.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sjoy.ko 2023-05-17T12:06:06.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sony.ko 2023-05-17T12:06:06.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-speedlink.ko 2023-05-17T12:06:06.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-steelseries.ko 2023-05-17T12:06:06.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sunplus.ko 2023-05-17T12:06:06.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-17T12:06:06.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-tivo.ko 2023-05-17T12:06:06.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-tmff.ko 2023-05-17T12:06:06.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-topseed.ko 2023-05-17T12:06:06.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-twinhan.ko 2023-05-17T12:06:06.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-uclogic.ko 2023-05-17T12:06:06.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-waltop.ko 2023-05-17T12:06:06.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-wiimote.ko 2023-05-17T12:06:06.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-xinmo.ko 2023-05-17T12:06:06.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-zpff.ko 2023-05-17T12:06:06.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-zydacron.ko 2023-05-17T12:06:06.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/uhid.ko 2023-05-17T12:06:06.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/wacom.ko 2023-05-17T12:06:06.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv 2023-05-17T12:06:06.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_balloon.ko 2023-05-17T12:06:06.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_utils.ko 2023-05-17T12:06:06.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_vmbus.ko 2023-05-17T12:06:06.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon 2023-05-17T12:06:06.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/abituguru.ko 2023-05-17T12:06:06.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/abituguru3.ko 2023-05-17T12:06:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-17T12:06:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ad7414.ko 2023-05-17T12:06:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ad7418.ko 2023-05-17T12:06:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adc128d818.ko 2023-05-17T12:06:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1025.ko 2023-05-17T12:06:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1026.ko 2023-05-17T12:06:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1029.ko 2023-05-17T12:06:06.297 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1031.ko 2023-05-17T12:06:06.297 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm9240.ko 2023-05-17T12:06:06.297 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ads7828.ko 2023-05-17T12:06:06.297 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7410.ko 2023-05-17T12:06:06.297 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7411.ko 2023-05-17T12:06:06.297 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7462.ko 2023-05-17T12:06:06.297 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7470.ko 2023-05-17T12:06:06.297 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7475.ko 2023-05-17T12:06:06.298 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7x10.ko 2023-05-17T12:06:06.298 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/amc6821.ko 2023-05-17T12:06:06.298 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/applesmc.ko 2023-05-17T12:06:06.298 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asb100.ko 2023-05-17T12:06:06.298 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asc7621.ko 2023-05-17T12:06:06.298 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-17T12:06:06.298 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/atxp1.ko 2023-05-17T12:06:06.299 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/coretemp.ko 2023-05-17T12:06:06.299 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-17T12:06:06.299 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/dme1737.ko 2023-05-17T12:06:06.299 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ds1621.ko 2023-05-17T12:06:06.300 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ds620.ko 2023-05-17T12:06:06.300 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc1403.ko 2023-05-17T12:06:06.300 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc6w201.ko 2023-05-17T12:06:06.300 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f71805f.ko 2023-05-17T12:06:06.300 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f71882fg.ko 2023-05-17T12:06:06.300 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f75375s.ko 2023-05-17T12:06:06.301 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/fam15h_power.ko 2023-05-17T12:06:06.301 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/fschmd.ko 2023-05-17T12:06:06.301 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/g760a.ko 2023-05-17T12:06:06.301 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/g762.ko 2023-05-17T12:06:06.301 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/gl518sm.ko 2023-05-17T12:06:06.301 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/gl520sm.ko 2023-05-17T12:06:06.301 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-17T12:06:06.301 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/i5500_temp.ko 2023-05-17T12:06:06.302 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/i5k_amb.ko 2023-05-17T12:06:06.302 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ibmaem.ko 2023-05-17T12:06:06.302 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ibmpex.ko 2023-05-17T12:06:06.302 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ina209.ko 2023-05-17T12:06:06.302 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ina2xx.ko 2023-05-17T12:06:06.302 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/it87.ko 2023-05-17T12:06:06.302 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/k10temp.ko 2023-05-17T12:06:06.303 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/k8temp.ko 2023-05-17T12:06:06.303 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lineage-pem.ko 2023-05-17T12:06:06.303 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm63.ko 2023-05-17T12:06:06.303 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm73.ko 2023-05-17T12:06:06.303 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm75.ko 2023-05-17T12:06:06.303 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm77.ko 2023-05-17T12:06:06.303 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm78.ko 2023-05-17T12:06:06.303 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm80.ko 2023-05-17T12:06:06.304 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm83.ko 2023-05-17T12:06:06.304 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm85.ko 2023-05-17T12:06:06.304 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm87.ko 2023-05-17T12:06:06.304 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm90.ko 2023-05-17T12:06:06.304 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm92.ko 2023-05-17T12:06:06.304 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm93.ko 2023-05-17T12:06:06.304 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95234.ko 2023-05-17T12:06:06.304 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95241.ko 2023-05-17T12:06:06.305 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95245.ko 2023-05-17T12:06:06.305 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc2945.ko 2023-05-17T12:06:06.305 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4151.ko 2023-05-17T12:06:06.305 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4215.ko 2023-05-17T12:06:06.305 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4222.ko 2023-05-17T12:06:06.305 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4245.ko 2023-05-17T12:06:06.305 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4260.ko 2023-05-17T12:06:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4261.ko 2023-05-17T12:06:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max16065.ko 2023-05-17T12:06:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max1619.ko 2023-05-17T12:06:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max1668.ko 2023-05-17T12:06:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max197.ko 2023-05-17T12:06:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6639.ko 2023-05-17T12:06:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6650.ko 2023-05-17T12:06:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6697.ko 2023-05-17T12:06:06.307 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/mcp3021.ko 2023-05-17T12:06:06.307 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6683.ko 2023-05-17T12:06:06.307 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6775-core.ko 2023-05-17T12:06:06.307 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6775.ko 2023-05-17T12:06:06.307 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct7802.ko 2023-05-17T12:06:06.307 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pc87360.ko 2023-05-17T12:06:06.307 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pc87427.ko 2023-05-17T12:06:06.307 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pcf8591.ko 2023-05-17T12:06:06.308 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus 2023-05-17T12:06:06.308 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-17T12:06:06.308 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-17T12:06:06.308 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-17T12:06:06.308 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-17T12:06:06.308 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-17T12:06:06.308 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-17T12:06:06.309 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-17T12:06:06.309 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-17T12:06:06.309 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-17T12:06:06.309 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-17T12:06:06.309 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-17T12:06:06.309 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-17T12:06:06.309 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/powr1220.ko 2023-05-17T12:06:06.309 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch5627.ko 2023-05-17T12:06:06.310 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch5636.ko 2023-05-17T12:06:06.310 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-17T12:06:06.310 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sht15.ko 2023-05-17T12:06:06.310 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sht21.ko 2023-05-17T12:06:06.310 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/shtc1.ko 2023-05-17T12:06:06.310 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sis5595.ko 2023-05-17T12:06:06.310 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47b397.ko 2023-05-17T12:06:06.311 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47m1.ko 2023-05-17T12:06:06.311 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47m192.ko 2023-05-17T12:06:06.311 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/thmc50.ko 2023-05-17T12:06:06.311 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp102.ko 2023-05-17T12:06:06.311 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp103.ko 2023-05-17T12:06:06.311 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp401.ko 2023-05-17T12:06:06.312 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp421.ko 2023-05-17T12:06:06.312 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/via-cputemp.ko 2023-05-17T12:06:06.312 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/via686a.ko 2023-05-17T12:06:06.312 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/vt1211.ko 2023-05-17T12:06:06.312 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/vt8231.ko 2023-05-17T12:06:06.313 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83627ehf.ko 2023-05-17T12:06:06.313 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83627hf.ko 2023-05-17T12:06:06.313 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83781d.ko 2023-05-17T12:06:06.313 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83791d.ko 2023-05-17T12:06:06.313 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83792d.ko 2023-05-17T12:06:06.313 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83793.ko 2023-05-17T12:06:06.313 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83795.ko 2023-05-17T12:06:06.313 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83l785ts.ko 2023-05-17T12:06:06.314 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83l786ng.ko 2023-05-17T12:06:06.314 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c 2023-05-17T12:06:06.314 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos 2023-05-17T12:06:06.314 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-17T12:06:06.314 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-17T12:06:06.314 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses 2023-05-17T12:06:06.314 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-17T12:06:06.315 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-17T12:06:06.315 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-17T12:06:06.315 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-17T12:06:06.315 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-17T12:06:06.315 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-17T12:06:06.315 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-17T12:06:06.315 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-17T12:06:06.315 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-17T12:06:06.316 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-17T12:06:06.316 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-17T12:06:06.316 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-17T12:06:06.316 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-17T12:06:06.316 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-17T12:06:06.316 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-17T12:06:06.316 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-17T12:06:06.316 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-17T12:06:06.317 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-17T12:06:06.317 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-17T12:06:06.317 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-17T12:06:06.317 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-17T12:06:06.317 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-17T12:06:06.317 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-17T12:06:06.317 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-dev.ko 2023-05-17T12:06:06.318 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-mux.ko 2023-05-17T12:06:06.318 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-17T12:06:06.318 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-smbus.ko 2023-05-17T12:06:06.318 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-stub.ko 2023-05-17T12:06:06.318 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband 2023-05-17T12:06:06.318 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core 2023-05-17T12:06:06.318 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-17T12:06:06.318 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_core.ko 2023-05-17T12:06:06.319 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-17T12:06:06.319 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-17T12:06:06.319 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-17T12:06:06.319 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-17T12:06:06.319 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-17T12:06:06.319 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw 2023-05-17T12:06:06.319 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/cxgb4 2023-05-17T12:06:06.320 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-17T12:06:06.320 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx4 2023-05-17T12:06:06.320 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-17T12:06:06.320 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx5 2023-05-17T12:06:06.320 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-17T12:06:06.320 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mthca 2023-05-17T12:06:06.320 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-17T12:06:06.320 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp 2023-05-17T12:06:06.321 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ipoib 2023-05-17T12:06:06.321 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-17T12:06:06.321 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/iser 2023-05-17T12:06:06.321 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-17T12:06:06.321 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/isert 2023-05-17T12:06:06.321 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-17T12:06:06.321 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srp 2023-05-17T12:06:06.321 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-17T12:06:06.322 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srpt 2023-05-17T12:06:06.322 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-17T12:06:06.322 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input 2023-05-17T12:06:06.322 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport 2023-05-17T12:06:06.322 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-17T12:06:06.322 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-17T12:06:06.322 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/gameport.ko 2023-05-17T12:06:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/lightning.ko 2023-05-17T12:06:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/ns558.ko 2023-05-17T12:06:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/joydev.ko 2023-05-17T12:06:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard 2023-05-17T12:06:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-17T12:06:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse 2023-05-17T12:06:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/appletouch.ko 2023-05-17T12:06:06.323 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/bcm5974.ko 2023-05-17T12:06:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/cyapatp.ko 2023-05-17T12:06:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-17T12:06:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/sermouse.ko 2023-05-17T12:06:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-17T12:06:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-17T12:06:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-17T12:06:06.324 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/rmi4 2023-05-17T12:06:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-17T12:06:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio 2023-05-17T12:06:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/altera_ps2.ko 2023-05-17T12:06:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/arc_ps2.ko 2023-05-17T12:06:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-17T12:06:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/serio_raw.ko 2023-05-17T12:06:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/sparse-keymap.ko 2023-05-17T12:06:06.325 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu 2023-05-17T12:06:06.326 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/amd 2023-05-17T12:06:06.326 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-17T12:06:06.326 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds 2023-05-17T12:06:06.326 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-blinkm.ko 2023-05-17T12:06:06.326 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm3530.ko 2023-05-17T12:06:06.326 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lp3944.ko 2023-05-17T12:06:06.326 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-ss4200.ko 2023-05-17T12:06:06.327 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger 2023-05-17T12:06:06.327 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-17T12:06:06.327 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-17T12:06:06.327 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-17T12:06:06.327 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-17T12:06:06.327 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-17T12:06:06.327 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-17T12:06:06.327 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-17T12:06:06.328 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-17T12:06:06.328 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-17T12:06:06.328 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md 2023-05-17T12:06:06.328 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/bcache 2023-05-17T12:06:06.328 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/bcache/bcache.ko 2023-05-17T12:06:06.328 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-bio-prison.ko 2023-05-17T12:06:06.328 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-cache-smq.ko 2023-05-17T12:06:06.328 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-cache.ko 2023-05-17T12:06:06.329 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-crypt.ko 2023-05-17T12:06:06.329 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-delay.ko 2023-05-17T12:06:06.329 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-flakey.ko 2023-05-17T12:06:06.329 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-log-userspace.ko 2023-05-17T12:06:06.329 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-multipath.ko 2023-05-17T12:06:06.329 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-queue-length.ko 2023-05-17T12:06:06.329 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-raid.ko 2023-05-17T12:06:06.330 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-round-robin.ko 2023-05-17T12:06:06.330 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-service-time.ko 2023-05-17T12:06:06.330 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-switch.ko 2023-05-17T12:06:06.330 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-thin-pool.ko 2023-05-17T12:06:06.330 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-verity.ko 2023-05-17T12:06:06.330 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/faulty.ko 2023-05-17T12:06:06.330 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/linear.ko 2023-05-17T12:06:06.330 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/multipath.ko 2023-05-17T12:06:06.331 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/persistent-data 2023-05-17T12:06:06.331 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-17T12:06:06.331 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid0.ko 2023-05-17T12:06:06.331 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid1.ko 2023-05-17T12:06:06.331 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid10.ko 2023-05-17T12:06:06.331 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid456.ko 2023-05-17T12:06:06.331 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message 2023-05-17T12:06:06.331 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion 2023-05-17T12:06:06.332 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptbase.ko 2023-05-17T12:06:06.332 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptctl.ko 2023-05-17T12:06:06.332 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptfc.ko 2023-05-17T12:06:06.332 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptlan.ko 2023-05-17T12:06:06.332 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptsas.ko 2023-05-17T12:06:06.332 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptscsih.ko 2023-05-17T12:06:06.332 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptspi.ko 2023-05-17T12:06:06.333 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd 2023-05-17T12:06:06.333 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lpc_ich.ko 2023-05-17T12:06:06.333 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lpc_sch.ko 2023-05-17T12:06:06.333 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/mfd-core.ko 2023-05-17T12:06:06.333 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/sm501.ko 2023-05-17T12:06:06.333 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/viperboard.ko 2023-05-17T12:06:06.333 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/vx855.ko 2023-05-17T12:06:06.333 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/wl1273-core.ko 2023-05-17T12:06:06.334 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc 2023-05-17T12:06:06.334 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/altera-stapl 2023-05-17T12:06:06.334 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-17T12:06:06.334 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/apds9802als.ko 2023-05-17T12:06:06.334 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/apds990x.ko 2023-05-17T12:06:06.334 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/bh1770glc.ko 2023-05-17T12:06:06.334 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/cb710 2023-05-17T12:06:06.335 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/cb710/cb710.ko 2023-05-17T12:06:06.335 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom 2023-05-17T12:06:06.335 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/at24.ko 2023-05-17T12:06:06.335 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-17T12:06:06.335 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-17T12:06:06.335 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/max6875.ko 2023-05-17T12:06:06.335 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/enclosure.ko 2023-05-17T12:06:06.335 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/hpilo.ko 2023-05-17T12:06:06.336 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/isl29003.ko 2023-05-17T12:06:06.336 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/isl29020.ko 2023-05-17T12:06:06.336 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d 2023-05-17T12:06:06.336 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-17T12:06:06.336 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-17T12:06:06.336 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei 2023-05-17T12:06:06.336 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei-me.ko 2023-05-17T12:06:06.337 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei-txe.ko 2023-05-17T12:06:06.337 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei.ko 2023-05-17T12:06:06.337 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-gru 2023-05-17T12:06:06.337 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-17T12:06:06.337 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-xp 2023-05-17T12:06:06.337 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-17T12:06:06.337 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-17T12:06:06.337 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-17T12:06:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tifm_7xx1.ko 2023-05-17T12:06:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tifm_core.ko 2023-05-17T12:06:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tsl2550.ko 2023-05-17T12:06:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_balloon.ko 2023-05-17T12:06:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_vmci 2023-05-17T12:06:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-17T12:06:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net 2023-05-17T12:06:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/bonding 2023-05-17T12:06:06.339 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/bonding/bonding.ko 2023-05-17T12:06:06.339 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa 2023-05-17T12:06:06.339 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/b53 2023-05-17T12:06:06.339 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-17T12:06:06.339 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-17T12:06:06.339 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-17T12:06:06.339 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6xxx 2023-05-17T12:06:06.339 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-17T12:06:06.340 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dummy.ko 2023-05-17T12:06:06.340 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/eql.ko 2023-05-17T12:06:06.340 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet 2023-05-17T12:06:06.340 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com 2023-05-17T12:06:06.340 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-17T12:06:06.340 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-17T12:06:06.340 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-17T12:06:06.341 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-17T12:06:06.341 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390 2023-05-17T12:06:06.341 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-17T12:06:06.341 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-17T12:06:06.341 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-17T12:06:06.341 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-17T12:06:06.341 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/adaptec 2023-05-17T12:06:06.341 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-17T12:06:06.342 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/agere 2023-05-17T12:06:06.342 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-17T12:06:06.342 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/alteon 2023-05-17T12:06:06.342 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-17T12:06:06.342 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/altera 2023-05-17T12:06:06.342 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-17T12:06:06.342 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd 2023-05-17T12:06:06.342 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-17T12:06:06.343 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-17T12:06:06.343 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-17T12:06:06.343 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros 2023-05-17T12:06:06.343 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/alx 2023-05-17T12:06:06.343 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-17T12:06:06.343 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-17T12:06:06.343 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-17T12:06:06.344 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-17T12:06:06.344 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-17T12:06:06.344 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx 2023-05-17T12:06:06.344 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-17T12:06:06.344 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-17T12:06:06.344 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom 2023-05-17T12:06:06.344 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-17T12:06:06.344 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-17T12:06:06.345 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-17T12:06:06.345 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-17T12:06:06.345 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-17T12:06:06.345 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/genet 2023-05-17T12:06:06.345 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-17T12:06:06.345 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-17T12:06:06.345 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade 2023-05-17T12:06:06.345 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/bna 2023-05-17T12:06:06.346 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-17T12:06:06.346 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio 2023-05-17T12:06:06.346 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-17T12:06:06.346 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-17T12:06:06.346 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-17T12:06:06.346 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-17T12:06:06.346 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-17T12:06:06.347 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-17T12:06:06.347 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-17T12:06:06.347 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-17T12:06:06.347 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-17T12:06:06.347 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-17T12:06:06.347 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco 2023-05-17T12:06:06.347 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/enic 2023-05-17T12:06:06.347 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec 2023-05-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip 2023-05-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-17T12:06:06.348 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-17T12:06:06.349 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink 2023-05-17T12:06:06.349 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-17T12:06:06.349 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-17T12:06:06.349 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dnet.ko 2023-05-17T12:06:06.349 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex 2023-05-17T12:06:06.349 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/benet 2023-05-17T12:06:06.349 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-17T12:06:06.350 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ethoc.ko 2023-05-17T12:06:06.350 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/fealnx.ko 2023-05-17T12:06:06.350 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel 2023-05-17T12:06:06.350 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-17T12:06:06.350 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000 2023-05-17T12:06:06.350 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-17T12:06:06.350 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000e 2023-05-17T12:06:06.350 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-17T12:06:06.351 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/fm10k 2023-05-17T12:06:06.351 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-17T12:06:06.351 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/i40e 2023-05-17T12:06:06.351 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-17T12:06:06.351 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/iavf 2023-05-17T12:06:06.351 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-17T12:06:06.351 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igb 2023-05-17T12:06:06.351 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-17T12:06:06.352 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igbvf 2023-05-17T12:06:06.352 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-17T12:06:06.352 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgb 2023-05-17T12:06:06.352 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-17T12:06:06.352 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-17T12:06:06.352 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-17T12:06:06.352 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-17T12:06:06.353 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-17T12:06:06.353 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/jme.ko 2023-05-17T12:06:06.353 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell 2023-05-17T12:06:06.353 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-17T12:06:06.353 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-17T12:06:06.353 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-17T12:06:06.353 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox 2023-05-17T12:06:06.353 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-17T12:06:06.354 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-17T12:06:06.354 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-17T12:06:06.354 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-17T12:06:06.354 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-17T12:06:06.354 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-17T12:06:06.354 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel 2023-05-17T12:06:06.354 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-17T12:06:06.354 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom 2023-05-17T12:06:06.355 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-17T12:06:06.355 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-17T12:06:06.355 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi 2023-05-17T12:06:06.355 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-17T12:06:06.355 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-17T12:06:06.355 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/neterion 2023-05-17T12:06:06.355 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-17T12:06:06.356 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/nvidia 2023-05-17T12:06:06.356 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-17T12:06:06.356 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines 2023-05-17T12:06:06.356 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-17T12:06:06.356 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-17T12:06:06.356 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic 2023-05-17T12:06:06.356 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-17T12:06:06.356 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-17T12:06:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-17T12:06:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-17T12:06:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-17T12:06:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rdc 2023-05-17T12:06:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-17T12:06:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek 2023-05-17T12:06:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-17T12:06:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-17T12:06:06.358 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-17T12:06:06.358 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-17T12:06:06.358 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rocker 2023-05-17T12:06:06.358 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-17T12:06:06.358 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sfc 2023-05-17T12:06:06.358 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-17T12:06:06.358 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/silan 2023-05-17T12:06:06.359 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-17T12:06:06.359 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis 2023-05-17T12:06:06.359 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-17T12:06:06.359 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-17T12:06:06.359 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc 2023-05-17T12:06:06.359 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-17T12:06:06.359 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-17T12:06:06.359 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-17T12:06:06.360 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-17T12:06:06.360 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro 2023-05-17T12:06:06.360 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-17T12:06:06.360 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-17T12:06:06.360 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-17T12:06:06.360 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun 2023-05-17T12:06:06.360 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-17T12:06:06.360 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-17T12:06:06.361 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-17T12:06:06.361 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-17T12:06:06.361 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/tehuti 2023-05-17T12:06:06.361 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-17T12:06:06.361 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ti 2023-05-17T12:06:06.361 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-17T12:06:06.361 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via 2023-05-17T12:06:06.361 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-17T12:06:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-17T12:06:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet 2023-05-17T12:06:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-17T12:06:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-17T12:06:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/xircom 2023-05-17T12:06:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-17T12:06:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/geneve.ko 2023-05-17T12:06:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/hyperv 2023-05-17T12:06:06.363 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-17T12:06:06.363 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ieee802154 2023-05-17T12:06:06.363 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-17T12:06:06.363 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ifb.ko 2023-05-17T12:06:06.363 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ipvlan 2023-05-17T12:06:06.363 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-17T12:06:06.363 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/macvlan.ko 2023-05-17T12:06:06.364 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/macvtap.ko 2023-05-17T12:06:06.364 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio 2023-05-17T12:06:06.364 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio.ko 2023-05-17T12:06:06.364 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-17T12:06:06.364 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-17T12:06:06.364 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mii.ko 2023-05-17T12:06:06.364 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/net_failover.ko 2023-05-17T12:06:06.364 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/netconsole.ko 2023-05-17T12:06:06.365 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/nlmon.ko 2023-05-17T12:06:06.365 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs 2023-05-17T12:06:06.365 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-17T12:06:06.365 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-17T12:06:06.365 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy 2023-05-17T12:06:06.365 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/amd.ko 2023-05-17T12:06:06.365 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-17T12:06:06.366 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-17T12:06:06.366 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-17T12:06:06.366 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm87xx.ko 2023-05-17T12:06:06.366 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/broadcom.ko 2023-05-17T12:06:06.366 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/cicada.ko 2023-05-17T12:06:06.366 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/davicom.ko 2023-05-17T12:06:06.366 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/dp83640.ko 2023-05-17T12:06:06.366 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/et1011c.ko 2023-05-17T12:06:06.367 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/icplus.ko 2023-05-17T12:06:06.367 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/lxt.ko 2023-05-17T12:06:06.367 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/marvell.ko 2023-05-17T12:06:06.367 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/micrel.ko 2023-05-17T12:06:06.367 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/national.ko 2023-05-17T12:06:06.367 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/phylink.ko 2023-05-17T12:06:06.367 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/qsemi.ko 2023-05-17T12:06:06.368 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/realtek.ko 2023-05-17T12:06:06.368 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/smsc.ko 2023-05-17T12:06:06.368 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/ste10Xp.ko 2023-05-17T12:06:06.368 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/vitesse.ko 2023-05-17T12:06:06.368 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp 2023-05-17T12:06:06.368 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-17T12:06:06.368 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_async.ko 2023-05-17T12:06:06.368 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-17T12:06:06.369 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-17T12:06:06.369 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-17T12:06:06.369 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-17T12:06:06.369 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pppoe.ko 2023-05-17T12:06:06.369 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pppox.ko 2023-05-17T12:06:06.369 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pptp.ko 2023-05-17T12:06:06.369 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip 2023-05-17T12:06:06.369 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip/slhc.ko 2023-05-17T12:06:06.370 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip/slip.ko 2023-05-17T12:06:06.370 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/sungem_phy.ko 2023-05-17T12:06:06.370 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/tap.ko 2023-05-17T12:06:06.370 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team 2023-05-17T12:06:06.370 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team.ko 2023-05-17T12:06:06.370 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-17T12:06:06.370 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-17T12:06:06.370 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-17T12:06:06.371 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_random.ko 2023-05-17T12:06:06.371 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-17T12:06:06.371 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/tun.ko 2023-05-17T12:06:06.371 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/veth.ko 2023-05-17T12:06:06.371 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/virtio_net.ko 2023-05-17T12:06:06.371 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vmxnet3 2023-05-17T12:06:06.371 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-17T12:06:06.371 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vxlan 2023-05-17T12:06:06.372 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vxlan/vxlan.ko 2023-05-17T12:06:06.372 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netback 2023-05-17T12:06:06.372 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-17T12:06:06.372 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netfront.ko 2023-05-17T12:06:06.372 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ntb 2023-05-17T12:06:06.372 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ntb/ntb.ko 2023-05-17T12:06:06.372 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme 2023-05-17T12:06:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host 2023-05-17T12:06:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/nvme-core.ko 2023-05-17T12:06:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/nvme.ko 2023-05-17T12:06:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport 2023-05-17T12:06:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport.ko 2023-05-17T12:06:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_cs.ko 2023-05-17T12:06:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_pc.ko 2023-05-17T12:06:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_serial.ko 2023-05-17T12:06:06.374 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci 2023-05-17T12:06:06.374 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug 2023-05-17T12:06:06.374 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-17T12:06:06.374 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/pcie 2023-05-17T12:06:06.374 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-17T12:06:06.374 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/xen-pcifront.ko 2023-05-17T12:06:06.374 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia 2023-05-17T12:06:06.374 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/i82092.ko 2023-05-17T12:06:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pd6729.ko 2023-05-17T12:06:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-17T12:06:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl 2023-05-17T12:06:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/intel 2023-05-17T12:06:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-17T12:06:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform 2023-05-17T12:06:06.375 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86 2023-05-17T12:06:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-17T12:06:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/acerhdf.ko 2023-05-17T12:06:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-17T12:06:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-17T12:06:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-17T12:06:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-17T12:06:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-17T12:06:06.376 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-17T12:06:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-17T12:06:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-17T12:06:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-17T12:06:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/hdaps.ko 2023-05-17T12:06:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel 2023-05-17T12:06:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-17T12:06:06.377 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel_ips.ko 2023-05-17T12:06:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-17T12:06:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-17T12:06:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-17T12:06:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-17T12:06:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-17T12:06:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-17T12:06:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-17T12:06:06.378 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-17T12:06:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-17T12:06:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/wmi.ko 2023-05-17T12:06:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap 2023-05-17T12:06:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-17T12:06:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-17T12:06:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps 2023-05-17T12:06:06.379 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients 2023-05-17T12:06:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-17T12:06:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-17T12:06:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps_parport.ko 2023-05-17T12:06:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/pps_core.ko 2023-05-17T12:06:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp 2023-05-17T12:06:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ptp.ko 2023-05-17T12:06:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ptp_kvm.ko 2023-05-17T12:06:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc 2023-05-17T12:06:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-17T12:06:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-17T12:06:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-17T12:06:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-17T12:06:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-17T12:06:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-17T12:06:06.381 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-17T12:06:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-17T12:06:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-17T12:06:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-17T12:06:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-17T12:06:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-em3027.ko 2023-05-17T12:06:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-17T12:06:06.382 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-17T12:06:06.383 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-17T12:06:06.383 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-17T12:06:06.383 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-17T12:06:06.383 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-17T12:06:06.383 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max6900.ko 2023-05-17T12:06:06.383 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-17T12:06:06.383 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-17T12:06:06.383 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-17T12:06:06.384 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-17T12:06:06.384 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-17T12:06:06.384 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-17T12:06:06.384 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-17T12:06:06.384 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-17T12:06:06.384 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-17T12:06:06.384 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-17T12:06:06.384 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-17T12:06:06.385 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-17T12:06:06.385 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-x1205.ko 2023-05-17T12:06:06.385 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi 2023-05-17T12:06:06.385 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-9xxx.ko 2023-05-17T12:06:06.385 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-sas.ko 2023-05-17T12:06:06.385 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-xxxx.ko 2023-05-17T12:06:06.385 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/BusLogic.ko 2023-05-17T12:06:06.386 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/a100u2w.ko 2023-05-17T12:06:06.386 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aacraid 2023-05-17T12:06:06.386 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-17T12:06:06.386 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/advansys.ko 2023-05-17T12:06:06.386 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx 2023-05-17T12:06:06.386 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-17T12:06:06.386 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-17T12:06:06.386 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/am53c974.ko 2023-05-17T12:06:06.387 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/arcmsr 2023-05-17T12:06:06.387 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-17T12:06:06.387 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/atp870u.ko 2023-05-17T12:06:06.387 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/be2iscsi 2023-05-17T12:06:06.387 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-17T12:06:06.387 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bfa 2023-05-17T12:06:06.387 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bfa/bfa.ko 2023-05-17T12:06:06.387 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2fc 2023-05-17T12:06:06.388 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-17T12:06:06.388 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2i 2023-05-17T12:06:06.388 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-17T12:06:06.388 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ch.ko 2023-05-17T12:06:06.388 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/csiostor 2023-05-17T12:06:06.388 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-17T12:06:06.388 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi 2023-05-17T12:06:06.389 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-17T12:06:06.389 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-17T12:06:06.389 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-17T12:06:06.389 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-17T12:06:06.389 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-17T12:06:06.389 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/dc395x.ko 2023-05-17T12:06:06.389 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler 2023-05-17T12:06:06.389 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-17T12:06:06.390 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-17T12:06:06.390 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-17T12:06:06.390 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-17T12:06:06.390 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/dmx3191d.ko 2023-05-17T12:06:06.390 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esas2r 2023-05-17T12:06:06.390 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-17T12:06:06.390 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esp_scsi.ko 2023-05-17T12:06:06.390 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe 2023-05-17T12:06:06.391 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-17T12:06:06.391 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-17T12:06:06.391 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fnic 2023-05-17T12:06:06.391 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fnic/fnic.ko 2023-05-17T12:06:06.391 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hpsa.ko 2023-05-17T12:06:06.391 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hptiop.ko 2023-05-17T12:06:06.391 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hv_storvsc.ko 2023-05-17T12:06:06.391 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/initio.ko 2023-05-17T12:06:06.392 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ipr.ko 2023-05-17T12:06:06.392 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ips.ko 2023-05-17T12:06:06.392 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/isci 2023-05-17T12:06:06.392 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/isci/isci.ko 2023-05-17T12:06:06.392 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-17T12:06:06.392 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-17T12:06:06.392 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libfc 2023-05-17T12:06:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libfc/libfc.ko 2023-05-17T12:06:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libiscsi.ko 2023-05-17T12:06:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-17T12:06:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libsas 2023-05-17T12:06:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libsas/libsas.ko 2023-05-17T12:06:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/lpfc 2023-05-17T12:06:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-17T12:06:06.393 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid 2023-05-17T12:06:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid.ko 2023-05-17T12:06:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-17T12:06:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-17T12:06:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-17T12:06:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mpt3sas 2023-05-17T12:06:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-17T12:06:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvsas 2023-05-17T12:06:06.394 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-17T12:06:06.395 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvumi.ko 2023-05-17T12:06:06.395 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pm8001 2023-05-17T12:06:06.395 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-17T12:06:06.395 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pmcraid.ko 2023-05-17T12:06:06.395 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla1280.ko 2023-05-17T12:06:06.395 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx 2023-05-17T12:06:06.395 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-17T12:06:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-17T12:06:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla4xxx 2023-05-17T12:06:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-17T12:06:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/raid_class.ko 2023-05-17T12:06:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_debug.ko 2023-05-17T12:06:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-17T12:06:06.396 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-17T12:06:06.397 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-17T12:06:06.397 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-17T12:06:06.397 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-17T12:06:06.397 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ses.ko 2023-05-17T12:06:06.397 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/st.ko 2023-05-17T12:06:06.397 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/stex.ko 2023-05-17T12:06:06.397 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/sym53c8xx_2 2023-05-17T12:06:06.397 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-17T12:06:06.398 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/virtio_scsi.ko 2023-05-17T12:06:06.398 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-17T12:06:06.398 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/wd719x.ko 2023-05-17T12:06:06.398 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ssb 2023-05-17T12:06:06.398 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ssb/ssb.ko 2023-05-17T12:06:06.398 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target 2023-05-17T12:06:06.398 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/iscsi 2023-05-17T12:06:06.398 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-17T12:06:06.399 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/loopback 2023-05-17T12:06:06.399 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-17T12:06:06.399 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_file.ko 2023-05-17T12:06:06.399 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_iblock.ko 2023-05-17T12:06:06.399 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_mod.ko 2023-05-17T12:06:06.399 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_pscsi.ko 2023-05-17T12:06:06.399 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_user.ko 2023-05-17T12:06:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/tcm_fc 2023-05-17T12:06:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-17T12:06:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal 2023-05-17T12:06:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel 2023-05-17T12:06:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal 2023-05-17T12:06:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-17T12:06:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-17T12:06:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-17T12:06:06.401 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-17T12:06:06.401 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-17T12:06:06.401 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-17T12:06:06.401 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-17T12:06:06.401 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-17T12:06:06.401 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-17T12:06:06.401 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-17T12:06:06.402 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-17T12:06:06.402 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-17T12:06:06.402 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-17T12:06:06.402 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-17T12:06:06.402 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-17T12:06:06.402 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty 2023-05-17T12:06:06.402 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ipwireless 2023-05-17T12:06:06.402 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-17T12:06:06.403 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/n_gsm.ko 2023-05-17T12:06:06.403 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/n_hdlc.ko 2023-05-17T12:06:06.403 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/nozomi.ko 2023-05-17T12:06:06.403 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial 2023-05-17T12:06:06.403 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250 2023-05-17T12:06:06.403 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-17T12:06:06.403 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/arc_uart.ko 2023-05-17T12:06:06.403 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/jsm 2023-05-17T12:06:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-17T12:06:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/synclink_gt.ko 2023-05-17T12:06:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs 2023-05-17T12:06:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/core 2023-05-17T12:06:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-17T12:06:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host 2023-05-17T12:06:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-17T12:06:06.404 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio 2023-05-17T12:06:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio.ko 2023-05-17T12:06:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_aec.ko 2023-05-17T12:06:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_cif.ko 2023-05-17T12:06:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_pci_generic.ko 2023-05-17T12:06:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_sercos3.ko 2023-05-17T12:06:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb 2023-05-17T12:06:06.405 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class 2023-05-17T12:06:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/cdc-acm.ko 2023-05-17T12:06:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-17T12:06:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/usblp.ko 2023-05-17T12:06:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/usbtmc.ko 2023-05-17T12:06:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host 2023-05-17T12:06:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-17T12:06:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/u132-hcd.ko 2023-05-17T12:06:06.406 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image 2023-05-17T12:06:06.407 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/mdc800.ko 2023-05-17T12:06:06.407 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/microtek.ko 2023-05-17T12:06:06.407 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc 2023-05-17T12:06:06.407 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/adutux.ko 2023-05-17T12:06:06.407 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/appledisplay.ko 2023-05-17T12:06:06.407 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/emi26.ko 2023-05-17T12:06:06.407 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/emi62.ko 2023-05-17T12:06:06.407 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ezusb.ko 2023-05-17T12:06:06.408 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-17T12:06:06.408 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/idmouse.ko 2023-05-17T12:06:06.408 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/iowarrior.ko 2023-05-17T12:06:06.408 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-17T12:06:06.408 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ldusb.ko 2023-05-17T12:06:06.408 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/legousbtower.ko 2023-05-17T12:06:06.408 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/sisusbvga 2023-05-17T12:06:06.408 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-17T12:06:06.409 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-17T12:06:06.409 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usb3503.ko 2023-05-17T12:06:06.409 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usblcd.ko 2023-05-17T12:06:06.409 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-17T12:06:06.409 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/uss720.ko 2023-05-17T12:06:06.409 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/yurex.ko 2023-05-17T12:06:06.409 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy 2023-05-17T12:06:06.409 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-generic.ko 2023-05-17T12:06:06.410 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial 2023-05-17T12:06:06.410 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/aircable.ko 2023-05-17T12:06:06.410 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ark3116.ko 2023-05-17T12:06:06.410 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-17T12:06:06.410 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ch341.ko 2023-05-17T12:06:06.410 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cp210x.ko 2023-05-17T12:06:06.410 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cyberjack.ko 2023-05-17T12:06:06.411 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-17T12:06:06.411 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-17T12:06:06.411 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/empeg.ko 2023-05-17T12:06:06.411 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-17T12:06:06.411 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-17T12:06:06.411 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-17T12:06:06.411 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/io_ti.ko 2023-05-17T12:06:06.411 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ipaq.ko 2023-05-17T12:06:06.412 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ipw.ko 2023-05-17T12:06:06.412 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ir-usb.ko 2023-05-17T12:06:06.412 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-17T12:06:06.412 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/keyspan.ko 2023-05-17T12:06:06.412 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-17T12:06:06.412 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-17T12:06:06.412 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-17T12:06:06.412 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mct_u232.ko 2023-05-17T12:06:06.413 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mos7720.ko 2023-05-17T12:06:06.413 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mos7840.ko 2023-05-17T12:06:06.413 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/navman.ko 2023-05-17T12:06:06.413 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/omninet.ko 2023-05-17T12:06:06.413 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/opticon.ko 2023-05-17T12:06:06.413 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/option.ko 2023-05-17T12:06:06.413 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/oti6858.ko 2023-05-17T12:06:06.414 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/pl2303.ko 2023-05-17T12:06:06.414 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/qcaux.ko 2023-05-17T12:06:06.414 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/qcserial.ko 2023-05-17T12:06:06.414 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/quatech2.ko 2023-05-17T12:06:06.414 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/safe_serial.ko 2023-05-17T12:06:06.414 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/sierra.ko 2023-05-17T12:06:06.414 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-17T12:06:06.414 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ssu100.ko 2023-05-17T12:06:06.415 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/symbolserial.ko 2023-05-17T12:06:06.415 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-17T12:06:06.415 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-17T12:06:06.415 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb_debug.ko 2023-05-17T12:06:06.415 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-17T12:06:06.415 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/visor.ko 2023-05-17T12:06:06.415 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/whiteheat.ko 2023-05-17T12:06:06.415 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-17T12:06:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage 2023-05-17T12:06:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/uas.ko 2023-05-17T12:06:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-17T12:06:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-17T12:06:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-17T12:06:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-17T12:06:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-17T12:06:06.416 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-17T12:06:06.417 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-17T12:06:06.417 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-karma.ko 2023-05-17T12:06:06.417 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-17T12:06:06.417 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-17T12:06:06.417 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-17T12:06:06.417 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-17T12:06:06.417 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-17T12:06:06.417 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/usb-storage.ko 2023-05-17T12:06:06.418 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip 2023-05-17T12:06:06.418 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-17T12:06:06.418 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-17T12:06:06.418 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-17T12:06:06.418 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio 2023-05-17T12:06:06.418 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci 2023-05-17T12:06:06.418 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-17T12:06:06.419 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-17T12:06:06.419 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/vfio.ko 2023-05-17T12:06:06.419 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-17T12:06:06.419 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost 2023-05-17T12:06:06.419 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost.ko 2023-05-17T12:06:06.419 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-17T12:06:06.419 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_net.ko 2023-05-17T12:06:06.419 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_scsi.ko 2023-05-17T12:06:06.420 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video 2023-05-17T12:06:06.420 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight 2023-05-17T12:06:06.420 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/apple_bl.ko 2023-05-17T12:06:06.420 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lcd.ko 2023-05-17T12:06:06.420 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-17T12:06:06.420 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio 2023-05-17T12:06:06.420 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio.ko 2023-05-17T12:06:06.420 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_balloon.ko 2023-05-17T12:06:06.421 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_mmio.ko 2023-05-17T12:06:06.421 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_pci.ko 2023-05-17T12:06:06.421 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-17T12:06:06.421 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-17T12:06:06.421 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_ring.ko 2023-05-17T12:06:06.421 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1 2023-05-17T12:06:06.421 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters 2023-05-17T12:06:06.422 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ds2482.ko 2023-05-17T12:06:06.422 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ds2490.ko 2023-05-17T12:06:06.422 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves 2023-05-17T12:06:06.422 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-17T12:06:06.422 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-17T12:06:06.422 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-17T12:06:06.422 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-17T12:06:06.422 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-17T12:06:06.423 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-17T12:06:06.423 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-17T12:06:06.423 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-17T12:06:06.423 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-17T12:06:06.423 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-17T12:06:06.423 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-17T12:06:06.423 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/wire.ko 2023-05-17T12:06:06.423 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog 2023-05-17T12:06:06.424 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-17T12:06:06.424 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-17T12:06:06.424 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-17T12:06:06.424 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/hpwdt.ko 2023-05-17T12:06:06.424 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/i6300esb.ko 2023-05-17T12:06:06.424 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-17T12:06:06.424 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-17T12:06:06.424 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ib700wdt.ko 2023-05-17T12:06:06.425 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ibmasr.ko 2023-05-17T12:06:06.425 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-17T12:06:06.425 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-17T12:06:06.425 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/it87_wdt.ko 2023-05-17T12:06:06.425 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/machzwd.ko 2023-05-17T12:06:06.425 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/nv_tco.ko 2023-05-17T12:06:06.425 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-17T12:06:06.426 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-17T12:06:06.426 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-17T12:06:06.426 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-17T12:06:06.426 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/softdog.ko 2023-05-17T12:06:06.426 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-17T12:06:06.426 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/via_wdt.ko 2023-05-17T12:06:06.426 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-17T12:06:06.427 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-17T12:06:06.427 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-17T12:06:06.427 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wdt_pci.ko 2023-05-17T12:06:06.427 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/xen_wdt.ko 2023-05-17T12:06:06.427 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen 2023-05-17T12:06:06.427 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-17T12:06:06.427 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-evtchn.ko 2023-05-17T12:06:06.427 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-gntalloc.ko 2023-05-17T12:06:06.428 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-gntdev.ko 2023-05-17T12:06:06.428 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-pciback 2023-05-17T12:06:06.428 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-17T12:06:06.428 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-privcmd.ko 2023-05-17T12:06:06.428 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xenfs 2023-05-17T12:06:06.428 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-17T12:06:06.428 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs 2023-05-17T12:06:06.428 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/9p 2023-05-17T12:06:06.429 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/9p/9p.ko 2023-05-17T12:06:06.429 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/affs 2023-05-17T12:06:06.429 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/affs/affs.ko 2023-05-17T12:06:06.429 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/befs 2023-05-17T12:06:06.429 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/befs/befs.ko 2023-05-17T12:06:06.429 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/binfmt_misc.ko 2023-05-17T12:06:06.429 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/btrfs 2023-05-17T12:06:06.430 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/btrfs/btrfs.ko 2023-05-17T12:06:06.430 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cachefiles 2023-05-17T12:06:06.430 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cachefiles/cachefiles.ko 2023-05-17T12:06:06.430 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ceph 2023-05-17T12:06:06.430 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ceph/ceph.ko 2023-05-17T12:06:06.430 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cifs 2023-05-17T12:06:06.430 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cifs/cifs.ko 2023-05-17T12:06:06.430 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/coda 2023-05-17T12:06:06.431 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/coda/coda.ko 2023-05-17T12:06:06.431 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cramfs 2023-05-17T12:06:06.431 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cramfs/cramfs.ko 2023-05-17T12:06:06.431 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/dlm 2023-05-17T12:06:06.431 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/dlm/dlm.ko 2023-05-17T12:06:06.431 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ecryptfs 2023-05-17T12:06:06.431 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-17T12:06:06.431 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/f2fs 2023-05-17T12:06:06.432 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/f2fs/f2fs.ko 2023-05-17T12:06:06.432 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat 2023-05-17T12:06:06.432 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/fat.ko 2023-05-17T12:06:06.432 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/msdos.ko 2023-05-17T12:06:06.432 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/vfat.ko 2023-05-17T12:06:06.432 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fscache 2023-05-17T12:06:06.432 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fscache/fscache.ko 2023-05-17T12:06:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse 2023-05-17T12:06:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse/cuse.ko 2023-05-17T12:06:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse/fuse.ko 2023-05-17T12:06:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/gfs2 2023-05-17T12:06:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/gfs2/gfs2.ko 2023-05-17T12:06:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfs 2023-05-17T12:06:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfs/hfs.ko 2023-05-17T12:06:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfsplus 2023-05-17T12:06:06.434 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfsplus/hfsplus.ko 2023-05-17T12:06:06.434 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/isofs 2023-05-17T12:06:06.434 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/isofs/isofs.ko 2023-05-17T12:06:06.434 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/jfs 2023-05-17T12:06:06.434 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/jfs/jfs.ko 2023-05-17T12:06:06.434 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/lockd 2023-05-17T12:06:06.434 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/lockd/lockd.ko 2023-05-17T12:06:06.434 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/minix 2023-05-17T12:06:06.435 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/minix/minix.ko 2023-05-17T12:06:06.435 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/netfs 2023-05-17T12:06:06.435 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/netfs/netfs.ko 2023-05-17T12:06:06.435 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs 2023-05-17T12:06:06.435 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/blocklayout 2023-05-17T12:06:06.435 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-17T12:06:06.435 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/filelayout 2023-05-17T12:06:06.435 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-17T12:06:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/flexfilelayout 2023-05-17T12:06:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-17T12:06:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfs.ko 2023-05-17T12:06:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv3.ko 2023-05-17T12:06:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv4.ko 2023-05-17T12:06:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common 2023-05-17T12:06:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/grace.ko 2023-05-17T12:06:06.437 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/nfs_acl.ko 2023-05-17T12:06:06.437 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfsd 2023-05-17T12:06:06.437 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfsd/nfsd.ko 2023-05-17T12:06:06.437 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nilfs2 2023-05-17T12:06:06.437 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nilfs2/nilfs2.ko 2023-05-17T12:06:06.437 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls 2023-05-17T12:06:06.437 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-celtic.ko 2023-05-17T12:06:06.437 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-centeuro.ko 2023-05-17T12:06:06.438 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-croatian.ko 2023-05-17T12:06:06.438 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-cyrillic.ko 2023-05-17T12:06:06.438 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-gaelic.ko 2023-05-17T12:06:06.438 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-greek.ko 2023-05-17T12:06:06.438 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-iceland.ko 2023-05-17T12:06:06.438 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-inuit.ko 2023-05-17T12:06:06.438 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-roman.ko 2023-05-17T12:06:06.438 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-romanian.ko 2023-05-17T12:06:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-turkish.ko 2023-05-17T12:06:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1250.ko 2023-05-17T12:06:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1251.ko 2023-05-17T12:06:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1255.ko 2023-05-17T12:06:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp737.ko 2023-05-17T12:06:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp775.ko 2023-05-17T12:06:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp850.ko 2023-05-17T12:06:06.439 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp852.ko 2023-05-17T12:06:06.440 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp855.ko 2023-05-17T12:06:06.440 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp857.ko 2023-05-17T12:06:06.440 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp860.ko 2023-05-17T12:06:06.440 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp861.ko 2023-05-17T12:06:06.440 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp862.ko 2023-05-17T12:06:06.440 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp863.ko 2023-05-17T12:06:06.440 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp864.ko 2023-05-17T12:06:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp865.ko 2023-05-17T12:06:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp866.ko 2023-05-17T12:06:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp869.ko 2023-05-17T12:06:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp874.ko 2023-05-17T12:06:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp932.ko 2023-05-17T12:06:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp936.ko 2023-05-17T12:06:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp949.ko 2023-05-17T12:06:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp950.ko 2023-05-17T12:06:06.442 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_euc-jp.ko 2023-05-17T12:06:06.442 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-1.ko 2023-05-17T12:06:06.442 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-13.ko 2023-05-17T12:06:06.442 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-14.ko 2023-05-17T12:06:06.442 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-15.ko 2023-05-17T12:06:06.442 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-2.ko 2023-05-17T12:06:06.442 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-3.ko 2023-05-17T12:06:06.442 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-4.ko 2023-05-17T12:06:06.443 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-5.ko 2023-05-17T12:06:06.443 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-6.ko 2023-05-17T12:06:06.443 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-7.ko 2023-05-17T12:06:06.443 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-9.ko 2023-05-17T12:06:06.443 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-r.ko 2023-05-17T12:06:06.443 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-ru.ko 2023-05-17T12:06:06.443 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-u.ko 2023-05-17T12:06:06.443 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_utf8.ko 2023-05-17T12:06:06.444 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2 2023-05-17T12:06:06.444 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/cluster 2023-05-17T12:06:06.444 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-17T12:06:06.444 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlm 2023-05-17T12:06:06.444 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-17T12:06:06.444 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlmfs 2023-05-17T12:06:06.444 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-17T12:06:06.445 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2.ko 2023-05-17T12:06:06.445 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-17T12:06:06.445 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-17T12:06:06.445 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-17T12:06:06.445 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/overlayfs 2023-05-17T12:06:06.445 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/overlayfs/overlay.ko 2023-05-17T12:06:06.445 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/pstore 2023-05-17T12:06:06.445 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/pstore/ramoops.ko 2023-05-17T12:06:06.446 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/reiserfs 2023-05-17T12:06:06.446 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/reiserfs/reiserfs.ko 2023-05-17T12:06:06.446 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/romfs 2023-05-17T12:06:06.446 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/romfs/romfs.ko 2023-05-17T12:06:06.446 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common 2023-05-17T12:06:06.446 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-17T12:06:06.446 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-17T12:06:06.446 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/squashfs 2023-05-17T12:06:06.447 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/squashfs/squashfs.ko 2023-05-17T12:06:06.447 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/sysv 2023-05-17T12:06:06.447 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/sysv/sysv.ko 2023-05-17T12:06:06.447 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/udf 2023-05-17T12:06:06.447 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/udf/udf.ko 2023-05-17T12:06:06.447 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ufs 2023-05-17T12:06:06.447 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ufs/ufs.ko 2023-05-17T12:06:06.448 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/xfs 2023-05-17T12:06:06.448 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/xfs/xfs.ko 2023-05-17T12:06:06.448 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel 2023-05-17T12:06:06.448 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/rcu 2023-05-17T12:06:06.448 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/rcu/rcutorture.ko 2023-05-17T12:06:06.448 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/torture.ko 2023-05-17T12:06:06.448 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/trace 2023-05-17T12:06:06.449 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-17T12:06:06.449 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib 2023-05-17T12:06:06.449 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/asn1_encoder.ko 2023-05-17T12:06:06.449 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc-itu-t.ko 2023-05-17T12:06:06.449 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc8.ko 2023-05-17T12:06:06.449 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto 2023-05-17T12:06:06.449 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/libarc4.ko 2023-05-17T12:06:06.449 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/libdes.ko 2023-05-17T12:06:06.450 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/libcrc32c.ko 2023-05-17T12:06:06.450 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/lru_cache.ko 2023-05-17T12:06:06.450 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4 2023-05-17T12:06:06.450 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/lz4_compress.ko 2023-05-17T12:06:06.450 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/lz4hc_compress.ko 2023-05-17T12:06:06.450 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/math 2023-05-17T12:06:06.450 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/math/cordic.ko 2023-05-17T12:06:06.450 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/raid6 2023-05-17T12:06:06.451 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/raid6/raid6_pq.ko 2023-05-17T12:06:06.451 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/reed_solomon 2023-05-17T12:06:06.451 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-17T12:06:06.451 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_bm.ko 2023-05-17T12:06:06.451 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_fsm.ko 2023-05-17T12:06:06.451 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_kmp.ko 2023-05-17T12:06:06.451 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/zstd 2023-05-17T12:06:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/zstd/zstd_compress.ko 2023-05-17T12:06:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/mm 2023-05-17T12:06:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/mm/hwpoison-inject.ko 2023-05-17T12:06:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net 2023-05-17T12:06:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan 2023-05-17T12:06:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/6lowpan.ko 2023-05-17T12:06:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_dest.ko 2023-05-17T12:06:06.452 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_fragment.ko 2023-05-17T12:06:06.453 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_hop.ko 2023-05-17T12:06:06.453 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-17T12:06:06.453 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_mobility.ko 2023-05-17T12:06:06.453 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_routing.ko 2023-05-17T12:06:06.453 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_udp.ko 2023-05-17T12:06:06.453 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802 2023-05-17T12:06:06.453 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/garp.ko 2023-05-17T12:06:06.453 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/mrp.ko 2023-05-17T12:06:06.454 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/p8022.ko 2023-05-17T12:06:06.454 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/psnap.ko 2023-05-17T12:06:06.454 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/stp.ko 2023-05-17T12:06:06.454 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/8021q 2023-05-17T12:06:06.454 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/8021q/8021q.ko 2023-05-17T12:06:06.454 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p 2023-05-17T12:06:06.454 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet.ko 2023-05-17T12:06:06.455 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_fd.ko 2023-05-17T12:06:06.455 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_rdma.ko 2023-05-17T12:06:06.455 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_virtio.ko 2023-05-17T12:06:06.455 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/batman-adv 2023-05-17T12:06:06.455 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/batman-adv/batman-adv.ko 2023-05-17T12:06:06.455 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge 2023-05-17T12:06:06.455 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/br_netfilter.ko 2023-05-17T12:06:06.455 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/bridge.ko 2023-05-17T12:06:06.456 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter 2023-05-17T12:06:06.456 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-17T12:06:06.456 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-17T12:06:06.456 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-17T12:06:06.456 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-17T12:06:06.456 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-17T12:06:06.456 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-17T12:06:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-17T12:06:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-17T12:06:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-17T12:06:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-17T12:06:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-17T12:06:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-17T12:06:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-17T12:06:06.457 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-17T12:06:06.458 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-17T12:06:06.458 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-17T12:06:06.458 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-17T12:06:06.458 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-17T12:06:06.458 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-17T12:06:06.458 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-17T12:06:06.458 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtables.ko 2023-05-17T12:06:06.458 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-17T12:06:06.459 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-17T12:06:06.459 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-17T12:06:06.459 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ceph 2023-05-17T12:06:06.459 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ceph/libceph.ko 2023-05-17T12:06:06.459 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/core 2023-05-17T12:06:06.459 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/core/failover.ko 2023-05-17T12:06:06.459 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/core/pktgen.ko 2023-05-17T12:06:06.459 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp 2023-05-17T12:06:06.460 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp.ko 2023-05-17T12:06:06.460 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_diag.ko 2023-05-17T12:06:06.460 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_ipv4.ko 2023-05-17T12:06:06.460 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_ipv6.ko 2023-05-17T12:06:06.460 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dns_resolver 2023-05-17T12:06:06.460 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dns_resolver/dns_resolver.ko 2023-05-17T12:06:06.460 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa 2023-05-17T12:06:06.460 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/dsa_core.ko 2023-05-17T12:06:06.461 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_brcm.ko 2023-05-17T12:06:06.461 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_dsa.ko 2023-05-17T12:06:06.461 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_none.ko 2023-05-17T12:06:06.461 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_trailer.ko 2023-05-17T12:06:06.461 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154 2023-05-17T12:06:06.461 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/6lowpan 2023-05-17T12:06:06.461 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-17T12:06:06.462 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ieee802154.ko 2023-05-17T12:06:06.462 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-17T12:06:06.462 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4 2023-05-17T12:06:06.462 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ah4.ko 2023-05-17T12:06:06.462 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/esp4.ko 2023-05-17T12:06:06.462 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/fou.ko 2023-05-17T12:06:06.462 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/gre.ko 2023-05-17T12:06:06.462 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/inet_diag.ko 2023-05-17T12:06:06.463 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_gre.ko 2023-05-17T12:06:06.463 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_tunnel.ko 2023-05-17T12:06:06.463 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_vti.ko 2023-05-17T12:06:06.463 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ipcomp.ko 2023-05-17T12:06:06.463 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ipip.ko 2023-05-17T12:06:06.463 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter 2023-05-17T12:06:06.463 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-17T12:06:06.463 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-17T12:06:06.464 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-17T12:06:06.464 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-17T12:06:06.464 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-17T12:06:06.464 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-17T12:06:06.464 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-17T12:06:06.464 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-17T12:06:06.464 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-17T12:06:06.465 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-17T12:06:06.465 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-17T12:06:06.465 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-17T12:06:06.465 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-17T12:06:06.465 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-17T12:06:06.465 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-17T12:06:06.465 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-17T12:06:06.465 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-17T12:06:06.466 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-17T12:06:06.466 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-17T12:06:06.466 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-17T12:06:06.466 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-17T12:06:06.466 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_bic.ko 2023-05-17T12:06:06.466 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_dctcp.ko 2023-05-17T12:06:06.466 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_diag.ko 2023-05-17T12:06:06.466 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_highspeed.ko 2023-05-17T12:06:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_htcp.ko 2023-05-17T12:06:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_hybla.ko 2023-05-17T12:06:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_illinois.ko 2023-05-17T12:06:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_lp.ko 2023-05-17T12:06:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_scalable.ko 2023-05-17T12:06:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_vegas.ko 2023-05-17T12:06:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_veno.ko 2023-05-17T12:06:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_westwood.ko 2023-05-17T12:06:06.468 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_yeah.ko 2023-05-17T12:06:06.468 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tunnel4.ko 2023-05-17T12:06:06.468 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/udp_diag.ko 2023-05-17T12:06:06.468 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/udp_tunnel.ko 2023-05-17T12:06:06.468 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-17T12:06:06.468 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6 2023-05-17T12:06:06.468 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ah6.ko 2023-05-17T12:06:06.469 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/esp6.ko 2023-05-17T12:06:06.469 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/fou6.ko 2023-05-17T12:06:06.469 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_tunnel.ko 2023-05-17T12:06:06.469 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-17T12:06:06.469 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_vti.ko 2023-05-17T12:06:06.469 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ipcomp6.ko 2023-05-17T12:06:06.469 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter 2023-05-17T12:06:06.469 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-17T12:06:06.470 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-17T12:06:06.470 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-17T12:06:06.470 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-17T12:06:06.470 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-17T12:06:06.470 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-17T12:06:06.470 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-17T12:06:06.470 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-17T12:06:06.470 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-17T12:06:06.471 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-17T12:06:06.471 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-17T12:06:06.471 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-17T12:06:06.471 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-17T12:06:06.471 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-17T12:06:06.471 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-17T12:06:06.471 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-17T12:06:06.472 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-17T12:06:06.472 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-17T12:06:06.472 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-17T12:06:06.472 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-17T12:06:06.472 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-17T12:06:06.472 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-17T12:06:06.472 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-17T12:06:06.472 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-17T12:06:06.473 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/sit.ko 2023-05-17T12:06:06.473 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/tunnel6.ko 2023-05-17T12:06:06.473 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-17T12:06:06.473 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/key 2023-05-17T12:06:06.473 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/key/af_key.ko 2023-05-17T12:06:06.473 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp 2023-05-17T12:06:06.473 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_core.ko 2023-05-17T12:06:06.473 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-17T12:06:06.474 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_eth.ko 2023-05-17T12:06:06.474 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ip.ko 2023-05-17T12:06:06.474 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ip6.ko 2023-05-17T12:06:06.474 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_netlink.ko 2023-05-17T12:06:06.474 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ppp.ko 2023-05-17T12:06:06.474 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/llc 2023-05-17T12:06:06.474 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/llc/llc.ko 2023-05-17T12:06:06.474 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/mac802154 2023-05-17T12:06:06.475 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/mac802154/mac802154.ko 2023-05-17T12:06:06.475 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/mpls 2023-05-17T12:06:06.475 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/mpls/mpls_gso.ko 2023-05-17T12:06:06.475 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter 2023-05-17T12:06:06.475 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset 2023-05-17T12:06:06.475 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set.ko 2023-05-17T12:06:06.475 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-17T12:06:06.475 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-17T12:06:06.476 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-17T12:06:06.476 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-17T12:06:06.476 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-17T12:06:06.476 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-17T12:06:06.476 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-17T12:06:06.476 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-17T12:06:06.476 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-17T12:06:06.477 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-17T12:06:06.477 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-17T12:06:06.477 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-17T12:06:06.477 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-17T12:06:06.477 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-17T12:06:06.477 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-17T12:06:06.477 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs 2023-05-17T12:06:06.477 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-17T12:06:06.478 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-17T12:06:06.478 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-17T12:06:06.478 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-17T12:06:06.478 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-17T12:06:06.478 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-17T12:06:06.478 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-17T12:06:06.478 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-17T12:06:06.479 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-17T12:06:06.479 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-17T12:06:06.479 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-17T12:06:06.479 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-17T12:06:06.479 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-17T12:06:06.479 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-17T12:06:06.479 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conncount.ko 2023-05-17T12:06:06.479 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack.ko 2023-05-17T12:06:06.480 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-17T12:06:06.480 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-17T12:06:06.480 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-17T12:06:06.480 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-17T12:06:06.480 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-17T12:06:06.480 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-17T12:06:06.480 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-17T12:06:06.480 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-17T12:06:06.481 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-17T12:06:06.481 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-17T12:06:06.481 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-17T12:06:06.481 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-17T12:06:06.481 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-17T12:06:06.481 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_flow_table.ko 2023-05-17T12:06:06.481 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-17T12:06:06.481 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_log_syslog.ko 2023-05-17T12:06:06.482 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat.ko 2023-05-17T12:06:06.482 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-17T12:06:06.482 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-17T12:06:06.482 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_irc.ko 2023-05-17T12:06:06.482 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_sip.ko 2023-05-17T12:06:06.482 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-17T12:06:06.482 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-17T12:06:06.482 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_tables.ko 2023-05-17T12:06:06.483 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink.ko 2023-05-17T12:06:06.483 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-17T12:06:06.483 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_log.ko 2023-05-17T12:06:06.483 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-17T12:06:06.483 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-17T12:06:06.483 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_chain_nat.ko 2023-05-17T12:06:06.483 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_compat.ko 2023-05-17T12:06:06.483 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_ct.ko 2023-05-17T12:06:06.484 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-17T12:06:06.484 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_fib.ko 2023-05-17T12:06:06.484 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-17T12:06:06.484 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_hash.ko 2023-05-17T12:06:06.484 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_limit.ko 2023-05-17T12:06:06.484 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_log.ko 2023-05-17T12:06:06.484 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_masq.ko 2023-05-17T12:06:06.485 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_nat.ko 2023-05-17T12:06:06.485 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_numgen.ko 2023-05-17T12:06:06.485 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_queue.ko 2023-05-17T12:06:06.485 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_quota.ko 2023-05-17T12:06:06.485 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_redir.ko 2023-05-17T12:06:06.485 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_reject.ko 2023-05-17T12:06:06.485 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_reject_inet.ko 2023-05-17T12:06:06.485 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_socket.ko 2023-05-17T12:06:06.486 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_tunnel.ko 2023-05-17T12:06:06.486 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_AUDIT.ko 2023-05-17T12:06:06.486 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-17T12:06:06.486 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-17T12:06:06.486 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-17T12:06:06.486 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CT.ko 2023-05-17T12:06:06.486 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_DSCP.ko 2023-05-17T12:06:06.486 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_HL.ko 2023-05-17T12:06:06.487 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_HMARK.ko 2023-05-17T12:06:06.487 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-17T12:06:06.487 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_LED.ko 2023-05-17T12:06:06.487 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_LOG.ko 2023-05-17T12:06:06.487 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-17T12:06:06.487 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NETMAP.ko 2023-05-17T12:06:06.487 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NFLOG.ko 2023-05-17T12:06:06.488 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-17T12:06:06.488 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_RATEEST.ko 2023-05-17T12:06:06.488 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-17T12:06:06.488 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_SECMARK.ko 2023-05-17T12:06:06.488 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-17T12:06:06.488 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-17T12:06:06.488 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TEE.ko 2023-05-17T12:06:06.488 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TPROXY.ko 2023-05-17T12:06:06.489 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TRACE.ko 2023-05-17T12:06:06.489 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_addrtype.ko 2023-05-17T12:06:06.489 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_bpf.ko 2023-05-17T12:06:06.489 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cgroup.ko 2023-05-17T12:06:06.489 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cluster.ko 2023-05-17T12:06:06.489 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_comment.ko 2023-05-17T12:06:06.489 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connbytes.ko 2023-05-17T12:06:06.489 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connlabel.ko 2023-05-17T12:06:06.490 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connlimit.ko 2023-05-17T12:06:06.490 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connmark.ko 2023-05-17T12:06:06.490 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_conntrack.ko 2023-05-17T12:06:06.490 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cpu.ko 2023-05-17T12:06:06.490 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_dccp.ko 2023-05-17T12:06:06.490 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_devgroup.ko 2023-05-17T12:06:06.490 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_dscp.ko 2023-05-17T12:06:06.490 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ecn.ko 2023-05-17T12:06:06.491 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_esp.ko 2023-05-17T12:06:06.491 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_hashlimit.ko 2023-05-17T12:06:06.491 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_helper.ko 2023-05-17T12:06:06.491 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_hl.ko 2023-05-17T12:06:06.491 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ipcomp.ko 2023-05-17T12:06:06.491 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_iprange.ko 2023-05-17T12:06:06.491 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ipvs.ko 2023-05-17T12:06:06.491 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_l2tp.ko 2023-05-17T12:06:06.492 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_length.ko 2023-05-17T12:06:06.492 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_limit.ko 2023-05-17T12:06:06.492 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_mac.ko 2023-05-17T12:06:06.492 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_mark.ko 2023-05-17T12:06:06.492 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_multiport.ko 2023-05-17T12:06:06.492 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_nat.ko 2023-05-17T12:06:06.492 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_nfacct.ko 2023-05-17T12:06:06.493 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_osf.ko 2023-05-17T12:06:06.493 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_owner.ko 2023-05-17T12:06:06.493 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_physdev.ko 2023-05-17T12:06:06.493 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_pkttype.ko 2023-05-17T12:06:06.493 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_policy.ko 2023-05-17T12:06:06.493 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_quota.ko 2023-05-17T12:06:06.493 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_rateest.ko 2023-05-17T12:06:06.493 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_realm.ko 2023-05-17T12:06:06.494 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_recent.ko 2023-05-17T12:06:06.494 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_sctp.ko 2023-05-17T12:06:06.494 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_set.ko 2023-05-17T12:06:06.494 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_socket.ko 2023-05-17T12:06:06.494 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_state.ko 2023-05-17T12:06:06.494 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_statistic.ko 2023-05-17T12:06:06.494 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_string.ko 2023-05-17T12:06:06.494 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_tcpmss.ko 2023-05-17T12:06:06.495 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_time.ko 2023-05-17T12:06:06.495 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_u32.ko 2023-05-17T12:06:06.495 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netlink 2023-05-17T12:06:06.495 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netlink/netlink_diag.ko 2023-05-17T12:06:06.495 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/nsh 2023-05-17T12:06:06.495 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/nsh/nsh.ko 2023-05-17T12:06:06.495 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch 2023-05-17T12:06:06.495 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/openvswitch.ko 2023-05-17T12:06:06.496 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-geneve.ko 2023-05-17T12:06:06.496 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-gre.ko 2023-05-17T12:06:06.496 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-vxlan.ko 2023-05-17T12:06:06.496 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/packet 2023-05-17T12:06:06.496 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/packet/af_packet_diag.ko 2023-05-17T12:06:06.496 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/rds 2023-05-17T12:06:06.496 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds.ko 2023-05-17T12:06:06.497 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds_rdma.ko 2023-05-17T12:06:06.497 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds_tcp.ko 2023-05-17T12:06:06.497 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched 2023-05-17T12:06:06.497 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_csum.ko 2023-05-17T12:06:06.497 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_gact.ko 2023-05-17T12:06:06.497 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_ipt.ko 2023-05-17T12:06:06.497 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_mirred.ko 2023-05-17T12:06:06.497 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_nat.ko 2023-05-17T12:06:06.498 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_pedit.ko 2023-05-17T12:06:06.498 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_police.ko 2023-05-17T12:06:06.498 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_simple.ko 2023-05-17T12:06:06.498 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_skbedit.ko 2023-05-17T12:06:06.498 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_vlan.ko 2023-05-17T12:06:06.498 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_basic.ko 2023-05-17T12:06:06.498 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_bpf.ko 2023-05-17T12:06:06.498 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_flow.ko 2023-05-17T12:06:06.499 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_fw.ko 2023-05-17T12:06:06.499 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_route.ko 2023-05-17T12:06:06.499 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_u32.ko 2023-05-17T12:06:06.499 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_cmp.ko 2023-05-17T12:06:06.499 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_ipset.ko 2023-05-17T12:06:06.499 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_meta.ko 2023-05-17T12:06:06.499 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_nbyte.ko 2023-05-17T12:06:06.499 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_text.ko 2023-05-17T12:06:06.500 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_u32.ko 2023-05-17T12:06:06.500 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_choke.ko 2023-05-17T12:06:06.500 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_codel.ko 2023-05-17T12:06:06.500 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_drr.ko 2023-05-17T12:06:06.500 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_fq.ko 2023-05-17T12:06:06.500 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_gred.ko 2023-05-17T12:06:06.500 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_hfsc.ko 2023-05-17T12:06:06.500 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_hhf.ko 2023-05-17T12:06:06.501 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_htb.ko 2023-05-17T12:06:06.501 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_ingress.ko 2023-05-17T12:06:06.501 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_mqprio.ko 2023-05-17T12:06:06.501 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_mqprio_lib.ko 2023-05-17T12:06:06.501 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_multiq.ko 2023-05-17T12:06:06.501 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_netem.ko 2023-05-17T12:06:06.501 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_pie.ko 2023-05-17T12:06:06.502 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_plug.ko 2023-05-17T12:06:06.502 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_prio.ko 2023-05-17T12:06:06.502 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_qfq.ko 2023-05-17T12:06:06.502 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_red.ko 2023-05-17T12:06:06.502 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_sfb.ko 2023-05-17T12:06:06.502 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_sfq.ko 2023-05-17T12:06:06.502 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_tbf.ko 2023-05-17T12:06:06.502 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_teql.ko 2023-05-17T12:06:06.503 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp 2023-05-17T12:06:06.503 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/sctp.ko 2023-05-17T12:06:06.503 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/sctp_diag.ko 2023-05-17T12:06:06.503 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc 2023-05-17T12:06:06.503 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss 2023-05-17T12:06:06.503 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-17T12:06:06.503 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-17T12:06:06.503 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/sunrpc.ko 2023-05-17T12:06:06.504 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/xprtrdma 2023-05-17T12:06:06.504 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-17T12:06:06.504 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc 2023-05-17T12:06:06.504 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/diag.ko 2023-05-17T12:06:06.504 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/tipc.ko 2023-05-17T12:06:06.504 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/unix 2023-05-17T12:06:06.504 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/unix/unix_diag.ko 2023-05-17T12:06:06.504 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock 2023-05-17T12:06:06.505 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-17T12:06:06.505 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-17T12:06:06.505 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock.ko 2023-05-17T12:06:06.505 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-17T12:06:06.505 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-17T12:06:06.505 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm 2023-05-17T12:06:06.505 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-17T12:06:06.505 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security 2023-05-17T12:06:06.506 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys 2023-05-17T12:06:06.506 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys/encrypted-keys 2023-05-17T12:06:06.506 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-17T12:06:06.506 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys/trusted-keys 2023-05-17T12:06:06.506 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys/trusted-keys/trusted.ko 2023-05-17T12:06:06.506 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/virt 2023-05-17T12:06:06.506 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/virt/lib 2023-05-17T12:06:06.506 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/virt/lib/irqbypass.ko 2023-05-17T12:06:06.507 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.alias 2023-05-17T12:06:06.507 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.alias.bin 2023-05-17T12:06:06.507 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.builtin 2023-05-17T12:06:06.507 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.builtin.bin 2023-05-17T12:06:06.507 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.builtin.modinfo 2023-05-17T12:06:06.507 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.dep 2023-05-17T12:06:06.507 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.dep.bin 2023-05-17T12:06:06.507 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.devname 2023-05-17T12:06:06.508 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.order 2023-05-17T12:06:06.508 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.softdep 2023-05-17T12:06:06.508 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.symbols 2023-05-17T12:06:06.508 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.symbols.bin 2023-05-17T12:06:06.509 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g2bcb17939031 2023-05-17T12:06:06.509 DEBUG:teuthology.orchestra.run.smithi088:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-17T12:06:06.537 INFO:teuthology.orchestra.run.smithi088.stdout:postinstall scriptlet (using /bin/sh): 2023-05-17T12:06:06.538 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-g2bcb17939031 -a -r /boot/System.map-6.3.0-g2bcb17939031 ]; then 2023-05-17T12:06:06.538 INFO:teuthology.orchestra.run.smithi088.stdout:cp /boot/vmlinuz-6.3.0-g2bcb17939031 /boot/.vmlinuz-6.3.0-g2bcb17939031-rpm 2023-05-17T12:06:06.538 INFO:teuthology.orchestra.run.smithi088.stdout:cp /boot/System.map-6.3.0-g2bcb17939031 /boot/.System.map-6.3.0-g2bcb17939031-rpm 2023-05-17T12:06:06.538 INFO:teuthology.orchestra.run.smithi088.stdout:rm -f /boot/vmlinuz-6.3.0-g2bcb17939031 /boot/System.map-6.3.0-g2bcb17939031 2023-05-17T12:06:06.538 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/installkernel 6.3.0-g2bcb17939031 /boot/.vmlinuz-6.3.0-g2bcb17939031-rpm /boot/.System.map-6.3.0-g2bcb17939031-rpm 2023-05-17T12:06:06.538 INFO:teuthology.orchestra.run.smithi088.stdout:rm -f /boot/.vmlinuz-6.3.0-g2bcb17939031-rpm /boot/.System.map-6.3.0-g2bcb17939031-rpm 2023-05-17T12:06:06.539 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-05-17T12:06:06.539 INFO:teuthology.orchestra.run.smithi088.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-17T12:06:06.539 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-17T12:06:06.539 INFO:teuthology.orchestra.run.smithi088.stdout:new-kernel-pkg --remove 6.3.0-g2bcb17939031 --rminitrd --initrdfile=/boot/initramfs-6.3.0-g2bcb17939031.img 2023-05-17T12:06:06.539 INFO:teuthology.orchestra.run.smithi088.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-17T12:06:06.539 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-install remove 6.3.0-g2bcb17939031 2023-05-17T12:06:06.539 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-05-17T12:06:06.540 INFO:teuthology.orchestra.run.smithi088.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-17T12:06:06.540 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-17T12:06:06.540 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/update-bootloader --remove 6.3.0-g2bcb17939031 2023-05-17T12:06:06.540 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-05-17T12:06:06.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2023-05-17T12:06:06.619 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2023-05-17T12:06:06.620 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2023-05-17T12:06:06.620 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.02 2023-05-17T12:06:06.620 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 129.el8 2023-05-17T12:06:06.620 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2023-05-17T12:06:06.620 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-05-17T12:06:06.620 INFO:teuthology.orchestra.run.smithi088.stdout:Group : System Environment/Base 2023-05-17T12:06:06.621 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 9265586 2023-05-17T12:06:06.621 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2023-05-17T12:06:06.621 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-05-17T12:06:06.621 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-05-17T12:06:06.621 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-05-17T12:06:06.621 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : kbuilder.bsys.centos.org 2023-05-17T12:06:06.621 INFO:teuthology.orchestra.run.smithi088.stdout:Relocations : (not relocatable) 2023-05-17T12:06:06.621 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : CentOS BuildSystem 2023-05-17T12:06:06.622 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2023-05-17T12:06:06.622 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-17T12:06:06.622 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2023-05-17T12:06:06.622 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2023-05-17T12:06:06.622 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:06:06.622 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-17T12:06:06.622 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-17T12:06:06.623 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-17T12:06:06.623 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2023-05-17T12:06:06.623 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:06:06.623 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2023-05-17T12:06:06.624 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-17T12:06:06.624 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 6.3.0-g2bcb17939031 2023-05-17T12:06:06.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-17T12:06:09.552 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-05-17T12:06:11.803 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-05-17T12:06:11.809 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-05-17T12:06:11.913 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.wZWpC4CPfS 2023-05-17T12:06:11.914 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wZWpC4CPfS 2023-05-17T12:06:11.948 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.wZWpC4CPfS 2023-05-17T12:06:12.104 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.wZWpC4CPfS is 6KB 2023-05-17T12:06:12.126 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.wZWpC4CPfS 2023-05-17T12:06:12.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2023-05-17T12:06:12.209 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-05-17T12:06:12.210 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-05-17T12:06:12.210 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-05-17T12:06:12.210 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-6.3.0-g2bcb17939031.conf 2023-05-17T12:06:12.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.3.0-g2bcb17939031 2023-05-17T12:06:12.356 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2023-05-17T12:06:16.132 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-17T12:06:16.133 DEBUG:teuthology.orchestra.run.smithi187:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-17T12:06:16.201 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/System.map-6.3.0-g2bcb17939031 2023-05-17T12:06:16.201 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/config-6.3.0-g2bcb17939031 2023-05-17T12:06:16.201 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/vmlinuz-6.3.0-g2bcb17939031 2023-05-17T12:06:16.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031 2023-05-17T12:06:16.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel 2023-05-17T12:06:16.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch 2023-05-17T12:06:16.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86 2023-05-17T12:06:16.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto 2023-05-17T12:06:16.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-17T12:06:16.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-17T12:06:16.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-17T12:06:16.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-17T12:06:16.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-17T12:06:16.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-17T12:06:16.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-17T12:06:16.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-17T12:06:16.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-17T12:06:16.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-17T12:06:16.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-17T12:06:16.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-17T12:06:16.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-17T12:06:16.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-17T12:06:16.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-17T12:06:16.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-17T12:06:16.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-17T12:06:16.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-17T12:06:16.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-17T12:06:16.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-17T12:06:16.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel 2023-05-17T12:06:16.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu 2023-05-17T12:06:16.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/mce 2023-05-17T12:06:16.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-17T12:06:16.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm 2023-05-17T12:06:16.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-17T12:06:16.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-17T12:06:16.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/arch/x86/kvm/kvm.ko 2023-05-17T12:06:16.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto 2023-05-17T12:06:16.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ansi_cprng.ko 2023-05-17T12:06:16.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/anubis.ko 2023-05-17T12:06:16.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/arc4.ko 2023-05-17T12:06:16.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx 2023-05-17T12:06:16.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_memcpy.ko 2023-05-17T12:06:16.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_pq.ko 2023-05-17T12:06:16.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-17T12:06:16.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_tx.ko 2023-05-17T12:06:16.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/async_xor.ko 2023-05-17T12:06:16.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/async_tx/raid6test.ko 2023-05-17T12:06:16.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/authenc.ko 2023-05-17T12:06:16.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/authencesn.ko 2023-05-17T12:06:16.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blake2b_generic.ko 2023-05-17T12:06:16.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blowfish_common.ko 2023-05-17T12:06:16.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/blowfish_generic.ko 2023-05-17T12:06:16.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/camellia_generic.ko 2023-05-17T12:06:16.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast5_generic.ko 2023-05-17T12:06:16.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast6_generic.ko 2023-05-17T12:06:16.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cast_common.ko 2023-05-17T12:06:16.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/ccm.ko 2023-05-17T12:06:16.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cmac.ko 2023-05-17T12:06:16.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crc32_generic.ko 2023-05-17T12:06:16.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_engine.ko 2023-05-17T12:06:16.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/crypto_user.ko 2023-05-17T12:06:16.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/cts.ko 2023-05-17T12:06:16.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/des_generic.ko 2023-05-17T12:06:16.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/dh_generic.ko 2023-05-17T12:06:16.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/echainiv.ko 2023-05-17T12:06:16.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/essiv.ko 2023-05-17T12:06:16.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/fcrypt.ko 2023-05-17T12:06:16.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/khazad.ko 2023-05-17T12:06:16.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lz4.ko 2023-05-17T12:06:16.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/lz4hc.ko 2023-05-17T12:06:16.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/md4.ko 2023-05-17T12:06:16.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/michael_mic.ko 2023-05-17T12:06:16.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/pcbc.ko 2023-05-17T12:06:16.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/pcrypt.ko 2023-05-17T12:06:16.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/rmd160.ko 2023-05-17T12:06:16.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/seed.ko 2023-05-17T12:06:16.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/serpent_generic.ko 2023-05-17T12:06:16.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/tcrypt.ko 2023-05-17T12:06:16.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/tea.ko 2023-05-17T12:06:16.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/twofish_common.ko 2023-05-17T12:06:16.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/twofish_generic.ko 2023-05-17T12:06:16.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/vmac.ko 2023-05-17T12:06:16.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/wp512.ko 2023-05-17T12:06:16.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xcbc.ko 2023-05-17T12:06:16.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xor.ko 2023-05-17T12:06:16.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/crypto/xxhash_generic.ko 2023-05-17T12:06:16.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers 2023-05-17T12:06:16.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi 2023-05-17T12:06:16.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-17T12:06:16.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/acpi_pad.ko 2023-05-17T12:06:16.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/custom_method.ko 2023-05-17T12:06:16.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/ec_sys.ko 2023-05-17T12:06:16.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/platform_profile.ko 2023-05-17T12:06:16.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/sbs.ko 2023-05-17T12:06:16.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/sbshc.ko 2023-05-17T12:06:16.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/acpi/video.ko 2023-05-17T12:06:16.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata 2023-05-17T12:06:16.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/acard-ahci.ko 2023-05-17T12:06:16.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ahci_platform.ko 2023-05-17T12:06:16.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/ata_generic.ko 2023-05-17T12:06:16.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/libahci_platform.ko 2023-05-17T12:06:16.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_acpi.ko 2023-05-17T12:06:16.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ali.ko 2023-05-17T12:06:16.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_amd.ko 2023-05-17T12:06:16.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_artop.ko 2023-05-17T12:06:16.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_atiixp.ko 2023-05-17T12:06:16.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_atp867x.ko 2023-05-17T12:06:16.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cmd640.ko 2023-05-17T12:06:16.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cmd64x.ko 2023-05-17T12:06:16.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_cypress.ko 2023-05-17T12:06:16.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_efar.ko 2023-05-17T12:06:16.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt366.ko 2023-05-17T12:06:16.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt37x.ko 2023-05-17T12:06:16.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-17T12:06:16.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-17T12:06:16.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_it8213.ko 2023-05-17T12:06:16.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_it821x.ko 2023-05-17T12:06:16.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_jmicron.ko 2023-05-17T12:06:16.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_marvell.ko 2023-05-17T12:06:16.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_mpiix.ko 2023-05-17T12:06:16.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_netcell.ko 2023-05-17T12:06:16.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ninja32.ko 2023-05-17T12:06:16.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ns87410.ko 2023-05-17T12:06:16.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_ns87415.ko 2023-05-17T12:06:16.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_oldpiix.ko 2023-05-17T12:06:16.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_opti.ko 2023-05-17T12:06:16.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_optidma.ko 2023-05-17T12:06:16.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pcmcia.ko 2023-05-17T12:06:16.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-17T12:06:16.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-17T12:06:16.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_piccolo.ko 2023-05-17T12:06:16.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_rdc.ko 2023-05-17T12:06:16.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sch.ko 2023-05-17T12:06:16.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_serverworks.ko 2023-05-17T12:06:16.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sil680.ko 2023-05-17T12:06:16.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sis.ko 2023-05-17T12:06:16.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_sl82c105.ko 2023-05-17T12:06:16.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_triflex.ko 2023-05-17T12:06:16.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pata_via.ko 2023-05-17T12:06:16.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/pdc_adma.ko 2023-05-17T12:06:16.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_inic162x.ko 2023-05-17T12:06:16.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_mv.ko 2023-05-17T12:06:16.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_nv.ko 2023-05-17T12:06:16.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_promise.ko 2023-05-17T12:06:16.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_qstor.ko 2023-05-17T12:06:16.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sil.ko 2023-05-17T12:06:16.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sil24.ko 2023-05-17T12:06:16.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sis.ko 2023-05-17T12:06:16.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_svw.ko 2023-05-17T12:06:16.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_sx4.ko 2023-05-17T12:06:16.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_uli.ko 2023-05-17T12:06:16.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_via.ko 2023-05-17T12:06:16.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ata/sata_vsc.ko 2023-05-17T12:06:16.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/auxdisplay 2023-05-17T12:06:16.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/auxdisplay/ks0108.ko 2023-05-17T12:06:16.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/base 2023-05-17T12:06:16.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/base/regmap 2023-05-17T12:06:16.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-17T12:06:16.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/bcma 2023-05-17T12:06:16.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/bcma/bcma.ko 2023-05-17T12:06:16.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block 2023-05-17T12:06:16.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/aoe 2023-05-17T12:06:16.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/aoe/aoe.ko 2023-05-17T12:06:16.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/brd.ko 2023-05-17T12:06:16.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/drbd 2023-05-17T12:06:16.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/drbd/drbd.ko 2023-05-17T12:06:16.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/floppy.ko 2023-05-17T12:06:16.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/loop.ko 2023-05-17T12:06:16.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/mtip32xx 2023-05-17T12:06:16.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-17T12:06:16.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/nbd.ko 2023-05-17T12:06:16.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/null_blk 2023-05-17T12:06:16.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/null_blk/null_blk.ko 2023-05-17T12:06:16.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/pktcdvd.ko 2023-05-17T12:06:16.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/rbd.ko 2023-05-17T12:06:16.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/virtio_blk.ko 2023-05-17T12:06:16.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkback 2023-05-17T12:06:16.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-17T12:06:16.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/xen-blkfront.ko 2023-05-17T12:06:16.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/zram 2023-05-17T12:06:16.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/block/zram/zram.ko 2023-05-17T12:06:16.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char 2023-05-17T12:06:16.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hangcheck-timer.ko 2023-05-17T12:06:16.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random 2023-05-17T12:06:16.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-17T12:06:16.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-17T12:06:16.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-17T12:06:16.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/via-rng.ko 2023-05-17T12:06:16.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-17T12:06:16.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi 2023-05-17T12:06:16.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-17T12:06:16.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-17T12:06:16.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-17T12:06:16.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-17T12:06:16.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-17T12:06:16.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-17T12:06:16.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/lp.ko 2023-05-17T12:06:16.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/mwave 2023-05-17T12:06:16.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/mwave/mwave.ko 2023-05-17T12:06:16.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia 2023-05-17T12:06:16.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-17T12:06:16.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-17T12:06:16.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/ppdev.ko 2023-05-17T12:06:16.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tlclk.ko 2023-05-17T12:06:16.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm 2023-05-17T12:06:16.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm.ko 2023-05-17T12:06:16.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-17T12:06:16.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-17T12:06:16.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-17T12:06:16.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-17T12:06:16.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-17T12:06:16.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/uv_mmtimer.ko 2023-05-17T12:06:16.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/char/virtio_console.ko 2023-05-17T12:06:16.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq 2023-05-17T12:06:16.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-17T12:06:16.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-17T12:06:16.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-17T12:06:16.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-17T12:06:16.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-17T12:06:16.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-17T12:06:16.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto 2023-05-17T12:06:16.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp 2023-05-17T12:06:16.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-17T12:06:16.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/ccp/ccp.ko 2023-05-17T12:06:16.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/padlock-aes.ko 2023-05-17T12:06:16.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/padlock-sha.ko 2023-05-17T12:06:16.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat 2023-05-17T12:06:16.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_common 2023-05-17T12:06:16.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-17T12:06:16.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-17T12:06:16.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-17T12:06:16.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/virtio 2023-05-17T12:06:16.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-17T12:06:16.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dca 2023-05-17T12:06:16.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dca/dca.ko 2023-05-17T12:06:16.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/devfreq 2023-05-17T12:06:16.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-17T12:06:16.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma 2023-05-17T12:06:16.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/dw 2023-05-17T12:06:16.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-17T12:06:16.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ioat 2023-05-17T12:06:16.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-17T12:06:16.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac 2023-05-17T12:06:16.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/amd64_edac.ko 2023-05-17T12:06:16.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/e752x_edac.ko 2023-05-17T12:06:16.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/edac_mce_amd.ko 2023-05-17T12:06:16.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i3000_edac.ko 2023-05-17T12:06:16.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i3200_edac.ko 2023-05-17T12:06:16.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i5100_edac.ko 2023-05-17T12:06:16.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i5400_edac.ko 2023-05-17T12:06:16.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i7300_edac.ko 2023-05-17T12:06:16.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i7core_edac.ko 2023-05-17T12:06:16.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/i82975x_edac.ko 2023-05-17T12:06:16.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/ie31200_edac.ko 2023-05-17T12:06:16.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/sb_edac.ko 2023-05-17T12:06:16.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/edac/x38_edac.ko 2023-05-17T12:06:16.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware 2023-05-17T12:06:16.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/edd.ko 2023-05-17T12:06:16.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-17T12:06:16.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio 2023-05-17T12:06:16.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-ich.ko 2023-05-17T12:06:16.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-17T12:06:16.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid 2023-05-17T12:06:16.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-appleir.ko 2023-05-17T12:06:16.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-aureal.ko 2023-05-17T12:06:16.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-axff.ko 2023-05-17T12:06:16.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-dr.ko 2023-05-17T12:06:16.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-elecom.ko 2023-05-17T12:06:16.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-elo.ko 2023-05-17T12:06:16.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-emsff.ko 2023-05-17T12:06:16.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gaff.ko 2023-05-17T12:06:16.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gt683r.ko 2023-05-17T12:06:16.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-gyration.ko 2023-05-17T12:06:16.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-17T12:06:16.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-17T12:06:16.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-holtekff.ko 2023-05-17T12:06:16.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-hyperv.ko 2023-05-17T12:06:16.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-icade.ko 2023-05-17T12:06:16.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-keytouch.ko 2023-05-17T12:06:16.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-kye.ko 2023-05-17T12:06:16.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lcpower.ko 2023-05-17T12:06:16.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-led.ko 2023-05-17T12:06:16.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-lenovo.ko 2023-05-17T12:06:16.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-17T12:06:16.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-17T12:06:16.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-multitouch.ko 2023-05-17T12:06:16.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-ortek.ko 2023-05-17T12:06:16.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-penmount.ko 2023-05-17T12:06:16.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-petalynx.ko 2023-05-17T12:06:16.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-picolcd.ko 2023-05-17T12:06:16.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-pl.ko 2023-05-17T12:06:16.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-plantronics.ko 2023-05-17T12:06:16.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-primax.ko 2023-05-17T12:06:16.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-rmi.ko 2023-05-17T12:06:16.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-17T12:06:16.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-common.ko 2023-05-17T12:06:16.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-17T12:06:16.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-17T12:06:16.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-17T12:06:16.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-17T12:06:16.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-17T12:06:16.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-17T12:06:16.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-17T12:06:16.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-17T12:06:16.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-17T12:06:16.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-roccat.ko 2023-05-17T12:06:16.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-saitek.ko 2023-05-17T12:06:16.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-samsung.ko 2023-05-17T12:06:16.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-17T12:06:16.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sjoy.ko 2023-05-17T12:06:16.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sony.ko 2023-05-17T12:06:16.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-speedlink.ko 2023-05-17T12:06:16.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-steelseries.ko 2023-05-17T12:06:16.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-sunplus.ko 2023-05-17T12:06:16.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-17T12:06:16.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-tivo.ko 2023-05-17T12:06:16.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-tmff.ko 2023-05-17T12:06:16.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-topseed.ko 2023-05-17T12:06:16.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-twinhan.ko 2023-05-17T12:06:16.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-uclogic.ko 2023-05-17T12:06:16.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-waltop.ko 2023-05-17T12:06:16.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-wiimote.ko 2023-05-17T12:06:16.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-xinmo.ko 2023-05-17T12:06:16.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-zpff.ko 2023-05-17T12:06:16.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/hid-zydacron.ko 2023-05-17T12:06:16.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/uhid.ko 2023-05-17T12:06:16.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hid/wacom.ko 2023-05-17T12:06:16.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv 2023-05-17T12:06:16.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_balloon.ko 2023-05-17T12:06:16.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_utils.ko 2023-05-17T12:06:16.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hv/hv_vmbus.ko 2023-05-17T12:06:16.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon 2023-05-17T12:06:16.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/abituguru.ko 2023-05-17T12:06:16.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/abituguru3.ko 2023-05-17T12:06:16.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-17T12:06:16.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ad7414.ko 2023-05-17T12:06:16.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ad7418.ko 2023-05-17T12:06:16.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adc128d818.ko 2023-05-17T12:06:16.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1025.ko 2023-05-17T12:06:16.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1026.ko 2023-05-17T12:06:16.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1029.ko 2023-05-17T12:06:16.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm1031.ko 2023-05-17T12:06:16.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adm9240.ko 2023-05-17T12:06:16.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ads7828.ko 2023-05-17T12:06:16.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7410.ko 2023-05-17T12:06:16.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7411.ko 2023-05-17T12:06:16.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7462.ko 2023-05-17T12:06:16.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7470.ko 2023-05-17T12:06:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7475.ko 2023-05-17T12:06:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/adt7x10.ko 2023-05-17T12:06:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/amc6821.ko 2023-05-17T12:06:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/applesmc.ko 2023-05-17T12:06:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asb100.ko 2023-05-17T12:06:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asc7621.ko 2023-05-17T12:06:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-17T12:06:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/atxp1.ko 2023-05-17T12:06:16.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/coretemp.ko 2023-05-17T12:06:16.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-17T12:06:16.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/dme1737.ko 2023-05-17T12:06:16.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ds1621.ko 2023-05-17T12:06:16.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ds620.ko 2023-05-17T12:06:16.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc1403.ko 2023-05-17T12:06:16.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/emc6w201.ko 2023-05-17T12:06:16.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f71805f.ko 2023-05-17T12:06:16.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f71882fg.ko 2023-05-17T12:06:16.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/f75375s.ko 2023-05-17T12:06:16.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/fam15h_power.ko 2023-05-17T12:06:16.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/fschmd.ko 2023-05-17T12:06:16.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/g760a.ko 2023-05-17T12:06:16.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/g762.ko 2023-05-17T12:06:16.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/gl518sm.ko 2023-05-17T12:06:16.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/gl520sm.ko 2023-05-17T12:06:16.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-17T12:06:16.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/i5500_temp.ko 2023-05-17T12:06:16.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/i5k_amb.ko 2023-05-17T12:06:16.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ibmaem.ko 2023-05-17T12:06:16.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ibmpex.ko 2023-05-17T12:06:16.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ina209.ko 2023-05-17T12:06:16.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ina2xx.ko 2023-05-17T12:06:16.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/it87.ko 2023-05-17T12:06:16.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/k10temp.ko 2023-05-17T12:06:16.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/k8temp.ko 2023-05-17T12:06:16.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lineage-pem.ko 2023-05-17T12:06:16.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm63.ko 2023-05-17T12:06:16.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm73.ko 2023-05-17T12:06:16.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm75.ko 2023-05-17T12:06:16.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm77.ko 2023-05-17T12:06:16.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm78.ko 2023-05-17T12:06:16.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm80.ko 2023-05-17T12:06:16.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm83.ko 2023-05-17T12:06:16.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm85.ko 2023-05-17T12:06:16.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm87.ko 2023-05-17T12:06:16.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm90.ko 2023-05-17T12:06:16.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm92.ko 2023-05-17T12:06:16.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm93.ko 2023-05-17T12:06:16.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95234.ko 2023-05-17T12:06:16.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95241.ko 2023-05-17T12:06:16.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/lm95245.ko 2023-05-17T12:06:16.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc2945.ko 2023-05-17T12:06:16.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4151.ko 2023-05-17T12:06:16.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4215.ko 2023-05-17T12:06:16.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4222.ko 2023-05-17T12:06:16.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4245.ko 2023-05-17T12:06:16.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4260.ko 2023-05-17T12:06:16.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/ltc4261.ko 2023-05-17T12:06:16.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max16065.ko 2023-05-17T12:06:16.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max1619.ko 2023-05-17T12:06:16.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max1668.ko 2023-05-17T12:06:16.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max197.ko 2023-05-17T12:06:16.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6639.ko 2023-05-17T12:06:16.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6650.ko 2023-05-17T12:06:16.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/max6697.ko 2023-05-17T12:06:16.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/mcp3021.ko 2023-05-17T12:06:16.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6683.ko 2023-05-17T12:06:16.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6775-core.ko 2023-05-17T12:06:16.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct6775.ko 2023-05-17T12:06:16.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/nct7802.ko 2023-05-17T12:06:16.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pc87360.ko 2023-05-17T12:06:16.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pc87427.ko 2023-05-17T12:06:16.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pcf8591.ko 2023-05-17T12:06:16.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus 2023-05-17T12:06:16.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-17T12:06:16.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-17T12:06:16.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-17T12:06:16.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-17T12:06:16.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-17T12:06:16.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-17T12:06:16.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-17T12:06:16.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-17T12:06:16.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-17T12:06:16.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-17T12:06:16.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-17T12:06:16.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-17T12:06:16.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/powr1220.ko 2023-05-17T12:06:16.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch5627.ko 2023-05-17T12:06:16.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch5636.ko 2023-05-17T12:06:16.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-17T12:06:16.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sht15.ko 2023-05-17T12:06:16.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sht21.ko 2023-05-17T12:06:16.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/shtc1.ko 2023-05-17T12:06:16.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/sis5595.ko 2023-05-17T12:06:16.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47b397.ko 2023-05-17T12:06:16.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47m1.ko 2023-05-17T12:06:16.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/smsc47m192.ko 2023-05-17T12:06:16.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/thmc50.ko 2023-05-17T12:06:16.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp102.ko 2023-05-17T12:06:16.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp103.ko 2023-05-17T12:06:16.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp401.ko 2023-05-17T12:06:16.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/tmp421.ko 2023-05-17T12:06:16.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/via-cputemp.ko 2023-05-17T12:06:16.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/via686a.ko 2023-05-17T12:06:16.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/vt1211.ko 2023-05-17T12:06:16.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/vt8231.ko 2023-05-17T12:06:16.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83627ehf.ko 2023-05-17T12:06:16.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83627hf.ko 2023-05-17T12:06:16.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83781d.ko 2023-05-17T12:06:16.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83791d.ko 2023-05-17T12:06:16.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83792d.ko 2023-05-17T12:06:16.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83793.ko 2023-05-17T12:06:16.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83795.ko 2023-05-17T12:06:16.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83l785ts.ko 2023-05-17T12:06:16.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/hwmon/w83l786ng.ko 2023-05-17T12:06:16.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c 2023-05-17T12:06:16.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos 2023-05-17T12:06:16.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-17T12:06:16.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-17T12:06:16.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses 2023-05-17T12:06:16.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-17T12:06:16.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-17T12:06:16.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-17T12:06:16.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-17T12:06:16.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-17T12:06:16.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-17T12:06:16.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-17T12:06:16.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-17T12:06:16.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-17T12:06:16.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-17T12:06:16.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-17T12:06:16.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-17T12:06:16.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-17T12:06:16.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-17T12:06:16.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-17T12:06:16.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-17T12:06:16.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-17T12:06:16.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-17T12:06:16.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-17T12:06:16.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-17T12:06:16.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-17T12:06:16.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-17T12:06:16.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-17T12:06:16.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-dev.ko 2023-05-17T12:06:16.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-mux.ko 2023-05-17T12:06:16.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-17T12:06:16.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-smbus.ko 2023-05-17T12:06:16.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/i2c/i2c-stub.ko 2023-05-17T12:06:16.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband 2023-05-17T12:06:16.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core 2023-05-17T12:06:16.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-17T12:06:16.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_core.ko 2023-05-17T12:06:16.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-17T12:06:16.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-17T12:06:16.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-17T12:06:16.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-17T12:06:16.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-17T12:06:16.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw 2023-05-17T12:06:16.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/cxgb4 2023-05-17T12:06:16.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-17T12:06:16.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx4 2023-05-17T12:06:16.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-17T12:06:16.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx5 2023-05-17T12:06:16.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-17T12:06:16.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mthca 2023-05-17T12:06:16.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-17T12:06:16.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp 2023-05-17T12:06:16.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ipoib 2023-05-17T12:06:16.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-17T12:06:16.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/iser 2023-05-17T12:06:16.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-17T12:06:16.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/isert 2023-05-17T12:06:16.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-17T12:06:16.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srp 2023-05-17T12:06:16.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-17T12:06:16.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srpt 2023-05-17T12:06:16.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-17T12:06:16.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input 2023-05-17T12:06:16.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport 2023-05-17T12:06:16.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-17T12:06:16.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-17T12:06:16.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/gameport.ko 2023-05-17T12:06:16.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/lightning.ko 2023-05-17T12:06:16.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/gameport/ns558.ko 2023-05-17T12:06:16.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/joydev.ko 2023-05-17T12:06:16.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard 2023-05-17T12:06:16.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-17T12:06:16.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse 2023-05-17T12:06:16.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/appletouch.ko 2023-05-17T12:06:16.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/bcm5974.ko 2023-05-17T12:06:16.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/cyapatp.ko 2023-05-17T12:06:16.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-17T12:06:16.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/sermouse.ko 2023-05-17T12:06:16.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-17T12:06:16.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-17T12:06:16.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-17T12:06:16.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/rmi4 2023-05-17T12:06:16.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-17T12:06:16.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio 2023-05-17T12:06:16.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/altera_ps2.ko 2023-05-17T12:06:16.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/arc_ps2.ko 2023-05-17T12:06:16.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-17T12:06:16.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/serio/serio_raw.ko 2023-05-17T12:06:16.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/input/sparse-keymap.ko 2023-05-17T12:06:16.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu 2023-05-17T12:06:16.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/amd 2023-05-17T12:06:16.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-17T12:06:16.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds 2023-05-17T12:06:16.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-blinkm.ko 2023-05-17T12:06:16.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lm3530.ko 2023-05-17T12:06:16.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-lp3944.ko 2023-05-17T12:06:16.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/leds-ss4200.ko 2023-05-17T12:06:16.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger 2023-05-17T12:06:16.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-17T12:06:16.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-17T12:06:16.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-17T12:06:16.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-17T12:06:16.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-17T12:06:16.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-17T12:06:16.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-17T12:06:16.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-17T12:06:16.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-17T12:06:16.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md 2023-05-17T12:06:16.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/bcache 2023-05-17T12:06:16.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/bcache/bcache.ko 2023-05-17T12:06:16.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-bio-prison.ko 2023-05-17T12:06:16.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-cache-smq.ko 2023-05-17T12:06:16.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-cache.ko 2023-05-17T12:06:16.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-crypt.ko 2023-05-17T12:06:16.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-delay.ko 2023-05-17T12:06:16.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-flakey.ko 2023-05-17T12:06:16.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-log-userspace.ko 2023-05-17T12:06:16.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-multipath.ko 2023-05-17T12:06:16.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-queue-length.ko 2023-05-17T12:06:16.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-raid.ko 2023-05-17T12:06:16.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-round-robin.ko 2023-05-17T12:06:16.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-service-time.ko 2023-05-17T12:06:16.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-switch.ko 2023-05-17T12:06:16.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-thin-pool.ko 2023-05-17T12:06:16.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/dm-verity.ko 2023-05-17T12:06:16.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/faulty.ko 2023-05-17T12:06:16.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/linear.ko 2023-05-17T12:06:16.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/multipath.ko 2023-05-17T12:06:16.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/persistent-data 2023-05-17T12:06:16.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-17T12:06:16.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid0.ko 2023-05-17T12:06:16.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid1.ko 2023-05-17T12:06:16.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid10.ko 2023-05-17T12:06:16.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/md/raid456.ko 2023-05-17T12:06:16.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message 2023-05-17T12:06:16.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion 2023-05-17T12:06:16.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptbase.ko 2023-05-17T12:06:16.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptctl.ko 2023-05-17T12:06:16.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptfc.ko 2023-05-17T12:06:16.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptlan.ko 2023-05-17T12:06:16.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptsas.ko 2023-05-17T12:06:16.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptscsih.ko 2023-05-17T12:06:16.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/message/fusion/mptspi.ko 2023-05-17T12:06:16.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd 2023-05-17T12:06:16.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lpc_ich.ko 2023-05-17T12:06:16.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/lpc_sch.ko 2023-05-17T12:06:16.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/mfd-core.ko 2023-05-17T12:06:16.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/sm501.ko 2023-05-17T12:06:16.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/viperboard.ko 2023-05-17T12:06:16.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/vx855.ko 2023-05-17T12:06:16.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/mfd/wl1273-core.ko 2023-05-17T12:06:16.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc 2023-05-17T12:06:16.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/altera-stapl 2023-05-17T12:06:16.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-17T12:06:16.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/apds9802als.ko 2023-05-17T12:06:16.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/apds990x.ko 2023-05-17T12:06:16.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/bh1770glc.ko 2023-05-17T12:06:16.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/cb710 2023-05-17T12:06:16.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/cb710/cb710.ko 2023-05-17T12:06:16.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom 2023-05-17T12:06:16.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/at24.ko 2023-05-17T12:06:16.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-17T12:06:16.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-17T12:06:16.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/eeprom/max6875.ko 2023-05-17T12:06:16.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/enclosure.ko 2023-05-17T12:06:16.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/hpilo.ko 2023-05-17T12:06:16.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/isl29003.ko 2023-05-17T12:06:16.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/isl29020.ko 2023-05-17T12:06:16.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d 2023-05-17T12:06:16.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-17T12:06:16.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-17T12:06:16.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei 2023-05-17T12:06:16.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei-me.ko 2023-05-17T12:06:16.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei-txe.ko 2023-05-17T12:06:16.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/mei/mei.ko 2023-05-17T12:06:16.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-gru 2023-05-17T12:06:16.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-17T12:06:16.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-xp 2023-05-17T12:06:16.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-17T12:06:16.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-17T12:06:16.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-17T12:06:16.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tifm_7xx1.ko 2023-05-17T12:06:16.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tifm_core.ko 2023-05-17T12:06:16.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/tsl2550.ko 2023-05-17T12:06:16.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_balloon.ko 2023-05-17T12:06:16.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_vmci 2023-05-17T12:06:16.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-17T12:06:16.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net 2023-05-17T12:06:16.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/bonding 2023-05-17T12:06:16.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/bonding/bonding.ko 2023-05-17T12:06:16.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa 2023-05-17T12:06:16.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/b53 2023-05-17T12:06:16.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-17T12:06:16.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-17T12:06:16.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-17T12:06:16.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6xxx 2023-05-17T12:06:16.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-17T12:06:16.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/dummy.ko 2023-05-17T12:06:16.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/eql.ko 2023-05-17T12:06:16.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet 2023-05-17T12:06:16.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com 2023-05-17T12:06:16.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-17T12:06:16.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-17T12:06:16.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-17T12:06:16.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-17T12:06:16.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390 2023-05-17T12:06:16.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-17T12:06:16.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-17T12:06:16.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-17T12:06:16.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-17T12:06:16.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/adaptec 2023-05-17T12:06:16.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-17T12:06:16.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/agere 2023-05-17T12:06:16.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-17T12:06:16.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/alteon 2023-05-17T12:06:16.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-17T12:06:16.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/altera 2023-05-17T12:06:16.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-17T12:06:16.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd 2023-05-17T12:06:16.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-17T12:06:16.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-17T12:06:16.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-17T12:06:16.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros 2023-05-17T12:06:16.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/alx 2023-05-17T12:06:16.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-17T12:06:16.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-17T12:06:16.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-17T12:06:16.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-17T12:06:16.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-17T12:06:16.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx 2023-05-17T12:06:16.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-17T12:06:16.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-17T12:06:16.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom 2023-05-17T12:06:16.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-17T12:06:16.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-17T12:06:16.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-17T12:06:16.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-17T12:06:16.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-17T12:06:16.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/genet 2023-05-17T12:06:16.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-17T12:06:16.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-17T12:06:16.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade 2023-05-17T12:06:16.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/bna 2023-05-17T12:06:16.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-17T12:06:16.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio 2023-05-17T12:06:16.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-17T12:06:16.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-17T12:06:16.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-17T12:06:16.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-17T12:06:16.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-17T12:06:16.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-17T12:06:16.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-17T12:06:16.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-17T12:06:16.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-17T12:06:16.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-17T12:06:16.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco 2023-05-17T12:06:16.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/enic 2023-05-17T12:06:16.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-17T12:06:16.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec 2023-05-17T12:06:16.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip 2023-05-17T12:06:16.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-17T12:06:16.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-17T12:06:16.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-17T12:06:16.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-17T12:06:16.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-17T12:06:16.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-17T12:06:16.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink 2023-05-17T12:06:16.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-17T12:06:16.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-17T12:06:16.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/dnet.ko 2023-05-17T12:06:16.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex 2023-05-17T12:06:16.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/benet 2023-05-17T12:06:16.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-17T12:06:16.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ethoc.ko 2023-05-17T12:06:16.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/fealnx.ko 2023-05-17T12:06:16.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel 2023-05-17T12:06:16.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-17T12:06:16.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000 2023-05-17T12:06:16.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-17T12:06:16.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000e 2023-05-17T12:06:16.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-17T12:06:16.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/fm10k 2023-05-17T12:06:16.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-17T12:06:16.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/i40e 2023-05-17T12:06:16.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-17T12:06:16.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/iavf 2023-05-17T12:06:16.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-17T12:06:16.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igb 2023-05-17T12:06:16.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-17T12:06:16.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igbvf 2023-05-17T12:06:16.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-17T12:06:16.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgb 2023-05-17T12:06:16.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-17T12:06:16.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-17T12:06:16.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-17T12:06:16.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-17T12:06:16.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-17T12:06:16.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/jme.ko 2023-05-17T12:06:16.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell 2023-05-17T12:06:16.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-17T12:06:16.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-17T12:06:16.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-17T12:06:16.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox 2023-05-17T12:06:16.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-17T12:06:16.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-17T12:06:16.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-17T12:06:16.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-17T12:06:16.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-17T12:06:16.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-17T12:06:16.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel 2023-05-17T12:06:16.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-17T12:06:16.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom 2023-05-17T12:06:16.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-17T12:06:16.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-17T12:06:16.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi 2023-05-17T12:06:16.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-17T12:06:16.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-17T12:06:16.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/neterion 2023-05-17T12:06:16.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-17T12:06:16.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/nvidia 2023-05-17T12:06:16.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-17T12:06:16.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines 2023-05-17T12:06:16.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-17T12:06:16.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-17T12:06:16.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic 2023-05-17T12:06:16.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-17T12:06:16.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-17T12:06:16.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-17T12:06:16.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-17T12:06:16.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-17T12:06:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rdc 2023-05-17T12:06:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-17T12:06:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek 2023-05-17T12:06:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-17T12:06:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-17T12:06:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-17T12:06:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-17T12:06:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rocker 2023-05-17T12:06:16.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-17T12:06:16.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sfc 2023-05-17T12:06:16.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-17T12:06:16.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/silan 2023-05-17T12:06:16.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-17T12:06:16.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis 2023-05-17T12:06:16.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-17T12:06:16.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-17T12:06:16.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc 2023-05-17T12:06:16.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-17T12:06:16.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-17T12:06:16.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-17T12:06:16.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-17T12:06:16.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro 2023-05-17T12:06:16.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-17T12:06:16.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-17T12:06:16.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-17T12:06:16.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun 2023-05-17T12:06:16.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-17T12:06:16.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-17T12:06:16.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-17T12:06:16.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-17T12:06:16.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/tehuti 2023-05-17T12:06:16.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-17T12:06:16.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ti 2023-05-17T12:06:16.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-17T12:06:16.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via 2023-05-17T12:06:16.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-17T12:06:16.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-17T12:06:16.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet 2023-05-17T12:06:16.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-17T12:06:16.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-17T12:06:16.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/xircom 2023-05-17T12:06:16.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-17T12:06:16.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/geneve.ko 2023-05-17T12:06:16.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/hyperv 2023-05-17T12:06:16.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-17T12:06:16.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ieee802154 2023-05-17T12:06:16.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-17T12:06:16.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ifb.ko 2023-05-17T12:06:16.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ipvlan 2023-05-17T12:06:16.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-17T12:06:16.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/macvlan.ko 2023-05-17T12:06:16.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/macvtap.ko 2023-05-17T12:06:16.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio 2023-05-17T12:06:16.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio.ko 2023-05-17T12:06:16.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-17T12:06:16.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-17T12:06:16.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/mii.ko 2023-05-17T12:06:16.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/net_failover.ko 2023-05-17T12:06:16.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/netconsole.ko 2023-05-17T12:06:16.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/nlmon.ko 2023-05-17T12:06:16.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs 2023-05-17T12:06:16.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-17T12:06:16.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-17T12:06:16.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy 2023-05-17T12:06:16.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/amd.ko 2023-05-17T12:06:16.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-17T12:06:16.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-17T12:06:16.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-17T12:06:16.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/bcm87xx.ko 2023-05-17T12:06:16.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/broadcom.ko 2023-05-17T12:06:16.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/cicada.ko 2023-05-17T12:06:16.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/davicom.ko 2023-05-17T12:06:16.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/dp83640.ko 2023-05-17T12:06:16.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/et1011c.ko 2023-05-17T12:06:16.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/icplus.ko 2023-05-17T12:06:16.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/lxt.ko 2023-05-17T12:06:16.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/marvell.ko 2023-05-17T12:06:16.315 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/micrel.ko 2023-05-17T12:06:16.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/national.ko 2023-05-17T12:06:16.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/phylink.ko 2023-05-17T12:06:16.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/qsemi.ko 2023-05-17T12:06:16.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/realtek.ko 2023-05-17T12:06:16.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/smsc.ko 2023-05-17T12:06:16.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/ste10Xp.ko 2023-05-17T12:06:16.316 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/phy/vitesse.ko 2023-05-17T12:06:16.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp 2023-05-17T12:06:16.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-17T12:06:16.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_async.ko 2023-05-17T12:06:16.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-17T12:06:16.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-17T12:06:16.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-17T12:06:16.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-17T12:06:16.317 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pppoe.ko 2023-05-17T12:06:16.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pppox.ko 2023-05-17T12:06:16.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/ppp/pptp.ko 2023-05-17T12:06:16.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip 2023-05-17T12:06:16.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip/slhc.ko 2023-05-17T12:06:16.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/slip/slip.ko 2023-05-17T12:06:16.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/sungem_phy.ko 2023-05-17T12:06:16.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/tap.ko 2023-05-17T12:06:16.318 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team 2023-05-17T12:06:16.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team.ko 2023-05-17T12:06:16.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-17T12:06:16.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-17T12:06:16.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-17T12:06:16.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_random.ko 2023-05-17T12:06:16.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-17T12:06:16.319 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/tun.ko 2023-05-17T12:06:16.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/veth.ko 2023-05-17T12:06:16.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/virtio_net.ko 2023-05-17T12:06:16.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vmxnet3 2023-05-17T12:06:16.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-17T12:06:16.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vxlan 2023-05-17T12:06:16.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/vxlan/vxlan.ko 2023-05-17T12:06:16.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netback 2023-05-17T12:06:16.320 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-17T12:06:16.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/net/xen-netfront.ko 2023-05-17T12:06:16.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ntb 2023-05-17T12:06:16.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ntb/ntb.ko 2023-05-17T12:06:16.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme 2023-05-17T12:06:16.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host 2023-05-17T12:06:16.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/nvme-core.ko 2023-05-17T12:06:16.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/nvme/host/nvme.ko 2023-05-17T12:06:16.321 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport 2023-05-17T12:06:16.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport.ko 2023-05-17T12:06:16.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_cs.ko 2023-05-17T12:06:16.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_pc.ko 2023-05-17T12:06:16.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/parport/parport_serial.ko 2023-05-17T12:06:16.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci 2023-05-17T12:06:16.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug 2023-05-17T12:06:16.322 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-17T12:06:16.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/pcie 2023-05-17T12:06:16.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-17T12:06:16.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pci/xen-pcifront.ko 2023-05-17T12:06:16.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia 2023-05-17T12:06:16.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/i82092.ko 2023-05-17T12:06:16.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/pd6729.ko 2023-05-17T12:06:16.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-17T12:06:16.323 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl 2023-05-17T12:06:16.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/intel 2023-05-17T12:06:16.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-17T12:06:16.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform 2023-05-17T12:06:16.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86 2023-05-17T12:06:16.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-17T12:06:16.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/acerhdf.ko 2023-05-17T12:06:16.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-17T12:06:16.324 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-17T12:06:16.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-17T12:06:16.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-17T12:06:16.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-17T12:06:16.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-17T12:06:16.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-17T12:06:16.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-17T12:06:16.325 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-17T12:06:16.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/hdaps.ko 2023-05-17T12:06:16.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel 2023-05-17T12:06:16.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-17T12:06:16.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/intel_ips.ko 2023-05-17T12:06:16.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-17T12:06:16.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-17T12:06:16.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-17T12:06:16.326 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-17T12:06:16.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-17T12:06:16.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-17T12:06:16.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-17T12:06:16.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-17T12:06:16.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-17T12:06:16.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/platform/x86/wmi.ko 2023-05-17T12:06:16.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap 2023-05-17T12:06:16.327 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-17T12:06:16.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-17T12:06:16.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps 2023-05-17T12:06:16.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients 2023-05-17T12:06:16.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-17T12:06:16.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-17T12:06:16.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/clients/pps_parport.ko 2023-05-17T12:06:16.328 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/pps/pps_core.ko 2023-05-17T12:06:16.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp 2023-05-17T12:06:16.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ptp.ko 2023-05-17T12:06:16.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ptp/ptp_kvm.ko 2023-05-17T12:06:16.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc 2023-05-17T12:06:16.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-17T12:06:16.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-17T12:06:16.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-17T12:06:16.329 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-17T12:06:16.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-17T12:06:16.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-17T12:06:16.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-17T12:06:16.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-17T12:06:16.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-17T12:06:16.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-17T12:06:16.330 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-17T12:06:16.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-em3027.ko 2023-05-17T12:06:16.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-17T12:06:16.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-17T12:06:16.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-17T12:06:16.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-17T12:06:16.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-17T12:06:16.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-17T12:06:16.331 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-max6900.ko 2023-05-17T12:06:16.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-17T12:06:16.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-17T12:06:16.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-17T12:06:16.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-17T12:06:16.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-17T12:06:16.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-17T12:06:16.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-17T12:06:16.332 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-17T12:06:16.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-17T12:06:16.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-17T12:06:16.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-17T12:06:16.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-17T12:06:16.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/rtc/rtc-x1205.ko 2023-05-17T12:06:16.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi 2023-05-17T12:06:16.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-9xxx.ko 2023-05-17T12:06:16.333 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-sas.ko 2023-05-17T12:06:16.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/3w-xxxx.ko 2023-05-17T12:06:16.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/BusLogic.ko 2023-05-17T12:06:16.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/a100u2w.ko 2023-05-17T12:06:16.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aacraid 2023-05-17T12:06:16.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-17T12:06:16.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/advansys.ko 2023-05-17T12:06:16.334 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx 2023-05-17T12:06:16.335 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-17T12:06:16.335 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-17T12:06:16.335 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/am53c974.ko 2023-05-17T12:06:16.335 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/arcmsr 2023-05-17T12:06:16.335 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-17T12:06:16.335 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/atp870u.ko 2023-05-17T12:06:16.335 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/be2iscsi 2023-05-17T12:06:16.335 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-17T12:06:16.336 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bfa 2023-05-17T12:06:16.336 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bfa/bfa.ko 2023-05-17T12:06:16.336 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2fc 2023-05-17T12:06:16.336 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-17T12:06:16.336 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2i 2023-05-17T12:06:16.336 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-17T12:06:16.336 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ch.ko 2023-05-17T12:06:16.336 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/csiostor 2023-05-17T12:06:16.337 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-17T12:06:16.337 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi 2023-05-17T12:06:16.337 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-17T12:06:16.337 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-17T12:06:16.337 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-17T12:06:16.337 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-17T12:06:16.337 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-17T12:06:16.337 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/dc395x.ko 2023-05-17T12:06:16.338 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler 2023-05-17T12:06:16.338 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-17T12:06:16.338 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-17T12:06:16.338 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-17T12:06:16.338 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-17T12:06:16.338 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/dmx3191d.ko 2023-05-17T12:06:16.338 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esas2r 2023-05-17T12:06:16.339 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-17T12:06:16.339 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/esp_scsi.ko 2023-05-17T12:06:16.339 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe 2023-05-17T12:06:16.339 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-17T12:06:16.339 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-17T12:06:16.339 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fnic 2023-05-17T12:06:16.339 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/fnic/fnic.ko 2023-05-17T12:06:16.339 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hpsa.ko 2023-05-17T12:06:16.340 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hptiop.ko 2023-05-17T12:06:16.340 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/hv_storvsc.ko 2023-05-17T12:06:16.340 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/initio.ko 2023-05-17T12:06:16.340 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ipr.ko 2023-05-17T12:06:16.340 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ips.ko 2023-05-17T12:06:16.340 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/isci 2023-05-17T12:06:16.340 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/isci/isci.ko 2023-05-17T12:06:16.340 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-17T12:06:16.341 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-17T12:06:16.341 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libfc 2023-05-17T12:06:16.341 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libfc/libfc.ko 2023-05-17T12:06:16.341 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libiscsi.ko 2023-05-17T12:06:16.341 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-17T12:06:16.341 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libsas 2023-05-17T12:06:16.341 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/libsas/libsas.ko 2023-05-17T12:06:16.342 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/lpfc 2023-05-17T12:06:16.342 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-17T12:06:16.342 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid 2023-05-17T12:06:16.342 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid.ko 2023-05-17T12:06:16.342 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-17T12:06:16.342 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-17T12:06:16.342 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-17T12:06:16.342 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mpt3sas 2023-05-17T12:06:16.343 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-17T12:06:16.343 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvsas 2023-05-17T12:06:16.343 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-17T12:06:16.343 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/mvumi.ko 2023-05-17T12:06:16.343 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pm8001 2023-05-17T12:06:16.343 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-17T12:06:16.343 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/pmcraid.ko 2023-05-17T12:06:16.344 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla1280.ko 2023-05-17T12:06:16.344 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx 2023-05-17T12:06:16.344 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-17T12:06:16.344 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-17T12:06:16.344 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla4xxx 2023-05-17T12:06:16.344 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-17T12:06:16.344 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/raid_class.ko 2023-05-17T12:06:16.344 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_debug.ko 2023-05-17T12:06:16.345 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-17T12:06:16.345 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-17T12:06:16.345 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-17T12:06:16.345 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-17T12:06:16.345 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-17T12:06:16.345 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/ses.ko 2023-05-17T12:06:16.345 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/st.ko 2023-05-17T12:06:16.346 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/stex.ko 2023-05-17T12:06:16.346 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/sym53c8xx_2 2023-05-17T12:06:16.346 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-17T12:06:16.346 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/virtio_scsi.ko 2023-05-17T12:06:16.346 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-17T12:06:16.346 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/scsi/wd719x.ko 2023-05-17T12:06:16.346 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ssb 2023-05-17T12:06:16.346 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ssb/ssb.ko 2023-05-17T12:06:16.347 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target 2023-05-17T12:06:16.347 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/iscsi 2023-05-17T12:06:16.347 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-17T12:06:16.347 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/loopback 2023-05-17T12:06:16.347 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-17T12:06:16.347 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_file.ko 2023-05-17T12:06:16.347 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_iblock.ko 2023-05-17T12:06:16.347 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_mod.ko 2023-05-17T12:06:16.348 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_pscsi.ko 2023-05-17T12:06:16.348 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/target_core_user.ko 2023-05-17T12:06:16.348 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/tcm_fc 2023-05-17T12:06:16.348 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-17T12:06:16.348 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal 2023-05-17T12:06:16.348 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel 2023-05-17T12:06:16.348 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal 2023-05-17T12:06:16.349 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-17T12:06:16.349 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-17T12:06:16.349 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-17T12:06:16.349 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-17T12:06:16.349 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-17T12:06:16.349 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-17T12:06:16.349 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-17T12:06:16.349 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-17T12:06:16.350 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-17T12:06:16.350 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-17T12:06:16.350 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-17T12:06:16.350 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-17T12:06:16.350 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-17T12:06:16.350 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-17T12:06:16.350 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-17T12:06:16.351 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty 2023-05-17T12:06:16.351 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ipwireless 2023-05-17T12:06:16.351 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-17T12:06:16.351 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/n_gsm.ko 2023-05-17T12:06:16.351 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/n_hdlc.ko 2023-05-17T12:06:16.351 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/nozomi.ko 2023-05-17T12:06:16.351 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial 2023-05-17T12:06:16.351 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250 2023-05-17T12:06:16.352 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-17T12:06:16.352 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/arc_uart.ko 2023-05-17T12:06:16.352 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/jsm 2023-05-17T12:06:16.352 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-17T12:06:16.352 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/tty/synclink_gt.ko 2023-05-17T12:06:16.352 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs 2023-05-17T12:06:16.352 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/core 2023-05-17T12:06:16.353 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-17T12:06:16.353 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host 2023-05-17T12:06:16.353 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-17T12:06:16.353 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio 2023-05-17T12:06:16.353 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio.ko 2023-05-17T12:06:16.353 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_aec.ko 2023-05-17T12:06:16.353 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_cif.ko 2023-05-17T12:06:16.353 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_pci_generic.ko 2023-05-17T12:06:16.354 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/uio/uio_sercos3.ko 2023-05-17T12:06:16.354 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb 2023-05-17T12:06:16.354 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class 2023-05-17T12:06:16.354 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/cdc-acm.ko 2023-05-17T12:06:16.354 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-17T12:06:16.354 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/usblp.ko 2023-05-17T12:06:16.354 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/class/usbtmc.ko 2023-05-17T12:06:16.354 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host 2023-05-17T12:06:16.355 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-17T12:06:16.355 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/host/u132-hcd.ko 2023-05-17T12:06:16.355 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image 2023-05-17T12:06:16.355 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/mdc800.ko 2023-05-17T12:06:16.355 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/image/microtek.ko 2023-05-17T12:06:16.355 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc 2023-05-17T12:06:16.355 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/adutux.ko 2023-05-17T12:06:16.355 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/appledisplay.ko 2023-05-17T12:06:16.356 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/emi26.ko 2023-05-17T12:06:16.356 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/emi62.ko 2023-05-17T12:06:16.356 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ezusb.ko 2023-05-17T12:06:16.356 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-17T12:06:16.356 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/idmouse.ko 2023-05-17T12:06:16.356 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/iowarrior.ko 2023-05-17T12:06:16.356 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-17T12:06:16.357 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/ldusb.ko 2023-05-17T12:06:16.357 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/legousbtower.ko 2023-05-17T12:06:16.357 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/sisusbvga 2023-05-17T12:06:16.357 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-17T12:06:16.357 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-17T12:06:16.357 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usb3503.ko 2023-05-17T12:06:16.357 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usblcd.ko 2023-05-17T12:06:16.357 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-17T12:06:16.358 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/uss720.ko 2023-05-17T12:06:16.358 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/misc/yurex.ko 2023-05-17T12:06:16.358 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy 2023-05-17T12:06:16.358 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/phy/phy-generic.ko 2023-05-17T12:06:16.358 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial 2023-05-17T12:06:16.358 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/aircable.ko 2023-05-17T12:06:16.358 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ark3116.ko 2023-05-17T12:06:16.358 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-17T12:06:16.359 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ch341.ko 2023-05-17T12:06:16.359 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cp210x.ko 2023-05-17T12:06:16.359 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cyberjack.ko 2023-05-17T12:06:16.359 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-17T12:06:16.359 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-17T12:06:16.359 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/empeg.ko 2023-05-17T12:06:16.359 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-17T12:06:16.360 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-17T12:06:16.360 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-17T12:06:16.360 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/io_ti.ko 2023-05-17T12:06:16.360 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ipaq.ko 2023-05-17T12:06:16.360 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ipw.ko 2023-05-17T12:06:16.360 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ir-usb.ko 2023-05-17T12:06:16.360 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-17T12:06:16.360 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/keyspan.ko 2023-05-17T12:06:16.361 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-17T12:06:16.361 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-17T12:06:16.361 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-17T12:06:16.361 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mct_u232.ko 2023-05-17T12:06:16.361 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mos7720.ko 2023-05-17T12:06:16.361 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/mos7840.ko 2023-05-17T12:06:16.361 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/navman.ko 2023-05-17T12:06:16.361 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/omninet.ko 2023-05-17T12:06:16.362 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/opticon.ko 2023-05-17T12:06:16.362 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/option.ko 2023-05-17T12:06:16.362 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/oti6858.ko 2023-05-17T12:06:16.362 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/pl2303.ko 2023-05-17T12:06:16.362 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/qcaux.ko 2023-05-17T12:06:16.362 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/qcserial.ko 2023-05-17T12:06:16.362 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/quatech2.ko 2023-05-17T12:06:16.362 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/safe_serial.ko 2023-05-17T12:06:16.363 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/sierra.ko 2023-05-17T12:06:16.363 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-17T12:06:16.363 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ssu100.ko 2023-05-17T12:06:16.363 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/symbolserial.ko 2023-05-17T12:06:16.363 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-17T12:06:16.363 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-17T12:06:16.363 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb_debug.ko 2023-05-17T12:06:16.364 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-17T12:06:16.364 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/visor.ko 2023-05-17T12:06:16.364 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/whiteheat.ko 2023-05-17T12:06:16.364 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-17T12:06:16.364 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage 2023-05-17T12:06:16.364 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/uas.ko 2023-05-17T12:06:16.364 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-17T12:06:16.364 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-17T12:06:16.365 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-17T12:06:16.365 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-17T12:06:16.365 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-17T12:06:16.365 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-17T12:06:16.365 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-17T12:06:16.365 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-karma.ko 2023-05-17T12:06:16.365 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-17T12:06:16.365 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-17T12:06:16.366 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-17T12:06:16.366 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-17T12:06:16.366 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-17T12:06:16.366 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/storage/usb-storage.ko 2023-05-17T12:06:16.366 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip 2023-05-17T12:06:16.366 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-17T12:06:16.366 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-17T12:06:16.366 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-17T12:06:16.367 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio 2023-05-17T12:06:16.367 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci 2023-05-17T12:06:16.367 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-17T12:06:16.367 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-17T12:06:16.367 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/vfio.ko 2023-05-17T12:06:16.367 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-17T12:06:16.367 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost 2023-05-17T12:06:16.367 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost.ko 2023-05-17T12:06:16.368 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-17T12:06:16.368 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_net.ko 2023-05-17T12:06:16.368 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/vhost/vhost_scsi.ko 2023-05-17T12:06:16.368 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video 2023-05-17T12:06:16.368 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight 2023-05-17T12:06:16.368 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/apple_bl.ko 2023-05-17T12:06:16.368 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/lcd.ko 2023-05-17T12:06:16.369 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-17T12:06:16.369 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio 2023-05-17T12:06:16.369 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio.ko 2023-05-17T12:06:16.369 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_balloon.ko 2023-05-17T12:06:16.369 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_mmio.ko 2023-05-17T12:06:16.369 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_pci.ko 2023-05-17T12:06:16.369 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-17T12:06:16.369 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-17T12:06:16.370 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/virtio/virtio_ring.ko 2023-05-17T12:06:16.370 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1 2023-05-17T12:06:16.370 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters 2023-05-17T12:06:16.370 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ds2482.ko 2023-05-17T12:06:16.370 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/masters/ds2490.ko 2023-05-17T12:06:16.370 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves 2023-05-17T12:06:16.370 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-17T12:06:16.370 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-17T12:06:16.371 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-17T12:06:16.371 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-17T12:06:16.371 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-17T12:06:16.371 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-17T12:06:16.371 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-17T12:06:16.371 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-17T12:06:16.371 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-17T12:06:16.372 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-17T12:06:16.372 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-17T12:06:16.372 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/w1/wire.ko 2023-05-17T12:06:16.372 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog 2023-05-17T12:06:16.372 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-17T12:06:16.372 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-17T12:06:16.372 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-17T12:06:16.372 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/hpwdt.ko 2023-05-17T12:06:16.373 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/i6300esb.ko 2023-05-17T12:06:16.373 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-17T12:06:16.373 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-17T12:06:16.373 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ib700wdt.ko 2023-05-17T12:06:16.373 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ibmasr.ko 2023-05-17T12:06:16.373 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-17T12:06:16.373 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-17T12:06:16.373 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/it87_wdt.ko 2023-05-17T12:06:16.374 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/machzwd.ko 2023-05-17T12:06:16.374 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/nv_tco.ko 2023-05-17T12:06:16.374 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-17T12:06:16.374 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-17T12:06:16.374 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-17T12:06:16.374 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-17T12:06:16.374 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/softdog.ko 2023-05-17T12:06:16.375 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-17T12:06:16.375 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/via_wdt.ko 2023-05-17T12:06:16.375 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-17T12:06:16.375 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-17T12:06:16.375 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-17T12:06:16.375 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/wdt_pci.ko 2023-05-17T12:06:16.375 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/watchdog/xen_wdt.ko 2023-05-17T12:06:16.375 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen 2023-05-17T12:06:16.376 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-17T12:06:16.376 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-evtchn.ko 2023-05-17T12:06:16.376 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-gntalloc.ko 2023-05-17T12:06:16.376 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-gntdev.ko 2023-05-17T12:06:16.376 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-pciback 2023-05-17T12:06:16.376 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-17T12:06:16.376 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xen-privcmd.ko 2023-05-17T12:06:16.377 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xenfs 2023-05-17T12:06:16.377 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-17T12:06:16.377 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs 2023-05-17T12:06:16.377 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/9p 2023-05-17T12:06:16.377 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/9p/9p.ko 2023-05-17T12:06:16.377 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/affs 2023-05-17T12:06:16.377 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/affs/affs.ko 2023-05-17T12:06:16.377 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/befs 2023-05-17T12:06:16.378 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/befs/befs.ko 2023-05-17T12:06:16.378 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/binfmt_misc.ko 2023-05-17T12:06:16.378 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/btrfs 2023-05-17T12:06:16.378 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/btrfs/btrfs.ko 2023-05-17T12:06:16.378 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cachefiles 2023-05-17T12:06:16.378 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cachefiles/cachefiles.ko 2023-05-17T12:06:16.378 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ceph 2023-05-17T12:06:16.378 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ceph/ceph.ko 2023-05-17T12:06:16.379 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cifs 2023-05-17T12:06:16.379 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cifs/cifs.ko 2023-05-17T12:06:16.379 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/coda 2023-05-17T12:06:16.379 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/coda/coda.ko 2023-05-17T12:06:16.379 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cramfs 2023-05-17T12:06:16.379 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/cramfs/cramfs.ko 2023-05-17T12:06:16.379 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/dlm 2023-05-17T12:06:16.380 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/dlm/dlm.ko 2023-05-17T12:06:16.380 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ecryptfs 2023-05-17T12:06:16.380 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-17T12:06:16.380 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/f2fs 2023-05-17T12:06:16.380 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/f2fs/f2fs.ko 2023-05-17T12:06:16.380 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat 2023-05-17T12:06:16.380 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/fat.ko 2023-05-17T12:06:16.380 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/msdos.ko 2023-05-17T12:06:16.381 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fat/vfat.ko 2023-05-17T12:06:16.381 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fscache 2023-05-17T12:06:16.381 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fscache/fscache.ko 2023-05-17T12:06:16.381 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse 2023-05-17T12:06:16.381 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse/cuse.ko 2023-05-17T12:06:16.381 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/fuse/fuse.ko 2023-05-17T12:06:16.381 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/gfs2 2023-05-17T12:06:16.382 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/gfs2/gfs2.ko 2023-05-17T12:06:16.382 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfs 2023-05-17T12:06:16.382 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfs/hfs.ko 2023-05-17T12:06:16.382 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfsplus 2023-05-17T12:06:16.382 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/hfsplus/hfsplus.ko 2023-05-17T12:06:16.382 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/isofs 2023-05-17T12:06:16.382 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/isofs/isofs.ko 2023-05-17T12:06:16.382 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/jfs 2023-05-17T12:06:16.383 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/jfs/jfs.ko 2023-05-17T12:06:16.383 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/lockd 2023-05-17T12:06:16.383 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/lockd/lockd.ko 2023-05-17T12:06:16.383 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/minix 2023-05-17T12:06:16.383 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/minix/minix.ko 2023-05-17T12:06:16.383 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/netfs 2023-05-17T12:06:16.383 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/netfs/netfs.ko 2023-05-17T12:06:16.383 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs 2023-05-17T12:06:16.384 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/blocklayout 2023-05-17T12:06:16.384 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-17T12:06:16.384 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/filelayout 2023-05-17T12:06:16.384 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-17T12:06:16.384 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/flexfilelayout 2023-05-17T12:06:16.384 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-17T12:06:16.384 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfs.ko 2023-05-17T12:06:16.385 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv3.ko 2023-05-17T12:06:16.385 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs/nfsv4.ko 2023-05-17T12:06:16.385 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common 2023-05-17T12:06:16.385 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/grace.ko 2023-05-17T12:06:16.385 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfs_common/nfs_acl.ko 2023-05-17T12:06:16.385 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfsd 2023-05-17T12:06:16.385 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nfsd/nfsd.ko 2023-05-17T12:06:16.385 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nilfs2 2023-05-17T12:06:16.386 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nilfs2/nilfs2.ko 2023-05-17T12:06:16.386 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls 2023-05-17T12:06:16.386 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-celtic.ko 2023-05-17T12:06:16.386 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-centeuro.ko 2023-05-17T12:06:16.386 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-croatian.ko 2023-05-17T12:06:16.386 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-cyrillic.ko 2023-05-17T12:06:16.386 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-gaelic.ko 2023-05-17T12:06:16.386 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-greek.ko 2023-05-17T12:06:16.387 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-iceland.ko 2023-05-17T12:06:16.387 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-inuit.ko 2023-05-17T12:06:16.387 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-roman.ko 2023-05-17T12:06:16.387 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-romanian.ko 2023-05-17T12:06:16.387 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/mac-turkish.ko 2023-05-17T12:06:16.387 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1250.ko 2023-05-17T12:06:16.387 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1251.ko 2023-05-17T12:06:16.387 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp1255.ko 2023-05-17T12:06:16.388 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp737.ko 2023-05-17T12:06:16.388 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp775.ko 2023-05-17T12:06:16.388 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp850.ko 2023-05-17T12:06:16.388 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp852.ko 2023-05-17T12:06:16.388 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp855.ko 2023-05-17T12:06:16.388 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp857.ko 2023-05-17T12:06:16.388 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp860.ko 2023-05-17T12:06:16.389 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp861.ko 2023-05-17T12:06:16.389 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp862.ko 2023-05-17T12:06:16.389 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp863.ko 2023-05-17T12:06:16.389 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp864.ko 2023-05-17T12:06:16.389 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp865.ko 2023-05-17T12:06:16.389 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp866.ko 2023-05-17T12:06:16.389 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp869.ko 2023-05-17T12:06:16.389 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp874.ko 2023-05-17T12:06:16.390 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp932.ko 2023-05-17T12:06:16.390 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp936.ko 2023-05-17T12:06:16.390 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp949.ko 2023-05-17T12:06:16.390 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_cp950.ko 2023-05-17T12:06:16.390 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_euc-jp.ko 2023-05-17T12:06:16.390 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-1.ko 2023-05-17T12:06:16.390 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-13.ko 2023-05-17T12:06:16.390 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-14.ko 2023-05-17T12:06:16.391 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-15.ko 2023-05-17T12:06:16.391 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-2.ko 2023-05-17T12:06:16.391 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-3.ko 2023-05-17T12:06:16.391 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-4.ko 2023-05-17T12:06:16.391 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-5.ko 2023-05-17T12:06:16.391 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-6.ko 2023-05-17T12:06:16.391 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-7.ko 2023-05-17T12:06:16.391 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_iso8859-9.ko 2023-05-17T12:06:16.392 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-r.ko 2023-05-17T12:06:16.392 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-ru.ko 2023-05-17T12:06:16.392 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_koi8-u.ko 2023-05-17T12:06:16.392 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/nls/nls_utf8.ko 2023-05-17T12:06:16.392 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2 2023-05-17T12:06:16.392 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/cluster 2023-05-17T12:06:16.392 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-17T12:06:16.393 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlm 2023-05-17T12:06:16.393 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-17T12:06:16.393 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlmfs 2023-05-17T12:06:16.393 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-17T12:06:16.393 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2.ko 2023-05-17T12:06:16.393 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-17T12:06:16.393 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-17T12:06:16.393 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-17T12:06:16.394 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/overlayfs 2023-05-17T12:06:16.394 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/overlayfs/overlay.ko 2023-05-17T12:06:16.394 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/pstore 2023-05-17T12:06:16.394 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/pstore/ramoops.ko 2023-05-17T12:06:16.394 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/reiserfs 2023-05-17T12:06:16.394 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/reiserfs/reiserfs.ko 2023-05-17T12:06:16.394 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/romfs 2023-05-17T12:06:16.394 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/romfs/romfs.ko 2023-05-17T12:06:16.395 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common 2023-05-17T12:06:16.395 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-17T12:06:16.395 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-17T12:06:16.395 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/squashfs 2023-05-17T12:06:16.395 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/squashfs/squashfs.ko 2023-05-17T12:06:16.395 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/sysv 2023-05-17T12:06:16.395 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/sysv/sysv.ko 2023-05-17T12:06:16.395 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/udf 2023-05-17T12:06:16.396 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/udf/udf.ko 2023-05-17T12:06:16.396 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ufs 2023-05-17T12:06:16.396 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/ufs/ufs.ko 2023-05-17T12:06:16.396 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/xfs 2023-05-17T12:06:16.396 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/fs/xfs/xfs.ko 2023-05-17T12:06:16.396 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel 2023-05-17T12:06:16.396 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/rcu 2023-05-17T12:06:16.397 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/rcu/rcutorture.ko 2023-05-17T12:06:16.397 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/torture.ko 2023-05-17T12:06:16.397 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/trace 2023-05-17T12:06:16.397 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-17T12:06:16.397 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib 2023-05-17T12:06:16.397 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/asn1_encoder.ko 2023-05-17T12:06:16.397 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc-itu-t.ko 2023-05-17T12:06:16.398 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crc8.ko 2023-05-17T12:06:16.398 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto 2023-05-17T12:06:16.398 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/libarc4.ko 2023-05-17T12:06:16.398 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/crypto/libdes.ko 2023-05-17T12:06:16.398 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/libcrc32c.ko 2023-05-17T12:06:16.398 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/lru_cache.ko 2023-05-17T12:06:16.398 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4 2023-05-17T12:06:16.398 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/lz4_compress.ko 2023-05-17T12:06:16.399 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/lz4/lz4hc_compress.ko 2023-05-17T12:06:16.399 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/math 2023-05-17T12:06:16.399 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/math/cordic.ko 2023-05-17T12:06:16.399 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/raid6 2023-05-17T12:06:16.399 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/raid6/raid6_pq.ko 2023-05-17T12:06:16.399 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/reed_solomon 2023-05-17T12:06:16.399 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-17T12:06:16.400 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_bm.ko 2023-05-17T12:06:16.400 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_fsm.ko 2023-05-17T12:06:16.400 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/ts_kmp.ko 2023-05-17T12:06:16.400 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/zstd 2023-05-17T12:06:16.400 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/lib/zstd/zstd_compress.ko 2023-05-17T12:06:16.400 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/mm 2023-05-17T12:06:16.400 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/mm/hwpoison-inject.ko 2023-05-17T12:06:16.400 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net 2023-05-17T12:06:16.401 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan 2023-05-17T12:06:16.401 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/6lowpan.ko 2023-05-17T12:06:16.401 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_dest.ko 2023-05-17T12:06:16.401 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_fragment.ko 2023-05-17T12:06:16.401 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_hop.ko 2023-05-17T12:06:16.401 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-17T12:06:16.401 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_mobility.ko 2023-05-17T12:06:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_routing.ko 2023-05-17T12:06:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/6lowpan/nhc_udp.ko 2023-05-17T12:06:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802 2023-05-17T12:06:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/garp.ko 2023-05-17T12:06:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/mrp.ko 2023-05-17T12:06:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/p8022.ko 2023-05-17T12:06:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/psnap.ko 2023-05-17T12:06:16.402 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/802/stp.ko 2023-05-17T12:06:16.403 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/8021q 2023-05-17T12:06:16.403 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/8021q/8021q.ko 2023-05-17T12:06:16.403 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p 2023-05-17T12:06:16.403 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet.ko 2023-05-17T12:06:16.403 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_fd.ko 2023-05-17T12:06:16.403 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_rdma.ko 2023-05-17T12:06:16.403 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/9p/9pnet_virtio.ko 2023-05-17T12:06:16.403 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/batman-adv 2023-05-17T12:06:16.404 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/batman-adv/batman-adv.ko 2023-05-17T12:06:16.404 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge 2023-05-17T12:06:16.404 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/br_netfilter.ko 2023-05-17T12:06:16.404 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/bridge.ko 2023-05-17T12:06:16.404 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter 2023-05-17T12:06:16.404 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-17T12:06:16.404 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-17T12:06:16.405 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-17T12:06:16.405 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-17T12:06:16.405 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-17T12:06:16.405 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-17T12:06:16.405 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-17T12:06:16.405 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-17T12:06:16.405 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-17T12:06:16.405 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-17T12:06:16.406 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-17T12:06:16.406 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-17T12:06:16.406 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-17T12:06:16.406 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-17T12:06:16.406 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-17T12:06:16.406 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-17T12:06:16.406 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-17T12:06:16.407 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-17T12:06:16.407 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-17T12:06:16.407 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-17T12:06:16.407 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/ebtables.ko 2023-05-17T12:06:16.407 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-17T12:06:16.407 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-17T12:06:16.407 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-17T12:06:16.407 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ceph 2023-05-17T12:06:16.408 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ceph/libceph.ko 2023-05-17T12:06:16.408 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/core 2023-05-17T12:06:16.408 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/core/failover.ko 2023-05-17T12:06:16.408 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/core/pktgen.ko 2023-05-17T12:06:16.408 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp 2023-05-17T12:06:16.408 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp.ko 2023-05-17T12:06:16.408 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_diag.ko 2023-05-17T12:06:16.408 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_ipv4.ko 2023-05-17T12:06:16.409 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dccp/dccp_ipv6.ko 2023-05-17T12:06:16.409 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dns_resolver 2023-05-17T12:06:16.409 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dns_resolver/dns_resolver.ko 2023-05-17T12:06:16.409 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa 2023-05-17T12:06:16.409 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/dsa_core.ko 2023-05-17T12:06:16.409 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_brcm.ko 2023-05-17T12:06:16.409 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_dsa.ko 2023-05-17T12:06:16.410 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_none.ko 2023-05-17T12:06:16.410 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/dsa/tag_trailer.ko 2023-05-17T12:06:16.410 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154 2023-05-17T12:06:16.410 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/6lowpan 2023-05-17T12:06:16.410 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-17T12:06:16.410 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ieee802154.ko 2023-05-17T12:06:16.410 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-17T12:06:16.410 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4 2023-05-17T12:06:16.411 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ah4.ko 2023-05-17T12:06:16.411 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/esp4.ko 2023-05-17T12:06:16.411 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/fou.ko 2023-05-17T12:06:16.411 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/gre.ko 2023-05-17T12:06:16.411 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/inet_diag.ko 2023-05-17T12:06:16.411 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_gre.ko 2023-05-17T12:06:16.411 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_tunnel.ko 2023-05-17T12:06:16.411 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ip_vti.ko 2023-05-17T12:06:16.412 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ipcomp.ko 2023-05-17T12:06:16.412 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/ipip.ko 2023-05-17T12:06:16.412 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter 2023-05-17T12:06:16.412 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-17T12:06:16.412 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-17T12:06:16.412 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-17T12:06:16.412 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-17T12:06:16.413 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-17T12:06:16.413 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-17T12:06:16.413 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-17T12:06:16.413 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-17T12:06:16.413 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-17T12:06:16.413 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-17T12:06:16.413 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-17T12:06:16.413 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-17T12:06:16.414 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-17T12:06:16.414 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-17T12:06:16.414 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-17T12:06:16.414 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-17T12:06:16.414 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-17T12:06:16.414 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-17T12:06:16.414 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-17T12:06:16.414 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-17T12:06:16.415 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-17T12:06:16.415 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_bic.ko 2023-05-17T12:06:16.415 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_dctcp.ko 2023-05-17T12:06:16.415 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_diag.ko 2023-05-17T12:06:16.415 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_highspeed.ko 2023-05-17T12:06:16.415 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_htcp.ko 2023-05-17T12:06:16.415 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_hybla.ko 2023-05-17T12:06:16.415 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_illinois.ko 2023-05-17T12:06:16.416 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_lp.ko 2023-05-17T12:06:16.416 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_scalable.ko 2023-05-17T12:06:16.416 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_vegas.ko 2023-05-17T12:06:16.416 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_veno.ko 2023-05-17T12:06:16.416 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_westwood.ko 2023-05-17T12:06:16.416 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tcp_yeah.ko 2023-05-17T12:06:16.416 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/tunnel4.ko 2023-05-17T12:06:16.417 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/udp_diag.ko 2023-05-17T12:06:16.417 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/udp_tunnel.ko 2023-05-17T12:06:16.417 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-17T12:06:16.417 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6 2023-05-17T12:06:16.417 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ah6.ko 2023-05-17T12:06:16.417 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/esp6.ko 2023-05-17T12:06:16.417 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/fou6.ko 2023-05-17T12:06:16.417 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_tunnel.ko 2023-05-17T12:06:16.418 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-17T12:06:16.418 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ip6_vti.ko 2023-05-17T12:06:16.418 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/ipcomp6.ko 2023-05-17T12:06:16.418 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter 2023-05-17T12:06:16.418 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-17T12:06:16.418 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-17T12:06:16.418 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-17T12:06:16.418 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-17T12:06:16.419 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-17T12:06:16.419 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-17T12:06:16.419 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-17T12:06:16.419 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-17T12:06:16.419 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-17T12:06:16.419 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-17T12:06:16.419 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-17T12:06:16.420 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-17T12:06:16.420 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-17T12:06:16.420 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-17T12:06:16.420 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-17T12:06:16.420 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-17T12:06:16.420 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-17T12:06:16.420 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-17T12:06:16.420 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-17T12:06:16.421 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-17T12:06:16.421 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-17T12:06:16.421 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-17T12:06:16.421 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-17T12:06:16.421 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-17T12:06:16.421 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/sit.ko 2023-05-17T12:06:16.421 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/tunnel6.ko 2023-05-17T12:06:16.421 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-17T12:06:16.422 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/key 2023-05-17T12:06:16.422 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/key/af_key.ko 2023-05-17T12:06:16.422 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp 2023-05-17T12:06:16.422 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_core.ko 2023-05-17T12:06:16.422 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-17T12:06:16.422 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_eth.ko 2023-05-17T12:06:16.422 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ip.ko 2023-05-17T12:06:16.423 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ip6.ko 2023-05-17T12:06:16.423 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_netlink.ko 2023-05-17T12:06:16.423 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/l2tp/l2tp_ppp.ko 2023-05-17T12:06:16.423 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/llc 2023-05-17T12:06:16.423 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/llc/llc.ko 2023-05-17T12:06:16.423 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/mac802154 2023-05-17T12:06:16.423 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/mac802154/mac802154.ko 2023-05-17T12:06:16.423 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/mpls 2023-05-17T12:06:16.424 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/mpls/mpls_gso.ko 2023-05-17T12:06:16.424 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter 2023-05-17T12:06:16.424 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset 2023-05-17T12:06:16.424 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set.ko 2023-05-17T12:06:16.424 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-17T12:06:16.424 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-17T12:06:16.424 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-17T12:06:16.424 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-17T12:06:16.425 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-17T12:06:16.425 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-17T12:06:16.425 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-17T12:06:16.425 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-17T12:06:16.425 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-17T12:06:16.425 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-17T12:06:16.425 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-17T12:06:16.426 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-17T12:06:16.426 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-17T12:06:16.426 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-17T12:06:16.426 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-17T12:06:16.426 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs 2023-05-17T12:06:16.426 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-17T12:06:16.426 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-17T12:06:16.426 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-17T12:06:16.427 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-17T12:06:16.427 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-17T12:06:16.427 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-17T12:06:16.427 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-17T12:06:16.427 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-17T12:06:16.427 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-17T12:06:16.427 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-17T12:06:16.427 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-17T12:06:16.428 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-17T12:06:16.428 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-17T12:06:16.428 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-17T12:06:16.428 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conncount.ko 2023-05-17T12:06:16.428 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack.ko 2023-05-17T12:06:16.428 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-17T12:06:16.428 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-17T12:06:16.428 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-17T12:06:16.429 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-17T12:06:16.429 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-17T12:06:16.429 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-17T12:06:16.429 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-17T12:06:16.429 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-17T12:06:16.429 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-17T12:06:16.429 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-17T12:06:16.430 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-17T12:06:16.430 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-17T12:06:16.430 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-17T12:06:16.430 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_flow_table.ko 2023-05-17T12:06:16.430 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-17T12:06:16.430 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_log_syslog.ko 2023-05-17T12:06:16.430 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat.ko 2023-05-17T12:06:16.430 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-17T12:06:16.431 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-17T12:06:16.431 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_irc.ko 2023-05-17T12:06:16.431 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_sip.ko 2023-05-17T12:06:16.431 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-17T12:06:16.431 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-17T12:06:16.431 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nf_tables.ko 2023-05-17T12:06:16.431 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink.ko 2023-05-17T12:06:16.431 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-17T12:06:16.432 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_log.ko 2023-05-17T12:06:16.432 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-17T12:06:16.432 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-17T12:06:16.432 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_chain_nat.ko 2023-05-17T12:06:16.432 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_compat.ko 2023-05-17T12:06:16.432 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_ct.ko 2023-05-17T12:06:16.432 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-17T12:06:16.433 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_fib.ko 2023-05-17T12:06:16.433 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-17T12:06:16.433 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_hash.ko 2023-05-17T12:06:16.433 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_limit.ko 2023-05-17T12:06:16.433 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_log.ko 2023-05-17T12:06:16.433 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_masq.ko 2023-05-17T12:06:16.433 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_nat.ko 2023-05-17T12:06:16.434 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_numgen.ko 2023-05-17T12:06:16.434 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_queue.ko 2023-05-17T12:06:16.434 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_quota.ko 2023-05-17T12:06:16.434 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_redir.ko 2023-05-17T12:06:16.434 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_reject.ko 2023-05-17T12:06:16.434 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_reject_inet.ko 2023-05-17T12:06:16.434 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_socket.ko 2023-05-17T12:06:16.434 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/nft_tunnel.ko 2023-05-17T12:06:16.435 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_AUDIT.ko 2023-05-17T12:06:16.435 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-17T12:06:16.435 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-17T12:06:16.435 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-17T12:06:16.435 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_CT.ko 2023-05-17T12:06:16.435 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_DSCP.ko 2023-05-17T12:06:16.435 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_HL.ko 2023-05-17T12:06:16.436 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_HMARK.ko 2023-05-17T12:06:16.436 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-17T12:06:16.436 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_LED.ko 2023-05-17T12:06:16.436 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_LOG.ko 2023-05-17T12:06:16.436 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-17T12:06:16.436 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NETMAP.ko 2023-05-17T12:06:16.436 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NFLOG.ko 2023-05-17T12:06:16.436 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-17T12:06:16.437 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_RATEEST.ko 2023-05-17T12:06:16.437 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-17T12:06:16.437 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_SECMARK.ko 2023-05-17T12:06:16.437 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-17T12:06:16.437 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-17T12:06:16.437 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TEE.ko 2023-05-17T12:06:16.437 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TPROXY.ko 2023-05-17T12:06:16.437 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_TRACE.ko 2023-05-17T12:06:16.438 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_addrtype.ko 2023-05-17T12:06:16.438 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_bpf.ko 2023-05-17T12:06:16.438 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cgroup.ko 2023-05-17T12:06:16.438 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cluster.ko 2023-05-17T12:06:16.438 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_comment.ko 2023-05-17T12:06:16.438 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connbytes.ko 2023-05-17T12:06:16.438 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connlabel.ko 2023-05-17T12:06:16.439 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connlimit.ko 2023-05-17T12:06:16.439 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_connmark.ko 2023-05-17T12:06:16.439 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_conntrack.ko 2023-05-17T12:06:16.439 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_cpu.ko 2023-05-17T12:06:16.439 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_dccp.ko 2023-05-17T12:06:16.439 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_devgroup.ko 2023-05-17T12:06:16.439 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_dscp.ko 2023-05-17T12:06:16.439 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ecn.ko 2023-05-17T12:06:16.440 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_esp.ko 2023-05-17T12:06:16.440 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_hashlimit.ko 2023-05-17T12:06:16.440 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_helper.ko 2023-05-17T12:06:16.440 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_hl.ko 2023-05-17T12:06:16.440 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ipcomp.ko 2023-05-17T12:06:16.440 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_iprange.ko 2023-05-17T12:06:16.440 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_ipvs.ko 2023-05-17T12:06:16.441 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_l2tp.ko 2023-05-17T12:06:16.441 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_length.ko 2023-05-17T12:06:16.441 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_limit.ko 2023-05-17T12:06:16.441 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_mac.ko 2023-05-17T12:06:16.441 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_mark.ko 2023-05-17T12:06:16.441 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_multiport.ko 2023-05-17T12:06:16.441 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_nat.ko 2023-05-17T12:06:16.441 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_nfacct.ko 2023-05-17T12:06:16.442 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_osf.ko 2023-05-17T12:06:16.442 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_owner.ko 2023-05-17T12:06:16.442 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_physdev.ko 2023-05-17T12:06:16.442 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_pkttype.ko 2023-05-17T12:06:16.442 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_policy.ko 2023-05-17T12:06:16.442 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_quota.ko 2023-05-17T12:06:16.442 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_rateest.ko 2023-05-17T12:06:16.443 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_realm.ko 2023-05-17T12:06:16.443 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_recent.ko 2023-05-17T12:06:16.443 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_sctp.ko 2023-05-17T12:06:16.443 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_set.ko 2023-05-17T12:06:16.443 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_socket.ko 2023-05-17T12:06:16.443 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_state.ko 2023-05-17T12:06:16.443 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_statistic.ko 2023-05-17T12:06:16.443 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_string.ko 2023-05-17T12:06:16.444 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_tcpmss.ko 2023-05-17T12:06:16.444 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_time.ko 2023-05-17T12:06:16.444 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netfilter/xt_u32.ko 2023-05-17T12:06:16.444 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netlink 2023-05-17T12:06:16.444 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/netlink/netlink_diag.ko 2023-05-17T12:06:16.444 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/nsh 2023-05-17T12:06:16.444 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/nsh/nsh.ko 2023-05-17T12:06:16.445 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch 2023-05-17T12:06:16.445 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/openvswitch.ko 2023-05-17T12:06:16.445 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-geneve.ko 2023-05-17T12:06:16.445 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-gre.ko 2023-05-17T12:06:16.445 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/openvswitch/vport-vxlan.ko 2023-05-17T12:06:16.445 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/packet 2023-05-17T12:06:16.445 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/packet/af_packet_diag.ko 2023-05-17T12:06:16.445 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/rds 2023-05-17T12:06:16.446 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds.ko 2023-05-17T12:06:16.446 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds_rdma.ko 2023-05-17T12:06:16.446 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/rds/rds_tcp.ko 2023-05-17T12:06:16.446 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched 2023-05-17T12:06:16.446 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_csum.ko 2023-05-17T12:06:16.446 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_gact.ko 2023-05-17T12:06:16.446 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_ipt.ko 2023-05-17T12:06:16.446 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_mirred.ko 2023-05-17T12:06:16.447 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_nat.ko 2023-05-17T12:06:16.447 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_pedit.ko 2023-05-17T12:06:16.447 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_police.ko 2023-05-17T12:06:16.447 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_simple.ko 2023-05-17T12:06:16.447 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_skbedit.ko 2023-05-17T12:06:16.447 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/act_vlan.ko 2023-05-17T12:06:16.447 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_basic.ko 2023-05-17T12:06:16.448 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_bpf.ko 2023-05-17T12:06:16.448 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_flow.ko 2023-05-17T12:06:16.448 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_fw.ko 2023-05-17T12:06:16.448 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_route.ko 2023-05-17T12:06:16.448 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/cls_u32.ko 2023-05-17T12:06:16.448 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_cmp.ko 2023-05-17T12:06:16.448 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_ipset.ko 2023-05-17T12:06:16.448 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_meta.ko 2023-05-17T12:06:16.449 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_nbyte.ko 2023-05-17T12:06:16.449 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_text.ko 2023-05-17T12:06:16.449 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/em_u32.ko 2023-05-17T12:06:16.449 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_choke.ko 2023-05-17T12:06:16.449 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_codel.ko 2023-05-17T12:06:16.449 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_drr.ko 2023-05-17T12:06:16.449 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_fq.ko 2023-05-17T12:06:16.450 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_gred.ko 2023-05-17T12:06:16.450 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_hfsc.ko 2023-05-17T12:06:16.450 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_hhf.ko 2023-05-17T12:06:16.450 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_htb.ko 2023-05-17T12:06:16.450 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_ingress.ko 2023-05-17T12:06:16.450 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_mqprio.ko 2023-05-17T12:06:16.450 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_mqprio_lib.ko 2023-05-17T12:06:16.450 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_multiq.ko 2023-05-17T12:06:16.451 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_netem.ko 2023-05-17T12:06:16.451 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_pie.ko 2023-05-17T12:06:16.451 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_plug.ko 2023-05-17T12:06:16.451 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_prio.ko 2023-05-17T12:06:16.451 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_qfq.ko 2023-05-17T12:06:16.451 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_red.ko 2023-05-17T12:06:16.451 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_sfb.ko 2023-05-17T12:06:16.451 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_sfq.ko 2023-05-17T12:06:16.452 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_tbf.ko 2023-05-17T12:06:16.452 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sched/sch_teql.ko 2023-05-17T12:06:16.452 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp 2023-05-17T12:06:16.452 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/sctp.ko 2023-05-17T12:06:16.452 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sctp/sctp_diag.ko 2023-05-17T12:06:16.452 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc 2023-05-17T12:06:16.452 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss 2023-05-17T12:06:16.452 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-17T12:06:16.453 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-17T12:06:16.453 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/sunrpc.ko 2023-05-17T12:06:16.453 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/xprtrdma 2023-05-17T12:06:16.453 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-17T12:06:16.453 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc 2023-05-17T12:06:16.453 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/diag.ko 2023-05-17T12:06:16.453 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/tipc/tipc.ko 2023-05-17T12:06:16.454 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/unix 2023-05-17T12:06:16.454 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/unix/unix_diag.ko 2023-05-17T12:06:16.454 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock 2023-05-17T12:06:16.454 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-17T12:06:16.454 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-17T12:06:16.454 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock.ko 2023-05-17T12:06:16.454 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-17T12:06:16.454 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-17T12:06:16.455 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm 2023-05-17T12:06:16.455 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-17T12:06:16.455 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security 2023-05-17T12:06:16.455 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys 2023-05-17T12:06:16.455 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys/encrypted-keys 2023-05-17T12:06:16.455 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-17T12:06:16.455 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys/trusted-keys 2023-05-17T12:06:16.455 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/security/keys/trusted-keys/trusted.ko 2023-05-17T12:06:16.456 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/virt 2023-05-17T12:06:16.456 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/virt/lib 2023-05-17T12:06:16.456 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/kernel/virt/lib/irqbypass.ko 2023-05-17T12:06:16.456 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.alias 2023-05-17T12:06:16.456 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.alias.bin 2023-05-17T12:06:16.456 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.builtin 2023-05-17T12:06:16.456 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.builtin.bin 2023-05-17T12:06:16.457 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.builtin.modinfo 2023-05-17T12:06:16.457 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.dep 2023-05-17T12:06:16.457 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.dep.bin 2023-05-17T12:06:16.457 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.devname 2023-05-17T12:06:16.457 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.order 2023-05-17T12:06:16.457 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.softdep 2023-05-17T12:06:16.457 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.symbols 2023-05-17T12:06:16.457 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.3.0-g2bcb17939031/modules.symbols.bin 2023-05-17T12:06:16.458 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g2bcb17939031 2023-05-17T12:06:16.458 DEBUG:teuthology.orchestra.run.smithi187:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-17T12:06:16.487 INFO:teuthology.orchestra.run.smithi187.stdout:postinstall scriptlet (using /bin/sh): 2023-05-17T12:06:16.487 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-g2bcb17939031 -a -r /boot/System.map-6.3.0-g2bcb17939031 ]; then 2023-05-17T12:06:16.487 INFO:teuthology.orchestra.run.smithi187.stdout:cp /boot/vmlinuz-6.3.0-g2bcb17939031 /boot/.vmlinuz-6.3.0-g2bcb17939031-rpm 2023-05-17T12:06:16.487 INFO:teuthology.orchestra.run.smithi187.stdout:cp /boot/System.map-6.3.0-g2bcb17939031 /boot/.System.map-6.3.0-g2bcb17939031-rpm 2023-05-17T12:06:16.488 INFO:teuthology.orchestra.run.smithi187.stdout:rm -f /boot/vmlinuz-6.3.0-g2bcb17939031 /boot/System.map-6.3.0-g2bcb17939031 2023-05-17T12:06:16.488 INFO:teuthology.orchestra.run.smithi187.stdout:/sbin/installkernel 6.3.0-g2bcb17939031 /boot/.vmlinuz-6.3.0-g2bcb17939031-rpm /boot/.System.map-6.3.0-g2bcb17939031-rpm 2023-05-17T12:06:16.488 INFO:teuthology.orchestra.run.smithi187.stdout:rm -f /boot/.vmlinuz-6.3.0-g2bcb17939031-rpm /boot/.System.map-6.3.0-g2bcb17939031-rpm 2023-05-17T12:06:16.488 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2023-05-17T12:06:16.488 INFO:teuthology.orchestra.run.smithi187.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-17T12:06:16.488 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-17T12:06:16.489 INFO:teuthology.orchestra.run.smithi187.stdout:new-kernel-pkg --remove 6.3.0-g2bcb17939031 --rminitrd --initrdfile=/boot/initramfs-6.3.0-g2bcb17939031.img 2023-05-17T12:06:16.489 INFO:teuthology.orchestra.run.smithi187.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-17T12:06:16.489 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-install remove 6.3.0-g2bcb17939031 2023-05-17T12:06:16.489 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2023-05-17T12:06:16.489 INFO:teuthology.orchestra.run.smithi187.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-17T12:06:16.489 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-17T12:06:16.490 INFO:teuthology.orchestra.run.smithi187.stdout:/sbin/update-bootloader --remove 6.3.0-g2bcb17939031 2023-05-17T12:06:16.490 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2023-05-17T12:06:16.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -qi grub2-tools 2023-05-17T12:06:16.572 INFO:teuthology.orchestra.run.smithi187.stdout:Name : grub2-tools 2023-05-17T12:06:16.572 INFO:teuthology.orchestra.run.smithi187.stdout:Epoch : 1 2023-05-17T12:06:16.572 INFO:teuthology.orchestra.run.smithi187.stdout:Version : 2.02 2023-05-17T12:06:16.572 INFO:teuthology.orchestra.run.smithi187.stdout:Release : 129.el8 2023-05-17T12:06:16.572 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: x86_64 2023-05-17T12:06:16.572 INFO:teuthology.orchestra.run.smithi187.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-05-17T12:06:16.573 INFO:teuthology.orchestra.run.smithi187.stdout:Group : System Environment/Base 2023-05-17T12:06:16.573 INFO:teuthology.orchestra.run.smithi187.stdout:Size : 9265586 2023-05-17T12:06:16.573 INFO:teuthology.orchestra.run.smithi187.stdout:License : GPLv3+ 2023-05-17T12:06:16.573 INFO:teuthology.orchestra.run.smithi187.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-05-17T12:06:16.573 INFO:teuthology.orchestra.run.smithi187.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-05-17T12:06:16.573 INFO:teuthology.orchestra.run.smithi187.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-05-17T12:06:16.573 INFO:teuthology.orchestra.run.smithi187.stdout:Build Host : kbuilder.bsys.centos.org 2023-05-17T12:06:16.574 INFO:teuthology.orchestra.run.smithi187.stdout:Relocations : (not relocatable) 2023-05-17T12:06:16.574 INFO:teuthology.orchestra.run.smithi187.stdout:Packager : CentOS BuildSystem 2023-05-17T12:06:16.574 INFO:teuthology.orchestra.run.smithi187.stdout:Vendor : CentOS 2023-05-17T12:06:16.574 INFO:teuthology.orchestra.run.smithi187.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-17T12:06:16.574 INFO:teuthology.orchestra.run.smithi187.stdout:Summary : Support tools for GRUB. 2023-05-17T12:06:16.574 INFO:teuthology.orchestra.run.smithi187.stdout:Description : 2023-05-17T12:06:16.574 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:06:16.574 INFO:teuthology.orchestra.run.smithi187.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-17T12:06:16.575 INFO:teuthology.orchestra.run.smithi187.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-17T12:06:16.575 INFO:teuthology.orchestra.run.smithi187.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-17T12:06:16.575 INFO:teuthology.orchestra.run.smithi187.stdout:hardware devices. 2023-05-17T12:06:16.575 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:06:16.575 INFO:teuthology.orchestra.run.smithi187.stdout:This subpackage provides tools for support of all platforms. 2023-05-17T12:06:16.576 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-17T12:06:16.576 INFO:teuthology.task.kernel:Updating grub on smithi187 to boot 6.3.0-g2bcb17939031 2023-05-17T12:06:16.577 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-17T12:06:20.018 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2023-05-17T12:06:22.188 INFO:teuthology.orchestra.run.smithi187.stderr:done 2023-05-17T12:06:22.190 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-05-17T12:06:22.227 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.rdGrpOxciQ 2023-05-17T12:06:22.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rdGrpOxciQ 2023-05-17T12:06:22.300 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.rdGrpOxciQ 2023-05-17T12:06:22.452 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.rdGrpOxciQ is 6KB 2023-05-17T12:06:22.474 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.rdGrpOxciQ 2023-05-17T12:06:22.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo /bin/ls /boot/loader/entries || true 2023-05-17T12:06:22.578 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-05-17T12:06:22.578 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-05-17T12:06:22.578 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-05-17T12:06:22.578 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-6.3.0-g2bcb17939031.conf 2023-05-17T12:06:22.579 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.3.0-g2bcb17939031 2023-05-17T12:06:22.698 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2023-05-17T12:06:42.376 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-05-17T12:06:42.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-05-17T12:06:42.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:06:52.708 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-05-17T12:06:52.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-05-17T12:06:52.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:07:00.720 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-05-17T12:07:11.216 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-05-17T12:07:30.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-05-17T12:07:30.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:07:41.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-05-17T12:07:41.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:07:44.304 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-05-17T12:08:05.232 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-05-17T12:08:14.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-05-17T12:08:14.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:08:14.681 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-05-17T12:08:15.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-05-17T12:08:15.047 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.3.0-g2bcb17939031"... 2023-05-17T12:08:15.047 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-05-17T12:08:15.087 INFO:teuthology.orchestra.run.smithi187.stdout:6.3.0-g2bcb17939031 2023-05-17T12:08:15.088 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g2bcb17939031 vs 6.3.0-g2bcb17939031 2023-05-17T12:08:15.088 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-17T12:08:15.088 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-05-17T12:08:16.089 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-05-17T12:08:16.090 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-17T12:08:16.208 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2023-05-17T12:08:16.231 DEBUG:teuthology.parallel:result is None 2023-05-17T12:08:35.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-05-17T12:08:35.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:08:35.596 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-05-17T12:08:35.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-05-17T12:08:35.987 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.3.0-g2bcb17939031"... 2023-05-17T12:08:35.987 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-05-17T12:08:36.027 INFO:teuthology.orchestra.run.smithi088.stdout:6.3.0-g2bcb17939031 2023-05-17T12:08:36.028 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g2bcb17939031 vs 6.3.0-g2bcb17939031 2023-05-17T12:08:36.028 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-17T12:08:36.029 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-05-17T12:08:37.029 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-05-17T12:08:37.030 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-17T12:08:37.429 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2023-05-17T12:08:37.456 DEBUG:teuthology.parallel:result is None 2023-05-17T12:08:37.457 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-17T12:08:37.466 INFO:teuthology.task.internal:Creating test directory... 2023-05-17T12:08:37.466 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-17T12:08:37.470 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-17T12:08:37.516 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-17T12:08:37.529 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-17T12:08:37.544 INFO:teuthology.task.internal:Creating archive directory... 2023-05-17T12:08:37.544 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-17T12:08:37.556 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-17T12:08:37.816 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-17T12:08:37.827 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-17T12:08:37.828 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-17T12:08:37.832 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-17T12:08:37.917 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T12:08:37.941 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T12:08:37.971 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T12:08:37.996 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-17T12:08:37.998 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-17T12:08:38.006 INFO:teuthology.task.internal:Configuring sudo... 2023-05-17T12:08:38.007 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-17T12:08:38.011 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-17T12:08:38.074 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-17T12:08:38.086 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-17T12:08:38.087 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-17T12:08:38.091 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-17T12:08:38.131 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T12:08:38.239 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T12:08:38.315 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T12:08:38.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T12:08:38.462 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:08:38.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-17T12:08:38.534 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T12:08:38.608 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-17T12:08:38.683 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T12:08:38.757 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-17T12:08:38.829 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:08:38.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-17T12:08:38.891 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-05-17T12:08:38.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2023-05-17T12:08:39.003 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-17T12:08:39.046 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-17T12:08:39.383 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-17T12:08:39.391 INFO:teuthology.task.internal:Starting timer... 2023-05-17T12:08:39.392 INFO:teuthology.run_tasks:Running task pcp... 2023-05-17T12:08:39.407 INFO:teuthology.run_tasks:Running task selinux... 2023-05-17T12:08:39.418 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-05-17T12:08:39.418 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2023-05-17T12:08:39.557 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2023-05-17T12:08:39.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2023-05-17T12:08:39.663 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2023-05-17T12:08:39.666 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-17T12:08:39.666 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2023-05-17T12:08:39.721 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2023-05-17T12:08:39.721 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2023-05-17T12:08:39.767 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2023-05-17T12:08:39.768 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2023-05-17T12:08:39.768 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-17T12:08:39.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T12:08:39.832 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-17T12:08:39.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T12:08:39.896 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-17T12:08:39.896 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2023-05-17T12:08:39.959 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2023-05-17T12:08:40.021 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-17T12:08:40.031 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-05-17T12:08:40.037 INFO:teuthology.repo_utils:Fetching main from origin 2023-05-17T12:08:40.154 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-17T12:08:40.178 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-17T12:08:40.180 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-17T12:16:48.134 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2023-05-17T12:16:48.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-05-17T12:16:48.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:16:48.252 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-05-17T12:16:48.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-05-17T12:16:48.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-17T12:16:48.452 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-05-17T12:16:48.561 INFO:teuthology.run_tasks:Running task clock... 2023-05-17T12:16:48.572 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-17T12:16:48.573 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-17T12:16:48.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-17T12:16:48.577 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-17T12:16:48.578 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-17T12:16:48.640 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-17T12:16:48.668 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-17T12:16:48.669 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-17T12:16:48.698 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-17T12:16:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2023-05-17T12:16:48.776 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2023-05-17T12:16:48.779 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2023-05-17T12:16:48.804 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2023-05-17T12:16:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-17T12:16:48.834 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-17T12:16:48.835 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-17T12:16:48.863 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-17T12:16:48.915 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-05-17T12:16:48.922 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-17T12:16:48.922 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-05-17T12:16:48.922 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T12:16:48.923 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T12:16:48.923 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T12:16:48.923 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T12:16:48.939 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2023-05-17T12:16:48.946 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-17T12:16:48.947 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-05-17T12:16:48.947 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T12:16:48.947 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T12:16:48.947 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T12:16:48.947 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-17T12:16:48.948 INFO:teuthology.run_tasks:Running task install... 2023-05-17T12:16:48.957 DEBUG:teuthology.task.install:project ceph 2023-05-17T12:16:48.958 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb'}} 2023-05-17T12:16:48.958 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb'} 2023-05-17T12:16:48.958 INFO:teuthology.task.install:Using flavor: default 2023-05-17T12:16:48.964 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-17T12:16:48.964 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-17T12:16:48.965 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb', 'tag': None, 'wait_for_package': False} 2023-05-17T12:16:48.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb 2023-05-17T12:16:48.967 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb', 'tag': None, 'wait_for_package': False} 2023-05-17T12:16:48.968 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb 2023-05-17T12:16:49.109 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-6/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/centos/8/flavors/default/ 2023-05-17T12:16:49.109 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3942.g280675bb 2023-05-17T12:16:49.147 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-6/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/centos/8/flavors/default/ 2023-05-17T12:16:49.147 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3942.g280675bb 2023-05-17T12:16:49.218 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-6/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-6/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-6/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-17T12:16:49.218 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:16:49.219 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-17T12:16:49.251 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-6/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-6/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020-6/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-17T12:16:49.252 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:16:49.252 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-17T12:16:49.282 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-17T12:16:49.282 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-17T12:16:49.314 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-17T12:16:49.315 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-17T12:16:49.386 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-17T12:16:49.418 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-17T12:16:49.481 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-17T12:16:49.508 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-17T12:16:49.543 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-05-17T12:16:49.545 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-05-17T12:16:49.570 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2023-05-17T12:16:49.572 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2023-05-17T12:16:49.862 INFO:teuthology.orchestra.run.smithi088.stdout:53 files removed 2023-05-17T12:16:49.880 INFO:teuthology.orchestra.run.smithi187.stdout:53 files removed 2023-05-17T12:16:49.896 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-17T12:16:49.914 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-17T12:16:50.721 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 299 kB/s | 80 kB 00:00 2023-05-17T12:16:50.740 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 297 kB/s | 80 kB 00:00 2023-05-17T12:16:50.985 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 41 kB/s | 9.4 kB 00:00 2023-05-17T12:16:51.013 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-05-17T12:16:51.243 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-05-17T12:16:51.255 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 6.9 kB/s | 1.5 kB 00:00 2023-05-17T12:16:54.485 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 9.0 MB/s | 29 MB 00:03 2023-05-17T12:16:54.830 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - AppStream 8.2 MB/s | 29 MB 00:03 2023-05-17T12:17:06.534 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 5.3 MB/s | 34 MB 00:06 2023-05-17T12:17:07.663 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - BaseOS 4.8 MB/s | 34 MB 00:07 2023-05-17T12:17:12.051 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 94 kB/s | 18 kB 00:00 2023-05-17T12:17:12.443 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.4 kB 00:00 2023-05-17T12:17:13.354 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2023-05-17T12:17:13.730 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras common packages 30 kB/s | 6.4 kB 00:00 2023-05-17T12:17:14.436 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2023-05-17T12:17:15.732 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2023-05-17T12:17:16.724 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 16 MB/s | 14 MB 00:00 2023-05-17T12:17:20.749 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 183 kB/s | 24 kB 00:00 2023-05-17T12:17:24.132 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-17T12:17:24.133 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-17T12:17:24.144 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-05-17T12:17:24.144 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-05-17T12:17:24.145 INFO:teuthology.orchestra.run.smithi187.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-05-17T12:17:24.146 INFO:teuthology.orchestra.run.smithi187.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-05-17T12:17:24.147 INFO:teuthology.orchestra.run.smithi187.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-17T12:17:24.149 INFO:teuthology.orchestra.run.smithi187.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-17T12:17:24.151 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-17T12:17:24.152 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-17T12:17:24.315 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-05-17T12:17:24.327 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================================ 2023-05-17T12:17:24.327 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2023-05-17T12:17:24.327 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================================ 2023-05-17T12:17:24.327 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2023-05-17T12:17:24.328 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-05-17T12:17:24.328 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:18.0.0-3942.g280675bb.el8 ceph 6.4 k 2023-05-17T12:17:24.328 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:18.0.0-3942.g280675bb.el8 ceph 5.3 M 2023-05-17T12:17:24.328 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:18.0.0-3942.g280675bb.el8 ceph 849 k 2023-05-17T12:17:24.328 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3942.g280675bb.el8 ceph 165 k 2023-05-17T12:17:24.328 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:18.0.0-3942.g280675bb.el8 ceph 1.5 M 2023-05-17T12:17:24.328 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 127 k 2023-05-17T12:17:24.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 1.7 M 2023-05-17T12:17:24.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 7.4 M 2023-05-17T12:17:24.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 47 k 2023-05-17T12:17:24.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:18.0.0-3942.g280675bb.el8 ceph 13 M 2023-05-17T12:17:24.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:18.0.0-3942.g280675bb.el8 ceph 41 M 2023-05-17T12:17:24.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 264 k 2023-05-17T12:17:24.329 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 83 k 2023-05-17T12:17:24.330 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror x86_64 2:18.0.0-3942.g280675bb.el8 ceph 258 k 2023-05-17T12:17:24.330 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 18 k 2023-05-17T12:17:24.330 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-05-17T12:17:24.330 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-05-17T12:17:24.330 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-05-17T12:17:24.330 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:18.0.0-3942.g280675bb.el8 ceph 31 k 2023-05-17T12:17:24.331 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 771 k 2023-05-17T12:17:24.331 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:18.0.0-3942.g280675bb.el8 ceph 139 k 2023-05-17T12:17:24.331 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-05-17T12:17:24.331 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.32.1-41.el8 baseos 99 k 2023-05-17T12:17:24.331 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-05-17T12:17:24.331 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-05-17T12:17:24.331 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-05-17T12:17:24.331 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-05-17T12:17:24.332 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:18.0.0-3942.g280675bb.el8 ceph 197 k 2023-05-17T12:17:24.332 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:18.0.0-3942.g280675bb.el8 ceph 371 k 2023-05-17T12:17:24.332 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:18.0.0-3942.g280675bb.el8 ceph 365 k 2023-05-17T12:17:24.332 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:18.0.0-3942.g280675bb.el8 ceph 107 k 2023-05-17T12:17:24.332 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:18.0.0-3942.g280675bb.el8 ceph 94 k 2023-05-17T12:17:24.332 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:18.0.0-3942.g280675bb.el8 ceph 3.4 M 2023-05-17T12:17:24.332 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:18.0.0-3942.g280675bb.el8 ceph 179 k 2023-05-17T12:17:24.333 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 baseos 72 k 2023-05-17T12:17:24.333 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2023-05-17T12:17:24.333 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-05-17T12:17:24.333 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-05-17T12:17:24.333 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-05-17T12:17:24.333 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 3.7 M 2023-05-17T12:17:24.333 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 3.6 M 2023-05-17T12:17:24.334 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2023-05-17T12:17:24.334 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-05-17T12:17:24.334 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:18.0.0-3942.g280675bb.el8 ceph 22 M 2023-05-17T12:17:24.334 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 23 k 2023-05-17T12:17:24.334 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:18.0.0-3942.g280675bb.el8 ceph 2.3 M 2023-05-17T12:17:24.334 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 240 k 2023-05-17T12:17:24.334 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:18.0.0-3942.g280675bb.el8 ceph 4.6 M 2023-05-17T12:17:24.334 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:18.0.0-3942.g280675bb.el8 ceph 18 M 2023-05-17T12:17:24.335 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 15 k 2023-05-17T12:17:24.335 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:18.0.0-3942.g280675bb.el8 ceph 24 k 2023-05-17T12:17:24.335 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-05-17T12:17:24.335 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-17T12:17:24.335 INFO:teuthology.orchestra.run.smithi187.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-05-17T12:17:24.335 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-05-17T12:17:24.335 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-05-17T12:17:24.336 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:18.0.0-3942.g280675bb.el8 ceph 137 k 2023-05-17T12:17:24.336 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-05-17T12:17:24.336 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-05-17T12:17:24.336 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-17T12:17:24.336 INFO:teuthology.orchestra.run.smithi187.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-05-17T12:17:24.337 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-05-17T12:17:24.337 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-05-17T12:17:24.337 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 473 k 2023-05-17T12:17:24.337 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-05-17T12:17:24.337 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 6.5 M 2023-05-17T12:17:24.337 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-05-17T12:17:24.337 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-05-17T12:17:24.338 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-17T12:17:24.338 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-05-17T12:17:24.338 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-05-17T12:17:24.338 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-05-17T12:17:24.338 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-05-17T12:17:24.338 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-05-17T12:17:24.338 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-05-17T12:17:24.338 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-05-17T12:17:24.339 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-05-17T12:17:24.339 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-05-17T12:17:24.339 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-17T12:17:24.339 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-05-17T12:17:24.339 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-17T12:17:24.339 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-17T12:17:24.339 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-17T12:17:24.340 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:18.0.0-3942.g280675bb.el8 ceph 45 k 2023-05-17T12:17:24.340 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:18.0.0-3942.g280675bb.el8 ceph 119 k 2023-05-17T12:17:24.340 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-17T12:17:24.340 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-05-17T12:17:24.340 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-17T12:17:24.341 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-17T12:17:24.341 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-05-17T12:17:24.341 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-17T12:17:24.341 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-17T12:17:24.341 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-17T12:17:24.341 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-05-17T12:17:24.341 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-05-17T12:17:24.341 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-05-17T12:17:24.342 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-05-17T12:17:24.342 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-17T12:17:24.342 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-17T12:17:24.342 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-05-17T12:17:24.342 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-05-17T12:17:24.342 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-17T12:17:24.342 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-17T12:17:24.343 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-05-17T12:17:24.343 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-05-17T12:17:24.343 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-05-17T12:17:24.343 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-17T12:17:24.343 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-17T12:17:24.343 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-05-17T12:17:24.343 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-05-17T12:17:24.344 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-05-17T12:17:24.344 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-05-17T12:17:24.344 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-05-17T12:17:24.344 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-05-17T12:17:24.344 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-17T12:17:24.344 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-05-17T12:17:24.344 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-17T12:17:24.345 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-17T12:17:24.345 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-05-17T12:17:24.345 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-17T12:17:24.345 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-17T12:17:24.345 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-17T12:17:24.345 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-17T12:17:24.345 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-17T12:17:24.345 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-17T12:17:24.346 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-17T12:17:24.346 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-17T12:17:24.346 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-05-17T12:17:24.346 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-17T12:17:24.346 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-05-17T12:17:24.346 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-17T12:17:24.346 INFO:teuthology.orchestra.run.smithi187.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-05-17T12:17:24.346 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-05-17T12:17:24.347 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-05-17T12:17:24.347 INFO:teuthology.orchestra.run.smithi187.stdout:Enabling module streams: 2023-05-17T12:17:24.347 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql 10 2023-05-17T12:17:24.347 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:17:24.347 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-05-17T12:17:24.347 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================================ 2023-05-17T12:17:24.347 INFO:teuthology.orchestra.run.smithi187.stdout:Install 128 Packages 2023-05-17T12:17:24.348 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 5 Packages 2023-05-17T12:17:24.348 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:17:24.348 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 198 M 2023-05-17T12:17:24.349 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-05-17T12:17:24.891 INFO:teuthology.orchestra.run.smithi187.stdout:(1/133): ceph-18.0.0-3942.g280675bb.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-05-17T12:17:25.100 INFO:teuthology.orchestra.run.smithi187.stdout:(2/133): ceph-fuse-18.0.0-3942.g280675bb.el8.x8 4.0 MB/s | 849 kB 00:00 2023-05-17T12:17:25.159 INFO:teuthology.orchestra.run.smithi187.stdout:(3/133): ceph-immutable-object-cache-18.0.0-394 2.8 MB/s | 165 kB 00:00 2023-05-17T12:17:25.501 INFO:teuthology.orchestra.run.smithi187.stdout:(4/133): ceph-mds-18.0.0-3942.g280675bb.el8.x86 6.7 MB/s | 2.3 MB 00:00 2023-05-17T12:17:25.576 INFO:teuthology.orchestra.run.smithi187.stdout:(5/133): ceph-base-18.0.0-3942.g280675bb.el8.x8 6.6 MB/s | 5.3 MB 00:00 2023-05-17T12:17:25.776 INFO:teuthology.orchestra.run.smithi187.stdout:(6/133): ceph-mgr-18.0.0-3942.g280675bb.el8.x86 5.6 MB/s | 1.5 MB 00:00 2023-05-17T12:17:26.110 INFO:teuthology.orchestra.run.smithi187.stdout:(7/133): ceph-mon-18.0.0-3942.g280675bb.el8.x86 8.6 MB/s | 4.6 MB 00:00 2023-05-17T12:17:27.052 INFO:teuthology.orchestra.run.smithi187.stdout:(8/133): ceph-common-18.0.0-3942.g280675bb.el8. 9.5 MB/s | 22 MB 00:02 2023-05-17T12:17:27.118 INFO:teuthology.orchestra.run.smithi187.stdout:(9/133): ceph-selinux-18.0.0-3942.g280675bb.el8 367 kB/s | 24 kB 00:00 2023-05-17T12:17:27.586 INFO:teuthology.orchestra.run.smithi187.stdout:(10/133): ceph-radosgw-18.0.0-3942.g280675bb.el 8.8 MB/s | 13 MB 00:01 2023-05-17T12:17:27.669 INFO:teuthology.orchestra.run.smithi187.stdout:(11/133): cephfs-mirror-18.0.0-3942.g280675bb.e 3.0 MB/s | 258 kB 00:00 2023-05-17T12:17:27.736 INFO:teuthology.orchestra.run.smithi187.stdout:(12/133): libcephfs-devel-18.0.0-3942.g280675bb 467 kB/s | 31 kB 00:00 2023-05-17T12:17:27.886 INFO:teuthology.orchestra.run.smithi187.stdout:(13/133): libcephfs2-18.0.0-3942.g280675bb.el8. 5.0 MB/s | 771 kB 00:00 2023-05-17T12:17:28.087 INFO:teuthology.orchestra.run.smithi187.stdout:(14/133): ceph-osd-18.0.0-3942.g280675bb.el8.x8 7.7 MB/s | 18 MB 00:02 2023-05-17T12:17:28.112 INFO:teuthology.orchestra.run.smithi187.stdout:(15/133): libcephsqlite-18.0.0-3942.g280675bb.e 608 kB/s | 137 kB 00:00 2023-05-17T12:17:28.137 INFO:teuthology.orchestra.run.smithi187.stdout:(16/133): librados-devel-18.0.0-3942.g280675bb. 2.7 MB/s | 139 kB 00:00 2023-05-17T12:17:28.171 INFO:teuthology.orchestra.run.smithi187.stdout:(17/133): libradosstriper1-18.0.0-3942.g280675b 7.9 MB/s | 473 kB 00:00 2023-05-17T12:17:28.238 INFO:teuthology.orchestra.run.smithi187.stdout:(18/133): python3-ceph-argparse-18.0.0-3942.g28 675 kB/s | 45 kB 00:00 2023-05-17T12:17:28.313 INFO:teuthology.orchestra.run.smithi187.stdout:(19/133): python3-ceph-common-18.0.0-3942.g2806 1.5 MB/s | 119 kB 00:00 2023-05-17T12:17:28.397 INFO:teuthology.orchestra.run.smithi187.stdout:(20/133): python3-cephfs-18.0.0-3942.g280675bb. 2.3 MB/s | 197 kB 00:00 2023-05-17T12:17:28.489 INFO:teuthology.orchestra.run.smithi187.stdout:(21/133): python3-rados-18.0.0-3942.g280675bb.e 4.0 MB/s | 371 kB 00:00 2023-05-17T12:17:28.581 INFO:teuthology.orchestra.run.smithi187.stdout:(22/133): python3-rbd-18.0.0-3942.g280675bb.el8 3.9 MB/s | 365 kB 00:00 2023-05-17T12:17:28.656 INFO:teuthology.orchestra.run.smithi187.stdout:(23/133): python3-rgw-18.0.0-3942.g280675bb.el8 1.4 MB/s | 107 kB 00:00 2023-05-17T12:17:28.732 INFO:teuthology.orchestra.run.smithi187.stdout:(24/133): rbd-fuse-18.0.0-3942.g280675bb.el8.x8 1.2 MB/s | 94 kB 00:00 2023-05-17T12:17:28.898 INFO:teuthology.orchestra.run.smithi187.stdout:(25/133): librgw2-18.0.0-3942.g280675bb.el8.x86 8.6 MB/s | 6.5 MB 00:00 2023-05-17T12:17:28.974 INFO:teuthology.orchestra.run.smithi187.stdout:(26/133): rbd-nbd-18.0.0-3942.g280675bb.el8.x86 2.3 MB/s | 179 kB 00:00 2023-05-17T12:17:29.049 INFO:teuthology.orchestra.run.smithi187.stdout:(27/133): ceph-grafana-dashboards-18.0.0-3942.g 309 kB/s | 23 kB 00:00 2023-05-17T12:17:29.124 INFO:teuthology.orchestra.run.smithi187.stdout:(28/133): rbd-mirror-18.0.0-3942.g280675bb.el8. 8.8 MB/s | 3.4 MB 00:00 2023-05-17T12:17:29.150 INFO:teuthology.orchestra.run.smithi187.stdout:(29/133): ceph-mgr-cephadm-18.0.0-3942.g280675b 1.2 MB/s | 127 kB 00:00 2023-05-17T12:17:29.358 INFO:teuthology.orchestra.run.smithi187.stdout:(30/133): ceph-mgr-dashboard-18.0.0-3942.g28067 7.3 MB/s | 1.7 MB 00:00 2023-05-17T12:17:29.442 INFO:teuthology.orchestra.run.smithi187.stdout:(31/133): ceph-mgr-modules-core-18.0.0-3942.g28 2.8 MB/s | 240 kB 00:00 2023-05-17T12:17:29.525 INFO:teuthology.orchestra.run.smithi187.stdout:(32/133): ceph-mgr-rook-18.0.0-3942.g280675bb.e 572 kB/s | 47 kB 00:00 2023-05-17T12:17:29.601 INFO:teuthology.orchestra.run.smithi187.stdout:(33/133): ceph-prometheus-alerts-18.0.0-3942.g2 193 kB/s | 15 kB 00:00 2023-05-17T12:17:29.684 INFO:teuthology.orchestra.run.smithi187.stdout:(34/133): ceph-volume-18.0.0-3942.g280675bb.el8 3.1 MB/s | 264 kB 00:00 2023-05-17T12:17:30.102 INFO:teuthology.orchestra.run.smithi187.stdout:(35/133): ceph-test-18.0.0-3942.g280675bb.el8.x 14 MB/s | 41 MB 00:02 2023-05-17T12:17:30.137 INFO:teuthology.orchestra.run.smithi187.stdout:(36/133): cephadm-18.0.0-3942.g280675bb.el8.noa 185 kB/s | 83 kB 00:00 2023-05-17T12:17:30.177 INFO:teuthology.orchestra.run.smithi187.stdout:(37/133): cephfs-top-18.0.0-3942.g280675bb.el8. 240 kB/s | 18 kB 00:00 2023-05-17T12:17:30.286 INFO:teuthology.orchestra.run.smithi187.stdout:(38/133): ceph-mgr-diskprediction-local-18.0.0- 6.5 MB/s | 7.4 MB 00:01 2023-05-17T12:17:31.269 INFO:teuthology.orchestra.run.smithi187.stdout:(39/133): flex-2.6.1-9.el8.x86_64.rpm 325 kB/s | 320 kB 00:00 2023-05-17T12:17:31.611 INFO:teuthology.orchestra.run.smithi187.stdout:(40/133): automake-1.16.1-7.el8.noarch.rpm 484 kB/s | 713 kB 00:01 2023-05-17T12:17:31.719 INFO:teuthology.orchestra.run.smithi187.stdout:(41/133): bison-3.0.4-10.el8.x86_64.rpm 446 kB/s | 688 kB 00:01 2023-05-17T12:17:32.220 INFO:teuthology.orchestra.run.smithi187.stdout:(42/133): jq-1.6-7.el8.x86_64.rpm 213 kB/s | 202 kB 00:00 2023-05-17T12:17:32.414 INFO:teuthology.orchestra.run.smithi187.stdout:(43/133): libpq-13.5-1.el8.x86_64.rpm 246 kB/s | 198 kB 00:00 2023-05-17T12:17:33.048 INFO:teuthology.orchestra.run.smithi187.stdout:(44/133): librdkafka-0.11.4-3.el8.x86_64.rpm 266 kB/s | 354 kB 00:01 2023-05-17T12:17:33.514 INFO:teuthology.orchestra.run.smithi187.stdout:(45/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 236 kB/s | 259 kB 00:01 2023-05-17T12:17:33.548 INFO:teuthology.orchestra.run.smithi187.stdout:(46/133): libtool-2.4.6-25.el8.x86_64.rpm 534 kB/s | 709 kB 00:01 2023-05-17T12:17:33.998 INFO:teuthology.orchestra.run.smithi187.stdout:(47/133): oniguruma-6.8.2-2.el8.x86_64.rpm 197 kB/s | 187 kB 00:00 2023-05-17T12:17:35.657 INFO:teuthology.orchestra.run.smithi187.stdout:(48/133): openblas-threads-0.3.15-4.el8.x86_64. 2.3 MB/s | 4.9 MB 00:02 2023-05-17T12:17:35.907 INFO:teuthology.orchestra.run.smithi187.stdout:(49/133): postgresql-10.23-1.module_el8+300+2c5 839 kB/s | 1.6 MB 00:01 2023-05-17T12:17:36.082 INFO:teuthology.orchestra.run.smithi187.stdout:(50/133): openblas-0.3.15-4.el8.x86_64.rpm 1.8 MB/s | 4.7 MB 00:02 2023-05-17T12:17:36.916 INFO:teuthology.orchestra.run.smithi187.stdout:(51/133): postgresql-contrib-10.23-1.module_el8 717 kB/s | 903 kB 00:01 2023-05-17T12:17:38.341 INFO:teuthology.orchestra.run.smithi187.stdout:(52/133): python3-babel-2.5.1-7.el8.noarch.rpm 2.1 MB/s | 4.8 MB 00:02 2023-05-17T12:17:38.408 INFO:teuthology.orchestra.run.smithi187.stdout:(53/133): postgresql-server-10.23-1.module_el8+ 2.0 MB/s | 5.1 MB 00:02 2023-05-17T12:17:38.433 INFO:teuthology.orchestra.run.smithi187.stdout:(54/133): python3-jinja2-2.10.1-3.el8.noarch.rp 355 kB/s | 538 kB 00:01 2023-05-17T12:17:38.541 INFO:teuthology.orchestra.run.smithi187.stdout:(55/133): python3-jsonpatch-1.21-2.el8.noarch.r 133 kB/s | 27 kB 00:00 2023-05-17T12:17:38.583 INFO:teuthology.orchestra.run.smithi187.stdout:(56/133): python3-jsonpointer-1.10-11.el8.noarc 114 kB/s | 20 kB 00:00 2023-05-17T12:17:38.959 INFO:teuthology.orchestra.run.smithi187.stdout:(57/133): python3-markupsafe-0.23-19.el8.x86_64 93 kB/s | 39 kB 00:00 2023-05-17T12:17:39.276 INFO:teuthology.orchestra.run.smithi187.stdout:(58/133): python3-mako-1.0.6-14.el8.noarch.rpm 186 kB/s | 157 kB 00:00 2023-05-17T12:17:39.934 INFO:teuthology.orchestra.run.smithi187.stdout:(59/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 231 kB/s | 225 kB 00:00 2023-05-17T12:17:40.417 INFO:teuthology.orchestra.run.smithi187.stdout:(60/133): python3-prettytable-0.7.2-14.el8.noar 38 kB/s | 44 kB 00:01 2023-05-17T12:17:40.726 INFO:teuthology.orchestra.run.smithi187.stdout:(61/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 131 kB/s | 103 kB 00:00 2023-05-17T12:17:41.301 INFO:teuthology.orchestra.run.smithi187.stdout:(62/133): python3-pyasn1-modules-0.3.7-6.el8.no 191 kB/s | 110 kB 00:00 2023-05-17T12:17:41.735 INFO:teuthology.orchestra.run.smithi187.stdout:(63/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 96 kB/s | 126 kB 00:01 2023-05-17T12:17:41.868 INFO:teuthology.orchestra.run.smithi187.stdout:(64/133): python3-pytz-2017.2-9.el8.noarch.rpm 95 kB/s | 54 kB 00:00 2023-05-17T12:17:43.285 INFO:teuthology.orchestra.run.smithi187.stdout:(65/133): python3-werkzeug-0.12.2-4.el8.noarch. 323 kB/s | 457 kB 00:01 2023-05-17T12:17:43.502 INFO:teuthology.orchestra.run.smithi187.stdout:(66/133): python3-numpy-1.14.3-10.el8.x86_64.rp 777 kB/s | 3.7 MB 00:04 2023-05-17T12:17:44.069 INFO:teuthology.orchestra.run.smithi187.stdout:(67/133): uuid-1.6.2-43.el8.x86_64.rpm 113 kB/s | 64 kB 00:00 2023-05-17T12:17:44.411 INFO:teuthology.orchestra.run.smithi187.stdout:(68/133): socat-1.7.4.1-1.el8.x86_64.rpm 287 kB/s | 323 kB 00:01 2023-05-17T12:17:44.570 INFO:teuthology.orchestra.run.smithi187.stdout:(69/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 141 kB/s | 71 kB 00:00 2023-05-17T12:17:44.803 INFO:teuthology.orchestra.run.smithi187.stdout:(70/133): elfutils-libelf-devel-0.189-2.el8.x86 157 kB/s | 61 kB 00:00 2023-05-17T12:17:45.012 INFO:teuthology.orchestra.run.smithi187.stdout:(71/133): fuse-2.9.7-17.el8.x86_64.rpm 188 kB/s | 83 kB 00:00 2023-05-17T12:17:45.062 INFO:teuthology.orchestra.run.smithi187.stdout:(72/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 186 kB/s | 48 kB 00:00 2023-05-17T12:17:45.446 INFO:teuthology.orchestra.run.smithi187.stdout:(73/133): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.3 MB/s | 561 kB 00:00 2023-05-17T12:17:45.471 INFO:teuthology.orchestra.run.smithi187.stdout:(74/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 46 kB/s | 19 kB 00:00 2023-05-17T12:17:45.671 INFO:teuthology.orchestra.run.smithi187.stdout:(75/133): libcom_err-devel-1.45.6-5.el8.x86_64. 172 kB/s | 39 kB 00:00 2023-05-17T12:17:46.088 INFO:teuthology.orchestra.run.smithi187.stdout:(76/133): libquadmath-8.5.0-19.el8.x86_64.rpm 413 kB/s | 172 kB 00:00 2023-05-17T12:17:46.255 INFO:teuthology.orchestra.run.smithi187.stdout:(77/133): libgfortran-8.5.0-19.el8.x86_64.rpm 823 kB/s | 645 kB 00:00 2023-05-17T12:17:46.272 INFO:teuthology.orchestra.run.smithi187.stdout:(78/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 256 kB/s | 47 kB 00:00 2023-05-17T12:17:46.473 INFO:teuthology.orchestra.run.smithi187.stdout:(79/133): libselinux-devel-2.9-8.el8.x86_64.rpm 923 kB/s | 200 kB 00:00 2023-05-17T12:17:46.664 INFO:teuthology.orchestra.run.smithi187.stdout:(80/133): libsepol-devel-2.9-3.el8.x86_64.rpm 222 kB/s | 87 kB 00:00 2023-05-17T12:17:46.865 INFO:teuthology.orchestra.run.smithi187.stdout:(81/133): libuuid-devel-2.32.1-41.el8.x86_64.rp 253 kB/s | 99 kB 00:00 2023-05-17T12:17:47.073 INFO:teuthology.orchestra.run.smithi187.stdout:(82/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 44 kB/s | 18 kB 00:00 2023-05-17T12:17:47.257 INFO:teuthology.orchestra.run.smithi187.stdout:(83/133): libzstd-devel-1.4.4-1.el8.x86_64.rpm 112 kB/s | 44 kB 00:00 2023-05-17T12:17:48.182 INFO:teuthology.orchestra.run.smithi187.stdout:(84/133): pcre2-devel-10.32-3.el8.x86_64.rpm 654 kB/s | 605 kB 00:00 2023-05-17T12:17:48.416 INFO:teuthology.orchestra.run.smithi187.stdout:(85/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 984 kB/s | 229 kB 00:00 2023-05-17T12:17:48.500 INFO:teuthology.orchestra.run.smithi187.stdout:(86/133): openssl-devel-1.1.1k-9.el8.x86_64.rpm 2.2 MB/s | 3.2 MB 00:01 2023-05-17T12:17:48.600 INFO:teuthology.orchestra.run.smithi187.stdout:(87/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-05-17T12:17:48.742 INFO:teuthology.orchestra.run.smithi187.stdout:(88/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 983 kB/s | 237 kB 00:00 2023-05-17T12:17:49.125 INFO:teuthology.orchestra.run.smithi187.stdout:(89/133): python3-jwt-1.6.1-2.el8.noarch.rpm 111 kB/s | 43 kB 00:00 2023-05-17T12:17:49.234 INFO:teuthology.orchestra.run.smithi187.stdout:(90/133): python3-cryptography-3.2.1-5.el8.x86_ 882 kB/s | 559 kB 00:00 2023-05-17T12:17:49.318 INFO:teuthology.orchestra.run.smithi187.stdout:(91/133): python3-oauthlib-2.1.0-1.el8.noarch.r 809 kB/s | 155 kB 00:00 2023-05-17T12:17:49.635 INFO:teuthology.orchestra.run.smithi187.stdout:(92/133): python3-pycparser-2.14-14.el8.noarch. 272 kB/s | 109 kB 00:00 2023-05-17T12:17:49.735 INFO:teuthology.orchestra.run.smithi187.stdout:(93/133): python3-requests-oauthlib-1.0.0-1.el8 102 kB/s | 43 kB 00:00 2023-05-17T12:17:50.010 INFO:teuthology.orchestra.run.smithi187.stdout:(94/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 193 kB/s | 72 kB 00:00 2023-05-17T12:17:50.127 INFO:teuthology.orchestra.run.smithi187.stdout:(95/133): zlib-devel-1.2.11-21.el8.x86_64.rpm 148 kB/s | 58 kB 00:00 2023-05-17T12:17:50.494 INFO:teuthology.orchestra.run.smithi187.stdout:(96/133): gperftools-libs-2.7-9.el8.x86_64.rpm 633 kB/s | 306 kB 00:00 2023-05-17T12:17:50.519 INFO:teuthology.orchestra.run.smithi187.stdout:(97/133): liboath-2.6.2-3.el8.x86_64.rpm 150 kB/s | 59 kB 00:00 2023-05-17T12:17:50.595 INFO:teuthology.orchestra.run.smithi187.stdout:(98/133): libunwind-1.3.1-3.el8.x86_64.rpm 749 kB/s | 75 kB 00:00 2023-05-17T12:17:50.687 INFO:teuthology.orchestra.run.smithi187.stdout:(99/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 477 kB/s | 44 kB 00:00 2023-05-17T12:17:50.837 INFO:teuthology.orchestra.run.smithi187.stdout:(100/133): python3-asyncssh-2.7.0-2.el8.noarch. 1.5 MB/s | 476 kB 00:00 2023-05-17T12:17:50.871 INFO:teuthology.orchestra.run.smithi187.stdout:(101/133): python3-beautifulsoup4-4.6.3-2.el8.1 1.0 MB/s | 185 kB 00:00 2023-05-17T12:17:50.929 INFO:teuthology.orchestra.run.smithi187.stdout:(102/133): python3-cachetools-3.1.1-4.el8.noarc 359 kB/s | 33 kB 00:00 2023-05-17T12:17:50.955 INFO:teuthology.orchestra.run.smithi187.stdout:(103/133): python3-certifi-2018.10.15-7.el8.noa 195 kB/s | 16 kB 00:00 2023-05-17T12:17:51.022 INFO:teuthology.orchestra.run.smithi187.stdout:(104/133): python3-cheroot-8.5.2-1.el8.noarch.r 1.8 MB/s | 173 kB 00:00 2023-05-17T12:17:51.137 INFO:teuthology.orchestra.run.smithi187.stdout:(105/133): python3-google-auth-1.1.1-10.el8.noa 704 kB/s | 81 kB 00:00 2023-05-17T12:17:51.172 INFO:teuthology.orchestra.run.smithi187.stdout:(106/133): python3-cherrypy-18.4.0-1.el8.noarch 1.7 MB/s | 384 kB 00:00 2023-05-17T12:17:51.222 INFO:teuthology.orchestra.run.smithi187.stdout:(107/133): python3-jaraco-6.2-6.el8.noarch.rpm 131 kB/s | 11 kB 00:00 2023-05-17T12:17:51.248 INFO:teuthology.orchestra.run.smithi187.stdout:(108/133): python3-jaraco-functools-2.0-4.el8.n 234 kB/s | 18 kB 00:00 2023-05-17T12:17:51.315 INFO:teuthology.orchestra.run.smithi187.stdout:(109/133): python3-logutils-0.3.5-11.el8.noarch 732 kB/s | 49 kB 00:00 2023-05-17T12:17:51.365 INFO:teuthology.orchestra.run.smithi187.stdout:(110/133): python3-kubernetes-11.0.0-6.el8.noar 8.2 MB/s | 1.2 MB 00:00 2023-05-17T12:17:51.432 INFO:teuthology.orchestra.run.smithi187.stdout:(111/133): python3-natsort-7.1.1-2.el8.noarch.r 909 kB/s | 60 kB 00:00 2023-05-17T12:17:51.449 INFO:teuthology.orchestra.run.smithi187.stdout:(112/133): python3-more-itertools-7.2.0-3.el8.n 439 kB/s | 59 kB 00:00 2023-05-17T12:17:51.516 INFO:teuthology.orchestra.run.smithi187.stdout:(113/133): python3-portend-2.6-1.el8.noarch.rpm 235 kB/s | 16 kB 00:00 2023-05-17T12:17:51.583 INFO:teuthology.orchestra.run.smithi187.stdout:(114/133): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-05-17T12:17:51.600 INFO:teuthology.orchestra.run.smithi187.stdout:(115/133): python3-repoze-lru-0.7-6.el8.noarch. 402 kB/s | 34 kB 00:00 2023-05-17T12:17:51.667 INFO:teuthology.orchestra.run.smithi187.stdout:(116/133): python3-rsa-4.8-1.el8.noarch.rpm 926 kB/s | 61 kB 00:00 2023-05-17T12:17:51.700 INFO:teuthology.orchestra.run.smithi187.stdout:(117/133): python3-routes-2.4.1-12.el8.noarch.r 1.6 MB/s | 196 kB 00:00 2023-05-17T12:17:51.734 INFO:teuthology.orchestra.run.smithi187.stdout:(118/133): python3-simplegeneric-0.8.1-17.el8.n 279 kB/s | 19 kB 00:00 2023-05-17T12:17:51.768 INFO:teuthology.orchestra.run.smithi187.stdout:(119/133): python3-singledispatch-3.4.0.3-18.el 358 kB/s | 24 kB 00:00 2023-05-17T12:17:51.801 INFO:teuthology.orchestra.run.smithi187.stdout:(120/133): python3-tempora-1.14.1-5.el8.noarch. 437 kB/s | 29 kB 00:00 2023-05-17T12:17:51.835 INFO:teuthology.orchestra.run.smithi187.stdout:(121/133): python3-trustme-0.6.0-4.el8.noarch.r 411 kB/s | 27 kB 00:00 2023-05-17T12:17:51.877 INFO:teuthology.orchestra.run.smithi187.stdout:(122/133): python3-waitress-1.2.1-2.el8.1.noarc 3.1 MB/s | 241 kB 00:00 2023-05-17T12:17:51.944 INFO:teuthology.orchestra.run.smithi187.stdout:(123/133): python3-webob-1.8.5-1.el8.1.noarch.r 2.3 MB/s | 251 kB 00:00 2023-05-17T12:17:51.969 INFO:teuthology.orchestra.run.smithi187.stdout:(124/133): python3-websocket-client-0.56.0-5.el 665 kB/s | 61 kB 00:00 2023-05-17T12:17:52.011 INFO:teuthology.orchestra.run.smithi187.stdout:(125/133): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2023-05-17T12:17:52.037 INFO:teuthology.orchestra.run.smithi187.stdout:(126/133): python3-zc-lockfile-2.0-2.el8.noarch 343 kB/s | 23 kB 00:00 2023-05-17T12:17:52.329 INFO:teuthology.orchestra.run.smithi187.stdout:(127/133): librados2-18.0.0-3942.g280675bb.el8. 13 MB/s | 3.7 MB 00:00 2023-05-17T12:17:52.529 INFO:teuthology.orchestra.run.smithi187.stdout:(128/133): librbd1-18.0.0-3942.g280675bb.el8.x8 18 MB/s | 3.6 MB 00:00 2023-05-17T12:17:52.646 INFO:teuthology.orchestra.run.smithi187.stdout:(129/133): thrift-0.13.0-2.el8.x86_64.rpm 2.7 MB/s | 1.7 MB 00:00 2023-05-17T12:17:52.813 INFO:teuthology.orchestra.run.smithi187.stdout:(130/133): elfutils-debuginfod-client-0.189-2.e 268 kB/s | 76 kB 00:00 2023-05-17T12:17:53.130 INFO:teuthology.orchestra.run.smithi187.stdout:(131/133): elfutils-libelf-0.189-2.el8.x86_64.r 479 kB/s | 232 kB 00:00 2023-05-17T12:17:53.405 INFO:teuthology.orchestra.run.smithi187.stdout:(132/133): elfutils-libs-0.189-2.el8.x86_64.rpm 511 kB/s | 302 kB 00:00 2023-05-17T12:17:53.597 INFO:teuthology.orchestra.run.smithi187.stdout:(133/133): python3-scipy-1.0.0-21.module_el8.5. 1.2 MB/s | 14 MB 00:11 2023-05-17T12:17:53.603 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-05-17T12:17:53.603 INFO:teuthology.orchestra.run.smithi187.stdout:Total 6.8 MB/s | 198 MB 00:29 2023-05-17T12:17:54.992 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-05-17T12:17:55.246 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-05-17T12:17:55.246 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-05-17T12:17:57.147 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-05-17T12:17:57.150 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-05-17T12:18:02.087 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-05-17T12:18:02.295 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/138 2023-05-17T12:18:02.477 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2023-05-17T12:18:02.699 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/138 2023-05-17T12:18:02.863 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-17T12:18:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-17T12:18:03.504 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:18.0.0-3942.g280675bb.el8.x86_64 5/138 2023-05-17T12:18:03.974 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:18.0.0-3942.g280675bb.el8.x86_64 5/138 2023-05-17T12:18:04.146 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:18.0.0-3942.g280675bb.el8.x86_64 6/138 2023-05-17T12:18:04.304 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:18.0.0-3942.g280675bb.el8.x86_64 6/138 2023-05-17T12:18:04.479 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:18.0.0-3942.g280675bb.el8.x86_64 7/138 2023-05-17T12:18:04.590 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:18.0.0-3942.g280675bb.el8.x86_64 7/138 2023-05-17T12:18:04.831 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:18.0.0-3942.g280675bb.el8.x86_64 8/138 2023-05-17T12:18:05.004 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-17T12:18:05.141 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-17T12:18:05.359 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 10/138 2023-05-17T12:18:05.603 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/138 2023-05-17T12:18:05.859 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2023-05-17T12:18:06.310 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpq-13.5-1.el8.x86_64 13/138 2023-05-17T12:18:06.567 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 14/138 2023-05-17T12:18:06.754 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:18.0.0-3942.g280675bb.el8.x86_64 15/138 2023-05-17T12:18:06.879 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3942.g280675bb.el8.x86_64 15/138 2023-05-17T12:18:07.037 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:18.0.0-3942.g280675bb.el8.x86 16/138 2023-05-17T12:18:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3942.g280675bb.el8.x86 16/138 2023-05-17T12:18:07.361 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/138 2023-05-17T12:18:07.539 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 18/138 2023-05-17T12:18:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-17T12:18:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-17T12:18:07.978 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-17T12:18:08.655 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-17T12:18:08.845 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/138 2023-05-17T12:18:09.541 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/138 2023-05-17T12:18:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-17T12:18:10.490 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-17T12:18:10.889 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/138 2023-05-17T12:18:11.079 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/138 2023-05-17T12:18:11.243 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/138 2023-05-17T12:18:11.481 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/138 2023-05-17T12:18:11.693 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:18.0.0-3942.g280675bb.el8. 27/138 2023-05-17T12:18:11.816 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:18.0.0-3942.g280675bb.el 28/138 2023-05-17T12:18:12.044 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:18.0.0-3942.g280675bb.el8.x86_6 29/138 2023-05-17T12:18:13.140 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 30/138 2023-05-17T12:18:13.500 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2023-05-17T12:18:13.822 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2023-05-17T12:18:14.053 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-17T12:18:16.132 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-17T12:18:16.523 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/138 2023-05-17T12:18:16.702 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/138 2023-05-17T12:18:16.928 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2023-05-17T12:18:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 37/138 2023-05-17T12:18:17.299 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 38/138 2023-05-17T12:18:17.477 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:18.0.0-3942.g280675bb.el8.x86_64 39/138 2023-05-17T12:18:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:18.0.0-3942.g280675bb.el8.x86_6 40/138 2023-05-17T12:18:17.802 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/138 2023-05-17T12:18:18.048 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/138 2023-05-17T12:18:18.277 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/138 2023-05-17T12:18:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/138 2023-05-17T12:18:18.599 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/138 2023-05-17T12:18:18.779 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/138 2023-05-17T12:18:18.987 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/138 2023-05-17T12:18:19.194 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/138 2023-05-17T12:18:19.364 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/138 2023-05-17T12:18:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/138 2023-05-17T12:18:19.667 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2023-05-17T12:18:19.834 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/138 2023-05-17T12:18:20.030 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/138 2023-05-17T12:18:20.207 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/138 2023-05-17T12:18:20.431 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/138 2023-05-17T12:18:20.711 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/138 2023-05-17T12:18:20.894 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/138 2023-05-17T12:18:21.242 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/138 2023-05-17T12:18:21.506 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/138 2023-05-17T12:18:21.689 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/138 2023-05-17T12:18:22.493 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/138 2023-05-17T12:18:22.693 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:18.0.0-3942.g280675bb.el8.x86_64 62/138 2023-05-17T12:18:22.785 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:18.0.0-3942.g280675bb.el8.x86_64 62/138 2023-05-17T12:18:22.988 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:18.0.0-3942.g280675bb.el8.x86_64 63/138 2023-05-17T12:18:23.230 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/138 2023-05-17T12:18:23.609 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/138 2023-05-17T12:18:23.900 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/138 2023-05-17T12:18:24.082 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/138 2023-05-17T12:18:24.346 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/138 2023-05-17T12:18:24.594 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/138 2023-05-17T12:18:25.892 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/138 2023-05-17T12:18:26.293 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/138 2023-05-17T12:18:26.544 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/138 2023-05-17T12:18:26.753 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/138 2023-05-17T12:18:27.067 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/138 2023-05-17T12:18:27.304 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/138 2023-05-17T12:18:27.554 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/138 2023-05-17T12:18:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/138 2023-05-17T12:18:28.090 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/138 2023-05-17T12:18:28.272 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/138 2023-05-17T12:18:28.411 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 80/138 2023-05-17T12:18:28.573 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 81/138 2023-05-17T12:18:28.757 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-17T12:18:29.425 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/138 2023-05-17T12:18:29.639 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 84/138 2023-05-17T12:18:29.808 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 85/138 2023-05-17T12:18:30.027 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/138 2023-05-17T12:18:30.253 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 87/138 2023-05-17T12:18:30.470 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.7-17.el8.x86_64 88/138 2023-05-17T12:18:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 89/138 2023-05-17T12:18:30.832 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : uuid-1.6.2-43.el8.x86_64 90/138 2023-05-17T12:18:30.959 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 90/138 2023-05-17T12:18:31.169 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 91/138 2023-05-17T12:18:31.335 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 92/138 2023-05-17T12:18:34.382 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 93/138 2023-05-17T12:18:34.608 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 93/138 2023-05-17T12:18:35.284 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 93/138 2023-05-17T12:18:35.569 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:18.0.0-3942.g280675bb.el8.x86_64 94/138 2023-05-17T12:18:35.701 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:18.0.0-3942.g280675bb.el8.x86_64 94/138 2023-05-17T12:18:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:18.0.0-3942.g280675bb.el8.x86_64 95/138 2023-05-17T12:18:56.315 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3942.g280675bb.el8.x86_64 95/138 2023-05-17T12:18:56.316 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2023-05-17T12:18:56.316 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2023-05-17T12:18:56.316 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-05-17T12:18:56.316 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /run 2023-05-17T12:18:56.316 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2023-05-17T12:18:56.317 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2023-05-17T12:18:56.317 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2023-05-17T12:18:56.317 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2023-05-17T12:18:56.317 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-05-17T12:18:56.317 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:18:56.754 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:18.0.0-3942.g280675bb.el8.noarch 96/138 2023-05-17T12:18:58.476 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:18.0.0-3942.g280675bb.el8.noarch 96/138 2023-05-17T12:18:58.681 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:18.0.0-3942.g280675bb.el8.x86_64 97/138 2023-05-17T12:18:58.954 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:18.0.0-3942.g280675bb.el8.x86_64 97/138 2023-05-17T12:18:59.128 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:18.0.0-3942.g280675bb.el8.x86_64 98/138 2023-05-17T12:18:59.644 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:18.0.0-3942.g280675bb.el8.x86_64 98/138 2023-05-17T12:18:59.834 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:18.0.0-3942.g280675bb.el8.x86_64 99/138 2023-05-17T12:18:59.873 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:18.0.0-3942.g280675bb.el8.x86_64 99/138 2023-05-17T12:19:00.087 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/138 2023-05-17T12:19:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/138 2023-05-17T12:19:00.444 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-17T12:19:00.530 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-17T12:19:00.831 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : jq-1.6-7.el8.x86_64 103/138 2023-05-17T12:19:01.069 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.1-7.el8.noarch 104/138 2023-05-17T12:19:01.655 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:18.0.0-3942.g280675bb.el8.noarch 105/138 2023-05-17T12:19:01.825 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:18.0.0-3942.g280675bb.el8.noarch 105/138 2023-05-17T12:19:01.943 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3942.g280675bb.e 106/138 2023-05-17T12:19:02.114 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3942.g280675bb. 107/138 2023-05-17T12:19:02.352 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3942.g280675bb.el8.noa 108/138 2023-05-17T12:19:02.606 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3942.g280675bb.el8.noa 108/138 2023-05-17T12:19:02.822 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3942.g280675bb.el8.n 109/138 2023-05-17T12:19:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3942.g280675bb.el8.n 109/138 2023-05-17T12:19:04.118 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3942.g280 110/138 2023-05-17T12:19:04.243 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3942.g280 110/138 2023-05-17T12:19:04.650 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3942.g280675bb.el 111/138 2023-05-17T12:19:04.889 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:18.0.0-3942.g280675bb.el8.x86_64 112/138 2023-05-17T12:19:04.949 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3942.g280675bb.el8.x86_64 112/138 2023-05-17T12:19:05.110 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:18.0.0-3942.g280675bb.el8.noarch 113/138 2023-05-17T12:19:05.134 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3942.g280675bb.el8.noarch 113/138 2023-05-17T12:19:05.326 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:18.0.0-3942.g280675bb.el8.x86_64 114/138 2023-05-17T12:19:05.468 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/138 2023-05-17T12:19:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/138 2023-05-17T12:19:11.239 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:18.0.0-3942.g280675bb.el8.x86_64 116/138 2023-05-17T12:19:11.446 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:18.0.0-3942.g280675bb.el8.x86_64 117/138 2023-05-17T12:19:11.503 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3942.g280675bb.el8.x86_64 117/138 2023-05-17T12:19:11.718 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3942.g28067 118/138 2023-05-17T12:19:11.783 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3942.g28067 118/138 2023-05-17T12:19:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 119/138 2023-05-17T12:19:12.369 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 119/138 2023-05-17T12:19:12.551 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 120/138 2023-05-17T12:19:12.829 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 120/138 2023-05-17T12:19:13.155 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 121/138 2023-05-17T12:19:14.342 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 122/138 2023-05-17T12:19:14.635 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 123/138 2023-05-17T12:19:14.797 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 124/138 2023-05-17T12:19:15.005 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 125/138 2023-05-17T12:19:15.184 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:18.0.0-3942.g280675bb.el8.x86_ 126/138 2023-05-17T12:19:16.335 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-17T12:19:16.567 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-17T12:19:16.599 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-17T12:19:16.809 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-top-2:18.0.0-3942.g280675bb.el8.noarch 128/138 2023-05-17T12:19:17.017 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 129/138 2023-05-17T12:19:17.226 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:18.0.0-3942.g280675bb.el8.x86_64 130/138 2023-05-17T12:19:17.420 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2023-05-17T12:19:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2023-05-17T12:19:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2023-05-17T12:19:17.941 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2023-05-17T12:19:17.964 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2023-05-17T12:19:18.134 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-17T12:19:18.306 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 135/138 2023-05-17T12:19:18.306 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-17T12:19:18.547 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-17T12:19:18.769 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-17T12:19:18.951 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-17T12:19:19.158 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-17T12:19:19.158 INFO:teuthology.orchestra.run.smithi187.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-17T12:19:19.158 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:19:19.866 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:18.0.0-3942.g280675bb.el8.x86_64 1/138 2023-05-17T12:19:19.866 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:18.0.0-3942.g280675bb.el8.x86_64 2/138 2023-05-17T12:19:19.867 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 3/138 2023-05-17T12:19:19.867 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 4/138 2023-05-17T12:19:19.867 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3942.g28067 5/138 2023-05-17T12:19:19.867 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:18.0.0-3942.g280675bb.el8.x86_64 6/138 2023-05-17T12:19:19.867 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:18.0.0-3942.g280675bb.el8.x86_64 7/138 2023-05-17T12:19:19.867 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:18.0.0-3942.g280675bb.el8.x86_64 8/138 2023-05-17T12:19:19.868 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:18.0.0-3942.g280675bb.el8.x86_64 9/138 2023-05-17T12:19:19.868 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:18.0.0-3942.g280675bb.el8.x86_64 10/138 2023-05-17T12:19:19.868 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:18.0.0-3942.g280675bb.el8.x86_64 11/138 2023-05-17T12:19:19.868 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:18.0.0-3942.g280675bb.el8.x86_64 12/138 2023-05-17T12:19:19.868 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 13/138 2023-05-17T12:19:19.868 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:18.0.0-3942.g280675bb.el8.x86_ 14/138 2023-05-17T12:19:19.869 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:18.0.0-3942.g280675bb.el8.x86_64 15/138 2023-05-17T12:19:19.869 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:18.0.0-3942.g280675bb.el8.x86_64 16/138 2023-05-17T12:19:19.869 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:18.0.0-3942.g280675bb.el8.x86_6 17/138 2023-05-17T12:19:19.869 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:18.0.0-3942.g280675bb.el8.x86 18/138 2023-05-17T12:19:19.869 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:18.0.0-3942.g280675bb.el8.x86_64 19/138 2023-05-17T12:19:19.869 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3942.g280675bb.el 20/138 2023-05-17T12:19:19.869 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:18.0.0-3942.g280675bb.el8. 21/138 2023-05-17T12:19:19.870 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:18.0.0-3942.g280675bb.el8.x86_6 22/138 2023-05-17T12:19:19.870 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:18.0.0-3942.g280675bb.el8.x86_64 23/138 2023-05-17T12:19:19.870 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:18.0.0-3942.g280675bb.el8.x86_64 24/138 2023-05-17T12:19:19.870 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:18.0.0-3942.g280675bb.el8.x86_64 25/138 2023-05-17T12:19:19.870 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 26/138 2023-05-17T12:19:19.870 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 27/138 2023-05-17T12:19:19.870 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:18.0.0-3942.g280675bb.el8.x86_64 28/138 2023-05-17T12:19:19.871 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3942.g280675bb. 29/138 2023-05-17T12:19:19.871 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3942.g280675bb.el8.noa 30/138 2023-05-17T12:19:19.871 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3942.g280675bb.el8.n 31/138 2023-05-17T12:19:19.871 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3942.g280 32/138 2023-05-17T12:19:19.871 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3942.g280675bb.el 33/138 2023-05-17T12:19:19.878 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3942.g280675bb.el8.noarch 34/138 2023-05-17T12:19:19.879 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3942.g280675bb.e 35/138 2023-05-17T12:19:19.879 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:18.0.0-3942.g280675bb.el8.noarch 36/138 2023-05-17T12:19:19.879 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:18.0.0-3942.g280675bb.el8.noarch 37/138 2023-05-17T12:19:19.879 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-top-2:18.0.0-3942.g280675bb.el8.noarch 38/138 2023-05-17T12:19:19.879 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/138 2023-05-17T12:19:19.880 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/138 2023-05-17T12:19:19.880 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/138 2023-05-17T12:19:19.880 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : jq-1.6-7.el8.x86_64 42/138 2023-05-17T12:19:19.881 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/138 2023-05-17T12:19:19.881 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/138 2023-05-17T12:19:19.881 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/138 2023-05-17T12:19:19.882 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/138 2023-05-17T12:19:19.882 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/138 2023-05-17T12:19:19.882 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/138 2023-05-17T12:19:19.882 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/138 2023-05-17T12:19:19.883 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/138 2023-05-17T12:19:19.883 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/138 2023-05-17T12:19:19.883 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/138 2023-05-17T12:19:19.884 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/138 2023-05-17T12:19:19.884 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/138 2023-05-17T12:19:19.884 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/138 2023-05-17T12:19:19.885 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/138 2023-05-17T12:19:19.885 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/138 2023-05-17T12:19:19.885 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/138 2023-05-17T12:19:19.886 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/138 2023-05-17T12:19:19.886 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/138 2023-05-17T12:19:19.886 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/138 2023-05-17T12:19:19.887 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/138 2023-05-17T12:19:19.887 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/138 2023-05-17T12:19:19.887 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/138 2023-05-17T12:19:19.887 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/138 2023-05-17T12:19:19.887 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/138 2023-05-17T12:19:19.888 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/138 2023-05-17T12:19:19.888 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/138 2023-05-17T12:19:19.888 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/138 2023-05-17T12:19:19.889 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/138 2023-05-17T12:19:19.889 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/138 2023-05-17T12:19:19.889 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/138 2023-05-17T12:19:19.890 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2023-05-17T12:19:19.890 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/138 2023-05-17T12:19:19.890 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/138 2023-05-17T12:19:19.890 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/138 2023-05-17T12:19:19.890 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/138 2023-05-17T12:19:19.890 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/138 2023-05-17T12:19:19.890 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/138 2023-05-17T12:19:19.891 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/138 2023-05-17T12:19:19.891 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/138 2023-05-17T12:19:19.891 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-17T12:19:19.891 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/138 2023-05-17T12:19:19.891 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/138 2023-05-17T12:19:19.891 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/138 2023-05-17T12:19:19.892 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/138 2023-05-17T12:19:19.892 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/138 2023-05-17T12:19:19.892 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/138 2023-05-17T12:19:19.892 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/138 2023-05-17T12:19:19.892 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/138 2023-05-17T12:19:19.892 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/138 2023-05-17T12:19:19.893 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/138 2023-05-17T12:19:19.893 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/138 2023-05-17T12:19:19.893 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/138 2023-05-17T12:19:19.893 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 95/138 2023-05-17T12:19:19.893 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/138 2023-05-17T12:19:19.893 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/138 2023-05-17T12:19:19.894 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/138 2023-05-17T12:19:19.894 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/138 2023-05-17T12:19:19.894 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/138 2023-05-17T12:19:19.894 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/138 2023-05-17T12:19:19.894 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/138 2023-05-17T12:19:19.894 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/138 2023-05-17T12:19:19.894 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/138 2023-05-17T12:19:19.895 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/138 2023-05-17T12:19:19.895 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/138 2023-05-17T12:19:19.895 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/138 2023-05-17T12:19:19.895 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/138 2023-05-17T12:19:19.895 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/138 2023-05-17T12:19:19.895 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/138 2023-05-17T12:19:19.895 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/138 2023-05-17T12:19:19.896 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/138 2023-05-17T12:19:19.896 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/138 2023-05-17T12:19:19.896 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/138 2023-05-17T12:19:19.896 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/138 2023-05-17T12:19:19.896 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/138 2023-05-17T12:19:19.896 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/138 2023-05-17T12:19:19.896 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/138 2023-05-17T12:19:19.897 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/138 2023-05-17T12:19:19.897 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/138 2023-05-17T12:19:19.897 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/138 2023-05-17T12:19:19.897 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/138 2023-05-17T12:19:19.897 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/138 2023-05-17T12:19:19.897 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/138 2023-05-17T12:19:19.897 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/138 2023-05-17T12:19:19.898 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/138 2023-05-17T12:19:19.898 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/138 2023-05-17T12:19:19.898 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/138 2023-05-17T12:19:19.898 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:18.0.0-3942.g280675bb.el8.x86_64 129/138 2023-05-17T12:19:19.898 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2023-05-17T12:19:19.898 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:18.0.0-3942.g280675bb.el8.x86_64 131/138 2023-05-17T12:19:19.898 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2023-05-17T12:19:19.899 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 133/138 2023-05-17T12:19:19.899 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-17T12:19:19.899 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 135/138 2023-05-17T12:19:19.899 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 136/138 2023-05-17T12:19:19.899 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 137/138 2023-05-17T12:19:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 138/138 2023-05-17T12:19:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:19:21.908 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2023-05-17T12:19:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-05-17T12:19:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-05-17T12:19:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-05-17T12:19:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.909 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2023-05-17T12:19:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.1-7.el8.noarch 2023-05-17T12:19:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.0.4-10.el8.x86_64 2023-05-17T12:19:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:19:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-05-17T12:19:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.1-9.el8.x86_64 2023-05-17T12:19:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.7-17.el8.x86_64 2023-05-17T12:19:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-17T12:19:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: jq-1.6-7.el8.x86_64 2023-05-17T12:19:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-17T12:19:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-05-17T12:19:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-17T12:19:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-05-17T12:19:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-05-17T12:19:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-17T12:19:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: libpq-13.5-1.el8.x86_64 2023-05-17T12:19:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-05-17T12:19:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-17T12:19:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-17T12:19:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-05-17T12:19:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-17T12:19:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-17T12:19:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-17T12:19:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-05-17T12:19:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-05-17T12:19:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-05-17T12:19:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-17T12:19:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-17T12:19:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.15-4.el8.x86_64 2023-05-17T12:19:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-05-17T12:19:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-05-17T12:19:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-05-17T12:19:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-05-17T12:19:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-05-17T12:19:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-17T12:19:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-17T12:19:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-17T12:19:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-17T12:19:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-17T12:19:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-17T12:19:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-17T12:19:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-17T12:19:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-17T12:19:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-17T12:19:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-17T12:19:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-17T12:19:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-17T12:19:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-17T12:19:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-17T12:19:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-17T12:19:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-17T12:19:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-17T12:19:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-17T12:19:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-17T12:19:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-17T12:19:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-17T12:19:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.0.6-14.el8.noarch 2023-05-17T12:19:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-17T12:19:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-17T12:19:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-17T12:19:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-17T12:19:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-17T12:19:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-17T12:19:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-17T12:19:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-2.6-1.el8.noarch 2023-05-17T12:19:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-17T12:19:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-17T12:19:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-17T12:19:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-17T12:19:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-17T12:19:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-17T12:19:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-17T12:19:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-17T12:19:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-17T12:19:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-17T12:19:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-05-17T12:19:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-17T12:19:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-17T12:19:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-17T12:19:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-17T12:19:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-17T12:19:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-17T12:19:21.924 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-17T12:19:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-17T12:19:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-17T12:19:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-17T12:19:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:19:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-17T12:19:21.925 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-17T12:19:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-17T12:19:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-17T12:19:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-17T12:19:21.926 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-05-17T12:19:21.927 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:19:21.927 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-05-17T12:19:22.144 DEBUG:teuthology.parallel:result is None 2023-05-17T12:21:39.123 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 54 kB/s | 14 MB 04:24 2023-05-17T12:21:43.239 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 105 kB/s | 24 kB 00:00 2023-05-17T12:21:46.625 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-17T12:21:46.626 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-17T12:21:46.638 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-05-17T12:21:46.638 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-05-17T12:21:46.639 INFO:teuthology.orchestra.run.smithi088.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-05-17T12:21:46.640 INFO:teuthology.orchestra.run.smithi088.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-05-17T12:21:46.641 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-17T12:21:46.642 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-17T12:21:46.645 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-17T12:21:46.646 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-17T12:21:46.810 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-05-17T12:21:46.823 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================================ 2023-05-17T12:21:46.823 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-05-17T12:21:46.823 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================================ 2023-05-17T12:21:46.823 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-05-17T12:21:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-05-17T12:21:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:18.0.0-3942.g280675bb.el8 ceph 6.4 k 2023-05-17T12:21:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:18.0.0-3942.g280675bb.el8 ceph 5.3 M 2023-05-17T12:21:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:18.0.0-3942.g280675bb.el8 ceph 849 k 2023-05-17T12:21:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3942.g280675bb.el8 ceph 165 k 2023-05-17T12:21:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:18.0.0-3942.g280675bb.el8 ceph 1.5 M 2023-05-17T12:21:46.824 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 127 k 2023-05-17T12:21:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 1.7 M 2023-05-17T12:21:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 7.4 M 2023-05-17T12:21:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 47 k 2023-05-17T12:21:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:18.0.0-3942.g280675bb.el8 ceph 13 M 2023-05-17T12:21:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:18.0.0-3942.g280675bb.el8 ceph 41 M 2023-05-17T12:21:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 264 k 2023-05-17T12:21:46.825 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 83 k 2023-05-17T12:21:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror x86_64 2:18.0.0-3942.g280675bb.el8 ceph 258 k 2023-05-17T12:21:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 18 k 2023-05-17T12:21:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-05-17T12:21:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-05-17T12:21:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-05-17T12:21:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:18.0.0-3942.g280675bb.el8 ceph 31 k 2023-05-17T12:21:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 771 k 2023-05-17T12:21:46.826 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:18.0.0-3942.g280675bb.el8 ceph 139 k 2023-05-17T12:21:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-05-17T12:21:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_64 2.32.1-41.el8 baseos 99 k 2023-05-17T12:21:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-05-17T12:21:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-05-17T12:21:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-05-17T12:21:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-05-17T12:21:46.827 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:18.0.0-3942.g280675bb.el8 ceph 197 k 2023-05-17T12:21:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:18.0.0-3942.g280675bb.el8 ceph 371 k 2023-05-17T12:21:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:18.0.0-3942.g280675bb.el8 ceph 365 k 2023-05-17T12:21:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:18.0.0-3942.g280675bb.el8 ceph 107 k 2023-05-17T12:21:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:18.0.0-3942.g280675bb.el8 ceph 94 k 2023-05-17T12:21:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:18.0.0-3942.g280675bb.el8 ceph 3.4 M 2023-05-17T12:21:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:18.0.0-3942.g280675bb.el8 ceph 179 k 2023-05-17T12:21:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 baseos 72 k 2023-05-17T12:21:46.828 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-05-17T12:21:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-05-17T12:21:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-05-17T12:21:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-05-17T12:21:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 3.7 M 2023-05-17T12:21:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 3.6 M 2023-05-17T12:21:46.829 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-05-17T12:21:46.829 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-05-17T12:21:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:18.0.0-3942.g280675bb.el8 ceph 22 M 2023-05-17T12:21:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 23 k 2023-05-17T12:21:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:18.0.0-3942.g280675bb.el8 ceph 2.3 M 2023-05-17T12:21:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 240 k 2023-05-17T12:21:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:18.0.0-3942.g280675bb.el8 ceph 4.6 M 2023-05-17T12:21:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:18.0.0-3942.g280675bb.el8 ceph 18 M 2023-05-17T12:21:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3942.g280675bb.el8 ceph-noarch 15 k 2023-05-17T12:21:46.830 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:18.0.0-3942.g280675bb.el8 ceph 24 k 2023-05-17T12:21:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-05-17T12:21:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-17T12:21:46.831 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-05-17T12:21:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-05-17T12:21:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-05-17T12:21:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:18.0.0-3942.g280675bb.el8 ceph 137 k 2023-05-17T12:21:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-05-17T12:21:46.832 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-05-17T12:21:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-17T12:21:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-05-17T12:21:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-05-17T12:21:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-05-17T12:21:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 473 k 2023-05-17T12:21:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-05-17T12:21:46.833 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:18.0.0-3942.g280675bb.el8 ceph 6.5 M 2023-05-17T12:21:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-05-17T12:21:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-05-17T12:21:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-17T12:21:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-05-17T12:21:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-05-17T12:21:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-05-17T12:21:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-05-17T12:21:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-05-17T12:21:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-05-17T12:21:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-05-17T12:21:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-05-17T12:21:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-05-17T12:21:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-17T12:21:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-05-17T12:21:46.835 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-17T12:21:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-17T12:21:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-17T12:21:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:18.0.0-3942.g280675bb.el8 ceph 45 k 2023-05-17T12:21:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:18.0.0-3942.g280675bb.el8 ceph 119 k 2023-05-17T12:21:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-17T12:21:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-05-17T12:21:46.836 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-17T12:21:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-17T12:21:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-05-17T12:21:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-17T12:21:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-17T12:21:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-17T12:21:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-05-17T12:21:46.837 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-05-17T12:21:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-05-17T12:21:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-05-17T12:21:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-17T12:21:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-17T12:21:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-05-17T12:21:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-05-17T12:21:46.838 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-17T12:21:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-17T12:21:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-05-17T12:21:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-05-17T12:21:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-05-17T12:21:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-17T12:21:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-17T12:21:46.839 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-05-17T12:21:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-05-17T12:21:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-05-17T12:21:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-05-17T12:21:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-05-17T12:21:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-05-17T12:21:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-17T12:21:46.840 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-05-17T12:21:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-17T12:21:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-17T12:21:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-05-17T12:21:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-17T12:21:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-17T12:21:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-17T12:21:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-17T12:21:46.841 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-17T12:21:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-17T12:21:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-17T12:21:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-17T12:21:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-05-17T12:21:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-17T12:21:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-05-17T12:21:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-17T12:21:46.842 INFO:teuthology.orchestra.run.smithi088.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-05-17T12:21:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-05-17T12:21:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-05-17T12:21:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling module streams: 2023-05-17T12:21:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql 10 2023-05-17T12:21:46.843 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:21:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-05-17T12:21:46.843 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================================ 2023-05-17T12:21:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:Install 128 Packages 2023-05-17T12:21:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 5 Packages 2023-05-17T12:21:46.844 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:21:46.844 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 198 M 2023-05-17T12:21:46.845 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-05-17T12:21:47.940 INFO:teuthology.orchestra.run.smithi088.stdout:(1/133): ceph-18.0.0-3942.g280675bb.el8.x86_64. 13 kB/s | 6.4 kB 00:00 2023-05-17T12:21:48.499 INFO:teuthology.orchestra.run.smithi088.stdout:(2/133): ceph-fuse-18.0.0-3942.g280675bb.el8.x8 1.5 MB/s | 849 kB 00:00 2023-05-17T12:21:48.599 INFO:teuthology.orchestra.run.smithi088.stdout:(3/133): ceph-immutable-object-cache-18.0.0-394 1.6 MB/s | 165 kB 00:00 2023-05-17T12:21:49.199 INFO:teuthology.orchestra.run.smithi088.stdout:(4/133): ceph-mds-18.0.0-3942.g280675bb.el8.x86 3.8 MB/s | 2.3 MB 00:00 2023-05-17T12:21:49.616 INFO:teuthology.orchestra.run.smithi088.stdout:(5/133): ceph-mgr-18.0.0-3942.g280675bb.el8.x86 3.7 MB/s | 1.5 MB 00:00 2023-05-17T12:21:50.149 INFO:teuthology.orchestra.run.smithi088.stdout:(6/133): ceph-base-18.0.0-3942.g280675bb.el8.x8 2.0 MB/s | 5.3 MB 00:02 2023-05-17T12:21:50.650 INFO:teuthology.orchestra.run.smithi088.stdout:(7/133): ceph-mon-18.0.0-3942.g280675bb.el8.x86 4.5 MB/s | 4.6 MB 00:01 2023-05-17T12:21:53.624 INFO:teuthology.orchestra.run.smithi088.stdout:(8/133): ceph-radosgw-18.0.0-3942.g280675bb.el8 4.4 MB/s | 13 MB 00:02 2023-05-17T12:21:53.716 INFO:teuthology.orchestra.run.smithi088.stdout:(9/133): ceph-selinux-18.0.0-3942.g280675bb.el8 266 kB/s | 24 kB 00:00 2023-05-17T12:21:55.458 INFO:teuthology.orchestra.run.smithi088.stdout:(10/133): ceph-common-18.0.0-3942.g280675bb.el8 2.7 MB/s | 22 MB 00:08 2023-05-17T12:21:55.633 INFO:teuthology.orchestra.run.smithi088.stdout:(11/133): cephfs-mirror-18.0.0-3942.g280675bb.e 1.4 MB/s | 258 kB 00:00 2023-05-17T12:21:55.733 INFO:teuthology.orchestra.run.smithi088.stdout:(12/133): libcephfs-devel-18.0.0-3942.g280675bb 311 kB/s | 31 kB 00:00 2023-05-17T12:21:56.208 INFO:teuthology.orchestra.run.smithi088.stdout:(13/133): ceph-osd-18.0.0-3942.g280675bb.el8.x8 2.9 MB/s | 18 MB 00:06 2023-05-17T12:21:56.250 INFO:teuthology.orchestra.run.smithi088.stdout:(14/133): libcephfs2-18.0.0-3942.g280675bb.el8. 1.5 MB/s | 771 kB 00:00 2023-05-17T12:21:56.301 INFO:teuthology.orchestra.run.smithi088.stdout:(15/133): libcephsqlite-18.0.0-3942.g280675bb.e 1.5 MB/s | 137 kB 00:00 2023-05-17T12:21:56.426 INFO:teuthology.orchestra.run.smithi088.stdout:(16/133): librados-devel-18.0.0-3942.g280675bb. 793 kB/s | 139 kB 00:00 2023-05-17T12:21:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:(17/133): libradosstriper1-18.0.0-3942.g280675b 1.9 MB/s | 473 kB 00:00 2023-05-17T12:21:56.643 INFO:teuthology.orchestra.run.smithi088.stdout:(18/133): python3-ceph-argparse-18.0.0-3942.g28 447 kB/s | 45 kB 00:00 2023-05-17T12:21:56.768 INFO:teuthology.orchestra.run.smithi088.stdout:(19/133): python3-ceph-common-18.0.0-3942.g2806 950 kB/s | 119 kB 00:00 2023-05-17T12:21:56.869 INFO:teuthology.orchestra.run.smithi088.stdout:(20/133): python3-cephfs-18.0.0-3942.g280675bb. 1.9 MB/s | 197 kB 00:00 2023-05-17T12:21:57.052 INFO:teuthology.orchestra.run.smithi088.stdout:(21/133): python3-rados-18.0.0-3942.g280675bb.e 2.0 MB/s | 371 kB 00:00 2023-05-17T12:21:57.244 INFO:teuthology.orchestra.run.smithi088.stdout:(22/133): python3-rbd-18.0.0-3942.g280675bb.el8 1.9 MB/s | 365 kB 00:00 2023-05-17T12:21:57.345 INFO:teuthology.orchestra.run.smithi088.stdout:(23/133): python3-rgw-18.0.0-3942.g280675bb.el8 1.0 MB/s | 107 kB 00:00 2023-05-17T12:21:57.445 INFO:teuthology.orchestra.run.smithi088.stdout:(24/133): rbd-fuse-18.0.0-3942.g280675bb.el8.x8 946 kB/s | 94 kB 00:00 2023-05-17T12:21:58.862 INFO:teuthology.orchestra.run.smithi088.stdout:(25/133): librgw2-18.0.0-3942.g280675bb.el8.x86 2.7 MB/s | 6.5 MB 00:02 2023-05-17T12:21:58.929 INFO:teuthology.orchestra.run.smithi088.stdout:(26/133): rbd-mirror-18.0.0-3942.g280675bb.el8. 2.3 MB/s | 3.4 MB 00:01 2023-05-17T12:21:59.004 INFO:teuthology.orchestra.run.smithi088.stdout:(27/133): rbd-nbd-18.0.0-3942.g280675bb.el8.x86 1.2 MB/s | 179 kB 00:00 2023-05-17T12:21:59.029 INFO:teuthology.orchestra.run.smithi088.stdout:(28/133): ceph-grafana-dashboards-18.0.0-3942.g 230 kB/s | 23 kB 00:00 2023-05-17T12:21:59.096 INFO:teuthology.orchestra.run.smithi088.stdout:(29/133): ceph-mgr-cephadm-18.0.0-3942.g280675b 1.4 MB/s | 127 kB 00:00 2023-05-17T12:21:59.679 INFO:teuthology.orchestra.run.smithi088.stdout:(30/133): ceph-mgr-dashboard-18.0.0-3942.g28067 2.6 MB/s | 1.7 MB 00:00 2023-05-17T12:21:59.788 INFO:teuthology.orchestra.run.smithi088.stdout:(31/133): ceph-mgr-modules-core-18.0.0-3942.g28 2.2 MB/s | 240 kB 00:00 2023-05-17T12:21:59.913 INFO:teuthology.orchestra.run.smithi088.stdout:(32/133): ceph-mgr-rook-18.0.0-3942.g280675bb.e 380 kB/s | 47 kB 00:00 2023-05-17T12:22:00.014 INFO:teuthology.orchestra.run.smithi088.stdout:(33/133): ceph-prometheus-alerts-18.0.0-3942.g2 145 kB/s | 15 kB 00:00 2023-05-17T12:22:00.180 INFO:teuthology.orchestra.run.smithi088.stdout:(34/133): ceph-volume-18.0.0-3942.g280675bb.el8 1.5 MB/s | 264 kB 00:00 2023-05-17T12:22:00.281 INFO:teuthology.orchestra.run.smithi088.stdout:(35/133): cephadm-18.0.0-3942.g280675bb.el8.noa 835 kB/s | 83 kB 00:00 2023-05-17T12:22:00.381 INFO:teuthology.orchestra.run.smithi088.stdout:(36/133): cephfs-top-18.0.0-3942.g280675bb.el8. 180 kB/s | 18 kB 00:00 2023-05-17T12:22:00.981 INFO:teuthology.orchestra.run.smithi088.stdout:(37/133): ceph-mgr-diskprediction-local-18.0.0- 3.9 MB/s | 7.4 MB 00:01 2023-05-17T12:22:01.398 INFO:teuthology.orchestra.run.smithi088.stdout:(38/133): ceph-test-18.0.0-3942.g280675bb.el8.x 5.3 MB/s | 41 MB 00:07 2023-05-17T12:22:01.590 INFO:teuthology.orchestra.run.smithi088.stdout:(39/133): automake-1.16.1-7.el8.noarch.rpm 590 kB/s | 713 kB 00:01 2023-05-17T12:22:02.382 INFO:teuthology.orchestra.run.smithi088.stdout:(40/133): jq-1.6-7.el8.x86_64.rpm 256 kB/s | 202 kB 00:00 2023-05-17T12:22:02.566 INFO:teuthology.orchestra.run.smithi088.stdout:(41/133): flex-2.6.1-9.el8.x86_64.rpm 274 kB/s | 320 kB 00:01 2023-05-17T12:22:02.732 INFO:teuthology.orchestra.run.smithi088.stdout:(42/133): bison-3.0.4-10.el8.x86_64.rpm 393 kB/s | 688 kB 00:01 2023-05-17T12:22:03.349 INFO:teuthology.orchestra.run.smithi088.stdout:(43/133): libpq-13.5-1.el8.x86_64.rpm 204 kB/s | 198 kB 00:00 2023-05-17T12:22:03.791 INFO:teuthology.orchestra.run.smithi088.stdout:(44/133): librdkafka-0.11.4-3.el8.x86_64.rpm 289 kB/s | 354 kB 00:01 2023-05-17T12:22:04.141 INFO:teuthology.orchestra.run.smithi088.stdout:(45/133): libtool-2.4.6-25.el8.x86_64.rpm 503 kB/s | 709 kB 00:01 2023-05-17T12:22:04.325 INFO:teuthology.orchestra.run.smithi088.stdout:(46/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 266 kB/s | 259 kB 00:00 2023-05-17T12:22:04.825 INFO:teuthology.orchestra.run.smithi088.stdout:(47/133): oniguruma-6.8.2-2.el8.x86_64.rpm 181 kB/s | 187 kB 00:01 2023-05-17T12:22:06.509 INFO:teuthology.orchestra.run.smithi088.stdout:(48/133): postgresql-10.23-1.module_el8+300+2c5 951 kB/s | 1.6 MB 00:01 2023-05-17T12:22:06.950 INFO:teuthology.orchestra.run.smithi088.stdout:(49/133): openblas-threads-0.3.15-4.el8.x86_64. 1.8 MB/s | 4.9 MB 00:02 2023-05-17T12:22:07.076 INFO:teuthology.orchestra.run.smithi088.stdout:(50/133): openblas-0.3.15-4.el8.x86_64.rpm 1.6 MB/s | 4.7 MB 00:02 2023-05-17T12:22:08.434 INFO:teuthology.orchestra.run.smithi088.stdout:(51/133): postgresql-contrib-10.23-1.module_el8 469 kB/s | 903 kB 00:01 2023-05-17T12:22:09.426 INFO:teuthology.orchestra.run.smithi088.stdout:(52/133): postgresql-server-10.23-1.module_el8+ 2.1 MB/s | 5.1 MB 00:02 2023-05-17T12:22:09.584 INFO:teuthology.orchestra.run.smithi088.stdout:(53/133): python3-babel-2.5.1-7.el8.noarch.rpm 1.9 MB/s | 4.8 MB 00:02 2023-05-17T12:22:09.610 INFO:teuthology.orchestra.run.smithi088.stdout:(54/133): python3-jinja2-2.10.1-3.el8.noarch.rp 458 kB/s | 538 kB 00:01 2023-05-17T12:22:09.685 INFO:teuthology.orchestra.run.smithi088.stdout:(55/133): python3-jsonpatch-1.21-2.el8.noarch.r 103 kB/s | 27 kB 00:00 2023-05-17T12:22:09.760 INFO:teuthology.orchestra.run.smithi088.stdout:(56/133): python3-jsonpointer-1.10-11.el8.noarc 114 kB/s | 20 kB 00:00 2023-05-17T12:22:10.169 INFO:teuthology.orchestra.run.smithi088.stdout:(57/133): python3-markupsafe-0.23-19.el8.x86_64 80 kB/s | 39 kB 00:00 2023-05-17T12:22:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:(58/133): python3-mako-1.0.6-14.el8.noarch.rpm 196 kB/s | 157 kB 00:00 2023-05-17T12:22:10.894 INFO:teuthology.orchestra.run.smithi088.stdout:(59/133): python3-prettytable-0.7.2-14.el8.noar 91 kB/s | 44 kB 00:00 2023-05-17T12:22:11.036 INFO:teuthology.orchestra.run.smithi088.stdout:(60/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 260 kB/s | 225 kB 00:00 2023-05-17T12:22:11.620 INFO:teuthology.orchestra.run.smithi088.stdout:(61/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 143 kB/s | 103 kB 00:00 2023-05-17T12:22:11.895 INFO:teuthology.orchestra.run.smithi088.stdout:(62/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 147 kB/s | 126 kB 00:00 2023-05-17T12:22:12.154 INFO:teuthology.orchestra.run.smithi088.stdout:(63/133): python3-numpy-1.14.3-10.el8.x86_64.rp 1.6 MB/s | 3.7 MB 00:02 2023-05-17T12:22:12.271 INFO:teuthology.orchestra.run.smithi088.stdout:(64/133): python3-pyasn1-modules-0.3.7-6.el8.no 169 kB/s | 110 kB 00:00 2023-05-17T12:22:12.312 INFO:teuthology.orchestra.run.smithi088.stdout:(65/133): python3-pytz-2017.2-9.el8.noarch.rpm 130 kB/s | 54 kB 00:00 2023-05-17T12:22:13.246 INFO:teuthology.orchestra.run.smithi088.stdout:(66/133): socat-1.7.4.1-1.el8.x86_64.rpm 346 kB/s | 323 kB 00:00 2023-05-17T12:22:13.579 INFO:teuthology.orchestra.run.smithi088.stdout:(67/133): python3-werkzeug-0.12.2-4.el8.noarch. 350 kB/s | 457 kB 00:01 2023-05-17T12:22:13.730 INFO:teuthology.orchestra.run.smithi088.stdout:(68/133): uuid-1.6.2-43.el8.x86_64.rpm 132 kB/s | 64 kB 00:00 2023-05-17T12:22:14.071 INFO:teuthology.orchestra.run.smithi088.stdout:(69/133): elfutils-libelf-devel-0.189-2.el8.x86 180 kB/s | 61 kB 00:00 2023-05-17T12:22:14.122 INFO:teuthology.orchestra.run.smithi088.stdout:(70/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 130 kB/s | 71 kB 00:00 2023-05-17T12:22:14.239 INFO:teuthology.orchestra.run.smithi088.stdout:(71/133): fuse-2.9.7-17.el8.x86_64.rpm 497 kB/s | 83 kB 00:00 2023-05-17T12:22:14.522 INFO:teuthology.orchestra.run.smithi088.stdout:(72/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 120 kB/s | 48 kB 00:00 2023-05-17T12:22:14.798 INFO:teuthology.orchestra.run.smithi088.stdout:(73/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 68 kB/s | 19 kB 00:00 2023-05-17T12:22:14.840 INFO:teuthology.orchestra.run.smithi088.stdout:(74/133): krb5-devel-1.18.2-22.el8.x86_64.rpm 934 kB/s | 561 kB 00:00 2023-05-17T12:22:14.990 INFO:teuthology.orchestra.run.smithi088.stdout:(75/133): libcom_err-devel-1.45.6-5.el8.x86_64. 202 kB/s | 39 kB 00:00 2023-05-17T12:22:15.423 INFO:teuthology.orchestra.run.smithi088.stdout:(76/133): libgfortran-8.5.0-19.el8.x86_64.rpm 1.1 MB/s | 645 kB 00:00 2023-05-17T12:22:15.515 INFO:teuthology.orchestra.run.smithi088.stdout:(77/133): libquadmath-8.5.0-19.el8.x86_64.rpm 328 kB/s | 172 kB 00:00 2023-05-17T12:22:15.582 INFO:teuthology.orchestra.run.smithi088.stdout:(78/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 295 kB/s | 47 kB 00:00 2023-05-17T12:22:15.941 INFO:teuthology.orchestra.run.smithi088.stdout:(79/133): libselinux-devel-2.9-8.el8.x86_64.rpm 471 kB/s | 200 kB 00:00 2023-05-17T12:22:15.991 INFO:teuthology.orchestra.run.smithi088.stdout:(80/133): libsepol-devel-2.9-3.el8.x86_64.rpm 213 kB/s | 87 kB 00:00 2023-05-17T12:22:16.233 INFO:teuthology.orchestra.run.smithi088.stdout:(81/133): libuuid-devel-2.32.1-41.el8.x86_64.rp 340 kB/s | 99 kB 00:00 2023-05-17T12:22:16.509 INFO:teuthology.orchestra.run.smithi088.stdout:(82/133): python3-scipy-1.0.0-21.module_el8.5.0 3.1 MB/s | 14 MB 00:04 2023-05-17T12:22:16.526 INFO:teuthology.orchestra.run.smithi088.stdout:(83/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 34 kB/s | 18 kB 00:00 2023-05-17T12:22:16.567 INFO:teuthology.orchestra.run.smithi088.stdout:(84/133): libzstd-devel-1.4.4-1.el8.x86_64.rpm 131 kB/s | 44 kB 00:00 2023-05-17T12:22:17.026 INFO:teuthology.orchestra.run.smithi088.stdout:(85/133): pcre2-devel-10.32-3.el8.x86_64.rpm 1.2 MB/s | 605 kB 00:00 2023-05-17T12:22:17.143 INFO:teuthology.orchestra.run.smithi088.stdout:(86/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 398 kB/s | 229 kB 00:00 2023-05-17T12:22:17.460 INFO:teuthology.orchestra.run.smithi088.stdout:(87/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 509 kB/s | 220 kB 00:00 2023-05-17T12:22:17.669 INFO:teuthology.orchestra.run.smithi088.stdout:(88/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 452 kB/s | 237 kB 00:00 2023-05-17T12:22:17.861 INFO:teuthology.orchestra.run.smithi088.stdout:(89/133): python3-cryptography-3.2.1-5.el8.x86_ 1.4 MB/s | 559 kB 00:00 2023-05-17T12:22:17.969 INFO:teuthology.orchestra.run.smithi088.stdout:(90/133): python3-jwt-1.6.1-2.el8.noarch.rpm 142 kB/s | 43 kB 00:00 2023-05-17T12:22:18.169 INFO:teuthology.orchestra.run.smithi088.stdout:(91/133): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.9 MB/s | 3.2 MB 00:01 2023-05-17T12:22:18.195 INFO:teuthology.orchestra.run.smithi088.stdout:(92/133): python3-oauthlib-2.1.0-1.el8.noarch.r 464 kB/s | 155 kB 00:00 2023-05-17T12:22:18.445 INFO:teuthology.orchestra.run.smithi088.stdout:(93/133): python3-pycparser-2.14-14.el8.noarch. 229 kB/s | 109 kB 00:00 2023-05-17T12:22:18.587 INFO:teuthology.orchestra.run.smithi088.stdout:(94/133): python3-requests-oauthlib-1.0.0-1.el8 102 kB/s | 43 kB 00:00 2023-05-17T12:22:18.795 INFO:teuthology.orchestra.run.smithi088.stdout:(95/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 120 kB/s | 72 kB 00:00 2023-05-17T12:22:18.971 INFO:teuthology.orchestra.run.smithi088.stdout:(96/133): zlib-devel-1.2.11-21.el8.x86_64.rpm 110 kB/s | 58 kB 00:00 2023-05-17T12:22:19.238 INFO:teuthology.orchestra.run.smithi088.stdout:(97/133): liboath-2.6.2-3.el8.x86_64.rpm 133 kB/s | 59 kB 00:00 2023-05-17T12:22:19.280 INFO:teuthology.orchestra.run.smithi088.stdout:(98/133): gperftools-libs-2.7-9.el8.x86_64.rpm 442 kB/s | 306 kB 00:00 2023-05-17T12:22:19.405 INFO:teuthology.orchestra.run.smithi088.stdout:(99/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 349 kB/s | 44 kB 00:00 2023-05-17T12:22:19.455 INFO:teuthology.orchestra.run.smithi088.stdout:(100/133): libunwind-1.3.1-3.el8.x86_64.rpm 155 kB/s | 75 kB 00:00 2023-05-17T12:22:19.555 INFO:teuthology.orchestra.run.smithi088.stdout:(101/133): python3-beautifulsoup4-4.6.3-2.el8.1 1.2 MB/s | 185 kB 00:00 2023-05-17T12:22:19.606 INFO:teuthology.orchestra.run.smithi088.stdout:(102/133): python3-cachetools-3.1.1-4.el8.noarc 220 kB/s | 33 kB 00:00 2023-05-17T12:22:19.639 INFO:teuthology.orchestra.run.smithi088.stdout:(103/133): python3-asyncssh-2.7.0-2.el8.noarch. 1.2 MB/s | 476 kB 00:00 2023-05-17T12:22:19.664 INFO:teuthology.orchestra.run.smithi088.stdout:(104/133): python3-certifi-2018.10.15-7.el8.noa 150 kB/s | 16 kB 00:00 2023-05-17T12:22:19.731 INFO:teuthology.orchestra.run.smithi088.stdout:(105/133): python3-cheroot-8.5.2-1.el8.noarch.r 1.3 MB/s | 173 kB 00:00 2023-05-17T12:22:19.807 INFO:teuthology.orchestra.run.smithi088.stdout:(106/133): python3-google-auth-1.1.1-10.el8.noa 572 kB/s | 81 kB 00:00 2023-05-17T12:22:19.849 INFO:teuthology.orchestra.run.smithi088.stdout:(107/133): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-05-17T12:22:19.916 INFO:teuthology.orchestra.run.smithi088.stdout:(108/133): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2023-05-17T12:22:19.976 INFO:teuthology.orchestra.run.smithi088.stdout:(109/133): python3-cherrypy-18.4.0-1.el8.noarch 1.1 MB/s | 384 kB 00:00 2023-05-17T12:22:20.050 INFO:teuthology.orchestra.run.smithi088.stdout:(110/133): python3-logutils-0.3.5-11.el8.noarch 365 kB/s | 49 kB 00:00 2023-05-17T12:22:20.109 INFO:teuthology.orchestra.run.smithi088.stdout:(111/133): python3-more-itertools-7.2.0-3.el8.n 444 kB/s | 59 kB 00:00 2023-05-17T12:22:20.142 INFO:teuthology.orchestra.run.smithi088.stdout:(112/133): python3-kubernetes-11.0.0-6.el8.noar 4.0 MB/s | 1.2 MB 00:00 2023-05-17T12:22:20.167 INFO:teuthology.orchestra.run.smithi088.stdout:(113/133): python3-natsort-7.1.1-2.el8.noarch.r 514 kB/s | 60 kB 00:00 2023-05-17T12:22:20.242 INFO:teuthology.orchestra.run.smithi088.stdout:(114/133): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-05-17T12:22:20.268 INFO:teuthology.orchestra.run.smithi088.stdout:(115/133): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-05-17T12:22:20.293 INFO:teuthology.orchestra.run.smithi088.stdout:(116/133): python3-repoze-lru-0.7-6.el8.noarch. 268 kB/s | 34 kB 00:00 2023-05-17T12:22:20.352 INFO:teuthology.orchestra.run.smithi088.stdout:(117/133): python3-routes-2.4.1-12.el8.noarch.r 1.8 MB/s | 196 kB 00:00 2023-05-17T12:22:20.377 INFO:teuthology.orchestra.run.smithi088.stdout:(118/133): python3-rsa-4.8-1.el8.noarch.rpm 565 kB/s | 61 kB 00:00 2023-05-17T12:22:20.402 INFO:teuthology.orchestra.run.smithi088.stdout:(119/133): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-05-17T12:22:20.452 INFO:teuthology.orchestra.run.smithi088.stdout:(120/133): python3-singledispatch-3.4.0.3-18.el 238 kB/s | 24 kB 00:00 2023-05-17T12:22:20.478 INFO:teuthology.orchestra.run.smithi088.stdout:(121/133): python3-tempora-1.14.1-5.el8.noarch. 291 kB/s | 29 kB 00:00 2023-05-17T12:22:20.503 INFO:teuthology.orchestra.run.smithi088.stdout:(122/133): python3-trustme-0.6.0-4.el8.noarch.r 274 kB/s | 27 kB 00:00 2023-05-17T12:22:20.562 INFO:teuthology.orchestra.run.smithi088.stdout:(123/133): python3-waitress-1.2.1-2.el8.1.noarc 2.2 MB/s | 241 kB 00:00 2023-05-17T12:22:20.612 INFO:teuthology.orchestra.run.smithi088.stdout:(124/133): python3-webob-1.8.5-1.el8.1.noarch.r 1.8 MB/s | 251 kB 00:00 2023-05-17T12:22:20.637 INFO:teuthology.orchestra.run.smithi088.stdout:(125/133): python3-websocket-client-0.56.0-5.el 457 kB/s | 61 kB 00:00 2023-05-17T12:22:20.663 INFO:teuthology.orchestra.run.smithi088.stdout:(126/133): python3-webtest-2.0.33-1.el8.noarch. 852 kB/s | 85 kB 00:00 2023-05-17T12:22:20.713 INFO:teuthology.orchestra.run.smithi088.stdout:(127/133): python3-zc-lockfile-2.0-2.el8.noarch 228 kB/s | 23 kB 00:00 2023-05-17T12:22:20.938 INFO:teuthology.orchestra.run.smithi088.stdout:(128/133): thrift-0.13.0-2.el8.x86_64.rpm 5.8 MB/s | 1.7 MB 00:00 2023-05-17T12:22:21.172 INFO:teuthology.orchestra.run.smithi088.stdout:(129/133): elfutils-debuginfod-client-0.189-2.e 325 kB/s | 76 kB 00:00 2023-05-17T12:22:21.406 INFO:teuthology.orchestra.run.smithi088.stdout:(130/133): elfutils-libelf-0.189-2.el8.x86_64.r 997 kB/s | 232 kB 00:00 2023-05-17T12:22:21.506 INFO:teuthology.orchestra.run.smithi088.stdout:(131/133): elfutils-libs-0.189-2.el8.x86_64.rpm 3.0 MB/s | 302 kB 00:00 2023-05-17T12:22:22.147 INFO:teuthology.orchestra.run.smithi088.stdout:(132/133): librados2-18.0.0-3942.g280675bb.el8. 2.5 MB/s | 3.7 MB 00:01 2023-05-17T12:22:22.831 INFO:teuthology.orchestra.run.smithi088.stdout:(133/133): librbd1-18.0.0-3942.g280675bb.el8.x8 1.7 MB/s | 3.6 MB 00:02 2023-05-17T12:22:22.836 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-05-17T12:22:22.837 INFO:teuthology.orchestra.run.smithi088.stdout:Total 5.5 MB/s | 198 MB 00:36 2023-05-17T12:22:24.227 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-05-17T12:22:24.482 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-05-17T12:22:24.482 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-05-17T12:22:26.397 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-05-17T12:22:26.401 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-05-17T12:22:31.297 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-05-17T12:22:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/138 2023-05-17T12:22:31.776 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2023-05-17T12:22:32.000 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/138 2023-05-17T12:22:32.213 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-17T12:22:32.680 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-17T12:22:32.888 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:18.0.0-3942.g280675bb.el8.x86_64 5/138 2023-05-17T12:22:33.345 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:18.0.0-3942.g280675bb.el8.x86_64 5/138 2023-05-17T12:22:33.524 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:18.0.0-3942.g280675bb.el8.x86_64 6/138 2023-05-17T12:22:33.661 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:18.0.0-3942.g280675bb.el8.x86_64 6/138 2023-05-17T12:22:33.879 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:18.0.0-3942.g280675bb.el8.x86_64 7/138 2023-05-17T12:22:33.981 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:18.0.0-3942.g280675bb.el8.x86_64 7/138 2023-05-17T12:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:18.0.0-3942.g280675bb.el8.x86_64 8/138 2023-05-17T12:22:34.362 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-17T12:22:34.484 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-17T12:22:34.692 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 10/138 2023-05-17T12:22:34.970 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/138 2023-05-17T12:22:35.242 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2023-05-17T12:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpq-13.5-1.el8.x86_64 13/138 2023-05-17T12:22:35.967 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 14/138 2023-05-17T12:22:36.120 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:18.0.0-3942.g280675bb.el8.x86_64 15/138 2023-05-17T12:22:36.231 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3942.g280675bb.el8.x86_64 15/138 2023-05-17T12:22:36.395 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:18.0.0-3942.g280675bb.el8.x86 16/138 2023-05-17T12:22:36.540 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3942.g280675bb.el8.x86 16/138 2023-05-17T12:22:36.753 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/138 2023-05-17T12:22:36.949 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 18/138 2023-05-17T12:22:37.103 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-17T12:22:37.240 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-17T12:22:37.395 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-17T12:22:38.084 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-17T12:22:38.270 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/138 2023-05-17T12:22:38.960 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/138 2023-05-17T12:22:39.103 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-17T12:22:39.933 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-17T12:22:40.314 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/138 2023-05-17T12:22:40.495 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/138 2023-05-17T12:22:40.660 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/138 2023-05-17T12:22:40.922 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/138 2023-05-17T12:22:41.126 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:18.0.0-3942.g280675bb.el8. 27/138 2023-05-17T12:22:41.265 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:18.0.0-3942.g280675bb.el 28/138 2023-05-17T12:22:41.478 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:18.0.0-3942.g280675bb.el8.x86_6 29/138 2023-05-17T12:22:42.594 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 30/138 2023-05-17T12:22:42.978 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2023-05-17T12:22:43.272 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2023-05-17T12:22:43.494 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-17T12:22:45.576 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-17T12:22:45.964 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/138 2023-05-17T12:22:46.152 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/138 2023-05-17T12:22:46.371 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2023-05-17T12:22:46.575 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 37/138 2023-05-17T12:22:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 38/138 2023-05-17T12:22:46.993 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:18.0.0-3942.g280675bb.el8.x86_64 39/138 2023-05-17T12:22:47.170 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:18.0.0-3942.g280675bb.el8.x86_6 40/138 2023-05-17T12:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/138 2023-05-17T12:22:47.589 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/138 2023-05-17T12:22:47.843 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/138 2023-05-17T12:22:47.981 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/138 2023-05-17T12:22:48.130 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/138 2023-05-17T12:22:48.307 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/138 2023-05-17T12:22:48.517 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/138 2023-05-17T12:22:48.715 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/138 2023-05-17T12:22:48.880 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/138 2023-05-17T12:22:49.033 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/138 2023-05-17T12:22:49.207 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2023-05-17T12:22:49.374 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/138 2023-05-17T12:22:49.551 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/138 2023-05-17T12:22:49.714 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/138 2023-05-17T12:22:49.947 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/138 2023-05-17T12:22:50.183 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/138 2023-05-17T12:22:50.376 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/138 2023-05-17T12:22:50.716 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/138 2023-05-17T12:22:50.969 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/138 2023-05-17T12:22:51.222 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/138 2023-05-17T12:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/138 2023-05-17T12:22:52.242 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:18.0.0-3942.g280675bb.el8.x86_64 62/138 2023-05-17T12:22:52.331 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:18.0.0-3942.g280675bb.el8.x86_64 62/138 2023-05-17T12:22:52.561 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:18.0.0-3942.g280675bb.el8.x86_64 63/138 2023-05-17T12:22:52.795 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/138 2023-05-17T12:22:53.201 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/138 2023-05-17T12:22:53.440 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/138 2023-05-17T12:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/138 2023-05-17T12:22:53.871 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/138 2023-05-17T12:22:54.102 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/138 2023-05-17T12:22:55.425 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/138 2023-05-17T12:22:55.830 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/138 2023-05-17T12:22:56.034 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/138 2023-05-17T12:22:56.252 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/138 2023-05-17T12:22:56.596 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/138 2023-05-17T12:22:56.858 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/138 2023-05-17T12:22:57.170 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/138 2023-05-17T12:22:57.379 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/138 2023-05-17T12:22:57.742 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/138 2023-05-17T12:22:58.005 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/138 2023-05-17T12:22:58.168 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 80/138 2023-05-17T12:22:58.361 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 81/138 2023-05-17T12:22:58.518 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-17T12:22:58.875 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/138 2023-05-17T12:22:59.105 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 84/138 2023-05-17T12:22:59.289 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 85/138 2023-05-17T12:22:59.517 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/138 2023-05-17T12:22:59.726 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 87/138 2023-05-17T12:22:59.927 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-17.el8.x86_64 88/138 2023-05-17T12:23:00.118 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 89/138 2023-05-17T12:23:00.285 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : uuid-1.6.2-43.el8.x86_64 90/138 2023-05-17T12:23:00.410 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 90/138 2023-05-17T12:23:00.625 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 91/138 2023-05-17T12:23:00.780 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 92/138 2023-05-17T12:23:03.850 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 93/138 2023-05-17T12:23:04.082 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 93/138 2023-05-17T12:23:04.765 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 93/138 2023-05-17T12:23:05.063 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:18.0.0-3942.g280675bb.el8.x86_64 94/138 2023-05-17T12:23:05.194 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:18.0.0-3942.g280675bb.el8.x86_64 94/138 2023-05-17T12:23:05.364 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:18.0.0-3942.g280675bb.el8.x86_64 95/138 2023-05-17T12:23:25.789 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3942.g280675bb.el8.x86_64 95/138 2023-05-17T12:23:25.789 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2023-05-17T12:23:25.789 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2023-05-17T12:23:25.790 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-05-17T12:23:25.790 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2023-05-17T12:23:25.790 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2023-05-17T12:23:25.790 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2023-05-17T12:23:25.790 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2023-05-17T12:23:25.790 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2023-05-17T12:23:25.790 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-05-17T12:23:25.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:26.193 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:18.0.0-3942.g280675bb.el8.noarch 96/138 2023-05-17T12:23:27.908 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:18.0.0-3942.g280675bb.el8.noarch 96/138 2023-05-17T12:23:28.108 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:18.0.0-3942.g280675bb.el8.x86_64 97/138 2023-05-17T12:23:28.377 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:18.0.0-3942.g280675bb.el8.x86_64 97/138 2023-05-17T12:23:28.567 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:18.0.0-3942.g280675bb.el8.x86_64 98/138 2023-05-17T12:23:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:18.0.0-3942.g280675bb.el8.x86_64 98/138 2023-05-17T12:23:29.317 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:18.0.0-3942.g280675bb.el8.x86_64 99/138 2023-05-17T12:23:29.363 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:18.0.0-3942.g280675bb.el8.x86_64 99/138 2023-05-17T12:23:29.542 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/138 2023-05-17T12:23:29.773 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/138 2023-05-17T12:23:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-17T12:23:30.016 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-17T12:23:30.295 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-7.el8.x86_64 103/138 2023-05-17T12:23:30.517 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.1-7.el8.noarch 104/138 2023-05-17T12:23:31.105 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.0.0-3942.g280675bb.el8.noarch 105/138 2023-05-17T12:23:31.269 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:18.0.0-3942.g280675bb.el8.noarch 105/138 2023-05-17T12:23:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3942.g280675bb.e 106/138 2023-05-17T12:23:31.595 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3942.g280675bb. 107/138 2023-05-17T12:23:31.808 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3942.g280675bb.el8.noa 108/138 2023-05-17T12:23:32.059 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3942.g280675bb.el8.noa 108/138 2023-05-17T12:23:32.257 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3942.g280675bb.el8.n 109/138 2023-05-17T12:23:33.360 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3942.g280675bb.el8.n 109/138 2023-05-17T12:23:33.541 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3942.g280 110/138 2023-05-17T12:23:33.666 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3942.g280 110/138 2023-05-17T12:23:34.057 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3942.g280675bb.el 111/138 2023-05-17T12:23:34.290 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:18.0.0-3942.g280675bb.el8.x86_64 112/138 2023-05-17T12:23:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3942.g280675bb.el8.x86_64 112/138 2023-05-17T12:23:34.532 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:18.0.0-3942.g280675bb.el8.noarch 113/138 2023-05-17T12:23:34.556 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3942.g280675bb.el8.noarch 113/138 2023-05-17T12:23:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:18.0.0-3942.g280675bb.el8.x86_64 114/138 2023-05-17T12:23:34.915 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/138 2023-05-17T12:23:39.206 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/138 2023-05-17T12:23:40.693 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:18.0.0-3942.g280675bb.el8.x86_64 116/138 2023-05-17T12:23:40.897 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:18.0.0-3942.g280675bb.el8.x86_64 117/138 2023-05-17T12:23:40.954 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3942.g280675bb.el8.x86_64 117/138 2023-05-17T12:23:41.131 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3942.g28067 118/138 2023-05-17T12:23:41.197 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3942.g28067 118/138 2023-05-17T12:23:41.389 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 119/138 2023-05-17T12:23:41.791 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 119/138 2023-05-17T12:23:42.014 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 120/138 2023-05-17T12:23:42.305 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 120/138 2023-05-17T12:23:42.611 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 121/138 2023-05-17T12:23:43.808 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 122/138 2023-05-17T12:23:44.119 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 123/138 2023-05-17T12:23:44.277 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 124/138 2023-05-17T12:23:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 125/138 2023-05-17T12:23:44.640 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:18.0.0-3942.g280675bb.el8.x86_ 126/138 2023-05-17T12:23:45.819 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-17T12:23:46.064 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-17T12:23:46.095 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-17T12:23:46.289 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-top-2:18.0.0-3942.g280675bb.el8.noarch 128/138 2023-05-17T12:23:46.481 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 129/138 2023-05-17T12:23:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:18.0.0-3942.g280675bb.el8.x86_64 130/138 2023-05-17T12:23:46.902 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2023-05-17T12:23:47.112 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2023-05-17T12:23:47.222 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2023-05-17T12:23:47.429 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2023-05-17T12:23:47.453 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2023-05-17T12:23:47.634 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-17T12:23:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 135/138 2023-05-17T12:23:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-17T12:23:48.052 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-17T12:23:48.052 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-17T12:23:48.299 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-17T12:23:48.514 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-17T12:23:48.703 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-17T12:23:48.703 INFO:teuthology.orchestra.run.smithi088.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-17T12:23:48.703 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:49.426 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:18.0.0-3942.g280675bb.el8.x86_64 1/138 2023-05-17T12:23:49.427 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:18.0.0-3942.g280675bb.el8.x86_64 2/138 2023-05-17T12:23:49.427 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 3/138 2023-05-17T12:23:49.427 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 4/138 2023-05-17T12:23:49.427 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3942.g28067 5/138 2023-05-17T12:23:49.427 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:18.0.0-3942.g280675bb.el8.x86_64 6/138 2023-05-17T12:23:49.428 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:18.0.0-3942.g280675bb.el8.x86_64 7/138 2023-05-17T12:23:49.428 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:18.0.0-3942.g280675bb.el8.x86_64 8/138 2023-05-17T12:23:49.428 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:18.0.0-3942.g280675bb.el8.x86_64 9/138 2023-05-17T12:23:49.428 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:18.0.0-3942.g280675bb.el8.x86_64 10/138 2023-05-17T12:23:49.428 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:18.0.0-3942.g280675bb.el8.x86_64 11/138 2023-05-17T12:23:49.428 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:18.0.0-3942.g280675bb.el8.x86_64 12/138 2023-05-17T12:23:49.429 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 13/138 2023-05-17T12:23:49.429 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:18.0.0-3942.g280675bb.el8.x86_ 14/138 2023-05-17T12:23:49.429 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:18.0.0-3942.g280675bb.el8.x86_64 15/138 2023-05-17T12:23:49.429 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:18.0.0-3942.g280675bb.el8.x86_64 16/138 2023-05-17T12:23:49.429 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:18.0.0-3942.g280675bb.el8.x86_6 17/138 2023-05-17T12:23:49.429 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:18.0.0-3942.g280675bb.el8.x86 18/138 2023-05-17T12:23:49.429 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:18.0.0-3942.g280675bb.el8.x86_64 19/138 2023-05-17T12:23:49.430 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3942.g280675bb.el 20/138 2023-05-17T12:23:49.430 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:18.0.0-3942.g280675bb.el8. 21/138 2023-05-17T12:23:49.430 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:18.0.0-3942.g280675bb.el8.x86_6 22/138 2023-05-17T12:23:49.430 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:18.0.0-3942.g280675bb.el8.x86_64 23/138 2023-05-17T12:23:49.430 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:18.0.0-3942.g280675bb.el8.x86_64 24/138 2023-05-17T12:23:49.430 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:18.0.0-3942.g280675bb.el8.x86_64 25/138 2023-05-17T12:23:49.431 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 26/138 2023-05-17T12:23:49.431 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 27/138 2023-05-17T12:23:49.431 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:18.0.0-3942.g280675bb.el8.x86_64 28/138 2023-05-17T12:23:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3942.g280675bb. 29/138 2023-05-17T12:23:49.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3942.g280675bb.el8.noa 30/138 2023-05-17T12:23:49.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3942.g280675bb.el8.n 31/138 2023-05-17T12:23:49.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3942.g280 32/138 2023-05-17T12:23:49.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3942.g280675bb.el 33/138 2023-05-17T12:23:49.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3942.g280675bb.el8.noarch 34/138 2023-05-17T12:23:49.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3942.g280675bb.e 35/138 2023-05-17T12:23:49.439 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:18.0.0-3942.g280675bb.el8.noarch 36/138 2023-05-17T12:23:49.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:18.0.0-3942.g280675bb.el8.noarch 37/138 2023-05-17T12:23:49.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-top-2:18.0.0-3942.g280675bb.el8.noarch 38/138 2023-05-17T12:23:49.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/138 2023-05-17T12:23:49.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/138 2023-05-17T12:23:49.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/138 2023-05-17T12:23:49.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-7.el8.x86_64 42/138 2023-05-17T12:23:49.440 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/138 2023-05-17T12:23:49.441 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/138 2023-05-17T12:23:49.441 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/138 2023-05-17T12:23:49.441 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/138 2023-05-17T12:23:49.441 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/138 2023-05-17T12:23:49.441 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/138 2023-05-17T12:23:49.441 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/138 2023-05-17T12:23:49.441 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/138 2023-05-17T12:23:49.442 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/138 2023-05-17T12:23:49.442 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/138 2023-05-17T12:23:49.442 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/138 2023-05-17T12:23:49.442 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/138 2023-05-17T12:23:49.442 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/138 2023-05-17T12:23:49.442 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/138 2023-05-17T12:23:49.442 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/138 2023-05-17T12:23:49.442 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/138 2023-05-17T12:23:49.443 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/138 2023-05-17T12:23:49.443 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/138 2023-05-17T12:23:49.443 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/138 2023-05-17T12:23:49.443 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/138 2023-05-17T12:23:49.443 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/138 2023-05-17T12:23:49.444 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/138 2023-05-17T12:23:49.444 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/138 2023-05-17T12:23:49.444 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/138 2023-05-17T12:23:49.444 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/138 2023-05-17T12:23:49.444 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/138 2023-05-17T12:23:49.444 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/138 2023-05-17T12:23:49.444 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/138 2023-05-17T12:23:49.445 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/138 2023-05-17T12:23:49.445 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/138 2023-05-17T12:23:49.445 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2023-05-17T12:23:49.445 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/138 2023-05-17T12:23:49.445 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/138 2023-05-17T12:23:49.445 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/138 2023-05-17T12:23:49.445 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/138 2023-05-17T12:23:49.445 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/138 2023-05-17T12:23:49.446 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/138 2023-05-17T12:23:49.446 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/138 2023-05-17T12:23:49.446 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/138 2023-05-17T12:23:49.446 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-17T12:23:49.446 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/138 2023-05-17T12:23:49.446 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/138 2023-05-17T12:23:49.447 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/138 2023-05-17T12:23:49.447 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/138 2023-05-17T12:23:49.447 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/138 2023-05-17T12:23:49.447 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/138 2023-05-17T12:23:49.447 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/138 2023-05-17T12:23:49.447 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/138 2023-05-17T12:23:49.447 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/138 2023-05-17T12:23:49.448 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/138 2023-05-17T12:23:49.448 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/138 2023-05-17T12:23:49.448 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/138 2023-05-17T12:23:49.448 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 95/138 2023-05-17T12:23:49.448 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/138 2023-05-17T12:23:49.448 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/138 2023-05-17T12:23:49.448 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/138 2023-05-17T12:23:49.448 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/138 2023-05-17T12:23:49.449 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/138 2023-05-17T12:23:49.449 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/138 2023-05-17T12:23:49.449 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/138 2023-05-17T12:23:49.449 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/138 2023-05-17T12:23:49.449 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/138 2023-05-17T12:23:49.449 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/138 2023-05-17T12:23:49.449 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/138 2023-05-17T12:23:49.449 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/138 2023-05-17T12:23:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/138 2023-05-17T12:23:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/138 2023-05-17T12:23:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/138 2023-05-17T12:23:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/138 2023-05-17T12:23:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/138 2023-05-17T12:23:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/138 2023-05-17T12:23:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/138 2023-05-17T12:23:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/138 2023-05-17T12:23:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/138 2023-05-17T12:23:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/138 2023-05-17T12:23:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/138 2023-05-17T12:23:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/138 2023-05-17T12:23:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/138 2023-05-17T12:23:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/138 2023-05-17T12:23:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/138 2023-05-17T12:23:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/138 2023-05-17T12:23:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/138 2023-05-17T12:23:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/138 2023-05-17T12:23:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/138 2023-05-17T12:23:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/138 2023-05-17T12:23:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/138 2023-05-17T12:23:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:18.0.0-3942.g280675bb.el8.x86_64 129/138 2023-05-17T12:23:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2023-05-17T12:23:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:18.0.0-3942.g280675bb.el8.x86_64 131/138 2023-05-17T12:23:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2023-05-17T12:23:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 133/138 2023-05-17T12:23:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-17T12:23:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 135/138 2023-05-17T12:23:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 136/138 2023-05-17T12:23:49.454 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 137/138 2023-05-17T12:23:51.389 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 138/138 2023-05-17T12:23:51.389 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:51.389 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-05-17T12:23:51.389 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-05-17T12:23:51.389 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-05-17T12:23:51.389 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-05-17T12:23:51.390 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.390 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.390 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-05-17T12:23:51.390 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.1-7.el8.noarch 2023-05-17T12:23:51.390 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.0.4-10.el8.x86_64 2023-05-17T12:23:51.390 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.391 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.391 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.391 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.391 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.392 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.392 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.392 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.393 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.393 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.393 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.393 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.394 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.394 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.395 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.395 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.395 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.395 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.396 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.396 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.396 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.396 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.397 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top-2:18.0.0-3942.g280675bb.el8.noarch 2023-05-17T12:23:51.397 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-05-17T12:23:51.397 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.1-9.el8.x86_64 2023-05-17T12:23:51.397 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.7-17.el8.x86_64 2023-05-17T12:23:51.398 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-17T12:23:51.398 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-7.el8.x86_64 2023-05-17T12:23:51.398 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-17T12:23:51.398 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-05-17T12:23:51.398 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-17T12:23:51.399 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.399 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.399 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.399 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-05-17T12:23:51.399 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-05-17T12:23:51.399 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-17T12:23:51.399 INFO:teuthology.orchestra.run.smithi088.stdout: libpq-13.5-1.el8.x86_64 2023-05-17T12:23:51.400 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-05-17T12:23:51.400 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-17T12:23:51.400 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.400 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.400 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-17T12:23:51.400 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.400 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-05-17T12:23:51.401 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-17T12:23:51.401 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-17T12:23:51.401 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-17T12:23:51.401 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-05-17T12:23:51.401 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-05-17T12:23:51.401 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-05-17T12:23:51.401 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-17T12:23:51.401 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-17T12:23:51.402 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.15-4.el8.x86_64 2023-05-17T12:23:51.402 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-05-17T12:23:51.402 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-05-17T12:23:51.402 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-05-17T12:23:51.402 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-05-17T12:23:51.402 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-05-17T12:23:51.403 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-17T12:23:51.403 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-17T12:23:51.403 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-17T12:23:51.403 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-17T12:23:51.403 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-17T12:23:51.403 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-17T12:23:51.404 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-17T12:23:51.404 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-17T12:23:51.404 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-17T12:23:51.405 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-17T12:23:51.406 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-17T12:23:51.406 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-17T12:23:51.406 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-17T12:23:51.406 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-17T12:23:51.406 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-17T12:23:51.407 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-17T12:23:51.407 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-17T12:23:51.407 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-17T12:23:51.407 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-17T12:23:51.407 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-17T12:23:51.407 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-17T12:23:51.407 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-17T12:23:51.407 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-14.el8.noarch 2023-05-17T12:23:51.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-17T12:23:51.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-17T12:23:51.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-17T12:23:51.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-17T12:23:51.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-17T12:23:51.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-17T12:23:51.408 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-17T12:23:51.409 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2023-05-17T12:23:51.409 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-17T12:23:51.409 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-17T12:23:51.409 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-17T12:23:51.409 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-17T12:23:51.409 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-17T12:23:51.409 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-17T12:23:51.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-17T12:23:51.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-17T12:23:51.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-17T12:23:51.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-17T12:23:51.410 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-05-17T12:23:51.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-17T12:23:51.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-17T12:23:51.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-17T12:23:51.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-17T12:23:51.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-17T12:23:51.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-17T12:23:51.411 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-17T12:23:51.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-17T12:23:51.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-17T12:23:51.412 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-17T12:23:51.412 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.412 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.412 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:18.0.0-3942.g280675bb.el8.x86_64 2023-05-17T12:23:51.412 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-17T12:23:51.413 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-17T12:23:51.413 INFO:teuthology.orchestra.run.smithi088.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-17T12:23:51.413 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-17T12:23:51.413 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-17T12:23:51.414 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-05-17T12:23:51.414 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:51.414 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-05-17T12:23:51.627 DEBUG:teuthology.parallel:result is None 2023-05-17T12:23:51.628 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb 2023-05-17T12:23:51.792 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-17T12:23:51.844 INFO:teuthology.orchestra.run.smithi088.stdout:18.0.0-3942.g280675bb.el8 2023-05-17T12:23:51.845 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3942.g280675bb.el8 2023-05-17T12:23:51.846 INFO:teuthology.task.install:The correct ceph version 18.0.0-3942.g280675bb is installed. 2023-05-17T12:23:51.846 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb 2023-05-17T12:23:51.989 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-17T12:23:52.046 INFO:teuthology.orchestra.run.smithi187.stdout:18.0.0-3942.g280675bb.el8 2023-05-17T12:23:52.047 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3942.g280675bb.el8 2023-05-17T12:23:52.047 INFO:teuthology.task.install:The correct ceph version 18.0.0-3942.g280675bb is installed. 2023-05-17T12:23:52.048 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-17T12:23:52.049 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:52.049 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-17T12:23:52.117 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:23:52.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-17T12:23:52.189 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-17T12:23:52.190 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:52.191 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-05-17T12:23:52.257 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-17T12:23:52.359 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:23:52.360 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2023-05-17T12:23:52.425 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-17T12:23:52.527 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-17T12:23:52.528 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:52.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-17T12:23:52.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-17T12:23:52.694 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:23:52.695 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-17T12:23:52.756 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-17T12:23:52.858 INFO:teuthology.run_tasks:Running task ceph... 2023-05-17T12:23:52.929 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-17T12:23:52.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2023-05-17T12:23:52.934 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2023-05-17T12:23:52.995 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-17T12:23:52.996 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-17T12:23:53.000 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-17T12:23:53.061 INFO:tasks.ceph:Creating extra log directories... 2023-05-17T12:23:53.062 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-17T12:23:53.067 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-17T12:23:53.135 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-17T12:23:53.136 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-17T12:23:53.136 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-17T12:23:53.136 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:53.137 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-17T12:23:53.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-17T12:23:53.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-17T12:23:53.437 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:23:53.438 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-17T12:23:53.478 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-17T12:23:53.702 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-17T12:23:53.772 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-17T12:23:53.773 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-17T12:23:53.773 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-05-17_11:52:03-fs-wip-vshankar-testing-20230509.090020-6-testing-default-smithi/7276643', 'branch': 'wip-vshankar-testing-20230509.090020-6', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7276643', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-05-17_11:52:03-fs-wip-vshankar-testing-20230509.090020-6-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230509.090020-6'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230509.090020-6', 'sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 20, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230509.090020-6', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi088.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDrhp0nTkm95pKMCZ7hkp5EHI74Ae1VK9JN8sJLK2MlewbUx2ytONyEebzyWEoWqUN7WPJZoOmfQacbmnYF1q+e++UG/g9gvdnt7CYS7BTh00UHqDtrSoRB+0mbcCpKnkVPy1+fDXrsOxgsWu2CDlNP+3w23qsv8Lyp1iPZecVeyOWQPIVib+UpvGPWAW4FTMi84RqoO+Dja5c03sTGgvhuuJUs5MEjGEgvw/1hHYI5J7g8NvgPSpVqLa9WfVar3TtIpnQo1KZCj6qFaNQJqibIbVZcvDgbzWG9vrVQh1j0BZCHJN1oLId77hVmVPYaXB5AjiljPT6ztFzF4bear3pcW52lGeDfa1m1Z4+o8LgGbzt/ii6BCDeXANNn/Wa/NJQrryzemLr2GYcdux+f4EATwGQCDGTm4V3vzhbK+LflRnuCGUulsViL/d57VKQAQuN2BuADhAJX2pL9xflmmds0WB1+mcL67kDdSuPyLpvqmLWPklAzDCo0fzlCR7fhGzk=', 'smithi187.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiKj4nDshQ3Gd3KQbVlKQ9ypPfCukHCnzSMBf6fJEQtpWQHtZiCmckoOLaIgpslG7IJfDbIuhUc0/aukmaLIIJldyT1FUUDVJ+x+NzFlEaF1rPVeLMRtd7BUCKqodkt3/Q6QdHqjs0rfXeZHlU0Cu7ddlH5ouQncjRBDCK5F1D7RLsB9B9T/On+FSnAnDDlbb/41Ua6X5r+X+OWKnxLa2BKQZoHjD0p86epbBxQ5R4HHGYeVylwIiAs0YE/ilLSeOtVqB4PlcwC2g7hrf5xUwcKpjWbDPPXHyWP2LJE+TQaBVfiHf5BKczvKoakASzabFi4eEEpdqgbBXBecoHejqBPs+gnD1RpavW+TkXctAZwujDfPeA5FKDbpjeFpCguVU+a3LyB7XewuYeuGp2Hkhq7HTDgeL2lnFZn5ppc+BdSESFZz36O9s2MqiKo7BlZzXd1sLK+U+164NCvBSMyiWkV7XJJfW97JckN4nw4e8/uMCeVnvS7ajhROeoJlplVdM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '2bcb179390319a07fc43480888bd707374860ab3'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-17_11:52:03', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-17T12:23:53.774 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-17T12:23:53.778 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-17T12:23:53.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2023-05-17T12:23:53.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2023-05-17T12:23:53.921 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:53.921 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-05-17T12:23:53.963 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-17T12:23:53.964 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-05-17T12:23:54.044 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-17T12:23:54.045 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T12:23:54.045 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-05-17T12:23:54.045 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T12:23:54.045 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T12:23:54.045 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-05-17 12:23:48.929425845 +0000 2023-05-17T12:23:54.045 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-05-17 12:16:09.584828871 +0000 2023-05-17T12:23:54.046 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-05-17 12:16:09.584828871 +0000 2023-05-17T12:23:54.046 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-05-17 12:16:09.560829344 +0000 2023-05-17T12:23:54.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-17T12:23:54.144 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-05-17T12:23:54.144 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-05-17T12:23:54.144 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000306735 s, 1.7 MB/s 2023-05-17T12:23:54.146 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-17T12:23:54.189 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-05-17T12:23:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-17T12:23:54.273 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T12:23:54.274 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-05-17T12:23:54.274 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T12:23:54.274 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T12:23:54.274 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-05-17 12:23:48.929425845 +0000 2023-05-17T12:23:54.274 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-05-17 12:16:10.367813437 +0000 2023-05-17T12:23:54.274 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-05-17 12:16:10.367813437 +0000 2023-05-17T12:23:54.275 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-05-17 12:16:10.343813910 +0000 2023-05-17T12:23:54.275 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-17T12:23:54.374 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-05-17T12:23:54.374 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-05-17T12:23:54.375 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000301148 s, 1.7 MB/s 2023-05-17T12:23:54.377 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-17T12:23:54.421 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-05-17T12:23:54.502 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-17T12:23:54.502 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T12:23:54.503 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-05-17T12:23:54.503 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T12:23:54.503 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T12:23:54.503 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-05-17 12:23:48.929425845 +0000 2023-05-17T12:23:54.503 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-05-17 12:16:11.173797549 +0000 2023-05-17T12:23:54.503 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-05-17 12:16:11.173797549 +0000 2023-05-17T12:23:54.503 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-05-17 12:16:11.149798022 +0000 2023-05-17T12:23:54.504 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-17T12:23:54.602 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-05-17T12:23:54.602 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-05-17T12:23:54.603 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000278785 s, 1.8 MB/s 2023-05-17T12:23:54.604 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-17T12:23:54.649 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-05-17T12:23:54.731 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-17T12:23:54.732 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T12:23:54.732 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-05-17T12:23:54.732 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T12:23:54.732 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T12:23:54.732 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-05-17 12:23:48.929425845 +0000 2023-05-17T12:23:54.732 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-05-17 12:16:11.959782056 +0000 2023-05-17T12:23:54.733 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-05-17 12:16:11.959782056 +0000 2023-05-17T12:23:54.733 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-05-17 12:16:11.936782509 +0000 2023-05-17T12:23:54.733 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-17T12:23:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-05-17T12:23:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-05-17T12:23:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000287712 s, 1.8 MB/s 2023-05-17T12:23:54.834 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-17T12:23:54.878 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T12:23:54.879 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:23:54.879 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2023-05-17T12:23:54.923 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-17T12:23:54.924 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2023-05-17T12:23:55.006 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-17T12:23:55.006 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T12:23:55.006 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-05-17T12:23:55.006 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T12:23:55.007 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T12:23:55.007 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-05-17 12:19:19.383320351 +0000 2023-05-17T12:23:55.007 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-05-17 12:16:09.506355508 +0000 2023-05-17T12:23:55.007 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-05-17 12:16:09.506355508 +0000 2023-05-17T12:23:55.007 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-05-17 12:16:09.483355861 +0000 2023-05-17T12:23:55.007 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-17T12:23:55.106 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-05-17T12:23:55.106 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-05-17T12:23:55.106 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000361222 s, 1.4 MB/s 2023-05-17T12:23:55.108 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-17T12:23:55.150 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2023-05-17T12:23:55.230 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-17T12:23:55.231 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T12:23:55.231 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-05-17T12:23:55.231 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T12:23:55.231 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T12:23:55.231 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-05-17 12:19:19.383320351 +0000 2023-05-17T12:23:55.232 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-05-17 12:16:10.287343542 +0000 2023-05-17T12:23:55.232 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-05-17 12:16:10.287343542 +0000 2023-05-17T12:23:55.232 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-05-17 12:16:10.266343864 +0000 2023-05-17T12:23:55.232 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-17T12:23:55.330 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-05-17T12:23:55.331 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-05-17T12:23:55.331 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000300342 s, 1.7 MB/s 2023-05-17T12:23:55.333 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-17T12:23:55.376 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2023-05-17T12:23:55.457 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-17T12:23:55.457 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T12:23:55.458 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-05-17T12:23:55.458 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T12:23:55.458 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T12:23:55.458 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-05-17 12:19:19.383320351 +0000 2023-05-17T12:23:55.458 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-05-17 12:16:11.059331715 +0000 2023-05-17T12:23:55.458 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-05-17 12:16:11.059331715 +0000 2023-05-17T12:23:55.458 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-05-17 12:16:11.036332067 +0000 2023-05-17T12:23:55.459 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-17T12:23:55.556 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-05-17T12:23:55.557 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-05-17T12:23:55.557 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000296822 s, 1.7 MB/s 2023-05-17T12:23:55.559 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-17T12:23:55.602 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2023-05-17T12:23:55.684 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-17T12:23:55.684 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-17T12:23:55.685 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-05-17T12:23:55.685 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-17T12:23:55.685 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-05-17T12:23:55.685 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-05-17 12:19:19.383320351 +0000 2023-05-17T12:23:55.685 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-05-17 12:16:11.843319702 +0000 2023-05-17T12:23:55.685 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-05-17 12:16:11.843319702 +0000 2023-05-17T12:23:55.685 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-05-17 12:16:11.821320039 +0000 2023-05-17T12:23:55.686 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-17T12:23:55.784 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-05-17T12:23:55.784 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-05-17T12:23:55.784 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000295541 s, 1.7 MB/s 2023-05-17T12:23:55.786 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-17T12:23:55.829 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T12:23:55.829 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-17T12:23:55.829 INFO:tasks.ceph:Generating config... 2023-05-17T12:23:55.830 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-17T12:23:55.831 INFO:tasks.ceph:[client] debug client = 20 2023-05-17T12:23:55.831 INFO:tasks.ceph:[client] debug ms = 1 2023-05-17T12:23:55.831 INFO:tasks.ceph:[client] pid file = 2023-05-17T12:23:55.831 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-17T12:23:55.832 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-17T12:23:55.832 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-17T12:23:55.832 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-17T12:23:55.832 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-17T12:23:55.832 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-17T12:23:55.833 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-17T12:23:55.833 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-17T12:23:55.833 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-17T12:23:55.833 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-17T12:23:55.833 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-17T12:23:55.833 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-17T12:23:55.834 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-17T12:23:55.834 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-17T12:23:55.834 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-17T12:23:55.834 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-17T12:23:55.834 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-17T12:23:55.835 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-17T12:23:55.835 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-17T12:23:55.835 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-17T12:23:55.835 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-05-17T12:23:55.835 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-05-17T12:23:55.836 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-17T12:23:55.836 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-17T12:23:55.836 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-05-17T12:23:55.836 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-17T12:23:55.836 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-17T12:23:55.836 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-17T12:23:55.837 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-17T12:23:55.837 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-17T12:23:55.838 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-17T12:23:55.838 INFO:tasks.ceph:Setting up mon.a... 2023-05-17T12:23:55.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-17T12:23:55.944 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2023-05-17T12:23:55.950 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-17T12:23:56.042 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-17T12:23:56.105 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '172.21.15.187'), ('mon.c', '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]')] 2023-05-17T12:23:56.105 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-17T12:23:56.106 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:56.107 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-17T12:23:56.147 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --add b 172.21.15.187 --addv c '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:23:56.271 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:23:56.272 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid 5fe2c233-5aa8-47bb-8675-a47cef3664c7 2023-05-17T12:23:56.272 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = pacific 2023-05-17T12:23:56.272 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2023-05-17T12:23:56.272 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 5fe2c233-5aa8-47bb-8675-a47cef3664c7 2023-05-17T12:23:56.272 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2023-05-17T12:23:56.269459+0000 2023-05-17T12:23:56.273 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-05-17T12:23:56.269459+0000 2023-05-17T12:23:56.273 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 16 (pacific) 2023-05-17T12:23:56.273 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2023-05-17T12:23:56.273 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2023-05-17T12:23:56.273 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2023-05-17T12:23:56.273 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] mon.c 2023-05-17T12:23:56.273 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-17T12:23:56.274 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-17T12:23:56.317 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5fe2c233-5aa8-47bb-8675-a47cef3664c7... 2023-05-17T12:23:56.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-17T12:23:56.362 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-17T12:23:56.465 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2023-05-17T12:23:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2023-05-17T12:23:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-17T12:23:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2023-05-17T12:23:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2023-05-17T12:23:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.466 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2023-05-17T12:23:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2023-05-17T12:23:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2023-05-17T12:23:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2023-05-17T12:23:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2023-05-17T12:23:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.467 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-17T12:23:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2023-05-17T12:23:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2023-05-17T12:23:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-17T12:23:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2023-05-17T12:23:56.468 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2023-05-17T12:23:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2023-05-17T12:23:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2023-05-17T12:23:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2023-05-17T12:23:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2023-05-17T12:23:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2023-05-17T12:23:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2023-05-17T12:23:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-17T12:23:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-17T12:23:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2023-05-17T12:23:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-17T12:23:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2023-05-17T12:23:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.470 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2023-05-17T12:23:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2023-05-17T12:23:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2023-05-17T12:23:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2023-05-17T12:23:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-05-17T12:23:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 5fe2c233-5aa8-47bb-8675-a47cef3664c7 2023-05-17T12:23:56.471 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.472 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2023-05-17T12:23:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2023-05-17T12:23:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2023-05-17T12:23:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2023-05-17T12:23:56.472 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2023-05-17T12:23:56.473 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2023-05-17T12:23:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2023-05-17T12:23:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2023-05-17T12:23:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2023-05-17T12:23:56.474 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2023-05-17T12:23:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2023-05-17T12:23:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2023-05-17T12:23:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2023-05-17T12:23:56.475 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2023-05-17T12:23:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2023-05-17T12:23:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2023-05-17T12:23:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2023-05-17T12:23:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2023-05-17T12:23:56.476 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2023-05-17T12:23:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2023-05-17T12:23:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 20 2023-05-17T12:23:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 20 2023-05-17T12:23:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-05-17T12:23:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2023-05-17T12:23:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 10 2023-05-17T12:23:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2023-05-17T12:23:56.477 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2023-05-17T12:23:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2023-05-17T12:23:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2023-05-17T12:23:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2023-05-17T12:23:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-05-17T12:23:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.478 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2023-05-17T12:23:56.478 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-05-17T12:23:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2023-05-17T12:23:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-05-17T12:23:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-05-17T12:23:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-05-17T12:23:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-05-17T12:23:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2023-05-17T12:23:56.479 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.480 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2023-05-17T12:23:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-05-17T12:23:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-05-17T12:23:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2023-05-17T12:23:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-05-17T12:23:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2023-05-17T12:23:56.480 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2023-05-17T12:23:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-05-17T12:23:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2023-05-17T12:23:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2023-05-17T12:23:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-05-17T12:23:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-17T12:23:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2023-05-17T12:23:56.481 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2023-05-17T12:23:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2023-05-17T12:23:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-17T12:23:56.482 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-17T12:23:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2023-05-17T12:23:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2023-05-17T12:23:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2023-05-17T12:23:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2023-05-17T12:23:56.483 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:23:56.483 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2023-05-17T12:23:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2023-05-17T12:23:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2023-05-17T12:23:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2023-05-17T12:23:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-17T12:23:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-17T12:23:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2023-05-17T12:23:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2023-05-17T12:23:56.484 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-05-17T12:23:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = "" 2023-05-17T12:23:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-05-17T12:23:56.485 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-05-17T12:23:56.485 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2023-05-17T12:23:56.485 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2023-05-17T12:23:56.485 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2023-05-17T12:23:56.485 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-05-17T12:23:56.485 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-05-17T12:23:56.486 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-05-17T12:23:56.486 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-05-17T12:23:56.486 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2023-05-17T12:23:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2023-05-17T12:23:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2023-05-17T12:23:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-05-17T12:23:56.486 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2023-05-17T12:23:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2023-05-17T12:23:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2023-05-17T12:23:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2023-05-17T12:23:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-05-17T12:23:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-05-17T12:23:56.487 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-05-17T12:23:56.488 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2023-05-17T12:23:56.488 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2023-05-17T12:23:56.488 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-17T12:23:56.488 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2023-05-17T12:23:56.488 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.489 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2023-05-17T12:23:56.489 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.489 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2023-05-17T12:23:56.489 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.489 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2023-05-17T12:23:56.489 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2023-05-17T12:23:56.489 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.489 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2023-05-17T12:23:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2023-05-17T12:23:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-17T12:23:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2023-05-17T12:23:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2023-05-17T12:23:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-17T12:23:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.491 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2023-05-17T12:23:56.491 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.491 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2023-05-17T12:23:56.491 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2023-05-17T12:23:56.491 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2023-05-17T12:23:56.491 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2023-05-17T12:23:56.491 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2023-05-17T12:23:56.492 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2023-05-17T12:23:56.492 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2023-05-17T12:23:56.492 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-17T12:23:56.492 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-17T12:23:56.492 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2023-05-17T12:23:56.492 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.492 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-17T12:23:56.493 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.493 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2023-05-17T12:23:56.493 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.493 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2023-05-17T12:23:56.493 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.493 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2023-05-17T12:23:56.493 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2023-05-17T12:23:56.493 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2023-05-17T12:23:56.494 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.88,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-05-17T12:23:56.494 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = 5fe2c233-5aa8-47bb-8675-a47cef3664c7 2023-05-17T12:23:56.494 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.494 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2023-05-17T12:23:56.494 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2023-05-17T12:23:56.494 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.494 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2023-05-17T12:23:56.494 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2023-05-17T12:23:56.495 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.495 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2023-05-17T12:23:56.495 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2023-05-17T12:23:56.495 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.495 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2023-05-17T12:23:56.495 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2023-05-17T12:23:56.495 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2023-05-17T12:23:56.495 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.496 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2023-05-17T12:23:56.496 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2023-05-17T12:23:56.496 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.496 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2023-05-17T12:23:56.496 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.497 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2023-05-17T12:23:56.497 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.497 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2023-05-17T12:23:56.497 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.497 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2023-05-17T12:23:56.497 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2023-05-17T12:23:56.497 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.497 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2023-05-17T12:23:56.498 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2023-05-17T12:23:56.498 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2023-05-17T12:23:56.498 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2023-05-17T12:23:56.498 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 20 2023-05-17T12:23:56.498 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 20 2023-05-17T12:23:56.499 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-05-17T12:23:56.499 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2023-05-17T12:23:56.499 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 10 2023-05-17T12:23:56.499 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2023-05-17T12:23:56.499 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2023-05-17T12:23:56.499 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2023-05-17T12:23:56.499 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2023-05-17T12:23:56.499 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2023-05-17T12:23:56.500 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-05-17T12:23:56.500 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.500 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2023-05-17T12:23:56.500 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-05-17T12:23:56.500 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2023-05-17T12:23:56.500 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-05-17T12:23:56.500 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-05-17T12:23:56.500 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-05-17T12:23:56.501 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-05-17T12:23:56.501 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2023-05-17T12:23:56.501 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.501 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2023-05-17T12:23:56.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-05-17T12:23:56.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-05-17T12:23:56.501 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2023-05-17T12:23:56.502 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-05-17T12:23:56.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2023-05-17T12:23:56.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2023-05-17T12:23:56.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-05-17T12:23:56.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2023-05-17T12:23:56.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2023-05-17T12:23:56.502 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-05-17T12:23:56.502 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.503 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-17T12:23:56.503 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2023-05-17T12:23:56.503 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2023-05-17T12:23:56.503 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.503 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2023-05-17T12:23:56.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-17T12:23:56.503 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-17T12:23:56.504 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.504 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2023-05-17T12:23:56.504 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2023-05-17T12:23:56.504 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.504 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2023-05-17T12:23:56.504 INFO:teuthology.orchestra.run.smithi187.stdout: mon op complaint time = 120 2023-05-17T12:23:56.504 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-05-17T12:23:56.504 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2023-05-17T12:23:56.505 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2023-05-17T12:23:56.505 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2023-05-17T12:23:56.505 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2023-05-17T12:23:56.505 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-17T12:23:56.505 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-17T12:23:56.505 INFO:teuthology.orchestra.run.smithi187.stdout: client mount timeout = 600 2023-05-17T12:23:56.505 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-05-17T12:23:56.505 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-05-17T12:23:56.506 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = "" 2023-05-17T12:23:56.506 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-05-17T12:23:56.506 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-05-17T12:23:56.506 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2023-05-17T12:23:56.506 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2023-05-17T12:23:56.506 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2023-05-17T12:23:56.506 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-05-17T12:23:56.507 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-05-17T12:23:56.507 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-05-17T12:23:56.507 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-05-17T12:23:56.507 INFO:teuthology.orchestra.run.smithi187.stdout:[mds] 2023-05-17T12:23:56.507 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds = 20 2023-05-17T12:23:56.507 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds balancer = 20 2023-05-17T12:23:56.507 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-05-17T12:23:56.507 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug frag = True 2023-05-17T12:23:56.508 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug scatterstat = True 2023-05-17T12:23:56.508 INFO:teuthology.orchestra.run.smithi187.stdout: mds op complaint time = 180 2023-05-17T12:23:56.508 INFO:teuthology.orchestra.run.smithi187.stdout: mds verify scatter = True 2023-05-17T12:23:56.508 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-05-17T12:23:56.508 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-05-17T12:23:56.508 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-05-17T12:23:56.509 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-17T12:23:56.510 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-17T12:23:56.613 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-17T12:23:56.614 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:56.614 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-17T12:23:56.655 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:56.655 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-17T12:23:56.737 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T12:23:56.737 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:56.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-17T12:23:56.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-17T12:23:56.868 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:23:56.869 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:23:56.949 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T12:23:56.950 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:23:56.950 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-17T12:23:56.950 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-17T12:23:57.035 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:23:57.036 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:23:57.116 INFO:tasks.ceph:Setting up mon nodes... 2023-05-17T12:23:57.116 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-17T12:23:57.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-17T12:23:57.234 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-17T12:23:57.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-17T12:23:57.357 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-17T12:23:57.364 INFO:tasks.ceph:Setting up mds nodes... 2023-05-17T12:23:57.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-17T12:23:57.477 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-17T12:23:57.481 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-17T12:23:57.547 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-17T12:23:57.660 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-17T12:23:57.665 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-17T12:23:57.729 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-17T12:23:57.840 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-17T12:23:57.845 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-17T12:23:57.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-17T12:23:58.017 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-17T12:23:58.021 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-17T12:23:58.083 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-17T12:23:58.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-17T12:23:58.175 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-17T12:23:58.202 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-17T12:23:58.291 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-17T12:23:58.319 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-17T12:23:58.408 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-17T12:23:58.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-17T12:23:58.524 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-17T12:23:58.552 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-17T12:23:58.553 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-17T12:23:58.553 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-17T12:23:58.616 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T12:23:58.616 INFO:tasks.ceph:role: osd.0 2023-05-17T12:23:58.617 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T12:23:58.617 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-17T12:23:58.688 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T12:23:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T12:23:58.688 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T12:23:58.689 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T12:23:58.689 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T12:23:58.689 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-05-17T12:23:58.689 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T12:23:58.689 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T12:23:58.689 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T12:23:58.690 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T12:23:59.114 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-05-17T12:23:59.118 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-05-17T12:23:59.118 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-17T12:23:59.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-17T12:23:59.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-17T12:23:59.432 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T12:23:59.433 INFO:tasks.ceph:role: osd.1 2023-05-17T12:23:59.433 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T12:23:59.434 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-17T12:23:59.513 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T12:23:59.513 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T12:23:59.513 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T12:23:59.513 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T12:23:59.513 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T12:23:59.514 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-05-17T12:23:59.514 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T12:23:59.514 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T12:23:59.514 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T12:23:59.514 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T12:23:59.913 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-05-17T12:23:59.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-05-17T12:23:59.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-17T12:24:00.049 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-17T12:24:00.118 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-17T12:24:00.179 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T12:24:00.180 INFO:tasks.ceph:role: osd.2 2023-05-17T12:24:00.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T12:24:00.180 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-17T12:24:00.249 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T12:24:00.250 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T12:24:00.250 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T12:24:00.250 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T12:24:00.250 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T12:24:00.250 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-05-17T12:24:00.250 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T12:24:00.250 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T12:24:00.251 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T12:24:00.251 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T12:24:00.687 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-05-17T12:24:00.691 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-05-17T12:24:00.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-17T12:24:00.871 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-17T12:24:00.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-17T12:24:01.007 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-17T12:24:01.008 INFO:tasks.ceph:role: osd.3 2023-05-17T12:24:01.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T12:24:01.008 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-17T12:24:01.077 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T12:24:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T12:24:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T12:24:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T12:24:01.078 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T12:24:01.078 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-05-17T12:24:01.078 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T12:24:01.078 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T12:24:01.079 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T12:24:01.079 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T12:24:01.517 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-05-17T12:24:01.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-05-17T12:24:01.522 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-17T12:24:01.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-17T12:24:01.749 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:01.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:01.854+0000 7f9cd15b8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-17T12:24:01.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:01.854+0000 7f9cd15b8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-17T12:24:01.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:01.854+0000 7f9cd15b8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-17T12:24:01.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:01.855+0000 7f9cd15b8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-17T12:24:01.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:01.855+0000 7f9cd15b8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-17T12:24:01.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:01.857+0000 7f9cd15b8640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-17T12:24:04.782 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-17T12:24:04.852 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:04.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:04.950+0000 7f829607d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-17T12:24:04.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:04.951+0000 7f829607d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-17T12:24:04.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:04.951+0000 7f829607d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-17T12:24:04.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:04.951+0000 7f829607d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-17T12:24:04.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:04.951+0000 7f829607d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-17T12:24:04.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:04.952+0000 7f829607d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-17T12:24:07.891 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-17T12:24:07.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:08.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:08.055+0000 7f1665e66640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-17T12:24:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:08.056+0000 7f1665e66640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-17T12:24:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:08.056+0000 7f1665e66640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-17T12:24:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:08.056+0000 7f1665e66640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-17T12:24:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:08.056+0000 7f1665e66640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-17T12:24:08.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:08.058+0000 7f1665e66640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-17T12:24:10.998 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-17T12:24:11.062 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:11.155+0000 7f28040cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-17T12:24:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:11.155+0000 7f28040cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-17T12:24:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:11.155+0000 7f28040cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-17T12:24:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:11.155+0000 7f28040cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-17T12:24:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:11.155+0000 7f28040cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-17T12:24:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:11.156+0000 7f28040cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-17T12:24:14.082 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-17T12:24:14.144 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-17T12:24:14.214 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T12:24:14.215 INFO:tasks.ceph:role: osd.4 2023-05-17T12:24:14.215 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T12:24:14.215 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-17T12:24:14.287 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T12:24:14.288 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T12:24:14.288 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T12:24:14.288 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T12:24:14.289 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T12:24:14.289 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-05-17T12:24:14.289 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T12:24:14.289 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T12:24:14.289 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T12:24:14.289 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T12:24:14.714 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-05-17T12:24:14.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-05-17T12:24:14.718 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-17T12:24:14.926 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-17T12:24:15.000 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-17T12:24:15.062 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T12:24:15.063 INFO:tasks.ceph:role: osd.5 2023-05-17T12:24:15.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T12:24:15.063 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-17T12:24:15.132 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T12:24:15.133 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T12:24:15.133 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T12:24:15.133 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T12:24:15.133 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T12:24:15.133 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-05-17T12:24:15.133 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T12:24:15.134 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T12:24:15.134 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T12:24:15.134 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T12:24:15.545 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-05-17T12:24:15.549 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-05-17T12:24:15.549 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-17T12:24:15.681 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-17T12:24:15.750 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-17T12:24:15.813 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T12:24:15.813 INFO:tasks.ceph:role: osd.6 2023-05-17T12:24:15.814 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T12:24:15.814 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-17T12:24:15.884 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T12:24:15.885 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T12:24:15.885 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T12:24:15.885 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T12:24:15.885 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T12:24:15.885 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-05-17T12:24:15.886 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T12:24:15.886 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T12:24:15.886 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T12:24:15.886 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T12:24:16.331 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-05-17T12:24:16.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-05-17T12:24:16.334 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-17T12:24:16.509 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-17T12:24:16.581 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-17T12:24:16.643 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-17T12:24:16.644 INFO:tasks.ceph:role: osd.7 2023-05-17T12:24:16.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T12:24:16.644 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-17T12:24:16.713 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-17T12:24:16.713 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-17T12:24:16.714 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-17T12:24:16.714 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-17T12:24:16.714 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-17T12:24:16.714 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-05-17T12:24:16.714 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-17T12:24:16.714 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-17T12:24:16.714 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-17T12:24:16.714 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-17T12:24:17.149 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-05-17T12:24:17.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-05-17T12:24:17.153 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-17T12:24:17.296 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-17T12:24:17.366 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:17.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:17.487+0000 7f05ce970640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-17T12:24:17.491 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:17.488+0000 7f05ce970640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-17T12:24:17.491 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:17.488+0000 7f05ce970640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-17T12:24:17.492 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:17.488+0000 7f05ce970640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-17T12:24:17.492 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:17.488+0000 7f05ce970640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-17T12:24:17.493 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:17.490+0000 7f05ce970640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-17T12:24:20.366 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-17T12:24:20.430 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:20.528 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:20.524+0000 7fead4ccc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-17T12:24:20.528 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:20.524+0000 7fead4ccc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-17T12:24:20.529 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:20.524+0000 7fead4ccc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-17T12:24:20.529 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:20.524+0000 7fead4ccc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-17T12:24:20.529 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:20.524+0000 7fead4ccc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-17T12:24:20.530 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:20.526+0000 7fead4ccc640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-17T12:24:23.406 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-17T12:24:23.470 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:23.565 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:23.562+0000 7fc08b88a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-17T12:24:23.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:23.562+0000 7fc08b88a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-17T12:24:23.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:23.562+0000 7fc08b88a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-17T12:24:23.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:23.562+0000 7fc08b88a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-17T12:24:23.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:23.562+0000 7fc08b88a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-17T12:24:23.567 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:23.564+0000 7fc08b88a640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-17T12:24:23.776 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:24:23.784 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:24:26.450 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-17T12:24:26.515 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:26.613 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:26.609+0000 7f1b983d4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-17T12:24:26.613 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:26.609+0000 7f1b983d4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-17T12:24:26.613 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:26.609+0000 7f1b983d4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-17T12:24:26.613 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:26.609+0000 7f1b983d4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-17T12:24:26.613 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:26.609+0000 7f1b983d4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-17T12:24:26.614 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:26.611+0000 7f1b983d4640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-17T12:24:29.492 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-17T12:24:29.557 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-17T12:24:29.558 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:29.558 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-17T12:24:29.624 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:29.625 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-17T12:24:29.731 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:29.731 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-17T12:24:29.839 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:29.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-17T12:24:29.944 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:29.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-17T12:24:30.047 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:30.049 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-17T12:24:30.152 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:30.152 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-17T12:24:30.256 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:30.256 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-17T12:24:30.325 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:30.356 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-17T12:24:30.435 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:30.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-17T12:24:30.538 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:30.538 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-17T12:24:30.642 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:30.642 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-17T12:24:30.744 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:30.745 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-17T12:24:30.848 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:30.849 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-17T12:24:30.953 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:30.953 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-17T12:24:30.998 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:30.999 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-17T12:24:31.083 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:31.083 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-17T12:24:31.126 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:31.127 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-17T12:24:31.207 INFO:tasks.ceph:Adding keys to all mons... 2023-05-17T12:24:31.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-17T12:24:31.212 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-17T12:24:31.269 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2023-05-17T12:24:31.269 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBdx2RkD//aDRAA0SoLiG2uPc5z98d7hr1J4g== 2023-05-17T12:24:31.269 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-05-17T12:24:31.269 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBdx2RkJwtTHBAAPMdL+AKW5o+hNc22xgIADg== 2023-05-17T12:24:31.269 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-05-17T12:24:31.270 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBdx2RkVng3JxAAg7HmTFwFc04cSTzN1YHYxQ== 2023-05-17T12:24:31.270 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2023-05-17T12:24:31.270 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBhx2Rkrpz0MhAAf91/kLGMbxxsj1vXVCTPSw== 2023-05-17T12:24:31.270 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2023-05-17T12:24:31.270 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBkx2RkKjG2OBAA4NREeQryhvG0UpX8K2EAcg== 2023-05-17T12:24:31.270 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2023-05-17T12:24:31.270 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBox2RkAHxaAxAAHUZoN5ymy+f9o/eFwinpew== 2023-05-17T12:24:31.270 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2023-05-17T12:24:31.271 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBrx2RkD2dWCRAAyRKsbOLvWkvMrd5GTO+oJQ== 2023-05-17T12:24:31.271 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2023-05-17T12:24:31.271 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBdx2RkH8gzFRAAK1hxXwVv4woXhMUs0C4YWg== 2023-05-17T12:24:31.271 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-05-17T12:24:31.271 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBdx2Rkplb7MRAA92QM43QQm/XEeWFeBESiYA== 2023-05-17T12:24:31.271 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-05-17T12:24:31.271 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBex2Rki5LkABAA+Pmbr5jS8aZKTG2KesV7tg== 2023-05-17T12:24:31.272 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2023-05-17T12:24:31.272 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBxx2Rka/MgHRAAXkuBP3JOWToC79EG7wBb9A== 2023-05-17T12:24:31.272 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2023-05-17T12:24:31.272 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB0x2RkI0RPHxAAM/QelMN8dN6RYjPyNSnmCA== 2023-05-17T12:24:31.272 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2023-05-17T12:24:31.272 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB3x2RkKDWUIRAAb3tIM1X1KyKQrhA969KDhA== 2023-05-17T12:24:31.272 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2023-05-17T12:24:31.273 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQB6x2RkDr1kJBAAuJVGm/HZi7sY32t+fv4vXg== 2023-05-17T12:24:31.273 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-05-17T12:24:31.273 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBex2Rk1nFUChAAukmFEq3MViAijh8ZXu6IBg== 2023-05-17T12:24:31.273 INFO:teuthology.orchestra.run.smithi088.stdout:[client.2] 2023-05-17T12:24:31.273 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBex2RkiZZFERAAjurF568X0kJDp7BDda+LpQ== 2023-05-17T12:24:31.273 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-05-17T12:24:31.273 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBex2RkuN86GBAAolpFFOo7rt9jPOjir69P6A== 2023-05-17T12:24:31.273 INFO:teuthology.orchestra.run.smithi088.stdout:[client.3] 2023-05-17T12:24:31.274 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBex2RkB8gkHxAA0X3OADTiAFMkW2lkoHWrdQ== 2023-05-17T12:24:31.307 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2023-05-17T12:24:31.307 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBdx2RkD//aDRAA0SoLiG2uPc5z98d7hr1J4g== 2023-05-17T12:24:31.308 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-05-17T12:24:31.308 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBdx2RkJwtTHBAAPMdL+AKW5o+hNc22xgIADg== 2023-05-17T12:24:31.308 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-05-17T12:24:31.308 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBdx2RkVng3JxAAg7HmTFwFc04cSTzN1YHYxQ== 2023-05-17T12:24:31.309 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2023-05-17T12:24:31.309 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBhx2Rkrpz0MhAAf91/kLGMbxxsj1vXVCTPSw== 2023-05-17T12:24:31.309 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2023-05-17T12:24:31.309 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBkx2RkKjG2OBAA4NREeQryhvG0UpX8K2EAcg== 2023-05-17T12:24:31.310 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2023-05-17T12:24:31.310 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBox2RkAHxaAxAAHUZoN5ymy+f9o/eFwinpew== 2023-05-17T12:24:31.310 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2023-05-17T12:24:31.310 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBrx2RkD2dWCRAAyRKsbOLvWkvMrd5GTO+oJQ== 2023-05-17T12:24:31.310 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2023-05-17T12:24:31.310 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBdx2RkH8gzFRAAK1hxXwVv4woXhMUs0C4YWg== 2023-05-17T12:24:31.311 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-05-17T12:24:31.311 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBdx2Rkplb7MRAA92QM43QQm/XEeWFeBESiYA== 2023-05-17T12:24:31.311 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-05-17T12:24:31.311 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBex2Rki5LkABAA+Pmbr5jS8aZKTG2KesV7tg== 2023-05-17T12:24:31.311 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2023-05-17T12:24:31.311 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBxx2Rka/MgHRAAXkuBP3JOWToC79EG7wBb9A== 2023-05-17T12:24:31.312 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2023-05-17T12:24:31.312 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB0x2RkI0RPHxAAM/QelMN8dN6RYjPyNSnmCA== 2023-05-17T12:24:31.312 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2023-05-17T12:24:31.312 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB3x2RkKDWUIRAAb3tIM1X1KyKQrhA969KDhA== 2023-05-17T12:24:31.312 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2023-05-17T12:24:31.312 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQB6x2RkDr1kJBAAuJVGm/HZi7sY32t+fv4vXg== 2023-05-17T12:24:31.313 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2023-05-17T12:24:31.313 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBex2Rk1nFUChAAukmFEq3MViAijh8ZXu6IBg== 2023-05-17T12:24:31.313 INFO:teuthology.orchestra.run.smithi187.stdout:[client.2] 2023-05-17T12:24:31.314 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBex2RkiZZFERAAjurF568X0kJDp7BDda+LpQ== 2023-05-17T12:24:31.314 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2023-05-17T12:24:31.314 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBex2RkuN86GBAAolpFFOo7rt9jPOjir69P6A== 2023-05-17T12:24:31.314 INFO:teuthology.orchestra.run.smithi187.stdout:[client.3] 2023-05-17T12:24:31.315 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQBex2RkB8gkHxAA0X3OADTiAFMkW2lkoHWrdQ== 2023-05-17T12:24:31.316 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T12:24:31.320 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T12:24:31.456 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T12:24:31.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T12:24:31.562 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T12:24:31.566 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T12:24:31.669 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:31.674 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:31.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:31.779 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:31.879 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:31.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:31.993 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:31.998 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:32.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T12:24:32.101 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-17T12:24:32.201 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T12:24:32.204 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T12:24:32.309 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T12:24:32.313 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-17T12:24:32.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:32.419 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:32.520 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:32.524 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:32.625 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:32.629 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:32.729 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:32.733 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-17T12:24:32.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T12:24:32.837 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T12:24:32.941 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T12:24:32.945 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T12:24:33.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T12:24:33.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T12:24:33.154 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T12:24:33.158 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-17T12:24:33.261 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-17T12:24:33.262 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-17T12:24:33.326 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-17T12:24:33.445 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-17T12:24:33.510 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-17T12:24:33.573 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-17T12:24:33.688 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-17T12:24:33.751 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-17T12:24:33.815 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-17T12:24:33.928 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-17T12:24:33.990 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:33.994 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-17T12:24:34.035 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-17T12:24:34.036 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-17T12:24:34.036 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-17T12:24:34.076 INFO:tasks.ceph.mon.a:Started 2023-05-17T12:24:34.077 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-17T12:24:34.077 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-17T12:24:34.081 INFO:tasks.ceph.mon.b:Started 2023-05-17T12:24:34.081 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-17T12:24:34.082 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-17T12:24:34.085 INFO:tasks.ceph.mon.c:Started 2023-05-17T12:24:34.085 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-17T12:24:34.086 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-17T12:24:34.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-17T12:24:34.090 INFO:tasks.ceph.mgr.y:Started 2023-05-17T12:24:34.091 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-17T12:24:34.091 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-17T12:24:34.095 INFO:tasks.ceph.mgr.x:Started 2023-05-17T12:24:34.096 INFO:tasks.ceph:Setting crush tunables to default 2023-05-17T12:24:34.096 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2023-05-17T12:24:34.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.298+0000 7efe823ff700 1 Processor -- start 2023-05-17T12:24:34.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.298+0000 7efe823ff700 1 -- start start 2023-05-17T12:24:34.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.299+0000 7efe823ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0b8770 0x7efe7c0cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:34.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.299+0000 7efe823ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efe7c0cd660 0x7efe7c06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:34.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.299+0000 7efe823ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7c1612f0 con 0x7efe7c06cd40 2023-05-17T12:24:34.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.299+0000 7efe823ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c06d1c0 con 0x7efe7c0cd660 2023-05-17T12:24:34.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.299+0000 7efe823ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c160e60 con 0x7efe7c0b8770 2023-05-17T12:24:34.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.299+0000 7efe7bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0b8770 0x7efe7c0cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:34.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.300+0000 7efe7bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0b8770 0x7efe7c0cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50796/0 (socket says 172.21.15.88:50796) 2023-05-17T12:24:34.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.300+0000 7efe7bfff700 1 -- 172.21.15.88:0/4058931 learned_addr learned my addr 172.21.15.88:0/4058931 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:34.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.300+0000 7efe7b7fe700 1 --2- 172.21.15.88:0/4058931 >> v2:172.21.15.187:3300/0 conn(0x7efe7c0cd660 0x7efe7c06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.300+0000 7efe7bfff700 1 -- 172.21.15.88:0/4058931 >> v2:172.21.15.187:3300/0 conn(0x7efe7c0cd660 msgr2=0x7efe7c06c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.300+0000 7efe7bfff700 1 --2- 172.21.15.88:0/4058931 >> v2:172.21.15.187:3300/0 conn(0x7efe7c0cd660 0x7efe7c06c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.300+0000 7efe7bfff700 1 -- 172.21.15.88:0/4058931 >> v1:172.21.15.88:6789/0 conn(0x7efe7c06cd40 legacy=0x7efe7c06a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.300+0000 7efe7affd700 1 -- 172.21.15.88:0/4058931 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370667241 0 0) 0x7efe7c1612f0 con 0x7efe7c06cd40 2023-05-17T12:24:34.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.300+0000 7efe7bfff700 1 -- 172.21.15.88:0/4058931 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c0cde20 con 0x7efe7c0b8770 2023-05-17T12:24:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.300+0000 7efe7b7fe700 1 --2- 172.21.15.88:0/4058931 >> v2:172.21.15.187:3300/0 conn(0x7efe7c0cd660 0x7efe7c06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:24:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.301+0000 7efe7bfff700 1 --2- 172.21.15.88:0/4058931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0b8770 0x7efe7c0cf260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0098f0 tx=0x7efe6c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90cdddae33f47e5f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.301+0000 7efe7affd700 1 -- 172.21.15.88:0/4058931 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c011830 con 0x7efe7c0b8770 2023-05-17T12:24:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.301+0000 7efe7affd700 1 -- 172.21.15.88:0/4058931 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c011990 con 0x7efe7c0b8770 2023-05-17T12:24:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.301+0000 7efe7affd700 1 -- 172.21.15.88:0/4058931 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c011d20 con 0x7efe7c0b8770 2023-05-17T12:24:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.302+0000 7efe823ff700 1 -- 172.21.15.88:0/4058931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0b8770 msgr2=0x7efe7c0cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:34.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.302+0000 7efe823ff700 1 --2- 172.21.15.88:0/4058931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0b8770 0x7efe7c0cf260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0098f0 tx=0x7efe6c009c00 comp rx=0 tx=0).stop 2023-05-17T12:24:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.302+0000 7efe823ff700 1 -- 172.21.15.88:0/4058931 shutdown_connections 2023-05-17T12:24:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.302+0000 7efe823ff700 1 --2- 172.21.15.88:0/4058931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0b8770 0x7efe7c0cf260 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.302+0000 7efe823ff700 1 --2- 172.21.15.88:0/4058931 >> v2:172.21.15.187:3300/0 conn(0x7efe7c0cd660 0x7efe7c06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.302+0000 7efe823ff700 1 -- 172.21.15.88:0/4058931 >> 172.21.15.88:0/4058931 conn(0x7efe7c0d06e0 msgr2=0x7efe7c0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.302+0000 7efe823ff700 1 -- 172.21.15.88:0/4058931 shutdown_connections 2023-05-17T12:24:34.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.302+0000 7efe823ff700 1 -- 172.21.15.88:0/4058931 wait complete. 2023-05-17T12:24:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.304+0000 7efe823ff700 1 Processor -- start 2023-05-17T12:24:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.304+0000 7efe823ff700 1 -- start start 2023-05-17T12:24:34.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe823ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe7c06cd40 0x7efe7c1f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe823ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe7c0b8770 0x7efe7c15d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe823ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0cd660 0x7efe7c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe823ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0cae20 con 0x7efe7c0b8770 2023-05-17T12:24:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe823ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0ca210 con 0x7efe7c06cd40 2023-05-17T12:24:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe823ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0ca4f0 con 0x7efe7c0cd660 2023-05-17T12:24:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe7b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe7c0b8770 0x7efe7c15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:34.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe7b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe7c0b8770 0x7efe7c15d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37236/0 (socket says 172.21.15.88:37236) 2023-05-17T12:24:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe7b7fe700 1 -- 172.21.15.88:0/2703924991 learned_addr learned my addr 172.21.15.88:0/2703924991 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe7b7fe700 1 -- 172.21.15.88:0/2703924991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0cd660 msgr2=0x7efe7c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe7b7fe700 1 --2- 172.21.15.88:0/2703924991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0cd660 0x7efe7c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe7b7fe700 1 -- 172.21.15.88:0/2703924991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe7c06cd40 msgr2=0x7efe7c1f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:34.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe7b7fe700 1 --2- 172.21.15.88:0/2703924991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe7c06cd40 0x7efe7c1f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.305+0000 7efe7b7fe700 1 -- 172.21.15.88:0/2703924991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe700094a0 con 0x7efe7c0b8770 2023-05-17T12:24:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.306+0000 7efe7b7fe700 1 --2- 172.21.15.88:0/2703924991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe7c0b8770 0x7efe7c15d890 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efe7000ebe0 tx=0x7efe70009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.306+0000 7efe78ff9700 1 -- 172.21.15.88:0/2703924991 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7000c8b0 con 0x7efe7c0b8770 2023-05-17T12:24:34.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.306+0000 7efe78ff9700 1 -- 172.21.15.88:0/2703924991 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7000ca10 con 0x7efe7c0b8770 2023-05-17T12:24:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.306+0000 7efe823ff700 1 -- 172.21.15.88:0/2703924991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c009550 con 0x7efe7c0b8770 2023-05-17T12:24:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.306+0000 7efe78ff9700 1 -- 172.21.15.88:0/2703924991 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7000cda0 con 0x7efe7c0b8770 2023-05-17T12:24:34.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.306+0000 7efe823ff700 1 -- 172.21.15.88:0/2703924991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c160810 con 0x7efe7c0b8770 2023-05-17T12:24:34.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.307+0000 7efe78ff9700 1 -- 172.21.15.88:0/2703924991 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efe70005d20 con 0x7efe7c0b8770 2023-05-17T12:24:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.307+0000 7efe78ff9700 1 -- 172.21.15.88:0/2703924991 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efe700137b0 con 0x7efe7c0b8770 2023-05-17T12:24:34.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.307+0000 7efe823ff700 1 -- 172.21.15.88:0/2703924991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c160530 con 0x7efe7c0b8770 2023-05-17T12:24:34.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.310+0000 7efe78ff9700 1 -- 172.21.15.88:0/2703924991 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7efe70021060 con 0x7efe7c0b8770 2023-05-17T12:24:34.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.392+0000 7efe823ff700 1 -- 172.21.15.88:0/2703924991 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7efe7c160af0 con 0x7efe7c0b8770 2023-05-17T12:24:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.396+0000 7efe78ff9700 1 -- 172.21.15.88:0/2703924991 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7efe7002a090 con 0x7efe7c0b8770 2023-05-17T12:24:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.397+0000 7efe823ff700 1 -- 172.21.15.88:0/2703924991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe7c0b8770 msgr2=0x7efe7c15d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.397+0000 7efe823ff700 1 --2- 172.21.15.88:0/2703924991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe7c0b8770 0x7efe7c15d890 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efe7000ebe0 tx=0x7efe70009e20 comp rx=0 tx=0).stop 2023-05-17T12:24:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.397+0000 7efe823ff700 1 -- 172.21.15.88:0/2703924991 shutdown_connections 2023-05-17T12:24:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.397+0000 7efe823ff700 1 --2- 172.21.15.88:0/2703924991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe7c0cd660 0x7efe7c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.397+0000 7efe823ff700 1 --2- 172.21.15.88:0/2703924991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe7c06cd40 0x7efe7c1f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.397+0000 7efe823ff700 1 --2- 172.21.15.88:0/2703924991 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe7c0b8770 0x7efe7c15d890 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.397+0000 7efe823ff700 1 -- 172.21.15.88:0/2703924991 >> 172.21.15.88:0/2703924991 conn(0x7efe7c0d06e0 msgr2=0x7efe7c0d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.398+0000 7efe823ff700 1 -- 172.21.15.88:0/2703924991 shutdown_connections 2023-05-17T12:24:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:34.398+0000 7efe823ff700 1 -- 172.21.15.88:0/2703924991 wait complete. 2023-05-17T12:24:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2023-05-17T12:24:34.419 INFO:tasks.ceph:check_enable_crimson: False 2023-05-17T12:24:34.419 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-17T12:24:34.419 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:34.420 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-17T12:24:34.467 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:34.463+0000 7fb040882200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T12:24:34.483 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:34.484 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-17T12:24:34.579 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:34.576+0000 7f1d3a91b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-17T12:24:34.599 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:34.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-17T12:24:34.702 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:34.698+0000 7fb040882200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T12:24:34.717 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:24:34.718 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-17T12:24:34.784 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:34.784 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-17T12:24:34.788 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:34.783+0000 7f1d3a91b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-17T12:24:34.847 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:34.849 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-17T12:24:34.950 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:34.950 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-17T12:24:35.052 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:24:35.052 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-17T12:24:35.155 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 8d655120-e2e4-4e56-ad85-62d3af479c45 0 2023-05-17T12:24:35.189 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:35.185+0000 7fb040882200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T12:24:35.200 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:35.196+0000 7f1d3a91b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-17T12:24:35.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.377+0000 7fe7645ff700 1 Processor -- start 2023-05-17T12:24:35.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.377+0000 7fe7645ff700 1 -- start start 2023-05-17T12:24:35.381 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.378+0000 7fe7645ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe75c06c760 0x7fe75c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.381 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.378+0000 7fe7645ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c06b4a0 con 0x7fe75c0b23a0 2023-05-17T12:24:35.382 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.378+0000 7fe7645ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c06a510 con 0x7fe75c0cf190 2023-05-17T12:24:35.382 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.378+0000 7fe7645ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0cd840 con 0x7fe75c06c760 2023-05-17T12:24:35.383 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.378+0000 7fe762b9c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fe75c0cf190 0x7fe75c160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:37640/0 (socket says 172.21.15.187:37640) 2023-05-17T12:24:35.383 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.378+0000 7fe762b9c700 1 -- 172.21.15.187:0/2838444875 learned_addr learned my addr 172.21.15.187:0/2838444875 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-05-17T12:24:35.383 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.378+0000 7fe76239b700 1 --2- 172.21.15.187:0/2838444875 >> v2:172.21.15.88:3300/0 conn(0x7fe75c06c760 0x7fe75c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.383 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.379+0000 7fe761399700 1 -- 172.21.15.187:0/2838444875 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586225349 0 0) 0x7fe75c06a510 con 0x7fe75c0cf190 2023-05-17T12:24:35.384 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.379+0000 7fe761399700 1 -- 172.21.15.187:0/2838444875 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7480035b0 con 0x7fe75c0cf190 2023-05-17T12:24:35.384 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.379+0000 7fe761399700 1 -- 172.21.15.187:0/2838444875 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032599348 0 0) 0x7fe74c001110 con 0x7fe75c0b23a0 2023-05-17T12:24:35.384 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.379+0000 7fe761399700 1 -- 172.21.15.187:0/2838444875 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe75c06a510 con 0x7fe75c0b23a0 2023-05-17T12:24:35.384 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.379+0000 7fe76239b700 1 -- 172.21.15.187:0/2838444875 >> v1:172.21.15.187:6789/0 conn(0x7fe75c0cf190 legacy=0x7fe75c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.384 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.379+0000 7fe76239b700 1 -- 172.21.15.187:0/2838444875 >> v1:172.21.15.88:6789/0 conn(0x7fe75c0b23a0 legacy=0x7fe75c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.384 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.379+0000 7fe76239b700 1 -- 172.21.15.187:0/2838444875 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0cdb20 con 0x7fe75c06c760 2023-05-17T12:24:35.384 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.379+0000 7fe76239b700 1 --2- 172.21.15.187:0/2838444875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe75c06c760 0x7fe75c06af60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe758009840 tx=0x7fe758009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f8856c0e1f2e49 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:35.385 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe761399700 1 -- 172.21.15.187:0/2838444875 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758011830 con 0x7fe75c06c760 2023-05-17T12:24:35.385 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe761399700 1 -- 172.21.15.187:0/2838444875 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758011990 con 0x7fe75c06c760 2023-05-17T12:24:35.385 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe761399700 1 -- 172.21.15.187:0/2838444875 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758011d20 con 0x7fe75c06c760 2023-05-17T12:24:35.386 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe7645ff700 1 -- 172.21.15.187:0/2838444875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe75c06c760 msgr2=0x7fe75c06af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.386 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe7645ff700 1 --2- 172.21.15.187:0/2838444875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe75c06c760 0x7fe75c06af60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe758009840 tx=0x7fe758009b50 comp rx=0 tx=0).stop 2023-05-17T12:24:35.386 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe7645ff700 1 -- 172.21.15.187:0/2838444875 shutdown_connections 2023-05-17T12:24:35.386 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe7645ff700 1 --2- 172.21.15.187:0/2838444875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe75c06c760 0x7fe75c06af60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.386 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe7645ff700 1 -- 172.21.15.187:0/2838444875 >> 172.21.15.187:0/2838444875 conn(0x7fe75c0d06f0 msgr2=0x7fe75c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:35.386 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe7645ff700 1 -- 172.21.15.187:0/2838444875 shutdown_connections 2023-05-17T12:24:35.386 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.380+0000 7fe7645ff700 1 -- 172.21.15.187:0/2838444875 wait complete. 2023-05-17T12:24:35.387 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.382+0000 7fe7645ff700 1 Processor -- start 2023-05-17T12:24:35.387 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.382+0000 7fe7645ff700 1 -- start start 2023-05-17T12:24:35.388 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe7645ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe75c06c760 0x7fe75c0c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.388 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe7645ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe75c0cf190 0x7fe75c0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.389 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe7645ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe75c0c70c0 0x7fe75c156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.389 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe7645ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0c7530 con 0x7fe75c0cf190 2023-05-17T12:24:35.389 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe7645ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c157ac0 con 0x7fe75c06c760 2023-05-17T12:24:35.389 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe7645ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c156eb0 con 0x7fe75c0c70c0 2023-05-17T12:24:35.389 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe76239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe75c06c760 0x7fe75c0c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.389 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe76239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe75c06c760 0x7fe75c0c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:43740/0 (socket says 172.21.15.187:43740) 2023-05-17T12:24:35.389 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe76239b700 1 -- 172.21.15.187:0/86758021 learned_addr learned my addr 172.21.15.187:0/86758021 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:35.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe762b9c700 1 --2- 172.21.15.187:0/86758021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe75c0c70c0 0x7fe75c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.383+0000 7fe761b9a700 1 --2- 172.21.15.187:0/86758021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe75c0cf190 0x7fe75c0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe76239b700 1 -- 172.21.15.187:0/86758021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe75c0c70c0 msgr2=0x7fe75c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe76239b700 1 --2- 172.21.15.187:0/86758021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe75c0c70c0 0x7fe75c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe76239b700 1 -- 172.21.15.187:0/86758021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe75c0cf190 msgr2=0x7fe75c0c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe76239b700 1 --2- 172.21.15.187:0/86758021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe75c0cf190 0x7fe75c0c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe76239b700 1 -- 172.21.15.187:0/86758021 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7580094a0 con 0x7fe75c06c760 2023-05-17T12:24:35.390 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe76239b700 1 --2- 172.21.15.187:0/86758021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe75c06c760 0x7fe75c0c60d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe758009fd0 tx=0x7fe758004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:35.391 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe752ffd700 1 -- 172.21.15.187:0/86758021 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75801a8f0 con 0x7fe75c06c760 2023-05-17T12:24:35.391 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe752ffd700 1 -- 172.21.15.187:0/86758021 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75801aa50 con 0x7fe75c06c760 2023-05-17T12:24:35.391 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe7645ff700 1 -- 172.21.15.187:0/86758021 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c06aa40 con 0x7fe75c06c760 2023-05-17T12:24:35.391 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.384+0000 7fe752ffd700 1 -- 172.21.15.187:0/86758021 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75801adc0 con 0x7fe75c06c760 2023-05-17T12:24:35.391 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.385+0000 7fe7645ff700 1 -- 172.21.15.187:0/86758021 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c06a760 con 0x7fe75c06c760 2023-05-17T12:24:35.391 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.385+0000 7fe752ffd700 1 -- 172.21.15.187:0/86758021 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe75802d6f0 con 0x7fe75c06c760 2023-05-17T12:24:35.391 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.385+0000 7fe752ffd700 1 -- 172.21.15.187:0/86758021 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe7580246a0 con 0x7fe75c06c760 2023-05-17T12:24:35.392 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.386+0000 7fe7645ff700 1 -- 172.21.15.187:0/86758021 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c15cb40 con 0x7fe75c06c760 2023-05-17T12:24:35.392 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.388+0000 7fe752ffd700 1 -- 172.21.15.187:0/86758021 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe758032060 con 0x7fe75c06c760 2023-05-17T12:24:35.477 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.474+0000 7fe7645ff700 1 -- 172.21.15.187:0/86758021 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8d655120-e2e4-4e56-ad85-62d3af479c45", "id": 0} v 0) v1 -- 0x7fe75c074530 con 0x7fe75c06c760 2023-05-17T12:24:35.486 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.482+0000 7fe752ffd700 1 -- 172.21.15.187:0/86758021 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d655120-e2e4-4e56-ad85-62d3af479c45", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe758015020 con 0x7fe75c06c760 2023-05-17T12:24:35.487 INFO:teuthology.orchestra.run.smithi187.stdout:0 2023-05-17T12:24:35.488 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.483+0000 7fe7645ff700 1 -- 172.21.15.187:0/86758021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe75c06c760 msgr2=0x7fe75c0c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.483+0000 7fe7645ff700 1 --2- 172.21.15.187:0/86758021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe75c06c760 0x7fe75c0c60d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe758009fd0 tx=0x7fe758004750 comp rx=0 tx=0).stop 2023-05-17T12:24:35.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.483+0000 7fe7645ff700 1 -- 172.21.15.187:0/86758021 shutdown_connections 2023-05-17T12:24:35.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.483+0000 7fe7645ff700 1 --2- 172.21.15.187:0/86758021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe75c0c70c0 0x7fe75c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.483+0000 7fe7645ff700 1 --2- 172.21.15.187:0/86758021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe75c06c760 0x7fe75c0c60d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.483+0000 7fe7645ff700 1 --2- 172.21.15.187:0/86758021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe75c0cf190 0x7fe75c0c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.483+0000 7fe7645ff700 1 -- 172.21.15.187:0/86758021 >> 172.21.15.187:0/86758021 conn(0x7fe75c0d06f0 msgr2=0x7fe75c0b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:35.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.483+0000 7fe7645ff700 1 -- 172.21.15.187:0/86758021 shutdown_connections 2023-05-17T12:24:35.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.483+0000 7fe7645ff700 1 -- 172.21.15.187:0/86758021 wait complete. 2023-05-17T12:24:35.503 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 4dc8ee5c-4dd5-4abf-86e9-2038e1353d59 1 2023-05-17T12:24:35.686 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.682+0000 7fce8d9ff700 1 Processor -- start 2023-05-17T12:24:35.686 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.682+0000 7fce8d9ff700 1 -- start start 2023-05-17T12:24:35.688 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.683+0000 7fce8d9ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fce880b23a0 0x7fce8806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.688 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.684+0000 7fce8d9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8806b4a0 con 0x7fce880cf190 2023-05-17T12:24:35.689 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.684+0000 7fce8d9ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8806a510 con 0x7fce8806c760 2023-05-17T12:24:35.689 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.684+0000 7fce8d9ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce880cd840 con 0x7fce880b23a0 2023-05-17T12:24:35.689 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.684+0000 7fce867fc700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fce880b23a0 0x7fce8806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.690 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.684+0000 7fce86ffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fce8806c760 0x7fce8806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:37656/0 (socket says 172.21.15.187:37656) 2023-05-17T12:24:35.690 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.684+0000 7fce86ffd700 1 -- 172.21.15.187:0/4065674742 learned_addr learned my addr 172.21.15.187:0/4065674742 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-05-17T12:24:35.690 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.684+0000 7fce85ffb700 1 -- 172.21.15.187:0/4065674742 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392359324 0 0) 0x7fce8806a510 con 0x7fce8806c760 2023-05-17T12:24:35.690 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.684+0000 7fce85ffb700 1 -- 172.21.15.187:0/4065674742 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce700035b0 con 0x7fce8806c760 2023-05-17T12:24:35.690 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.684+0000 7fce85ffb700 1 -- 172.21.15.187:0/4065674742 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404605779 0 0) 0x7fce700035b0 con 0x7fce8806c760 2023-05-17T12:24:35.690 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.685+0000 7fce867fc700 1 -- 172.21.15.187:0/4065674742 >> v1:172.21.15.187:6789/0 conn(0x7fce8806c760 legacy=0x7fce8806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.691 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.685+0000 7fce867fc700 1 -- 172.21.15.187:0/4065674742 >> v1:172.21.15.88:6789/0 conn(0x7fce880cf190 legacy=0x7fce88160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.691 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.685+0000 7fce867fc700 1 -- 172.21.15.187:0/4065674742 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce880cdb20 con 0x7fce880b23a0 2023-05-17T12:24:35.691 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.685+0000 7fce867fc700 1 --2- 172.21.15.187:0/4065674742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880b23a0 0x7fce8806af60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0097c0 tx=0x7fce7c009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0d6c739060a840f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:35.693 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.685+0000 7fce85ffb700 1 -- 172.21.15.187:0/4065674742 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78001670 con 0x7fce880b23a0 2023-05-17T12:24:35.693 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.685+0000 7fce85ffb700 1 -- 172.21.15.187:0/4065674742 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c004030 con 0x7fce880b23a0 2023-05-17T12:24:35.693 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.685+0000 7fce85ffb700 1 -- 172.21.15.187:0/4065674742 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0043c0 con 0x7fce880b23a0 2023-05-17T12:24:35.694 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.686+0000 7fce8d9ff700 1 -- 172.21.15.187:0/4065674742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880b23a0 msgr2=0x7fce8806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.694 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.686+0000 7fce8d9ff700 1 --2- 172.21.15.187:0/4065674742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880b23a0 0x7fce8806af60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0097c0 tx=0x7fce7c009ad0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.694 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.686+0000 7fce8d9ff700 1 -- 172.21.15.187:0/4065674742 shutdown_connections 2023-05-17T12:24:35.694 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.686+0000 7fce8d9ff700 1 --2- 172.21.15.187:0/4065674742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880b23a0 0x7fce8806af60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.695 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.686+0000 7fce8d9ff700 1 -- 172.21.15.187:0/4065674742 >> 172.21.15.187:0/4065674742 conn(0x7fce880d06f0 msgr2=0x7fce880d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:35.695 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.686+0000 7fce8d9ff700 1 -- 172.21.15.187:0/4065674742 shutdown_connections 2023-05-17T12:24:35.695 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.686+0000 7fce8d9ff700 1 -- 172.21.15.187:0/4065674742 wait complete. 2023-05-17T12:24:35.695 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.688+0000 7fce8d9ff700 1 Processor -- start 2023-05-17T12:24:35.696 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.688+0000 7fce8d9ff700 1 -- start start 2023-05-17T12:24:35.696 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce8d9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce8806c760 0x7fce8814c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.696 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce8d9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880cf190 0x7fce880b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.697 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce8d9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce88159330 0x7fce880cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.697 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce8d9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce880b7fd0 con 0x7fce8806c760 2023-05-17T12:24:35.697 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce8d9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce880b73c0 con 0x7fce880cf190 2023-05-17T12:24:35.698 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce8d9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880b76a0 con 0x7fce88159330 2023-05-17T12:24:35.698 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce867fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880cf190 0x7fce880b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.698 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce877fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce88159330 0x7fce880cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.699 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce867fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880cf190 0x7fce880b8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:43754/0 (socket says 172.21.15.187:43754) 2023-05-17T12:24:35.699 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce867fc700 1 -- 172.21.15.187:0/2367176860 learned_addr learned my addr 172.21.15.187:0/2367176860 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:35.699 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce86ffd700 1 --2- 172.21.15.187:0/2367176860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce8806c760 0x7fce8814c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.699 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce877fe700 1 -- 172.21.15.187:0/2367176860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880cf190 msgr2=0x7fce880b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.700 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce877fe700 1 --2- 172.21.15.187:0/2367176860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880cf190 0x7fce880b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.700 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce877fe700 1 -- 172.21.15.187:0/2367176860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce8806c760 msgr2=0x7fce8814c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.700 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce877fe700 1 --2- 172.21.15.187:0/2367176860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce8806c760 0x7fce8814c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.701 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce877fe700 1 -- 172.21.15.187:0/2367176860 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c0094a0 con 0x7fce88159330 2023-05-17T12:24:35.701 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.689+0000 7fce867fc700 1 --2- 172.21.15.187:0/2367176860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880cf190 0x7fce880b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:24:35.701 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.690+0000 7fce877fe700 1 --2- 172.21.15.187:0/2367176860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce88159330 0x7fce880cb680 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fce8000cae0 tx=0x7fce8000cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:35.701 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.690+0000 7fce6ffff700 1 -- 172.21.15.187:0/2367176860 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80003c00 con 0x7fce88159330 2023-05-17T12:24:35.702 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.690+0000 7fce6ffff700 1 -- 172.21.15.187:0/2367176860 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80003d60 con 0x7fce88159330 2023-05-17T12:24:35.702 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.690+0000 7fce6ffff700 1 -- 172.21.15.187:0/2367176860 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000aa20 con 0x7fce88159330 2023-05-17T12:24:35.702 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.690+0000 7fce8d9ff700 1 -- 172.21.15.187:0/2367176860 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8806aa40 con 0x7fce88159330 2023-05-17T12:24:35.702 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.690+0000 7fce8d9ff700 1 -- 172.21.15.187:0/2367176860 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8806a760 con 0x7fce88159330 2023-05-17T12:24:35.704 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.690+0000 7fce6ffff700 1 -- 172.21.15.187:0/2367176860 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fce800050d0 con 0x7fce88159330 2023-05-17T12:24:35.704 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.690+0000 7fce6ffff700 1 -- 172.21.15.187:0/2367176860 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fce800124c0 con 0x7fce88159330 2023-05-17T12:24:35.704 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.691+0000 7fce8d9ff700 1 -- 172.21.15.187:0/2367176860 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8815cb40 con 0x7fce88159330 2023-05-17T12:24:35.704 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.694+0000 7fce6ffff700 1 -- 172.21.15.187:0/2367176860 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fce8806b4a0 con 0x7fce88159330 2023-05-17T12:24:35.783 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.780+0000 7fce8d9ff700 1 -- 172.21.15.187:0/2367176860 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4dc8ee5c-4dd5-4abf-86e9-2038e1353d59", "id": 1} v 0) v1 -- 0x7fce880b8140 con 0x7fce88159330 2023-05-17T12:24:35.791 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.787+0000 7fce6ffff700 1 -- 172.21.15.187:0/2367176860 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4dc8ee5c-4dd5-4abf-86e9-2038e1353d59", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce80005590 con 0x7fce88159330 2023-05-17T12:24:35.791 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-05-17T12:24:35.792 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.788+0000 7fce8d9ff700 1 -- 172.21.15.187:0/2367176860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce88159330 msgr2=0x7fce880cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.792 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.788+0000 7fce8d9ff700 1 --2- 172.21.15.187:0/2367176860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce88159330 0x7fce880cb680 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fce8000cae0 tx=0x7fce8000cdf0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.792 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.788+0000 7fce8d9ff700 1 -- 172.21.15.187:0/2367176860 shutdown_connections 2023-05-17T12:24:35.793 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.788+0000 7fce8d9ff700 1 --2- 172.21.15.187:0/2367176860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce88159330 0x7fce880cb680 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.793 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.788+0000 7fce8d9ff700 1 --2- 172.21.15.187:0/2367176860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce8806c760 0x7fce8814c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.793 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.788+0000 7fce8d9ff700 1 --2- 172.21.15.187:0/2367176860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce880cf190 0x7fce880b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.794 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.788+0000 7fce8d9ff700 1 -- 172.21.15.187:0/2367176860 >> 172.21.15.187:0/2367176860 conn(0x7fce880d06f0 msgr2=0x7fce880b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:35.794 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.789+0000 7fce8d9ff700 1 -- 172.21.15.187:0/2367176860 shutdown_connections 2023-05-17T12:24:35.794 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.789+0000 7fce8d9ff700 1 -- 172.21.15.187:0/2367176860 wait complete. 2023-05-17T12:24:35.809 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 5b72c775-3c4a-4d6d-ba6d-a23fbbba168f 2 2023-05-17T12:24:35.851 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:35.848+0000 7f1d3a91b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T12:24:35.877 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:35.873+0000 7fb040882200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-17T12:24:35.990 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.987+0000 7f515b1ff700 1 Processor -- start 2023-05-17T12:24:35.991 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.987+0000 7f515b1ff700 1 -- start start 2023-05-17T12:24:35.992 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.988+0000 7f515b1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f515406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.992 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.988+0000 7f515b1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515406b4a0 con 0x7f51540b23a0 2023-05-17T12:24:35.992 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.988+0000 7f515b1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515406a510 con 0x7f51540cf190 2023-05-17T12:24:35.992 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.988+0000 7f515b1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51540cd840 con 0x7f515406c760 2023-05-17T12:24:35.992 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f5158f9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f515406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.992 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f515979c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f51540cf190 0x7f5154160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:37670/0 (socket says 172.21.15.187:37670) 2023-05-17T12:24:35.993 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f515979c700 1 -- 172.21.15.187:0/2976671803 learned_addr learned my addr 172.21.15.187:0/2976671803 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-05-17T12:24:35.994 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f5158f9b700 1 -- 172.21.15.187:0/2976671803 >> v1:172.21.15.187:6789/0 conn(0x7f51540cf190 legacy=0x7f5154160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.994 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f5158f9b700 1 -- 172.21.15.187:0/2976671803 >> v1:172.21.15.88:6789/0 conn(0x7f51540b23a0 legacy=0x7f515406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:35.994 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f5158f9b700 1 -- 172.21.15.187:0/2976671803 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540cdb20 con 0x7f515406c760 2023-05-17T12:24:35.994 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f51537fe700 1 -- 172.21.15.187:0/2976671803 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841440701 0 0) 0x7f515406a510 con 0x7f51540cf190 2023-05-17T12:24:35.994 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f5158f9b700 1 --2- 172.21.15.187:0/2976671803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f515406af60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5148009870 tx=0x7f5148009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c023666ba7cda58 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:35.995 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f51537fe700 1 -- 172.21.15.187:0/2976671803 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148004230 con 0x7f515406c760 2023-05-17T12:24:35.995 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f51537fe700 1 -- 172.21.15.187:0/2976671803 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148004390 con 0x7f515406c760 2023-05-17T12:24:35.995 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.989+0000 7f51537fe700 1 -- 172.21.15.187:0/2976671803 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51480036a0 con 0x7f515406c760 2023-05-17T12:24:35.995 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.990+0000 7f515b1ff700 1 -- 172.21.15.187:0/2976671803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 msgr2=0x7f515406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:35.995 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.990+0000 7f515b1ff700 1 --2- 172.21.15.187:0/2976671803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f515406af60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5148009870 tx=0x7f5148009b80 comp rx=0 tx=0).stop 2023-05-17T12:24:35.995 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.990+0000 7f515b1ff700 1 -- 172.21.15.187:0/2976671803 shutdown_connections 2023-05-17T12:24:35.995 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.990+0000 7f515b1ff700 1 --2- 172.21.15.187:0/2976671803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f515406af60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:35.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.990+0000 7f515b1ff700 1 -- 172.21.15.187:0/2976671803 >> 172.21.15.187:0/2976671803 conn(0x7f51540d06f0 msgr2=0x7f51540d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:35.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.990+0000 7f515b1ff700 1 -- 172.21.15.187:0/2976671803 shutdown_connections 2023-05-17T12:24:35.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.990+0000 7f515b1ff700 1 -- 172.21.15.187:0/2976671803 wait complete. 2023-05-17T12:24:35.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.992+0000 7f515b1ff700 1 Processor -- start 2023-05-17T12:24:35.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.992+0000 7f515b1ff700 1 -- start start 2023-05-17T12:24:35.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f515b1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f5154153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f515b1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51540cf190 0x7f51540c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f515b1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51540ca120 0x7f51540cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:35.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f515b1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5154153ac0 con 0x7f51540cf190 2023-05-17T12:24:35.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f515b1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51540ca690 con 0x7f51540ca120 2023-05-17T12:24:35.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f515b1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51540ca970 con 0x7f515406c760 2023-05-17T12:24:35.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f5158f9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f5154153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f515979c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51540ca120 0x7f51540cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:35.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f5158f9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f5154153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:42464/0 (socket says 172.21.15.187:42464) 2023-05-17T12:24:35.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.993+0000 7f5158f9b700 1 -- 172.21.15.187:0/3949949212 learned_addr learned my addr 172.21.15.187:0/3949949212 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:35.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f5153fff700 1 --2- 172.21.15.187:0/3949949212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51540cf190 0x7f51540c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.000 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f5158f9b700 1 -- 172.21.15.187:0/3949949212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51540ca120 msgr2=0x7f51540cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.000 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f5158f9b700 1 --2- 172.21.15.187:0/3949949212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51540ca120 0x7f51540cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.000 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f5158f9b700 1 -- 172.21.15.187:0/3949949212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51540cf190 msgr2=0x7f51540c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.000 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f5158f9b700 1 --2- 172.21.15.187:0/3949949212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51540cf190 0x7f51540c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.000 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f5158f9b700 1 -- 172.21.15.187:0/3949949212 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51480094a0 con 0x7f515406c760 2023-05-17T12:24:36.000 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f5158f9b700 1 --2- 172.21.15.187:0/3949949212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f5154153580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51480097c0 tx=0x7f51480047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:36.001 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f51517fa700 1 -- 172.21.15.187:0/3949949212 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148011630 con 0x7f515406c760 2023-05-17T12:24:36.001 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f51517fa700 1 -- 172.21.15.187:0/3949949212 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51480117b0 con 0x7f515406c760 2023-05-17T12:24:36.001 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.994+0000 7f515b1ff700 1 -- 172.21.15.187:0/3949949212 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515406aa40 con 0x7f515406c760 2023-05-17T12:24:36.001 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.995+0000 7f51517fa700 1 -- 172.21.15.187:0/3949949212 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148011b60 con 0x7f515406c760 2023-05-17T12:24:36.001 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.995+0000 7f515b1ff700 1 -- 172.21.15.187:0/3949949212 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515406a760 con 0x7f515406c760 2023-05-17T12:24:36.001 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.995+0000 7f51517fa700 1 -- 172.21.15.187:0/3949949212 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f514801b440 con 0x7f515406c760 2023-05-17T12:24:36.001 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.995+0000 7f51517fa700 1 -- 172.21.15.187:0/3949949212 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5148025830 con 0x7f515406c760 2023-05-17T12:24:36.001 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:35.996+0000 7f515b1ff700 1 -- 172.21.15.187:0/3949949212 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515415cb40 con 0x7f515406c760 2023-05-17T12:24:36.003 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.000+0000 7f51517fa700 1 -- 172.21.15.187:0/3949949212 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f515406b4a0 con 0x7f515406c760 2023-05-17T12:24:36.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.085+0000 7f515b1ff700 1 -- 172.21.15.187:0/3949949212 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5b72c775-3c4a-4d6d-ba6d-a23fbbba168f", "id": 2} v 0) v1 -- 0x7f5154074530 con 0x7f515406c760 2023-05-17T12:24:36.091 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:36.088+0000 7f1d3a91b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-17T12:24:36.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.091+0000 7f51517fa700 1 -- 172.21.15.187:0/3949949212 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b72c775-3c4a-4d6d-ba6d-a23fbbba168f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f51480254e0 con 0x7f515406c760 2023-05-17T12:24:36.095 INFO:teuthology.orchestra.run.smithi187.stdout:2 2023-05-17T12:24:36.096 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.092+0000 7f515b1ff700 1 -- 172.21.15.187:0/3949949212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 msgr2=0x7f5154153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.096 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.092+0000 7f515b1ff700 1 --2- 172.21.15.187:0/3949949212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f5154153580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51480097c0 tx=0x7f51480047c0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.096 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.092+0000 7f515b1ff700 1 -- 172.21.15.187:0/3949949212 shutdown_connections 2023-05-17T12:24:36.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.092+0000 7f515b1ff700 1 --2- 172.21.15.187:0/3949949212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51540ca120 0x7f51540cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.092+0000 7f515b1ff700 1 --2- 172.21.15.187:0/3949949212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f515406c760 0x7f5154153580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.092+0000 7f515b1ff700 1 --2- 172.21.15.187:0/3949949212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51540cf190 0x7f51540c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.092+0000 7f515b1ff700 1 -- 172.21.15.187:0/3949949212 >> 172.21.15.187:0/3949949212 conn(0x7f51540d06f0 msgr2=0x7f51540d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:36.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.093+0000 7f515b1ff700 1 -- 172.21.15.187:0/3949949212 shutdown_connections 2023-05-17T12:24:36.097 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.093+0000 7f515b1ff700 1 -- 172.21.15.187:0/3949949212 wait complete. 2023-05-17T12:24:36.112 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new d12a1bf2-1510-462a-a734-fb204b1c8465 3 2023-05-17T12:24:36.115 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:36.111+0000 7fb040882200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-17T12:24:36.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.335+0000 7f697e1ff700 1 Processor -- start 2023-05-17T12:24:36.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.335+0000 7f697e1ff700 1 -- start start 2023-05-17T12:24:36.339 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.336+0000 7f697e1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f697806c760 0x7f697806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.340 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.336+0000 7f697e1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697806b4a0 con 0x7f69780cf190 2023-05-17T12:24:36.340 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.336+0000 7f697e1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697806a510 con 0x7f69780b23a0 2023-05-17T12:24:36.340 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.336+0000 7f697e1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69780cd840 con 0x7f697806c760 2023-05-17T12:24:36.340 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.336+0000 7f6976ffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f69780b23a0 0x7f697806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:37682/0 (socket says 172.21.15.187:37682) 2023-05-17T12:24:36.340 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.336+0000 7f6976ffd700 1 -- 172.21.15.187:0/4195586131 learned_addr learned my addr 172.21.15.187:0/4195586131 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-05-17T12:24:36.340 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.336+0000 7f69777fe700 1 --2- 172.21.15.187:0/4195586131 >> v2:172.21.15.88:3300/0 conn(0x7f697806c760 0x7f697806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.341 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.337+0000 7f69777fe700 1 -- 172.21.15.187:0/4195586131 >> v1:172.21.15.187:6789/0 conn(0x7f69780b23a0 legacy=0x7f697806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.337+0000 7f69777fe700 1 -- 172.21.15.187:0/4195586131 >> v1:172.21.15.88:6789/0 conn(0x7f69780cf190 legacy=0x7f6978160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.337+0000 7f69767fc700 1 -- 172.21.15.187:0/4195586131 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872317870 0 0) 0x7f697806a510 con 0x7f69780b23a0 2023-05-17T12:24:36.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.337+0000 7f69777fe700 1 -- 172.21.15.187:0/4195586131 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780cdb20 con 0x7f697806c760 2023-05-17T12:24:36.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.337+0000 7f69777fe700 1 --2- 172.21.15.187:0/4195586131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f697806c760 0x7f697806af60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6968009840 tx=0x7f6968009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968a85d4e6891488 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:36.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.337+0000 7f69767fc700 1 -- 172.21.15.187:0/4195586131 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968004230 con 0x7f697806c760 2023-05-17T12:24:36.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.337+0000 7f69767fc700 1 -- 172.21.15.187:0/4195586131 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968004390 con 0x7f697806c760 2023-05-17T12:24:36.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.337+0000 7f69767fc700 1 -- 172.21.15.187:0/4195586131 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680036a0 con 0x7f697806c760 2023-05-17T12:24:36.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.338+0000 7f697e1ff700 1 -- 172.21.15.187:0/4195586131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f697806c760 msgr2=0x7f697806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.338+0000 7f697e1ff700 1 --2- 172.21.15.187:0/4195586131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f697806c760 0x7f697806af60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6968009840 tx=0x7f6968009b50 comp rx=0 tx=0).stop 2023-05-17T12:24:36.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.338+0000 7f697e1ff700 1 -- 172.21.15.187:0/4195586131 shutdown_connections 2023-05-17T12:24:36.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.338+0000 7f697e1ff700 1 --2- 172.21.15.187:0/4195586131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f697806c760 0x7f697806af60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.338+0000 7f697e1ff700 1 -- 172.21.15.187:0/4195586131 >> 172.21.15.187:0/4195586131 conn(0x7f69780d06f0 msgr2=0x7f69780d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:36.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.338+0000 7f697e1ff700 1 -- 172.21.15.187:0/4195586131 shutdown_connections 2023-05-17T12:24:36.344 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.338+0000 7f697e1ff700 1 -- 172.21.15.187:0/4195586131 wait complete. 2023-05-17T12:24:36.346 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.340+0000 7f697e1ff700 1 Processor -- start 2023-05-17T12:24:36.346 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.340+0000 7f697e1ff700 1 -- start start 2023-05-17T12:24:36.346 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f697e1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f697806c760 0x7f6978157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.346 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f697e1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69780cf190 0x7f69780b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.347 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f697e1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69781585c0 0x7f69780cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.347 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f697e1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69781e62f0 con 0x7f69780cf190 2023-05-17T12:24:36.347 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f697e1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69781e65d0 con 0x7f697806c760 2023-05-17T12:24:36.347 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f697e1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69781e68b0 con 0x7f69781585c0 2023-05-17T12:24:36.347 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f69777fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f697806c760 0x7f6978157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.347 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f69777fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f697806c760 0x7f6978157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:43768/0 (socket says 172.21.15.187:43768) 2023-05-17T12:24:36.347 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f69777fe700 1 -- 172.21.15.187:0/572144004 learned_addr learned my addr 172.21.15.187:0/572144004 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:36.348 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f6977fff700 1 --2- 172.21.15.187:0/572144004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69781585c0 0x7f69780cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.348 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f6976ffd700 1 --2- 172.21.15.187:0/572144004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69780cf190 0x7f69780b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.348 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f69777fe700 1 -- 172.21.15.187:0/572144004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69781585c0 msgr2=0x7f69780cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.348 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f69777fe700 1 --2- 172.21.15.187:0/572144004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69781585c0 0x7f69780cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.348 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f69777fe700 1 -- 172.21.15.187:0/572144004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69780cf190 msgr2=0x7f69780b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.348 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f69777fe700 1 --2- 172.21.15.187:0/572144004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69780cf190 0x7f69780b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.348 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.341+0000 7f69777fe700 1 -- 172.21.15.187:0/572144004 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680094a0 con 0x7f697806c760 2023-05-17T12:24:36.349 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.342+0000 7f69777fe700 1 --2- 172.21.15.187:0/572144004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f697806c760 0x7f6978157e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69680090b0 tx=0x7f6968004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:36.349 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.342+0000 7f695ffff700 1 -- 172.21.15.187:0/572144004 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968003cd0 con 0x7f697806c760 2023-05-17T12:24:36.349 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.342+0000 7f695ffff700 1 -- 172.21.15.187:0/572144004 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696801f070 con 0x7f697806c760 2023-05-17T12:24:36.349 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.342+0000 7f695ffff700 1 -- 172.21.15.187:0/572144004 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968011870 con 0x7f697806c760 2023-05-17T12:24:36.349 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.342+0000 7f697e1ff700 1 -- 172.21.15.187:0/572144004 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697806aa40 con 0x7f697806c760 2023-05-17T12:24:36.349 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.342+0000 7f697e1ff700 1 -- 172.21.15.187:0/572144004 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697806a760 con 0x7f697806c760 2023-05-17T12:24:36.349 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.342+0000 7f695ffff700 1 -- 172.21.15.187:0/572144004 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6968021030 con 0x7f697806c760 2023-05-17T12:24:36.349 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.343+0000 7f695ffff700 1 -- 172.21.15.187:0/572144004 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f696801a440 con 0x7f697806c760 2023-05-17T12:24:36.350 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.343+0000 7f697e1ff700 1 -- 172.21.15.187:0/572144004 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697815cb40 con 0x7f697806c760 2023-05-17T12:24:36.350 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.346+0000 7f695ffff700 1 -- 172.21.15.187:0/572144004 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f6968044b10 con 0x7f697806c760 2023-05-17T12:24:36.435 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.431+0000 7f697e1ff700 1 -- 172.21.15.187:0/572144004 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d12a1bf2-1510-462a-a734-fb204b1c8465", "id": 3} v 0) v1 -- 0x7f697815cb40 con 0x7f697806c760 2023-05-17T12:24:36.442 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.439+0000 7f695ffff700 1 -- 172.21.15.187:0/572144004 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d12a1bf2-1510-462a-a734-fb204b1c8465", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6968033020 con 0x7f697806c760 2023-05-17T12:24:36.443 INFO:teuthology.orchestra.run.smithi187.stdout:3 2023-05-17T12:24:36.444 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.440+0000 7f697e1ff700 1 -- 172.21.15.187:0/572144004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f697806c760 msgr2=0x7f6978157e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.444 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.440+0000 7f697e1ff700 1 --2- 172.21.15.187:0/572144004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f697806c760 0x7f6978157e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69680090b0 tx=0x7f6968004750 comp rx=0 tx=0).stop 2023-05-17T12:24:36.444 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.440+0000 7f697e1ff700 1 -- 172.21.15.187:0/572144004 shutdown_connections 2023-05-17T12:24:36.444 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.440+0000 7f697e1ff700 1 --2- 172.21.15.187:0/572144004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69781585c0 0x7f69780cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.444 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.440+0000 7f697e1ff700 1 --2- 172.21.15.187:0/572144004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f697806c760 0x7f6978157e30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.444 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.440+0000 7f697e1ff700 1 --2- 172.21.15.187:0/572144004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69780cf190 0x7f69780b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.445 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.440+0000 7f697e1ff700 1 -- 172.21.15.187:0/572144004 >> 172.21.15.187:0/572144004 conn(0x7f69780d06f0 msgr2=0x7f69780c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:36.445 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.440+0000 7f697e1ff700 1 -- 172.21.15.187:0/572144004 shutdown_connections 2023-05-17T12:24:36.445 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.440+0000 7f697e1ff700 1 -- 172.21.15.187:0/572144004 wait complete. 2023-05-17T12:24:36.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 15a8e45a-7004-4f11-8790-cb6575823725 4 2023-05-17T12:24:36.562 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:36.559+0000 7f1d3a91b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T12:24:36.567 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:36.564+0000 7fb040882200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-17T12:24:36.643 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.640+0000 7f28f29ff700 1 Processor -- start 2023-05-17T12:24:36.644 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.640+0000 7f28f29ff700 1 -- start start 2023-05-17T12:24:36.645 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.641+0000 7f28f29ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28ec0b23a0 0x7f28ec06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.645 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.641+0000 7f28f29ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28ec0cf190 0x7f28ec160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.645 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.641+0000 7f28f29ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec06b4a0 con 0x7f28ec06c760 2023-05-17T12:24:36.645 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.641+0000 7f28f29ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec06a510 con 0x7f28ec0b23a0 2023-05-17T12:24:36.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.641+0000 7f28f29ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec0cd840 con 0x7f28ec0cf190 2023-05-17T12:24:36.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.641+0000 7f28f0f9c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28ec0cf190 0x7f28ec160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.641+0000 7f28eb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28ec0b23a0 0x7f28ec06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.641+0000 7f28f0f9c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28ec0cf190 0x7f28ec160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:43774/0 (socket says 172.21.15.187:43774) 2023-05-17T12:24:36.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.641+0000 7f28f0f9c700 1 -- 172.21.15.187:0/3470879549 learned_addr learned my addr 172.21.15.187:0/3470879549 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:36.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.642+0000 7f28f0f9c700 1 -- 172.21.15.187:0/3470879549 >> v2:172.21.15.88:3300/0 conn(0x7f28ec0b23a0 msgr2=0x7f28ec06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:36.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.642+0000 7f28f0f9c700 1 --2- 172.21.15.187:0/3470879549 >> v2:172.21.15.88:3300/0 conn(0x7f28ec0b23a0 0x7f28ec06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.642+0000 7f28f0f9c700 1 -- 172.21.15.187:0/3470879549 >> v1:172.21.15.88:6789/0 conn(0x7f28ec06c760 legacy=0x7f28ec06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.647 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.642+0000 7f28f0f9c700 1 -- 172.21.15.187:0/3470879549 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec0cdb20 con 0x7f28ec0cf190 2023-05-17T12:24:36.647 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.642+0000 7f28eaffd700 1 -- 172.21.15.187:0/3470879549 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193809385 0 0) 0x7f28dc001110 con 0x7f28ec06c760 2023-05-17T12:24:36.648 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.642+0000 7f28f0f9c700 1 --2- 172.21.15.187:0/3470879549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 0x7f28ec160380 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28ec08c360 tx=0x7f28e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b517fc7b9f3bc7e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:36.648 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.642+0000 7f28eaffd700 1 -- 172.21.15.187:0/3470879549 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400e070 con 0x7f28ec0cf190 2023-05-17T12:24:36.648 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.642+0000 7f28eaffd700 1 -- 172.21.15.187:0/3470879549 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400b910 con 0x7f28ec0cf190 2023-05-17T12:24:36.648 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.642+0000 7f28eaffd700 1 -- 172.21.15.187:0/3470879549 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400bcc0 con 0x7f28ec0cf190 2023-05-17T12:24:36.649 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.643+0000 7f28f29ff700 1 -- 172.21.15.187:0/3470879549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 msgr2=0x7f28ec160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.649 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.643+0000 7f28f29ff700 1 --2- 172.21.15.187:0/3470879549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 0x7f28ec160380 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28ec08c360 tx=0x7f28e400b330 comp rx=0 tx=0).stop 2023-05-17T12:24:36.649 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.643+0000 7f28f29ff700 1 -- 172.21.15.187:0/3470879549 shutdown_connections 2023-05-17T12:24:36.649 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.643+0000 7f28f29ff700 1 --2- 172.21.15.187:0/3470879549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 0x7f28ec160380 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.649 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.643+0000 7f28f29ff700 1 --2- 172.21.15.187:0/3470879549 >> v2:172.21.15.88:3300/0 conn(0x7f28ec0b23a0 0x7f28ec06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.649 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.643+0000 7f28f29ff700 1 -- 172.21.15.187:0/3470879549 >> 172.21.15.187:0/3470879549 conn(0x7f28ec0d06f0 msgr2=0x7f28ec0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:36.650 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.643+0000 7f28f29ff700 1 -- 172.21.15.187:0/3470879549 shutdown_connections 2023-05-17T12:24:36.650 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.643+0000 7f28f29ff700 1 -- 172.21.15.187:0/3470879549 wait complete. 2023-05-17T12:24:36.650 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.645+0000 7f28f29ff700 1 Processor -- start 2023-05-17T12:24:36.650 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.645+0000 7f28f29ff700 1 -- start start 2023-05-17T12:24:36.652 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28f29ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ec06c760 0x7f28ec154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.652 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28f29ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 0x7f28ec0c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.652 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28f29ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ec0b77d0 0x7f28ec0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28f29ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0c78f0 con 0x7f28ec06c760 2023-05-17T12:24:36.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28f29ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0c6d20 con 0x7f28ec0cf190 2023-05-17T12:24:36.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28f29ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0c6fc0 con 0x7f28ec0b77d0 2023-05-17T12:24:36.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28eb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 0x7f28ec0c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28eb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 0x7f28ec0c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:43776/0 (socket says 172.21.15.187:43776) 2023-05-17T12:24:36.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28f0f9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ec0b77d0 0x7f28ec0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28eb7fe700 1 -- 172.21.15.187:0/1884318213 learned_addr learned my addr 172.21.15.187:0/1884318213 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:36.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28ebfff700 1 --2- 172.21.15.187:0/1884318213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ec06c760 0x7f28ec154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28f0f9c700 1 -- 172.21.15.187:0/1884318213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 msgr2=0x7f28ec0c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.646+0000 7f28f0f9c700 1 --2- 172.21.15.187:0/1884318213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 0x7f28ec0c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28f0f9c700 1 -- 172.21.15.187:0/1884318213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ec06c760 msgr2=0x7f28ec154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28f0f9c700 1 --2- 172.21.15.187:0/1884318213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ec06c760 0x7f28ec154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.655 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28f0f9c700 1 -- 172.21.15.187:0/1884318213 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4009b30 con 0x7f28ec0b77d0 2023-05-17T12:24:36.655 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28eb7fe700 1 --2- 172.21.15.187:0/1884318213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 0x7f28ec0c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:24:36.655 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28f0f9c700 1 --2- 172.21.15.187:0/1884318213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ec0b77d0 0x7f28ec0c7d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f28e4015000 tx=0x7f28e4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:36.655 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28e8ff9700 1 -- 172.21.15.187:0/1884318213 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4004880 con 0x7f28ec0b77d0 2023-05-17T12:24:36.655 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28e8ff9700 1 -- 172.21.15.187:0/1884318213 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e40099b0 con 0x7f28ec0b77d0 2023-05-17T12:24:36.655 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28f29ff700 1 -- 172.21.15.187:0/1884318213 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec06aa40 con 0x7f28ec0b77d0 2023-05-17T12:24:36.655 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28e8ff9700 1 -- 172.21.15.187:0/1884318213 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e401b670 con 0x7f28ec0b77d0 2023-05-17T12:24:36.656 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.647+0000 7f28f29ff700 1 -- 172.21.15.187:0/1884318213 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec06a760 con 0x7f28ec0b77d0 2023-05-17T12:24:36.656 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.648+0000 7f28e8ff9700 1 -- 172.21.15.187:0/1884318213 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f28e401bad0 con 0x7f28ec0b77d0 2023-05-17T12:24:36.656 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.648+0000 7f28e8ff9700 1 -- 172.21.15.187:0/1884318213 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f28e4024cd0 con 0x7f28ec0b77d0 2023-05-17T12:24:36.656 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.649+0000 7f28f29ff700 1 -- 172.21.15.187:0/1884318213 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec15cb40 con 0x7f28ec0b77d0 2023-05-17T12:24:36.657 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.651+0000 7f28e8ff9700 1 -- 172.21.15.187:0/1884318213 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f28e401f070 con 0x7f28ec0b77d0 2023-05-17T12:24:36.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.736+0000 7f28f29ff700 1 -- 172.21.15.187:0/1884318213 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15a8e45a-7004-4f11-8790-cb6575823725", "id": 4} v 0) v1 -- 0x7f28ec074530 con 0x7f28ec0b77d0 2023-05-17T12:24:36.747 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.743+0000 7f28e8ff9700 1 -- 172.21.15.187:0/1884318213 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15a8e45a-7004-4f11-8790-cb6575823725", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28e40247c0 con 0x7f28ec0b77d0 2023-05-17T12:24:36.747 INFO:teuthology.orchestra.run.smithi187.stdout:4 2023-05-17T12:24:36.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.745+0000 7f28f29ff700 1 -- 172.21.15.187:0/1884318213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ec0b77d0 msgr2=0x7f28ec0c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.745+0000 7f28f29ff700 1 --2- 172.21.15.187:0/1884318213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ec0b77d0 0x7f28ec0c7d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f28e4015000 tx=0x7f28e4004ad0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.745+0000 7f28f29ff700 1 -- 172.21.15.187:0/1884318213 shutdown_connections 2023-05-17T12:24:36.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.745+0000 7f28f29ff700 1 --2- 172.21.15.187:0/1884318213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28ec0b77d0 0x7f28ec0c7d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.745+0000 7f28f29ff700 1 --2- 172.21.15.187:0/1884318213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ec06c760 0x7f28ec154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.745+0000 7f28f29ff700 1 --2- 172.21.15.187:0/1884318213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28ec0cf190 0x7f28ec0c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.745+0000 7f28f29ff700 1 -- 172.21.15.187:0/1884318213 >> 172.21.15.187:0/1884318213 conn(0x7f28ec0d06f0 msgr2=0x7f28ec0b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:36.751 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.745+0000 7f28f29ff700 1 -- 172.21.15.187:0/1884318213 shutdown_connections 2023-05-17T12:24:36.751 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.745+0000 7f28f29ff700 1 -- 172.21.15.187:0/1884318213 wait complete. 2023-05-17T12:24:36.764 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new f7b8b23d-a2c2-4565-a243-a8afe667a365 5 2023-05-17T12:24:36.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.943+0000 7f6800fff700 1 Processor -- start 2023-05-17T12:24:36.947 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.943+0000 7f6800fff700 1 -- start start 2023-05-17T12:24:36.950 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.944+0000 7f6800fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0af400 0x7f67fc0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.944+0000 7f6800fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67fc0d0300 0x7f67fc15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f6800fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67fc0b0d40 con 0x7f67fc0cfe90 2023-05-17T12:24:36.951 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f6800fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc0b08b0 con 0x7f67fc0d0300 2023-05-17T12:24:36.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f6800fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc15ac80 con 0x7f67fc0af400 2023-05-17T12:24:36.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f67fa59c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0af400 0x7f67fc0b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f67fa59c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0af400 0x7f67fc0b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:42488/0 (socket says 172.21.15.187:42488) 2023-05-17T12:24:36.952 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f67fa59c700 1 -- 172.21.15.187:0/2560189086 learned_addr learned my addr 172.21.15.187:0/2560189086 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:36.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f67fad9d700 1 --2- 172.21.15.187:0/2560189086 >> v2:172.21.15.88:3300/0 conn(0x7f67fc0d0300 0x7f67fc15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f67fa59c700 1 -- 172.21.15.187:0/2560189086 >> v2:172.21.15.88:3300/0 conn(0x7f67fc0d0300 msgr2=0x7f67fc15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:36.953 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f67fa59c700 1 --2- 172.21.15.187:0/2560189086 >> v2:172.21.15.88:3300/0 conn(0x7f67fc0d0300 0x7f67fc15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.954 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f67fa59c700 1 -- 172.21.15.187:0/2560189086 >> v1:172.21.15.88:6789/0 conn(0x7f67fc0cfe90 legacy=0x7f67fc15e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.954 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f67fa59c700 1 -- 172.21.15.187:0/2560189086 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc0afca0 con 0x7f67fc0af400 2023-05-17T12:24:36.955 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.945+0000 7f67fa59c700 1 --2- 172.21.15.187:0/2560189086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0af400 0x7f67fc0b21a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0098f0 tx=0x7f67ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1a4ff01a8333486 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:36.955 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.946+0000 7f67f9d9b700 1 -- 172.21.15.187:0/2560189086 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec00b8a0 con 0x7f67fc0af400 2023-05-17T12:24:36.956 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.946+0000 7f67f9d9b700 1 -- 172.21.15.187:0/2560189086 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec00ba00 con 0x7f67fc0af400 2023-05-17T12:24:36.956 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.946+0000 7f67f9d9b700 1 -- 172.21.15.187:0/2560189086 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec00bd90 con 0x7f67fc0af400 2023-05-17T12:24:36.957 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.946+0000 7f6800fff700 1 -- 172.21.15.187:0/2560189086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0af400 msgr2=0x7f67fc0b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.957 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.946+0000 7f6800fff700 1 --2- 172.21.15.187:0/2560189086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0af400 0x7f67fc0b21a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0098f0 tx=0x7f67ec009c00 comp rx=0 tx=0).stop 2023-05-17T12:24:36.957 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.946+0000 7f6800fff700 1 -- 172.21.15.187:0/2560189086 shutdown_connections 2023-05-17T12:24:36.958 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.946+0000 7f6800fff700 1 --2- 172.21.15.187:0/2560189086 >> v2:172.21.15.88:3300/0 conn(0x7f67fc0d0300 0x7f67fc15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.958 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.946+0000 7f6800fff700 1 --2- 172.21.15.187:0/2560189086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0af400 0x7f67fc0b21a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.958 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.946+0000 7f6800fff700 1 -- 172.21.15.187:0/2560189086 >> 172.21.15.187:0/2560189086 conn(0x7f67fc0b2de0 msgr2=0x7f67fc0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:36.959 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.947+0000 7f6800fff700 1 -- 172.21.15.187:0/2560189086 shutdown_connections 2023-05-17T12:24:36.959 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.947+0000 7f6800fff700 1 -- 172.21.15.187:0/2560189086 wait complete. 2023-05-17T12:24:36.962 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.948+0000 7f6800fff700 1 Processor -- start 2023-05-17T12:24:36.962 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.948+0000 7f6800fff700 1 -- start start 2023-05-17T12:24:36.962 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.949+0000 7f6800fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67fc0af400 0x7f67fc154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.963 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.949+0000 7f6800fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67fc0cfe90 0x7f67fc154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.963 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.949+0000 7f6800fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0d0300 0x7f67fc157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:36.963 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.949+0000 7f6800fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0c7090 con 0x7f67fc0cfe90 2023-05-17T12:24:36.963 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.949+0000 7f6800fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc1581f0 con 0x7f67fc0af400 2023-05-17T12:24:36.964 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.949+0000 7f6800fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0c7330 con 0x7f67fc0d0300 2023-05-17T12:24:36.964 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.949+0000 7f67fa59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67fc0af400 0x7f67fc154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.964 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.949+0000 7f67fa59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67fc0af400 0x7f67fc154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:43792/0 (socket says 172.21.15.187:43792) 2023-05-17T12:24:36.965 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.949+0000 7f67fa59c700 1 -- 172.21.15.187:0/727714832 learned_addr learned my addr 172.21.15.187:0/727714832 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:36.965 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67f3fff700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67fc0cfe90 0x7f67fc154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.965 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67fad9d700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0d0300 0x7f67fc157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:36.965 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67fa59c700 1 -- 172.21.15.187:0/727714832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0d0300 msgr2=0x7f67fc157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.966 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67fa59c700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0d0300 0x7f67fc157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.966 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67fa59c700 1 -- 172.21.15.187:0/727714832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67fc0cfe90 msgr2=0x7f67fc154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:36.966 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67fa59c700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67fc0cfe90 0x7f67fc154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:36.966 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67fa59c700 1 -- 172.21.15.187:0/727714832 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec009550 con 0x7f67fc0af400 2023-05-17T12:24:36.967 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67fad9d700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0d0300 0x7f67fc157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:24:36.967 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67fa59c700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67fc0af400 0x7f67fc154d90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009c40 tx=0x7f67ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:36.968 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.950+0000 7f67f2ffd700 1 -- 172.21.15.187:0/727714832 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec004590 con 0x7f67fc0af400 2023-05-17T12:24:36.968 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.951+0000 7f67f2ffd700 1 -- 172.21.15.187:0/727714832 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec01e070 con 0x7f67fc0af400 2023-05-17T12:24:36.968 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.951+0000 7f67f2ffd700 1 -- 172.21.15.187:0/727714832 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0038e0 con 0x7f67fc0af400 2023-05-17T12:24:36.969 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.951+0000 7f6800fff700 1 -- 172.21.15.187:0/727714832 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc0b0260 con 0x7f67fc0af400 2023-05-17T12:24:36.969 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.951+0000 7f6800fff700 1 -- 172.21.15.187:0/727714832 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc0aff80 con 0x7f67fc0af400 2023-05-17T12:24:36.969 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.951+0000 7f67f2ffd700 1 -- 172.21.15.187:0/727714832 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f67ec003d40 con 0x7f67fc0af400 2023-05-17T12:24:36.969 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.951+0000 7f67f2ffd700 1 -- 172.21.15.187:0/727714832 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f67ec020070 con 0x7f67fc0af400 2023-05-17T12:24:36.970 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.952+0000 7f6800fff700 1 -- 172.21.15.187:0/727714832 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc0b0540 con 0x7f67fc0af400 2023-05-17T12:24:36.970 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:36.954+0000 7f67f2ffd700 1 -- 172.21.15.187:0/727714832 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f67ec02a020 con 0x7f67fc0af400 2023-05-17T12:24:37.043 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.040+0000 7f6800fff700 1 -- 172.21.15.187:0/727714832 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f7b8b23d-a2c2-4565-a243-a8afe667a365", "id": 5} v 0) v1 -- 0x7f67fc074530 con 0x7f67fc0af400 2023-05-17T12:24:37.051 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.047+0000 7f67f2ffd700 1 -- 172.21.15.187:0/727714832 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7b8b23d-a2c2-4565-a243-a8afe667a365", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f67ec034020 con 0x7f67fc0af400 2023-05-17T12:24:37.051 INFO:teuthology.orchestra.run.smithi187.stdout:5 2023-05-17T12:24:37.052 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.049+0000 7f6800fff700 1 -- 172.21.15.187:0/727714832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67fc0af400 msgr2=0x7f67fc154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.052 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.049+0000 7f6800fff700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67fc0af400 0x7f67fc154d90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009c40 tx=0x7f67ec004750 comp rx=0 tx=0).stop 2023-05-17T12:24:37.052 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.049+0000 7f6800fff700 1 -- 172.21.15.187:0/727714832 shutdown_connections 2023-05-17T12:24:37.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.049+0000 7f6800fff700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67fc0d0300 0x7f67fc157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.049+0000 7f6800fff700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67fc0af400 0x7f67fc154d90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.049+0000 7f6800fff700 1 --2- 172.21.15.187:0/727714832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67fc0cfe90 0x7f67fc154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.049+0000 7f6800fff700 1 -- 172.21.15.187:0/727714832 >> 172.21.15.187:0/727714832 conn(0x7f67fc0b2de0 msgr2=0x7f67fc06c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:37.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.049+0000 7f6800fff700 1 -- 172.21.15.187:0/727714832 shutdown_connections 2023-05-17T12:24:37.053 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.049+0000 7f6800fff700 1 -- 172.21.15.187:0/727714832 wait complete. 2023-05-17T12:24:37.069 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new ac0a3f4b-4d94-4857-acce-e2798bd54be2 6 2023-05-17T12:24:37.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.251+0000 7fd7c2fff700 1 Processor -- start 2023-05-17T12:24:37.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.251+0000 7fd7c2fff700 1 -- start start 2023-05-17T12:24:37.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.252+0000 7fd7c2fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7bc06af60 0x7fd7bc160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.252+0000 7fd7c2fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc06a510 con 0x7fd7bc06c760 2023-05-17T12:24:37.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.252+0000 7fd7c2fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc0cf8a0 con 0x7fd7bc0b23a0 2023-05-17T12:24:37.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7c2fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc0cd840 con 0x7fd7bc06af60 2023-05-17T12:24:37.257 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7bbfff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd7bc0b23a0 0x7fd7bc0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:37698/0 (socket says 172.21.15.187:37698) 2023-05-17T12:24:37.257 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7bbfff700 1 -- 172.21.15.187:0/2827548362 learned_addr learned my addr 172.21.15.187:0/2827548362 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-05-17T12:24:37.257 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7c159c700 1 --2- 172.21.15.187:0/2827548362 >> v2:172.21.15.88:3300/0 conn(0x7fd7bc06af60 0x7fd7bc160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.258 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7bb7fe700 1 -- 172.21.15.187:0/2827548362 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991463722 0 0) 0x7fd7bc0cf8a0 con 0x7fd7bc0b23a0 2023-05-17T12:24:37.258 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7bb7fe700 1 -- 172.21.15.187:0/2827548362 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ac0035b0 con 0x7fd7bc0b23a0 2023-05-17T12:24:37.259 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7bb7fe700 1 -- 172.21.15.187:0/2827548362 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177456782 0 0) 0x7fd7bc06a510 con 0x7fd7bc06c760 2023-05-17T12:24:37.259 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7bb7fe700 1 -- 172.21.15.187:0/2827548362 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7bc0cf8a0 con 0x7fd7bc06c760 2023-05-17T12:24:37.259 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7c159c700 1 -- 172.21.15.187:0/2827548362 >> v1:172.21.15.187:6789/0 conn(0x7fd7bc0b23a0 legacy=0x7fd7bc0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.259 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7c159c700 1 -- 172.21.15.187:0/2827548362 >> v1:172.21.15.88:6789/0 conn(0x7fd7bc06c760 legacy=0x7fd7bc06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.259 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.253+0000 7fd7c159c700 1 -- 172.21.15.187:0/2827548362 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc0cdb20 con 0x7fd7bc06af60 2023-05-17T12:24:37.259 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.254+0000 7fd7c159c700 1 --2- 172.21.15.187:0/2827548362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7bc06af60 0x7fd7bc160380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009d90 tx=0x7fd7b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20a187e4176e5f2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:37.259 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.254+0000 7fd7bb7fe700 1 -- 172.21.15.187:0/2827548362 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400e070 con 0x7fd7bc06af60 2023-05-17T12:24:37.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.254+0000 7fd7bb7fe700 1 -- 172.21.15.187:0/2827548362 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b400bb20 con 0x7fd7bc06af60 2023-05-17T12:24:37.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.254+0000 7fd7bb7fe700 1 -- 172.21.15.187:0/2827548362 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4012430 con 0x7fd7bc06af60 2023-05-17T12:24:37.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.254+0000 7fd7c2fff700 1 -- 172.21.15.187:0/2827548362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7bc06af60 msgr2=0x7fd7bc160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.254+0000 7fd7c2fff700 1 --2- 172.21.15.187:0/2827548362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7bc06af60 0x7fd7bc160380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009d90 tx=0x7fd7b400b330 comp rx=0 tx=0).stop 2023-05-17T12:24:37.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.255+0000 7fd7c2fff700 1 -- 172.21.15.187:0/2827548362 shutdown_connections 2023-05-17T12:24:37.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.255+0000 7fd7c2fff700 1 --2- 172.21.15.187:0/2827548362 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7bc06af60 0x7fd7bc160380 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.255+0000 7fd7c2fff700 1 -- 172.21.15.187:0/2827548362 >> 172.21.15.187:0/2827548362 conn(0x7fd7bc0d06f0 msgr2=0x7fd7bc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:37.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.255+0000 7fd7c2fff700 1 -- 172.21.15.187:0/2827548362 shutdown_connections 2023-05-17T12:24:37.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.255+0000 7fd7c2fff700 1 -- 172.21.15.187:0/2827548362 wait complete. 2023-05-17T12:24:37.262 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.256+0000 7fd7c2fff700 1 Processor -- start 2023-05-17T12:24:37.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.257+0000 7fd7c2fff700 1 -- start start 2023-05-17T12:24:37.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.257+0000 7fd7c2fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7bc06af60 0x7fd7bc155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.257+0000 7fd7c2fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7bc06c760 0x7fd7bc152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.257+0000 7fd7c2fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7bc0c8d50 0x7fd7bc0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.257+0000 7fd7c2fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc153e20 con 0x7fd7bc06c760 2023-05-17T12:24:37.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.257+0000 7fd7c2fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0c9730 con 0x7fd7bc0c8d50 2023-05-17T12:24:37.263 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.257+0000 7fd7c2fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc152a60 con 0x7fd7bc06af60 2023-05-17T12:24:37.264 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c0d9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7bc06af60 0x7fd7bc155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.264 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c159c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7bc0c8d50 0x7fd7bc0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.264 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c0d9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7bc06af60 0x7fd7bc155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:42504/0 (socket says 172.21.15.187:42504) 2023-05-17T12:24:37.264 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c0d9b700 1 -- 172.21.15.187:0/3821210723 learned_addr learned my addr 172.21.15.187:0/3821210723 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:37.264 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7bbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7bc06c760 0x7fd7bc152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.264 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c0d9b700 1 -- 172.21.15.187:0/3821210723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7bc0c8d50 msgr2=0x7fd7bc0c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.264 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c0d9b700 1 --2- 172.21.15.187:0/3821210723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7bc0c8d50 0x7fd7bc0c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.265 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c0d9b700 1 -- 172.21.15.187:0/3821210723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7bc06c760 msgr2=0x7fd7bc152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.265 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c0d9b700 1 --2- 172.21.15.187:0/3821210723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7bc06c760 0x7fd7bc152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.265 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c0d9b700 1 -- 172.21.15.187:0/3821210723 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009a70 con 0x7fd7bc06af60 2023-05-17T12:24:37.265 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c159c700 1 --2- 172.21.15.187:0/3821210723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7bc0c8d50 0x7fd7bc0c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:24:37.265 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.258+0000 7fd7c0d9b700 1 --2- 172.21.15.187:0/3821210723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7bc06af60 0x7fd7bc155900 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000c550 tx=0x7fd7b000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:37.265 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.259+0000 7fd7b97fa700 1 -- 172.21.15.187:0/3821210723 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00052d0 con 0x7fd7bc06af60 2023-05-17T12:24:37.265 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.259+0000 7fd7b97fa700 1 -- 172.21.15.187:0/3821210723 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b0005430 con 0x7fd7bc06af60 2023-05-17T12:24:37.265 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.259+0000 7fd7c2fff700 1 -- 172.21.15.187:0/3821210723 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc06aa40 con 0x7fd7bc06af60 2023-05-17T12:24:37.266 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.259+0000 7fd7b97fa700 1 -- 172.21.15.187:0/3821210723 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00038c0 con 0x7fd7bc06af60 2023-05-17T12:24:37.266 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.259+0000 7fd7c2fff700 1 -- 172.21.15.187:0/3821210723 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc06a760 con 0x7fd7bc06af60 2023-05-17T12:24:37.266 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.259+0000 7fd7b97fa700 1 -- 172.21.15.187:0/3821210723 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd7b0003d20 con 0x7fd7bc06af60 2023-05-17T12:24:37.266 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.259+0000 7fd7b97fa700 1 -- 172.21.15.187:0/3821210723 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd7b0012a10 con 0x7fd7bc06af60 2023-05-17T12:24:37.266 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.260+0000 7fd7c2fff700 1 -- 172.21.15.187:0/3821210723 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc15cb40 con 0x7fd7bc06af60 2023-05-17T12:24:37.267 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.262+0000 7fd7b97fa700 1 -- 172.21.15.187:0/3821210723 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd7b0017070 con 0x7fd7bc06af60 2023-05-17T12:24:37.353 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.349+0000 7fd7c2fff700 1 -- 172.21.15.187:0/3821210723 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ac0a3f4b-4d94-4857-acce-e2798bd54be2", "id": 6} v 0) v1 -- 0x7fd7bc06b380 con 0x7fd7bc06af60 2023-05-17T12:24:37.357 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.354+0000 7fd7b97fa700 1 -- 172.21.15.187:0/3821210723 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac0a3f4b-4d94-4857-acce-e2798bd54be2", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd7b0011e50 con 0x7fd7bc06af60 2023-05-17T12:24:37.358 INFO:teuthology.orchestra.run.smithi187.stdout:6 2023-05-17T12:24:37.358 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.355+0000 7fd7c2fff700 1 -- 172.21.15.187:0/3821210723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7bc06af60 msgr2=0x7fd7bc155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.359 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.355+0000 7fd7c2fff700 1 --2- 172.21.15.187:0/3821210723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7bc06af60 0x7fd7bc155900 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000c550 tx=0x7fd7b000c860 comp rx=0 tx=0).stop 2023-05-17T12:24:37.359 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.355+0000 7fd7c2fff700 1 -- 172.21.15.187:0/3821210723 shutdown_connections 2023-05-17T12:24:37.359 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.355+0000 7fd7c2fff700 1 --2- 172.21.15.187:0/3821210723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7bc0c8d50 0x7fd7bc0c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.359 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.355+0000 7fd7c2fff700 1 --2- 172.21.15.187:0/3821210723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7bc06af60 0x7fd7bc155900 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.359 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.355+0000 7fd7c2fff700 1 --2- 172.21.15.187:0/3821210723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7bc06c760 0x7fd7bc152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.359 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.355+0000 7fd7c2fff700 1 -- 172.21.15.187:0/3821210723 >> 172.21.15.187:0/3821210723 conn(0x7fd7bc0d06f0 msgr2=0x7fd7bc06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:37.360 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.355+0000 7fd7c2fff700 1 -- 172.21.15.187:0/3821210723 shutdown_connections 2023-05-17T12:24:37.360 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.355+0000 7fd7c2fff700 1 -- 172.21.15.187:0/3821210723 wait complete. 2023-05-17T12:24:37.375 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 8a5e0c25-1500-4453-b8fc-951fb9e0fea7 7 2023-05-17T12:24:37.387 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:37.384+0000 7fb040882200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T12:24:37.397 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:37.394+0000 7f1d3a91b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-17T12:24:37.480 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:37.476+0000 7fb040882200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T12:24:37.493 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:37.490+0000 7f1d3a91b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-17T12:24:37.560 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.556+0000 7fc5a17ff700 1 Processor -- start 2023-05-17T12:24:37.560 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.556+0000 7fc5a17ff700 1 -- start start 2023-05-17T12:24:37.561 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc5a17ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc5a17ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc59c0b4750 0x7fc59c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc5a17ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c06b430 con 0x7fc59c0c9370 2023-05-17T12:24:37.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc5a17ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c06b680 con 0x7fc59c0b4750 2023-05-17T12:24:37.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc5a17ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c06b960 con 0x7fc59c06a510 2023-05-17T12:24:37.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc593fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc593fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:42508/0 (socket says 172.21.15.187:42508) 2023-05-17T12:24:37.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc593fff700 1 -- 172.21.15.187:0/2789790344 learned_addr learned my addr 172.21.15.187:0/2789790344 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:37.563 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc59b7fe700 1 --2- 172.21.15.187:0/2789790344 >> v2:172.21.15.88:3300/0 conn(0x7fc59c0b4750 0x7fc59c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.564 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc593fff700 1 -- 172.21.15.187:0/2789790344 >> v2:172.21.15.88:3300/0 conn(0x7fc59c0b4750 msgr2=0x7fc59c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:37.564 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.558+0000 7fc593fff700 1 --2- 172.21.15.187:0/2789790344 >> v2:172.21.15.88:3300/0 conn(0x7fc59c0b4750 0x7fc59c0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.564 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.559+0000 7fc593fff700 1 -- 172.21.15.187:0/2789790344 >> v1:172.21.15.88:6789/0 conn(0x7fc59c0c9370 legacy=0x7fc59c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.564 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.559+0000 7fc593fff700 1 -- 172.21.15.187:0/2789790344 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c06bc40 con 0x7fc59c06a510 2023-05-17T12:24:37.564 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.559+0000 7fc593fff700 1 --2- 172.21.15.187:0/2789790344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c0cd1a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc5840098f0 tx=0x7fc584009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb58523e59b4d13 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:37.564 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.559+0000 7fc59a7fc700 1 -- 172.21.15.187:0/2789790344 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584011830 con 0x7fc59c06a510 2023-05-17T12:24:37.564 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.559+0000 7fc59a7fc700 1 -- 172.21.15.187:0/2789790344 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc584011990 con 0x7fc59c06a510 2023-05-17T12:24:37.565 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.559+0000 7fc59a7fc700 1 -- 172.21.15.187:0/2789790344 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584011d20 con 0x7fc59c06a510 2023-05-17T12:24:37.565 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.560+0000 7fc5a17ff700 1 -- 172.21.15.187:0/2789790344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 msgr2=0x7fc59c0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.560+0000 7fc5a17ff700 1 --2- 172.21.15.187:0/2789790344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c0cd1a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc5840098f0 tx=0x7fc584009c00 comp rx=0 tx=0).stop 2023-05-17T12:24:37.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.560+0000 7fc5a17ff700 1 -- 172.21.15.187:0/2789790344 shutdown_connections 2023-05-17T12:24:37.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.560+0000 7fc5a17ff700 1 --2- 172.21.15.187:0/2789790344 >> v2:172.21.15.88:3300/0 conn(0x7fc59c0b4750 0x7fc59c0cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.560+0000 7fc5a17ff700 1 --2- 172.21.15.187:0/2789790344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c0cd1a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.560+0000 7fc5a17ff700 1 -- 172.21.15.187:0/2789790344 >> 172.21.15.187:0/2789790344 conn(0x7fc59c0cf970 msgr2=0x7fc59c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:37.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.560+0000 7fc5a17ff700 1 -- 172.21.15.187:0/2789790344 shutdown_connections 2023-05-17T12:24:37.567 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.560+0000 7fc5a17ff700 1 -- 172.21.15.187:0/2789790344 wait complete. 2023-05-17T12:24:37.569 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.561+0000 7fc5a17ff700 1 Processor -- start 2023-05-17T12:24:37.569 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.562+0000 7fc5a17ff700 1 -- start start 2023-05-17T12:24:37.569 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.562+0000 7fc5a17ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c1e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.569 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.562+0000 7fc5a17ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc59c0b4750 0x7fc59c1406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.569 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.562+0000 7fc5a17ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59c0c9370 0x7fc59c1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.569 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.562+0000 7fc5a17ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1e6c20 con 0x7fc59c0b4750 2023-05-17T12:24:37.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.562+0000 7fc5a17ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c152370 con 0x7fc59c0c9370 2023-05-17T12:24:37.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.562+0000 7fc5a17ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1e6360 con 0x7fc59c06a510 2023-05-17T12:24:37.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc59affd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c1e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc59affd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c1e66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:42518/0 (socket says 172.21.15.187:42518) 2023-05-17T12:24:37.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc593fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc59c0b4750 0x7fc59c1406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc59affd700 1 -- 172.21.15.187:0/3677117558 learned_addr learned my addr 172.21.15.187:0/3677117558 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-05-17T12:24:37.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc59b7fe700 1 --2- 172.21.15.187:0/3677117558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59c0c9370 0x7fc59c1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc593fff700 1 -- 172.21.15.187:0/3677117558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 msgr2=0x7fc59c1e66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc593fff700 1 --2- 172.21.15.187:0/3677117558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c1e66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc593fff700 1 -- 172.21.15.187:0/3677117558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59c0c9370 msgr2=0x7fc59c1530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc593fff700 1 --2- 172.21.15.187:0/3677117558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59c0c9370 0x7fc59c1530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc593fff700 1 -- 172.21.15.187:0/3677117558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc584009550 con 0x7fc59c0b4750 2023-05-17T12:24:37.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.563+0000 7fc59affd700 1 --2- 172.21.15.187:0/3677117558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c1e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:24:37.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.564+0000 7fc593fff700 1 --2- 172.21.15.187:0/3677117558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc59c0b4750 0x7fc59c1406f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc59c06f430 tx=0x7fc584004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:37.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.564+0000 7fc5937fe700 1 -- 172.21.15.187:0/3677117558 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584004400 con 0x7fc59c0b4750 2023-05-17T12:24:37.572 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.564+0000 7fc5937fe700 1 -- 172.21.15.187:0/3677117558 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58401f070 con 0x7fc59c0b4750 2023-05-17T12:24:37.572 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.564+0000 7fc5a17ff700 1 -- 172.21.15.187:0/3677117558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c071f30 con 0x7fc59c0b4750 2023-05-17T12:24:37.572 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.564+0000 7fc5937fe700 1 -- 172.21.15.187:0/3677117558 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840038e0 con 0x7fc59c0b4750 2023-05-17T12:24:37.572 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.564+0000 7fc5a17ff700 1 -- 172.21.15.187:0/3677117558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c15a8e0 con 0x7fc59c0b4750 2023-05-17T12:24:37.572 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.564+0000 7fc5937fe700 1 -- 172.21.15.187:0/3677117558 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc584021030 con 0x7fc59c0b4750 2023-05-17T12:24:37.572 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.564+0000 7fc5937fe700 1 -- 172.21.15.187:0/3677117558 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc58401a450 con 0x7fc59c0b4750 2023-05-17T12:24:37.572 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.565+0000 7fc5a17ff700 1 -- 172.21.15.187:0/3677117558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c0720c0 con 0x7fc59c0b4750 2023-05-17T12:24:37.573 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.568+0000 7fc5937fe700 1 -- 172.21.15.187:0/3677117558 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fc584015020 con 0x7fc59c0b4750 2023-05-17T12:24:37.652 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:37.648+0000 7fb040882200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T12:24:37.655 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.651+0000 7fc5a17ff700 1 -- 172.21.15.187:0/3677117558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8a5e0c25-1500-4453-b8fc-951fb9e0fea7", "id": 7} v 0) v1 -- 0x7fc59c074530 con 0x7fc59c0b4750 2023-05-17T12:24:37.658 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.655+0000 7fc5937fe700 1 -- 172.21.15.187:0/3677117558 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a5e0c25-1500-4453-b8fc-951fb9e0fea7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc584003d40 con 0x7fc59c0b4750 2023-05-17T12:24:37.659 INFO:teuthology.orchestra.run.smithi187.stdout:7 2023-05-17T12:24:37.659 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.656+0000 7fc5a17ff700 1 -- 172.21.15.187:0/3677117558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc59c0b4750 msgr2=0x7fc59c1406f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.656+0000 7fc5a17ff700 1 --2- 172.21.15.187:0/3677117558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc59c0b4750 0x7fc59c1406f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc59c06f430 tx=0x7fc584004750 comp rx=0 tx=0).stop 2023-05-17T12:24:37.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.656+0000 7fc5a17ff700 1 -- 172.21.15.187:0/3677117558 shutdown_connections 2023-05-17T12:24:37.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.656+0000 7fc5a17ff700 1 --2- 172.21.15.187:0/3677117558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59c0c9370 0x7fc59c1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.656+0000 7fc5a17ff700 1 --2- 172.21.15.187:0/3677117558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc59c06a510 0x7fc59c1e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.656+0000 7fc5a17ff700 1 --2- 172.21.15.187:0/3677117558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc59c0b4750 0x7fc59c1406f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.660 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.656+0000 7fc5a17ff700 1 -- 172.21.15.187:0/3677117558 >> 172.21.15.187:0/3677117558 conn(0x7fc59c0cf970 msgr2=0x7fc59c0cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:37.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.656+0000 7fc5a17ff700 1 -- 172.21.15.187:0/3677117558 shutdown_connections 2023-05-17T12:24:37.661 INFO:teuthology.orchestra.run.smithi187.stderr:2023-05-17T12:24:37.656+0000 7fc5a17ff700 1 -- 172.21.15.187:0/3677117558 wait complete. 2023-05-17T12:24:37.661 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:37.658+0000 7f1d3a91b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-17T12:24:37.676 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-17T12:24:37.676 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-17T12:24:37.681 INFO:tasks.ceph.osd.0:Started 2023-05-17T12:24:37.682 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-17T12:24:37.682 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-17T12:24:37.687 INFO:tasks.ceph.osd.1:Started 2023-05-17T12:24:37.687 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-17T12:24:37.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-17T12:24:37.692 INFO:tasks.ceph.osd.2:Started 2023-05-17T12:24:37.693 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-17T12:24:37.693 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-17T12:24:37.697 INFO:tasks.ceph.osd.3:Started 2023-05-17T12:24:37.697 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-17T12:24:37.698 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-17T12:24:37.720 INFO:tasks.ceph.osd.4:Started 2023-05-17T12:24:37.720 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-17T12:24:37.720 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-17T12:24:37.724 INFO:tasks.ceph.osd.5:Started 2023-05-17T12:24:37.724 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-17T12:24:37.725 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-17T12:24:37.729 INFO:tasks.ceph.osd.6:Started 2023-05-17T12:24:37.730 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-17T12:24:37.730 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-17T12:24:37.735 INFO:tasks.ceph.osd.7:Started 2023-05-17T12:24:37.735 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:24:37.760 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:37.756+0000 7f1d3a91b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T12:24:37.766 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:37.763+0000 7fb040882200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-17T12:24:37.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.987+0000 7f64bf7ff700 1 Processor -- start 2023-05-17T12:24:37.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.987+0000 7f64bf7ff700 1 -- start start 2023-05-17T12:24:37.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.988+0000 7f64bf7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64b815c840 0x7f64b806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.988+0000 7f64bf7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:37.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.988+0000 7f64bf7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b80cd6b0 con 0x7f64b806c330 2023-05-17T12:24:37.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.988+0000 7f64bf7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b80cdf50 con 0x7f64b815c840 2023-05-17T12:24:37.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.988+0000 7f64bf7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80cf860 con 0x7f64b806b0b0 2023-05-17T12:24:37.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64bd59b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64b815c840 0x7f64b806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64bd59b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64b815c840 0x7f64b806b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37266/0 (socket says 172.21.15.88:37266) 2023-05-17T12:24:37.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64bd59b700 1 -- 172.21.15.88:0/3594346054 learned_addr learned my addr 172.21.15.88:0/3594346054 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64bdd9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f64b806c330 0x7f64b8160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60714/0 (socket says 172.21.15.88:60714) 2023-05-17T12:24:37.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64bcd9a700 1 --2- 172.21.15.88:0/3594346054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:37.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64bd59b700 1 -- 172.21.15.88:0/3594346054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 msgr2=0x7f64b80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:37.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64bd59b700 1 --2- 172.21.15.88:0/3594346054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64bd59b700 1 -- 172.21.15.88:0/3594346054 >> v1:172.21.15.88:6789/0 conn(0x7f64b806c330 legacy=0x7f64b8160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64bd59b700 1 -- 172.21.15.88:0/3594346054 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80b2460 con 0x7f64b815c840 2023-05-17T12:24:37.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.989+0000 7f64affff700 1 -- 172.21.15.88:0/3594346054 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422246640 0 0) 0x7f64b80cd6b0 con 0x7f64b806c330 2023-05-17T12:24:37.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64bd59b700 1 --2- 172.21.15.88:0/3594346054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 0x7f64b806b940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f64b40098f0 tx=0x7f64b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3560461fb1b75f4d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:37.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64affff700 1 -- 172.21.15.88:0/3594346054 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4011830 con 0x7f64b815c840 2023-05-17T12:24:37.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64affff700 1 -- 172.21.15.88:0/3594346054 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4011990 con 0x7f64b815c840 2023-05-17T12:24:37.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64affff700 1 -- 172.21.15.88:0/3594346054 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4011d20 con 0x7f64b815c840 2023-05-17T12:24:37.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64bf7ff700 1 -- 172.21.15.88:0/3594346054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 msgr2=0x7f64b806b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:37.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64bf7ff700 1 --2- 172.21.15.88:0/3594346054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 0x7f64b806b940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f64b40098f0 tx=0x7f64b4009c00 comp rx=0 tx=0).stop 2023-05-17T12:24:37.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64bf7ff700 1 -- 172.21.15.88:0/3594346054 shutdown_connections 2023-05-17T12:24:37.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64bf7ff700 1 --2- 172.21.15.88:0/3594346054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 0x7f64b806b940 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64bf7ff700 1 --2- 172.21.15.88:0/3594346054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:37.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64bf7ff700 1 -- 172.21.15.88:0/3594346054 >> 172.21.15.88:0/3594346054 conn(0x7f64b80d3060 msgr2=0x7f64b80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:37.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.990+0000 7f64bf7ff700 1 -- 172.21.15.88:0/3594346054 shutdown_connections 2023-05-17T12:24:37.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.991+0000 7f64bf7ff700 1 -- 172.21.15.88:0/3594346054 wait complete. 2023-05-17T12:24:37.998 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:37.994+0000 7f1d3a91b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T12:24:37.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.992+0000 7f64bf7ff700 1 Processor -- start 2023-05-17T12:24:37.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.992+0000 7f64bf7ff700 1 -- start start 2023-05-17T12:24:38.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.993+0000 7f64bf7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:38.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.993+0000 7f64bf7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64b806c330 0x7f64b81f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:38.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.993+0000 7f64bf7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 0x7f64b81f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:38.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.993+0000 7f64bf7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80b8400 con 0x7f64b815c840 2023-05-17T12:24:38.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.993+0000 7f64bf7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b815f710 con 0x7f64b806c330 2023-05-17T12:24:38.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.993+0000 7f64bf7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80b77f0 con 0x7f64b806b0b0 2023-05-17T12:24:38.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.993+0000 7f64bdd9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 0x7f64b81f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:38.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.993+0000 7f64bd59b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:38.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bd59b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50824/0 (socket says 172.21.15.88:50824) 2023-05-17T12:24:38.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bd59b700 1 -- 172.21.15.88:0/1935865796 learned_addr learned my addr 172.21.15.88:0/1935865796 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:38.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bcd9a700 1 --2- 172.21.15.88:0/1935865796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64b806c330 0x7f64b81f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:38.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bdd9c700 1 -- 172.21.15.88:0/1935865796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 msgr2=0x7f64b80b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:38.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bdd9c700 1 --2- 172.21.15.88:0/1935865796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:38.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bdd9c700 1 -- 172.21.15.88:0/1935865796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64b806c330 msgr2=0x7f64b81f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:38.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bdd9c700 1 --2- 172.21.15.88:0/1935865796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64b806c330 0x7f64b81f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:38.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bdd9c700 1 -- 172.21.15.88:0/1935865796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b4009550 con 0x7f64b815c840 2023-05-17T12:24:38.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bd59b700 1 --2- 172.21.15.88:0/1935865796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:24:38.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bdd9c700 1 --2- 172.21.15.88:0/1935865796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 0x7f64b81f61f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f64b000cbe0 tx=0x7f64b000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:38.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64adffb700 1 -- 172.21.15.88:0/1935865796 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b000aa40 con 0x7f64b815c840 2023-05-17T12:24:38.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64adffb700 1 -- 172.21.15.88:0/1935865796 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b000abc0 con 0x7f64b815c840 2023-05-17T12:24:38.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64bf7ff700 1 -- 172.21.15.88:0/1935865796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b80cd900 con 0x7f64b815c840 2023-05-17T12:24:38.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.994+0000 7f64adffb700 1 -- 172.21.15.88:0/1935865796 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b00070d0 con 0x7f64b815c840 2023-05-17T12:24:38.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.995+0000 7f64bf7ff700 1 -- 172.21.15.88:0/1935865796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b80b2740 con 0x7f64b815c840 2023-05-17T12:24:38.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.995+0000 7f64adffb700 1 -- 172.21.15.88:0/1935865796 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f64b0007530 con 0x7f64b815c840 2023-05-17T12:24:38.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.995+0000 7f64adffb700 1 -- 172.21.15.88:0/1935865796 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f64b001d440 con 0x7f64b815c840 2023-05-17T12:24:38.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.996+0000 7f64bf7ff700 1 -- 172.21.15.88:0/1935865796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b80cdbe0 con 0x7f64b815c840 2023-05-17T12:24:38.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:37.998+0000 7f64adffb700 1 -- 172.21.15.88:0/1935865796 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f64b0018070 con 0x7f64b815c840 2023-05-17T12:24:38.013 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:38.009+0000 7fb040882200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-17T12:24:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.070+0000 7f64bf7ff700 1 -- 172.21.15.88:0/1935865796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64b80b8570 con 0x7f64b815c840 2023-05-17T12:24:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.071+0000 7f64adffb700 1 -- 172.21.15.88:0/1935865796 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f64b00077e0 con 0x7f64b815c840 2023-05-17T12:24:38.075 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:24:38.075 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:24:37.653519+0000","last_up_change":"0.000000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:24:38.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.072+0000 7f64bf7ff700 1 -- 172.21.15.88:0/1935865796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 msgr2=0x7f64b81f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:38.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.072+0000 7f64bf7ff700 1 --2- 172.21.15.88:0/1935865796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 0x7f64b81f61f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f64b000cbe0 tx=0x7f64b000cef0 comp rx=0 tx=0).stop 2023-05-17T12:24:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.072+0000 7f64bf7ff700 1 -- 172.21.15.88:0/1935865796 shutdown_connections 2023-05-17T12:24:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.072+0000 7f64bf7ff700 1 --2- 172.21.15.88:0/1935865796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b815c840 0x7f64b81f61f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.072+0000 7f64bf7ff700 1 --2- 172.21.15.88:0/1935865796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64b806b0b0 0x7f64b80b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.072+0000 7f64bf7ff700 1 --2- 172.21.15.88:0/1935865796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64b806c330 0x7f64b81f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.072+0000 7f64bf7ff700 1 -- 172.21.15.88:0/1935865796 >> 172.21.15.88:0/1935865796 conn(0x7f64b80d3060 msgr2=0x7f64b80cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.073+0000 7f64bf7ff700 1 -- 172.21.15.88:0/1935865796 shutdown_connections 2023-05-17T12:24:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:38.073+0000 7f64bf7ff700 1 -- 172.21.15.88:0/1935865796 wait complete. 2023-05-17T12:24:38.093 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-17T12:24:38.093 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-17T12:24:38.094 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:38.090+0000 7f1d3a91b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T12:24:38.113 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:38.110+0000 7fb040882200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-17T12:24:38.187 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:38.184+0000 7f1d3a91b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-17T12:24:38.210 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:38.206+0000 7fb040882200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-17T12:24:38.294 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:38.290+0000 7f1d3a91b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T12:24:38.315 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:38.312+0000 7fb040882200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-17T12:24:38.378 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T12:24:38.374+0000 7f8aa9b76640 -1 Falling back to public interface 2023-05-17T12:24:38.386 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T12:24:38.382+0000 7f53d06df640 -1 Falling back to public interface 2023-05-17T12:24:38.402 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T12:24:38.399+0000 7f1126688640 -1 Falling back to public interface 2023-05-17T12:24:38.410 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T12:24:38.406+0000 7f59b8802640 -1 Falling back to public interface 2023-05-17T12:24:38.422 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T12:24:38.419+0000 7fcf6c8da640 -1 Falling back to public interface 2023-05-17T12:24:38.434 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T12:24:38.431+0000 7fd5865c3640 -1 Falling back to public interface 2023-05-17T12:24:38.435 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T12:24:38.431+0000 7fd6ea652640 -1 Falling back to public interface 2023-05-17T12:24:38.438 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T12:24:38.435+0000 7f63debc0640 -1 Falling back to public interface 2023-05-17T12:24:38.521 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:38.518+0000 7f1d3a91b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T12:24:38.537 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:38.533+0000 7fb040882200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-17T12:24:38.620 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:38.617+0000 7f1d3a91b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T12:24:38.636 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:38.632+0000 7fb040882200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-17T12:24:38.900 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-17T12:24:38.965 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:38.962+0000 7f1d3a91b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T12:24:38.982 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:38.979+0000 7fb040882200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-17T12:24:39.054 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:39.051+0000 7f1d3a91b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T12:24:39.068 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.065+0000 7f45059ff700 1 Processor -- start 2023-05-17T12:24:39.069 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.065+0000 7f45059ff700 1 -- start start 2023-05-17T12:24:39.073 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.066+0000 7f45059ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f450015cc90 0x7f45000cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:39.073 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.066+0000 7f45059ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f45000d1f70 0x7f450006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:39.074 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f45059ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450006bdf0 con 0x7f450006c370 2023-05-17T12:24:39.074 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f45059ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45000d1ae0 con 0x7f450015cc90 2023-05-17T12:24:39.074 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f45059ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45000d29e0 con 0x7f45000d1f70 2023-05-17T12:24:39.074 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f44feffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f450015cc90 0x7f45000cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:39.075 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f44feffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f450015cc90 0x7f45000cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37286/0 (socket says 172.21.15.88:37286) 2023-05-17T12:24:39.075 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f44feffd700 1 -- 172.21.15.88:0/2807427010 learned_addr learned my addr 172.21.15.88:0/2807427010 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:39.075 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f44fe7fc700 1 --2- 172.21.15.88:0/2807427010 >> v2:172.21.15.187:3300/0 conn(0x7f45000d1f70 0x7f450006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:39.075 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f44feffd700 1 -- 172.21.15.88:0/2807427010 >> v2:172.21.15.187:3300/0 conn(0x7f45000d1f70 msgr2=0x7f450006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:39.075 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f44feffd700 1 --2- 172.21.15.88:0/2807427010 >> v2:172.21.15.187:3300/0 conn(0x7f45000d1f70 0x7f450006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:39.076 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f44feffd700 1 -- 172.21.15.88:0/2807427010 >> v1:172.21.15.187:6789/0 conn(0x7f450006c370 legacy=0x7f45000b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:39.076 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f44feffd700 1 -- 172.21.15.88:0/2807427010 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45000cf990 con 0x7f450015cc90 2023-05-17T12:24:39.076 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.067+0000 7f44feffd700 1 --2- 172.21.15.88:0/2807427010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f450015cc90 0x7f45000cf390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45000b2220 tx=0x7f44f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5088d8a6ce6d6e7b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:39.076 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f44fdffb700 1 -- 172.21.15.88:0/2807427010 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0011830 con 0x7f450015cc90 2023-05-17T12:24:39.076 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f44fdffb700 1 -- 172.21.15.88:0/2807427010 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0011990 con 0x7f450015cc90 2023-05-17T12:24:39.077 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f44fdffb700 1 -- 172.21.15.88:0/2807427010 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0011d20 con 0x7f450015cc90 2023-05-17T12:24:39.077 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f45059ff700 1 -- 172.21.15.88:0/2807427010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f450015cc90 msgr2=0x7f45000cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:39.077 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f45059ff700 1 --2- 172.21.15.88:0/2807427010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f450015cc90 0x7f45000cf390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45000b2220 tx=0x7f44f0009bd0 comp rx=0 tx=0).stop 2023-05-17T12:24:39.077 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f45059ff700 1 -- 172.21.15.88:0/2807427010 shutdown_connections 2023-05-17T12:24:39.077 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f45059ff700 1 --2- 172.21.15.88:0/2807427010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f450015cc90 0x7f45000cf390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:39.077 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f45059ff700 1 --2- 172.21.15.88:0/2807427010 >> v2:172.21.15.187:3300/0 conn(0x7f45000d1f70 0x7f450006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:39.077 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f45059ff700 1 -- 172.21.15.88:0/2807427010 >> 172.21.15.88:0/2807427010 conn(0x7f45000d3da0 msgr2=0x7f45000cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:39.078 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f45059ff700 1 -- 172.21.15.88:0/2807427010 shutdown_connections 2023-05-17T12:24:39.078 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.068+0000 7f45059ff700 1 -- 172.21.15.88:0/2807427010 wait complete. 2023-05-17T12:24:39.078 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.070+0000 7f45059ff700 1 Processor -- start 2023-05-17T12:24:39.078 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.070+0000 7f45059ff700 1 -- start start 2023-05-17T12:24:39.078 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:39.070+0000 7fb040882200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-17T12:24:39.080 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f45059ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450006c370 0x7f45001546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:39.081 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f45059ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45000d1f70 0x7f45000b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:39.081 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f45059ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450015cc90 0x7f450015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:39.081 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f45059ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45000b59b0 con 0x7f45000d1f70 2023-05-17T12:24:39.081 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f45059ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45000cb1a0 con 0x7f450015cc90 2023-05-17T12:24:39.081 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f45059ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45000cba00 con 0x7f450006c370 2023-05-17T12:24:39.081 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f44fe7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45000d1f70 0x7f45000b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:39.081 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f44fe7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45000d1f70 0x7f45000b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37294/0 (socket says 172.21.15.88:37294) 2023-05-17T12:24:39.082 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f44fe7fc700 1 -- 172.21.15.88:0/2878494850 learned_addr learned my addr 172.21.15.88:0/2878494850 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:39.082 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.071+0000 7f44feffd700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450006c370 0x7f45001546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:39.082 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44ff7fe700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450015cc90 0x7f450015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:39.082 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44fe7fc700 1 -- 172.21.15.88:0/2878494850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450006c370 msgr2=0x7f45001546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:39.082 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44fe7fc700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450006c370 0x7f45001546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:39.082 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44fe7fc700 1 -- 172.21.15.88:0/2878494850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450015cc90 msgr2=0x7f450015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:39.082 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44fe7fc700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450015cc90 0x7f450015aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:39.083 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44fe7fc700 1 -- 172.21.15.88:0/2878494850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f0009550 con 0x7f45000d1f70 2023-05-17T12:24:39.083 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44ff7fe700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450015cc90 0x7f450015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:39.083 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44fe7fc700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45000d1f70 0x7f45000b4c30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44f400e870 tx=0x7f44f400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:39.083 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44e7fff700 1 -- 172.21.15.88:0/2878494850 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f4009590 con 0x7f45000d1f70 2023-05-17T12:24:39.083 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44e7fff700 1 -- 172.21.15.88:0/2878494850 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f4013680 con 0x7f45000d1f70 2023-05-17T12:24:39.083 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f45059ff700 1 -- 172.21.15.88:0/2878494850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45000cdae0 con 0x7f45000d1f70 2023-05-17T12:24:39.083 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f44e7fff700 1 -- 172.21.15.88:0/2878494850 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40139f0 con 0x7f45000d1f70 2023-05-17T12:24:39.083 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.072+0000 7f45059ff700 1 -- 172.21.15.88:0/2878494850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45000cd800 con 0x7f45000d1f70 2023-05-17T12:24:39.084 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.073+0000 7f44e7fff700 1 -- 172.21.15.88:0/2878494850 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f44f4005a20 con 0x7f45000d1f70 2023-05-17T12:24:39.084 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.073+0000 7f44e7fff700 1 -- 172.21.15.88:0/2878494850 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f44f4006660 con 0x7f45000d1f70 2023-05-17T12:24:39.084 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.074+0000 7f45059ff700 1 -- 172.21.15.88:0/2878494850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45000cddc0 con 0x7f45000d1f70 2023-05-17T12:24:39.084 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.076+0000 7f44e7fff700 1 -- 172.21.15.88:0/2878494850 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f44f4021060 con 0x7f45000d1f70 2023-05-17T12:24:39.151 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.148+0000 7f45059ff700 1 -- 172.21.15.88:0/2878494850 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4500073c80 con 0x7f45000d1f70 2023-05-17T12:24:39.152 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.149+0000 7f44e7fff700 1 -- 172.21.15.88:0/2878494850 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f44f4017070 con 0x7f45000d1f70 2023-05-17T12:24:39.152 INFO:teuthology.misc.health.smithi088.stdout: 2023-05-17T12:24:39.152 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:24:37.653519+0000","last_up_change":"0.000000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:24:39.153 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.150+0000 7f45059ff700 1 -- 172.21.15.88:0/2878494850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45000d1f70 msgr2=0x7f45000b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:39.154 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.150+0000 7f45059ff700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45000d1f70 0x7f45000b4c30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f44f400e870 tx=0x7f44f400eb80 comp rx=0 tx=0).stop 2023-05-17T12:24:39.154 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.150+0000 7f45059ff700 1 -- 172.21.15.88:0/2878494850 shutdown_connections 2023-05-17T12:24:39.154 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.150+0000 7f45059ff700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f450015cc90 0x7f450015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:39.154 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.150+0000 7f45059ff700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f450006c370 0x7f45001546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:39.154 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.150+0000 7f45059ff700 1 --2- 172.21.15.88:0/2878494850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45000d1f70 0x7f45000b4c30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:39.154 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.150+0000 7f45059ff700 1 -- 172.21.15.88:0/2878494850 >> 172.21.15.88:0/2878494850 conn(0x7f45000d3da0 msgr2=0x7f45000b7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:39.154 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.150+0000 7f45059ff700 1 -- 172.21.15.88:0/2878494850 shutdown_connections 2023-05-17T12:24:39.155 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:39.150+0000 7f45059ff700 1 -- 172.21.15.88:0/2878494850 wait complete. 2023-05-17T12:24:39.167 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-17T12:24:39.665 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:39.661+0000 7f1d3a91b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T12:24:39.686 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:39.684+0000 7fb040882200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-17T12:24:40.036 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:40.033+0000 7f1d3a91b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T12:24:40.056 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:40.053+0000 7fb040882200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-17T12:24:40.210 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:40.207+0000 7f1d3a91b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T12:24:40.230 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:40.228+0000 7fb040882200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-17T12:24:40.639 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:40.635+0000 7f1d3a91b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T12:24:40.738 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:40.664+0000 7fb040882200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-17T12:24:40.812 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:40.809+0000 7f1d3a91b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T12:24:40.855 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:40.852+0000 7fb040882200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-17T12:24:41.010 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:41.007+0000 7f1d3a91b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-17T12:24:41.057 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:41.055+0000 7fb040882200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-17T12:24:41.431 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:41.427+0000 7f1d3a91b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T12:24:41.470 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-05-17T12:24:41.468+0000 7fb040882200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-17T12:24:41.918 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T12:24:41.915+0000 7f8aa9b76640 -1 osd.0 0 log_to_monitors true 2023-05-17T12:24:41.942 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T12:24:41.938+0000 7f1126688640 -1 osd.4 0 log_to_monitors true 2023-05-17T12:24:41.985 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T12:24:41.981+0000 7fd5865c3640 -1 osd.5 0 log_to_monitors true 2023-05-17T12:24:41.985 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T12:24:41.983+0000 7f59b8802640 -1 osd.1 0 log_to_monitors true 2023-05-17T12:24:42.186 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T12:24:42.183+0000 7f53d06df640 -1 osd.2 0 log_to_monitors true 2023-05-17T12:24:42.201 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T12:24:42.197+0000 7fcf6c8da640 -1 osd.7 0 log_to_monitors true 2023-05-17T12:24:42.239 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T12:24:42.236+0000 7fd6ea652640 -1 osd.6 0 log_to_monitors true 2023-05-17T12:24:42.246 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T12:24:42.243+0000 7f63debc0640 -1 osd.3 0 log_to_monitors true 2023-05-17T12:24:42.449 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:42.446+0000 7f1cf41fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-17T12:24:42.454 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T12:24:42.450+0000 7f1cf41fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-17T12:24:45.594 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T12:24:45.590+0000 7f53bf5f7700 -1 osd.2 0 waiting for initial osdmap 2023-05-17T12:24:45.611 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T12:24:45.608+0000 7f53b6dfa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T12:24:45.616 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T12:24:45.612+0000 7f11155f7700 -1 osd.4 0 waiting for initial osdmap 2023-05-17T12:24:45.643 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T12:24:45.640+0000 7f110cdfa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T12:24:45.656 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T12:24:45.653+0000 7f8a989f7700 -1 osd.0 0 waiting for initial osdmap 2023-05-17T12:24:45.664 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T12:24:45.660+0000 7fd6d95f7700 -1 osd.6 0 waiting for initial osdmap 2023-05-17T12:24:45.667 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T12:24:45.664+0000 7f59a75f7700 -1 osd.1 0 waiting for initial osdmap 2023-05-17T12:24:45.671 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T12:24:45.668+0000 7f8a901fa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T12:24:45.677 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T12:24:45.674+0000 7fd5753f7700 -1 osd.5 0 waiting for initial osdmap 2023-05-17T12:24:45.680 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T12:24:45.677+0000 7f63cd9f7700 -1 osd.3 0 waiting for initial osdmap 2023-05-17T12:24:45.687 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T12:24:45.684+0000 7f599edfa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T12:24:45.694 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T12:24:45.691+0000 7fd6d0dfa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T12:24:45.696 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T12:24:45.693+0000 7f63c51fa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T12:24:45.720 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T12:24:45.717+0000 7fd56cbfa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T12:24:45.975 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-17T12:24:46.138 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.136+0000 7f136e3ff700 1 Processor -- start 2023-05-17T12:24:46.139 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.136+0000 7f136e3ff700 1 -- start start 2023-05-17T12:24:46.140 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.137+0000 7f136e3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136806ca80 0x7f13680cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:46.140 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.137+0000 7f136e3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13680d1f70 0x7f136806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:46.140 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.137+0000 7f136e3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136806bdf0 con 0x7f136815cc90 2023-05-17T12:24:46.140 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.137+0000 7f136e3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680d1ae0 con 0x7f13680d1f70 2023-05-17T12:24:46.141 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.137+0000 7f136e3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13680d29e0 con 0x7f136806ca80 2023-05-17T12:24:46.141 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.137+0000 7f136c99c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13680d1f70 0x7f136806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:46.141 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.137+0000 7f13677fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136806ca80 0x7f13680cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:46.141 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.137+0000 7f1367fff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f136815cc90 0x7f136806c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:44486/0 (socket says 172.21.15.88:44486) 2023-05-17T12:24:46.141 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.137+0000 7f1367fff700 1 -- 172.21.15.88:0/1848022186 learned_addr learned my addr 172.21.15.88:0/1848022186 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:24:46.142 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f13677fe700 1 -- 172.21.15.88:0/1848022186 >> v2:172.21.15.88:3300/0 conn(0x7f13680d1f70 msgr2=0x7f136806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:46.142 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f13677fe700 1 --2- 172.21.15.88:0/1848022186 >> v2:172.21.15.88:3300/0 conn(0x7f13680d1f70 0x7f136806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:46.143 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f13677fe700 1 -- 172.21.15.88:0/1848022186 >> v1:172.21.15.187:6789/0 conn(0x7f136815cc90 legacy=0x7f136806c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:46.143 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f13677fe700 1 -- 172.21.15.88:0/1848022186 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680cf990 con 0x7f136806ca80 2023-05-17T12:24:46.143 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f1366ffd700 1 -- 172.21.15.88:0/1848022186 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980609721 0 0) 0x7f1358001110 con 0x7f136815cc90 2023-05-17T12:24:46.143 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f136c99c700 1 --2- 172.21.15.88:0/1848022186 >> v2:172.21.15.88:3300/0 conn(0x7f13680d1f70 0x7f136806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:24:46.143 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f13677fe700 1 --2- 172.21.15.88:0/1848022186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136806ca80 0x7f13680cf390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f135c009840 tx=0x7f135c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=663690af77d15252 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:46.143 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f1366ffd700 1 -- 172.21.15.88:0/1848022186 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c011830 con 0x7f136806ca80 2023-05-17T12:24:46.143 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f1366ffd700 1 -- 172.21.15.88:0/1848022186 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c011990 con 0x7f136806ca80 2023-05-17T12:24:46.144 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.138+0000 7f1366ffd700 1 -- 172.21.15.88:0/1848022186 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c011d20 con 0x7f136806ca80 2023-05-17T12:24:46.144 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.139+0000 7f136e3ff700 1 -- 172.21.15.88:0/1848022186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136806ca80 msgr2=0x7f13680cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:46.144 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.139+0000 7f136e3ff700 1 --2- 172.21.15.88:0/1848022186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136806ca80 0x7f13680cf390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f135c009840 tx=0x7f135c009b50 comp rx=0 tx=0).stop 2023-05-17T12:24:46.144 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.139+0000 7f136e3ff700 1 -- 172.21.15.88:0/1848022186 shutdown_connections 2023-05-17T12:24:46.144 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.139+0000 7f136e3ff700 1 --2- 172.21.15.88:0/1848022186 >> v2:172.21.15.88:3300/0 conn(0x7f13680d1f70 0x7f136806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:46.144 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.139+0000 7f136e3ff700 1 --2- 172.21.15.88:0/1848022186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136806ca80 0x7f13680cf390 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:46.144 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.139+0000 7f136e3ff700 1 -- 172.21.15.88:0/1848022186 >> 172.21.15.88:0/1848022186 conn(0x7f13680d3da0 msgr2=0x7f13680cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:46.145 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.139+0000 7f136e3ff700 1 -- 172.21.15.88:0/1848022186 shutdown_connections 2023-05-17T12:24:46.145 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.139+0000 7f136e3ff700 1 -- 172.21.15.88:0/1848022186 wait complete. 2023-05-17T12:24:46.146 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.141+0000 7f136e3ff700 1 Processor -- start 2023-05-17T12:24:46.146 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.141+0000 7f136e3ff700 1 -- start start 2023-05-17T12:24:46.147 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f136e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136806ca80 0x7f136814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:46.147 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f136e3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13680d1f70 0x7f13680cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:46.147 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f136e3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136815cc90 0x7f13680cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:46.147 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f136e3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680cc9d0 con 0x7f13680d1f70 2023-05-17T12:24:46.147 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f136e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680b4f70 con 0x7f136806ca80 2023-05-17T12:24:46.147 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f136e3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13680b5250 con 0x7f136815cc90 2023-05-17T12:24:46.147 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f13677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13680d1f70 0x7f13680cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:46.147 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f13677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13680d1f70 0x7f13680cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45882/0 (socket says 172.21.15.88:45882) 2023-05-17T12:24:46.148 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f13677fe700 1 -- 172.21.15.88:0/3534937347 learned_addr learned my addr 172.21.15.88:0/3534937347 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:46.148 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f1367fff700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136806ca80 0x7f136814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:46.148 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f136c99c700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136815cc90 0x7f13680cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:46.148 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f13677fe700 1 -- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136815cc90 msgr2=0x7f13680cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:46.148 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f13677fe700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136815cc90 0x7f13680cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:46.148 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f13677fe700 1 -- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136806ca80 msgr2=0x7f136814e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:46.148 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f13677fe700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136806ca80 0x7f136814e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:46.149 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.142+0000 7f13677fe700 1 -- 172.21.15.88:0/3534937347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360009a70 con 0x7f13680d1f70 2023-05-17T12:24:46.149 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.143+0000 7f13677fe700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13680d1f70 0x7f13680cb600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f135c009fd0 tx=0x7f135c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:46.149 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.143+0000 7f1364ff9700 1 -- 172.21.15.88:0/3534937347 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c0045d0 con 0x7f13680d1f70 2023-05-17T12:24:46.149 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.143+0000 7f1364ff9700 1 -- 172.21.15.88:0/3534937347 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c01e070 con 0x7f13680d1f70 2023-05-17T12:24:46.149 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.143+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c0094a0 con 0x7f13680d1f70 2023-05-17T12:24:46.149 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.143+0000 7f1364ff9700 1 -- 172.21.15.88:0/3534937347 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c0038a0 con 0x7f13680d1f70 2023-05-17T12:24:46.149 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.143+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13680cdae0 con 0x7f13680d1f70 2023-05-17T12:24:46.150 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.144+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13680cd800 con 0x7f13680d1f70 2023-05-17T12:24:46.150 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.145+0000 7f1364ff9700 1 -- 172.21.15.88:0/3534937347 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f135c003a00 con 0x7f13680d1f70 2023-05-17T12:24:46.150 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.146+0000 7f1364ff9700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f135406ac50 0x7f135406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:46.151 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.146+0000 7f1364ff9700 1 -- 172.21.15.88:0/3534937347 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f135c0893c0 con 0x7f13680d1f70 2023-05-17T12:24:46.151 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.146+0000 7f1367fff700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f135406ac50 0x7f135406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:46.151 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.147+0000 7f1367fff700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f135406ac50 0x7f135406d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1358000f60 tx=0x7f1358007c20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:46.154 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.151+0000 7f1364ff9700 1 -- 172.21.15.88:0/3534937347 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f135c055430 con 0x7f13680d1f70 2023-05-17T12:24:46.347 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.344+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13680cddc0 con 0x7f13680d1f70 2023-05-17T12:24:46.348 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.345+0000 7f1364ff9700 1 -- 172.21.15.88:0/3534937347 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f135c015020 con 0x7f13680d1f70 2023-05-17T12:24:46.348 INFO:teuthology.misc.health.smithi088.stdout: 2023-05-17T12:24:46.348 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":12,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:24:43.496049+0000","last_up_change":"0.000000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:24:46.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f135406ac50 msgr2=0x7f135406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:46.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f135406ac50 0x7f135406d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1358000f60 tx=0x7f1358007c20 comp rx=0 tx=0).stop 2023-05-17T12:24:46.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13680d1f70 msgr2=0x7f13680cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:46.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13680d1f70 0x7f13680cb600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f135c009fd0 tx=0x7f135c004750 comp rx=0 tx=0).stop 2023-05-17T12:24:46.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 shutdown_connections 2023-05-17T12:24:46.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f135406ac50 0x7f135406d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:46.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f136815cc90 0x7f13680cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:46.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136806ca80 0x7f136814e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:46.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 --2- 172.21.15.88:0/3534937347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13680d1f70 0x7f13680cb600 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:46.352 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 >> 172.21.15.88:0/3534937347 conn(0x7f13680d3da0 msgr2=0x7f13680cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:46.352 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 shutdown_connections 2023-05-17T12:24:46.352 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:46.347+0000 7f136e3ff700 1 -- 172.21.15.88:0/3534937347 wait complete. 2023-05-17T12:24:46.366 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-17T12:24:46.404 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T12:24:46.400+0000 7fcf5b7f7700 -1 osd.7 0 waiting for initial osdmap 2023-05-17T12:24:46.423 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T12:24:46.419+0000 7fcf52ffa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-17T12:24:53.173 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-17T12:24:53.346 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.343+0000 7f85215ff700 1 Processor -- start 2023-05-17T12:24:53.346 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.343+0000 7f85215ff700 1 -- start start 2023-05-17T12:24:53.347 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.344+0000 7f85215ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f851c15cc90 0x7f851c0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.347 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.344+0000 7f85215ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c06ca80 0x7f851c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.347 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.344+0000 7f85215ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c06bdf0 con 0x7f851c0d1f70 2023-05-17T12:24:53.348 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.344+0000 7f85215ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c0d1ae0 con 0x7f851c15cc90 2023-05-17T12:24:53.348 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.344+0000 7f85215ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0d29e0 con 0x7f851c06ca80 2023-05-17T12:24:53.348 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.344+0000 7f851affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f851c15cc90 0x7f851c0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.348 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f851affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f851c15cc90 0x7f851c0cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44574/0 (socket says 172.21.15.88:44574) 2023-05-17T12:24:53.348 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f851affd700 1 -- 172.21.15.88:0/879950273 learned_addr learned my addr 172.21.15.88:0/879950273 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:53.348 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f851b7fe700 1 --2- 172.21.15.88:0/879950273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c06ca80 0x7f851c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f851affd700 1 -- 172.21.15.88:0/879950273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c06ca80 msgr2=0x7f851c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:53.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f851affd700 1 --2- 172.21.15.88:0/879950273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c06ca80 0x7f851c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f851affd700 1 -- 172.21.15.88:0/879950273 >> v1:172.21.15.187:6789/0 conn(0x7f851c0d1f70 legacy=0x7f851c06c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f851affd700 1 -- 172.21.15.88:0/879950273 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0cf990 con 0x7f851c15cc90 2023-05-17T12:24:53.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f851affd700 1 --2- 172.21.15.88:0/879950273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c15cc90 0x7f851c0cf390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f850c0098f0 tx=0x7f850c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c1dabfc4fcfbc4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:53.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f8519ffb700 1 -- 172.21.15.88:0/879950273 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00b8a0 con 0x7f851c15cc90 2023-05-17T12:24:53.350 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f8519ffb700 1 -- 172.21.15.88:0/879950273 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00ba00 con 0x7f851c15cc90 2023-05-17T12:24:53.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.345+0000 7f8519ffb700 1 -- 172.21.15.88:0/879950273 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00bd90 con 0x7f851c15cc90 2023-05-17T12:24:53.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.346+0000 7f85215ff700 1 -- 172.21.15.88:0/879950273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c15cc90 msgr2=0x7f851c0cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.346+0000 7f85215ff700 1 --2- 172.21.15.88:0/879950273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c15cc90 0x7f851c0cf390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f850c0098f0 tx=0x7f850c009c00 comp rx=0 tx=0).stop 2023-05-17T12:24:53.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.346+0000 7f85215ff700 1 -- 172.21.15.88:0/879950273 shutdown_connections 2023-05-17T12:24:53.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.346+0000 7f85215ff700 1 --2- 172.21.15.88:0/879950273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c06ca80 0x7f851c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.346+0000 7f85215ff700 1 --2- 172.21.15.88:0/879950273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c15cc90 0x7f851c0cf390 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.351 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.346+0000 7f85215ff700 1 -- 172.21.15.88:0/879950273 >> 172.21.15.88:0/879950273 conn(0x7f851c0d3da0 msgr2=0x7f851c0cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:53.352 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.346+0000 7f85215ff700 1 -- 172.21.15.88:0/879950273 shutdown_connections 2023-05-17T12:24:53.352 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.346+0000 7f85215ff700 1 -- 172.21.15.88:0/879950273 wait complete. 2023-05-17T12:24:53.353 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.348+0000 7f85215ff700 1 Processor -- start 2023-05-17T12:24:53.354 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.348+0000 7f85215ff700 1 -- start start 2023-05-17T12:24:53.354 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f85215ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c06ca80 0x7f851c159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.354 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f85215ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0d1f70 0x7f851c15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.354 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f85215ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c15cc90 0x7f851c15be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.354 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f85215ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c1e7510 con 0x7f851c06ca80 2023-05-17T12:24:53.354 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f85215ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c159770 con 0x7f851c15cc90 2023-05-17T12:24:53.354 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f85215ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0cbce0 con 0x7f851c0d1f70 2023-05-17T12:24:53.355 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c06ca80 0x7f851c159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.355 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c06ca80 0x7f851c159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44576/0 (socket says 172.21.15.88:44576) 2023-05-17T12:24:53.355 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851affd700 1 -- 172.21.15.88:0/2173555217 learned_addr learned my addr 172.21.15.88:0/2173555217 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:53.355 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851affd700 1 -- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0d1f70 msgr2=0x7f851c15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.355 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851a7fc700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0d1f70 0x7f851c15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.355 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851b7fe700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c15cc90 0x7f851c15be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.355 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851affd700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0d1f70 0x7f851c15b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.355 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851affd700 1 -- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c15cc90 msgr2=0x7f851c15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.356 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851affd700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c15cc90 0x7f851c15be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.356 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851affd700 1 -- 172.21.15.88:0/2173555217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c009550 con 0x7f851c06ca80 2023-05-17T12:24:53.356 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851a7fc700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0d1f70 0x7f851c15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:24:53.356 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.349+0000 7f851b7fe700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c15cc90 0x7f851c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:24:53.356 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.350+0000 7f851affd700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c06ca80 0x7f851c159230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f850c000c00 tx=0x7f850c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:53.356 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.350+0000 7f85037fe700 1 -- 172.21.15.88:0/2173555217 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c004480 con 0x7f851c06ca80 2023-05-17T12:24:53.356 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.350+0000 7f85037fe700 1 -- 172.21.15.88:0/2173555217 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c01f070 con 0x7f851c06ca80 2023-05-17T12:24:53.357 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.350+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c0cdae0 con 0x7f851c06ca80 2023-05-17T12:24:53.357 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.350+0000 7f85037fe700 1 -- 172.21.15.88:0/2173555217 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c0038c0 con 0x7f851c06ca80 2023-05-17T12:24:53.357 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.350+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c0cd800 con 0x7f851c06ca80 2023-05-17T12:24:53.357 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.351+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c0cddc0 con 0x7f851c06ca80 2023-05-17T12:24:53.358 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.352+0000 7f85037fe700 1 -- 172.21.15.88:0/2173555217 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f850c021030 con 0x7f851c06ca80 2023-05-17T12:24:53.358 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.353+0000 7f85037fe700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f850806ace0 0x7f850806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.358 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.353+0000 7f85037fe700 1 -- 172.21.15.88:0/2173555217 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f850c08a5b0 con 0x7f851c06ca80 2023-05-17T12:24:53.358 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.353+0000 7f851a7fc700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f850806ace0 0x7f850806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.358 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.354+0000 7f851a7fc700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f850806ace0 0x7f850806d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f851c0cb6d0 tx=0x7f8510009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:53.361 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.358+0000 7f85037fe700 1 -- 172.21.15.88:0/2173555217 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f850c055c20 con 0x7f851c06ca80 2023-05-17T12:24:53.555 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.552+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f851c1e7270 con 0x7f851c06ca80 2023-05-17T12:24:53.556 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.553+0000 7f85037fe700 1 -- 172.21.15.88:0/2173555217 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f851c1e7270 con 0x7f851c06ca80 2023-05-17T12:24:53.557 INFO:teuthology.misc.health.smithi088.stdout: 2023-05-17T12:24:53.557 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":16,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:24:49.708553+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:24:53.561 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.555+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f850806ace0 msgr2=0x7f850806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.561 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.555+0000 7f85215ff700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f850806ace0 0x7f850806d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f851c0cb6d0 tx=0x7f8510009040 comp rx=0 tx=0).stop 2023-05-17T12:24:53.562 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.555+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c06ca80 msgr2=0x7f851c159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.562 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.555+0000 7f85215ff700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c06ca80 0x7f851c159230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f850c000c00 tx=0x7f850c004750 comp rx=0 tx=0).stop 2023-05-17T12:24:53.562 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.556+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 shutdown_connections 2023-05-17T12:24:53.563 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.556+0000 7f85215ff700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f850806ace0 0x7f850806d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.563 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.556+0000 7f85215ff700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c15cc90 0x7f851c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.563 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.556+0000 7f85215ff700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f851c06ca80 0x7f851c159230 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.564 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.556+0000 7f85215ff700 1 --2- 172.21.15.88:0/2173555217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0d1f70 0x7f851c15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.564 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.556+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 >> 172.21.15.88:0/2173555217 conn(0x7f851c0d3da0 msgr2=0x7f851c15e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:53.564 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.556+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 shutdown_connections 2023-05-17T12:24:53.565 INFO:teuthology.misc.health.smithi088.stderr:2023-05-17T12:24:53.556+0000 7f85215ff700 1 -- 172.21.15.88:0/2173555217 wait complete. 2023-05-17T12:24:53.573 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-17T12:24:53.574 INFO:tasks.ceph:Creating RBD pool 2023-05-17T12:24:53.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-17T12:24:53.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.753+0000 7f13413ff700 1 Processor -- start 2023-05-17T12:24:53.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.754+0000 7f13413ff700 1 -- start start 2023-05-17T12:24:53.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.755+0000 7f13413ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f133c0b23a0 0x7f133c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.755+0000 7f13413ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f133c0cf190 0x7f133c160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.755+0000 7f13413ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c06b4a0 con 0x7f133c06c760 2023-05-17T12:24:53.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.755+0000 7f13413ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c06a510 con 0x7f133c0cf190 2023-05-17T12:24:53.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.755+0000 7f13413ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0cd840 con 0x7f133c0b23a0 2023-05-17T12:24:53.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f133affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f133c06c760 0x7f133c06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34596/0 (socket says 172.21.15.88:34596) 2023-05-17T12:24:53.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f133affd700 1 -- 172.21.15.88:0/561512979 learned_addr learned my addr 172.21.15.88:0/561512979 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:24:53.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f133b7fe700 1 --2- 172.21.15.88:0/561512979 >> v2:172.21.15.88:3300/0 conn(0x7f133c0cf190 0x7f133c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f133a7fc700 1 --2- 172.21.15.88:0/561512979 >> v2:172.21.15.187:3300/0 conn(0x7f133c0b23a0 0x7f133c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f1339ffb700 1 -- 172.21.15.88:0/561512979 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054449357 0 0) 0x7f132c001110 con 0x7f133c06c760 2023-05-17T12:24:53.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f1339ffb700 1 -- 172.21.15.88:0/561512979 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13240035b0 con 0x7f133c06c760 2023-05-17T12:24:53.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f133b7fe700 1 -- 172.21.15.88:0/561512979 >> v2:172.21.15.187:3300/0 conn(0x7f133c0b23a0 msgr2=0x7f133c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:53.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f133b7fe700 1 --2- 172.21.15.88:0/561512979 >> v2:172.21.15.187:3300/0 conn(0x7f133c0b23a0 0x7f133c06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f133b7fe700 1 -- 172.21.15.88:0/561512979 >> v1:172.21.15.88:6789/0 conn(0x7f133c06c760 legacy=0x7f133c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.756+0000 7f133b7fe700 1 -- 172.21.15.88:0/561512979 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0cdb20 con 0x7f133c0cf190 2023-05-17T12:24:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f133b7fe700 1 --2- 172.21.15.88:0/561512979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cf190 0x7f133c160380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f133c06c540 tx=0x7f133400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749df70c0b164d55 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f1339ffb700 1 -- 172.21.15.88:0/561512979 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400e070 con 0x7f133c0cf190 2023-05-17T12:24:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f1339ffb700 1 -- 172.21.15.88:0/561512979 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400bb20 con 0x7f133c0cf190 2023-05-17T12:24:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f1339ffb700 1 -- 172.21.15.88:0/561512979 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334012430 con 0x7f133c0cf190 2023-05-17T12:24:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f13413ff700 1 -- 172.21.15.88:0/561512979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cf190 msgr2=0x7f133c160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f13413ff700 1 --2- 172.21.15.88:0/561512979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cf190 0x7f133c160380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f133c06c540 tx=0x7f133400b330 comp rx=0 tx=0).stop 2023-05-17T12:24:53.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f13413ff700 1 -- 172.21.15.88:0/561512979 shutdown_connections 2023-05-17T12:24:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f13413ff700 1 --2- 172.21.15.88:0/561512979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cf190 0x7f133c160380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f13413ff700 1 --2- 172.21.15.88:0/561512979 >> v2:172.21.15.187:3300/0 conn(0x7f133c0b23a0 0x7f133c06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f13413ff700 1 -- 172.21.15.88:0/561512979 >> 172.21.15.88:0/561512979 conn(0x7f133c0d06f0 msgr2=0x7f133c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.757+0000 7f13413ff700 1 -- 172.21.15.88:0/561512979 shutdown_connections 2023-05-17T12:24:53.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.758+0000 7f13413ff700 1 -- 172.21.15.88:0/561512979 wait complete. 2023-05-17T12:24:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.760+0000 7f13413ff700 1 Processor -- start 2023-05-17T12:24:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.760+0000 7f13413ff700 1 -- start start 2023-05-17T12:24:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f13413ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133c06c760 0x7f133c1f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f13413ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0cf190 0x7f133c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f13413ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cb020 0x7f133c158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f13413ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1f2fc0 con 0x7f133c0cb020 2023-05-17T12:24:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f13413ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1f3270 con 0x7f133c0cf190 2023-05-17T12:24:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f13413ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0cb5d0 con 0x7f133c06c760 2023-05-17T12:24:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f133b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cb020 0x7f133c158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f133b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cb020 0x7f133c158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44600/0 (socket says 172.21.15.88:44600) 2023-05-17T12:24:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f133b7fe700 1 -- 172.21.15.88:0/1842400749 learned_addr learned my addr 172.21.15.88:0/1842400749 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.761+0000 7f133a7fc700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0cf190 0x7f133c0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f133affd700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133c06c760 0x7f133c1f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f133b7fe700 1 -- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133c06c760 msgr2=0x7f133c1f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f133b7fe700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133c06c760 0x7f133c1f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f133b7fe700 1 -- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0cf190 msgr2=0x7f133c0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f133b7fe700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0cf190 0x7f133c0caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f133b7fe700 1 -- 172.21.15.88:0/1842400749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1334009a70 con 0x7f133c0cb020 2023-05-17T12:24:53.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f133b7fe700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cb020 0x7f133c158df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1334014040 tx=0x7f1334004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f13237fe700 1 -- 172.21.15.88:0/1842400749 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334012430 con 0x7f133c0cb020 2023-05-17T12:24:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f13237fe700 1 -- 172.21.15.88:0/1842400749 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1334020070 con 0x7f133c0cb020 2023-05-17T12:24:53.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f13237fe700 1 -- 172.21.15.88:0/1842400749 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13340098f0 con 0x7f133c0cb020 2023-05-17T12:24:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.762+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c06aa40 con 0x7f133c0cb020 2023-05-17T12:24:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.763+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c06a760 con 0x7f133c0cb020 2023-05-17T12:24:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.763+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c15cb40 con 0x7f133c0cb020 2023-05-17T12:24:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.764+0000 7f13237fe700 1 -- 172.21.15.88:0/1842400749 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1334004040 con 0x7f133c0cb020 2023-05-17T12:24:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.765+0000 7f13237fe700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f132806ace0 0x7f132806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.765+0000 7f13237fe700 1 -- 172.21.15.88:0/1842400749 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1334022070 con 0x7f133c0cb020 2023-05-17T12:24:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.766+0000 7f133affd700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f132806ace0 0x7f132806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:53.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.766+0000 7f133affd700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f132806ace0 0x7f132806d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f132c007fd0 tx=0x7f132c007c40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:53.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.769+0000 7f13237fe700 1 -- 172.21.15.88:0/1842400749 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1334056110 con 0x7f133c0cb020 2023-05-17T12:24:53.960 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:24:53.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:24:53.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:53.964+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f133c1f33e0 con 0x7f133c0cb020 2023-05-17T12:24:54.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.740+0000 7f13237fe700 1 -- 172.21.15.88:0/1842400749 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f133402c020 con 0x7f133c0cb020 2023-05-17T12:24:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f132806ace0 msgr2=0x7f132806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f132806ace0 0x7f132806d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f132c007fd0 tx=0x7f132c007c40 comp rx=0 tx=0).stop 2023-05-17T12:24:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cb020 msgr2=0x7f133c158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:54.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cb020 0x7f133c158df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1334014040 tx=0x7f1334004ad0 comp rx=0 tx=0).stop 2023-05-17T12:24:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 shutdown_connections 2023-05-17T12:24:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f132806ace0 0x7f132806d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f133c0cb020 0x7f133c158df0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f133c06c760 0x7f133c1f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 --2- 172.21.15.88:0/1842400749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0cf190 0x7f133c0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:54.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.744+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 >> 172.21.15.88:0/1842400749 conn(0x7f133c0d06f0 msgr2=0x7f133c0d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:54.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.745+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 shutdown_connections 2023-05-17T12:24:54.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.745+0000 7f13413ff700 1 -- 172.21.15.88:0/1842400749 wait complete. 2023-05-17T12:24:54.750 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'rbd' created 2023-05-17T12:24:54.768 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-17T12:24:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.949+0000 7f7a9a5ff700 1 Processor -- start 2023-05-17T12:24:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.949+0000 7f7a9a5ff700 1 -- start start 2023-05-17T12:24:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.950+0000 7f7a9a5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a940d2b10 0x7f7a940d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.950+0000 7f7a9a5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a940b2990 con 0x7f7a9406cb10 2023-05-17T12:24:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.950+0000 7f7a9a5ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a940cd850 con 0x7f7a940b25c0 2023-05-17T12:24:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.950+0000 7f7a9a5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a94161180 con 0x7f7a940d2b10 2023-05-17T12:24:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.951+0000 7f7a98b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a940d2b10 0x7f7a940d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.951+0000 7f7a937fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7a9406cb10 0x7f7a940d0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34606/0 (socket says 172.21.15.88:34606) 2023-05-17T12:24:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.951+0000 7f7a937fe700 1 -- 172.21.15.88:0/3219651152 learned_addr learned my addr 172.21.15.88:0/3219651152 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:24:54.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.951+0000 7f7a98b9c700 1 -- 172.21.15.88:0/3219651152 >> v1:172.21.15.187:6789/0 conn(0x7f7a940b25c0 legacy=0x7f7a9406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:54.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.951+0000 7f7a98b9c700 1 -- 172.21.15.88:0/3219651152 >> v1:172.21.15.88:6789/0 conn(0x7f7a9406cb10 legacy=0x7f7a940d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.951+0000 7f7a98b9c700 1 -- 172.21.15.88:0/3219651152 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a940cf560 con 0x7f7a940d2b10 2023-05-17T12:24:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.951+0000 7f7a92ffd700 1 -- 172.21.15.88:0/3219651152 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203986197 0 0) 0x7f7a88001110 con 0x7f7a9406cb10 2023-05-17T12:24:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.951+0000 7f7a98b9c700 1 --2- 172.21.15.88:0/3219651152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 0x7f7a940d13b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009d90 tx=0x7f7a8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afc3dfda0a4abd2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.951+0000 7f7a92ffd700 1 -- 172.21.15.88:0/3219651152 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c00e070 con 0x7f7a940d2b10 2023-05-17T12:24:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.952+0000 7f7a92ffd700 1 -- 172.21.15.88:0/3219651152 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c00bbd0 con 0x7f7a940d2b10 2023-05-17T12:24:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.952+0000 7f7a92ffd700 1 -- 172.21.15.88:0/3219651152 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c012430 con 0x7f7a940d2b10 2023-05-17T12:24:54.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.952+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3219651152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 msgr2=0x7f7a940d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:54.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.952+0000 7f7a9a5ff700 1 --2- 172.21.15.88:0/3219651152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 0x7f7a940d13b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009d90 tx=0x7f7a8c00b330 comp rx=0 tx=0).stop 2023-05-17T12:24:54.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.952+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3219651152 shutdown_connections 2023-05-17T12:24:54.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.952+0000 7f7a9a5ff700 1 --2- 172.21.15.88:0/3219651152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 0x7f7a940d13b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:54.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.952+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3219651152 >> 172.21.15.88:0/3219651152 conn(0x7f7a940d0630 msgr2=0x7f7a940d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:54.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.952+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3219651152 shutdown_connections 2023-05-17T12:24:54.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.952+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3219651152 wait complete. 2023-05-17T12:24:54.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.954+0000 7f7a9a5ff700 1 Processor -- start 2023-05-17T12:24:54.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.954+0000 7f7a9a5ff700 1 -- start start 2023-05-17T12:24:54.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.955+0000 7f7a9a5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9406cb10 0x7f7a9415e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.955+0000 7f7a9a5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940b25c0 0x7f7a9415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.955+0000 7f7a9a5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 0x7f7a9415b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.955+0000 7f7a9a5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9415f970 con 0x7f7a940d2b10 2023-05-17T12:24:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.955+0000 7f7a9a5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9415ed60 con 0x7f7a9406cb10 2023-05-17T12:24:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.955+0000 7f7a9a5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9415f040 con 0x7f7a940b25c0 2023-05-17T12:24:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.955+0000 7f7a98b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 0x7f7a9415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.955+0000 7f7a98b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 0x7f7a9415b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44620/0 (socket says 172.21.15.88:44620) 2023-05-17T12:24:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.955+0000 7f7a98b9c700 1 -- 172.21.15.88:0/3856352215 learned_addr learned my addr 172.21.15.88:0/3856352215 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a93fff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9406cb10 0x7f7a9415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a98b9c700 1 -- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940b25c0 msgr2=0x7f7a9415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a937fe700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940b25c0 0x7f7a9415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a98b9c700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940b25c0 0x7f7a9415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a98b9c700 1 -- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9406cb10 msgr2=0x7f7a9415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a98b9c700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9406cb10 0x7f7a9415e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a98b9c700 1 -- 172.21.15.88:0/3856352215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c009a70 con 0x7f7a940d2b10 2023-05-17T12:24:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a93fff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9406cb10 0x7f7a9415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:24:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a937fe700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940b25c0 0x7f7a9415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:24:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a98b9c700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 0x7f7a9415b580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c014040 tx=0x7f7a8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a90ff9700 1 -- 172.21.15.88:0/3856352215 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c01b8a0 con 0x7f7a940d2b10 2023-05-17T12:24:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a90ff9700 1 -- 172.21.15.88:0/3856352215 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c020070 con 0x7f7a940d2b10 2023-05-17T12:24:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a940cdce0 con 0x7f7a940d2b10 2023-05-17T12:24:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a90ff9700 1 -- 172.21.15.88:0/3856352215 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c01bc40 con 0x7f7a940d2b10 2023-05-17T12:24:54.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.956+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a940cf840 con 0x7f7a940d2b10 2023-05-17T12:24:54.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.957+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a940cf210 con 0x7f7a940d2b10 2023-05-17T12:24:54.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.959+0000 7f7a90ff9700 1 -- 172.21.15.88:0/3856352215 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a8c026400 con 0x7f7a940d2b10 2023-05-17T12:24:54.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.959+0000 7f7a90ff9700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a8006ace0 0x7f7a8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:54.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.960+0000 7f7a90ff9700 1 -- 172.21.15.88:0/3856352215 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f7a8c08b0a0 con 0x7f7a940d2b10 2023-05-17T12:24:54.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.960+0000 7f7a93fff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a8006ace0 0x7f7a8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:54.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.961+0000 7f7a93fff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a8006ace0 0x7f7a8006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7a940b3c00 tx=0x7f7a84009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:54.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:54.965+0000 7f7a90ff9700 1 -- 172.21.15.88:0/3856352215 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7a8c059f30 con 0x7f7a940d2b10 2023-05-17T12:24:55.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.158+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7a94074530 con 0x7f7a940d2b10 2023-05-17T12:24:55.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.746+0000 7f7a90ff9700 1 -- 172.21.15.88:0/3856352215 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7a8c0220c0 con 0x7f7a940d2b10 2023-05-17T12:24:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a8006ace0 msgr2=0x7f7a8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a8006ace0 0x7f7a8006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7a940b3c00 tx=0x7f7a84009040 comp rx=0 tx=0).stop 2023-05-17T12:24:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 msgr2=0x7f7a9415b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 0x7f7a9415b580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c014040 tx=0x7f7a8c004ad0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 shutdown_connections 2023-05-17T12:24:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a8006ace0 0x7f7a8006d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a940d2b10 0x7f7a9415b580 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a9406cb10 0x7f7a9415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 --2- 172.21.15.88:0/3856352215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a940b25c0 0x7f7a9415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 >> 172.21.15.88:0/3856352215 conn(0x7f7a940d0630 msgr2=0x7f7a940b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.750+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 shutdown_connections 2023-05-17T12:24:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.751+0000 7f7a9a5ff700 1 -- 172.21.15.88:0/3856352215 wait complete. 2023-05-17T12:24:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-17T12:24:55.771 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-17T12:24:55.771 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T12:24:55.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T12:24:55.776 INFO:tasks.ceph.mds.a:Started 2023-05-17T12:24:55.776 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T12:24:55.776 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T12:24:55.780 INFO:tasks.ceph.mds.c:Started 2023-05-17T12:24:55.780 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T12:24:55.780 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T12:24:55.784 INFO:tasks.ceph.mds.b:Started 2023-05-17T12:24:55.785 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T12:24:55.785 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T12:24:55.789 INFO:tasks.ceph.mds.d:Started 2023-05-17T12:24:55.789 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-17T12:24:55.789 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:24:55.918 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-05-17T12:24:55.919 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-05-17T12:24:55.929 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-05-17T12:24:55.931 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-05-17T12:24:55.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.984+0000 7fa1989ff700 1 Processor -- start 2023-05-17T12:24:55.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.985+0000 7fa1989ff700 1 -- start start 2023-05-17T12:24:55.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.986+0000 7fa1989ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa19406b0b0 0x7fa19406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:55.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.986+0000 7fa1989ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 0x7fa19406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:55.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.986+0000 7fa1989ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1940cd6b0 con 0x7fa19415c840 2023-05-17T12:24:55.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.986+0000 7fa1989ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1940cdf50 con 0x7fa19406b0b0 2023-05-17T12:24:55.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.986+0000 7fa1989ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19406ccf0 con 0x7fa19406c330 2023-05-17T12:24:55.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.986+0000 7fa18bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa19406b0b0 0x7fa19406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:55.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa18bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa19406b0b0 0x7fa19406b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44652/0 (socket says 172.21.15.88:44652) 2023-05-17T12:24:55.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa18bfff700 1 -- 172.21.15.88:0/882391101 learned_addr learned my addr 172.21.15.88:0/882391101 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:55.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa192d9d700 1 --2- 172.21.15.88:0/882391101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 0x7fa19406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:55.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa18bfff700 1 -- 172.21.15.88:0/882391101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 msgr2=0x7fa19406c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:55.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa18bfff700 1 --2- 172.21.15.88:0/882391101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 0x7fa19406c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa18bfff700 1 -- 172.21.15.88:0/882391101 >> v1:172.21.15.187:6789/0 conn(0x7fa19415c840 legacy=0x7fa1940cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:55.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa18bfff700 1 -- 172.21.15.88:0/882391101 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1940b2460 con 0x7fa19406b0b0 2023-05-17T12:24:55.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa18bfff700 1 --2- 172.21.15.88:0/882391101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19406b0b0 0x7fa19406b940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098f0 tx=0x7fa17c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5683d9107a66a4e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:55.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa191d9b700 1 -- 172.21.15.88:0/882391101 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c011830 con 0x7fa19406b0b0 2023-05-17T12:24:55.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa191d9b700 1 -- 172.21.15.88:0/882391101 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c011990 con 0x7fa19406b0b0 2023-05-17T12:24:55.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.987+0000 7fa191d9b700 1 -- 172.21.15.88:0/882391101 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c011d20 con 0x7fa19406b0b0 2023-05-17T12:24:55.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.988+0000 7fa1989ff700 1 -- 172.21.15.88:0/882391101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19406b0b0 msgr2=0x7fa19406b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:55.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.988+0000 7fa1989ff700 1 --2- 172.21.15.88:0/882391101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19406b0b0 0x7fa19406b940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098f0 tx=0x7fa17c009c00 comp rx=0 tx=0).stop 2023-05-17T12:24:55.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.988+0000 7fa1989ff700 1 -- 172.21.15.88:0/882391101 shutdown_connections 2023-05-17T12:24:55.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.988+0000 7fa1989ff700 1 --2- 172.21.15.88:0/882391101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 0x7fa19406c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.988+0000 7fa1989ff700 1 --2- 172.21.15.88:0/882391101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19406b0b0 0x7fa19406b940 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.988+0000 7fa1989ff700 1 -- 172.21.15.88:0/882391101 >> 172.21.15.88:0/882391101 conn(0x7fa1940d3060 msgr2=0x7fa1940d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:55.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.988+0000 7fa1989ff700 1 -- 172.21.15.88:0/882391101 shutdown_connections 2023-05-17T12:24:55.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.988+0000 7fa1989ff700 1 -- 172.21.15.88:0/882391101 wait complete. 2023-05-17T12:24:55.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.990+0000 7fa1989ff700 1 Processor -- start 2023-05-17T12:24:55.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.990+0000 7fa1989ff700 1 -- start start 2023-05-17T12:24:55.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa1989ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa19406b0b0 0x7fa1941575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:55.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa1989ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 0x7fa19415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:55.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa1989ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19415c840 0x7fa1940cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:55.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa1989ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19415ac50 con 0x7fa19415c840 2023-05-17T12:24:55.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa1989ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19415f0d0 con 0x7fa19406b0b0 2023-05-17T12:24:55.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa1989ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19415e4c0 con 0x7fa19406c330 2023-05-17T12:24:55.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19415c840 0x7fa1940cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:55.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa192d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19415c840 0x7fa1940cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44654/0 (socket says 172.21.15.88:44654) 2023-05-17T12:24:55.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa192d9d700 1 -- 172.21.15.88:0/1277023915 learned_addr learned my addr 172.21.15.88:0/1277023915 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:55.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa18bfff700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 0x7fa19415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:55.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa19259c700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa19406b0b0 0x7fa1941575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:55.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa192d9d700 1 -- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 msgr2=0x7fa19415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:55.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa192d9d700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 0x7fa19415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa192d9d700 1 -- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa19406b0b0 msgr2=0x7fa1941575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:55.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa192d9d700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa19406b0b0 0x7fa1941575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:55.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.991+0000 7fa192d9d700 1 -- 172.21.15.88:0/1277023915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c009550 con 0x7fa19415c840 2023-05-17T12:24:55.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.992+0000 7fa192d9d700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19415c840 0x7fa1940cb9b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00efc0 tx=0x7fa18c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:55.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.992+0000 7fa18affd700 1 -- 172.21.15.88:0/1277023915 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c009ea0 con 0x7fa19415c840 2023-05-17T12:24:55.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.992+0000 7fa18affd700 1 -- 172.21.15.88:0/1277023915 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c00f040 con 0x7fa19415c840 2023-05-17T12:24:55.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.992+0000 7fa18affd700 1 -- 172.21.15.88:0/1277023915 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c00ced0 con 0x7fa19415c840 2023-05-17T12:24:55.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.992+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1940cd900 con 0x7fa19415c840 2023-05-17T12:24:55.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.992+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1940b2740 con 0x7fa19415c840 2023-05-17T12:24:55.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.993+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1940cdbe0 con 0x7fa19415c840 2023-05-17T12:24:55.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.994+0000 7fa18affd700 1 -- 172.21.15.88:0/1277023915 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa18c014480 con 0x7fa19415c840 2023-05-17T12:24:56.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.995+0000 7fa18affd700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa17406ace0 0x7fa17406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.995+0000 7fa18affd700 1 -- 172.21.15.88:0/1277023915 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa18c0898a0 con 0x7fa19415c840 2023-05-17T12:24:56.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.995+0000 7fa19259c700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa17406ace0 0x7fa17406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.996+0000 7fa19259c700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa17406ace0 0x7fa17406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa19415a820 tx=0x7fa184009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:56.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:55.999+0000 7fa18affd700 1 -- 172.21.15.88:0/1277023915 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa18c054d30 con 0x7fa19415c840 2023-05-17T12:24:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.198+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa19415f240 con 0x7fa19415c840 2023-05-17T12:24:56.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.199+0000 7fa18affd700 1 -- 172.21.15.88:0/1277023915 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14637 (secure 0 0 0) 0x7fa18c058350 con 0x7fa19415c840 2023-05-17T12:24:56.202 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:24:56.202 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:24:55.739635+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:24:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa17406ace0 msgr2=0x7fa17406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa17406ace0 0x7fa17406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa19415a820 tx=0x7fa184009040 comp rx=0 tx=0).stop 2023-05-17T12:24:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19415c840 msgr2=0x7fa1940cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19415c840 0x7fa1940cb9b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00efc0 tx=0x7fa18c00c3a0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 shutdown_connections 2023-05-17T12:24:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa17406ace0 0x7fa17406d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa19415c840 0x7fa1940cb9b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa19406b0b0 0x7fa1941575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 --2- 172.21.15.88:0/1277023915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa19406c330 0x7fa19415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 >> 172.21.15.88:0/1277023915 conn(0x7fa1940d3060 msgr2=0x7fa1940cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 shutdown_connections 2023-05-17T12:24:56.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.201+0000 7fa1989ff700 1 -- 172.21.15.88:0/1277023915 wait complete. 2023-05-17T12:24:56.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T12:24:56.222 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:24:56.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.405+0000 7ff9aadff700 1 Processor -- start 2023-05-17T12:24:56.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.405+0000 7ff9aadff700 1 -- start start 2023-05-17T12:24:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.406+0000 7ff9aadff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9a406c760 0x7ff9a406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.406+0000 7ff9aadff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a406b4a0 con 0x7ff9a40cf190 2023-05-17T12:24:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.406+0000 7ff9aadff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a406a510 con 0x7ff9a40b23a0 2023-05-17T12:24:56.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.406+0000 7ff9aadff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a40cd840 con 0x7ff9a406c760 2023-05-17T12:24:56.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.407+0000 7ff9a8b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9a406c760 0x7ff9a406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.407+0000 7ff9a939c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff9a40cf190 0x7ff9a4160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34636/0 (socket says 172.21.15.88:34636) 2023-05-17T12:24:56.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.407+0000 7ff9a939c700 1 -- 172.21.15.88:0/3926124472 learned_addr learned my addr 172.21.15.88:0/3926124472 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:24:56.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.407+0000 7ff9a37fe700 1 -- 172.21.15.88:0/3926124472 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190351261 0 0) 0x7ff9a406a510 con 0x7ff9a40b23a0 2023-05-17T12:24:56.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.407+0000 7ff9a37fe700 1 -- 172.21.15.88:0/3926124472 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9940035b0 con 0x7ff9a40b23a0 2023-05-17T12:24:56.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.407+0000 7ff9a8b9b700 1 -- 172.21.15.88:0/3926124472 >> v1:172.21.15.187:6789/0 conn(0x7ff9a40b23a0 legacy=0x7ff9a406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.407+0000 7ff9a8b9b700 1 -- 172.21.15.88:0/3926124472 >> v1:172.21.15.88:6789/0 conn(0x7ff9a40cf190 legacy=0x7ff9a4160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.407+0000 7ff9a8b9b700 1 -- 172.21.15.88:0/3926124472 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40cdb20 con 0x7ff9a406c760 2023-05-17T12:24:56.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.407+0000 7ff9a8b9b700 1 --2- 172.21.15.88:0/3926124472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a406c760 0x7ff9a406af60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff998009840 tx=0x7ff998009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e70c945839a260f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:56.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9a37fe700 1 -- 172.21.15.88:0/3926124472 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998011830 con 0x7ff9a406c760 2023-05-17T12:24:56.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9a37fe700 1 -- 172.21.15.88:0/3926124472 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998011990 con 0x7ff9a406c760 2023-05-17T12:24:56.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9a37fe700 1 -- 172.21.15.88:0/3926124472 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998011d20 con 0x7ff9a406c760 2023-05-17T12:24:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9aadff700 1 -- 172.21.15.88:0/3926124472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a406c760 msgr2=0x7ff9a406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9aadff700 1 --2- 172.21.15.88:0/3926124472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a406c760 0x7ff9a406af60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff998009840 tx=0x7ff998009b50 comp rx=0 tx=0).stop 2023-05-17T12:24:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9aadff700 1 -- 172.21.15.88:0/3926124472 shutdown_connections 2023-05-17T12:24:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9aadff700 1 --2- 172.21.15.88:0/3926124472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a406c760 0x7ff9a406af60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9aadff700 1 -- 172.21.15.88:0/3926124472 >> 172.21.15.88:0/3926124472 conn(0x7ff9a40d06f0 msgr2=0x7ff9a40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9aadff700 1 -- 172.21.15.88:0/3926124472 shutdown_connections 2023-05-17T12:24:56.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.408+0000 7ff9aadff700 1 -- 172.21.15.88:0/3926124472 wait complete. 2023-05-17T12:24:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.410+0000 7ff9aadff700 1 Processor -- start 2023-05-17T12:24:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.410+0000 7ff9aadff700 1 -- start start 2023-05-17T12:24:56.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9aadff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9a406c760 0x7ff9a40c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9aadff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a40cf190 0x7ff9a40c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9aadff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9a40ccb70 0x7ff9a40ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9aadff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40c9a60 con 0x7ff9a40cf190 2023-05-17T12:24:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9aadff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40cd3c0 con 0x7ff9a406c760 2023-05-17T12:24:56.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9aadff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a41e7990 con 0x7ff9a40ccb70 2023-05-17T12:24:56.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a40cf190 0x7ff9a40c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9a3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a40cf190 0x7ff9a40c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44670/0 (socket says 172.21.15.88:44670) 2023-05-17T12:24:56.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9a3fff700 1 -- 172.21.15.88:0/3336501451 learned_addr learned my addr 172.21.15.88:0/3336501451 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:56.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9a8b9b700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9a406c760 0x7ff9a40c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.411+0000 7ff9a939c700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9a40ccb70 0x7ff9a40ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a3fff700 1 -- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9a40ccb70 msgr2=0x7ff9a40ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a3fff700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9a40ccb70 0x7ff9a40ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a3fff700 1 -- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9a406c760 msgr2=0x7ff9a40c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a3fff700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9a406c760 0x7ff9a40c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a3fff700 1 -- 172.21.15.88:0/3336501451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980094a0 con 0x7ff9a40cf190 2023-05-17T12:24:56.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a939c700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9a40ccb70 0x7ff9a40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:56.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a3fff700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a40cf190 0x7ff9a40c7150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c500 tx=0x7ff99000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a17fa700 1 -- 172.21.15.88:0/3336501451 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900052d0 con 0x7ff9a40cf190 2023-05-17T12:24:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a17fa700 1 -- 172.21.15.88:0/3336501451 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff990005430 con 0x7ff9a40cf190 2023-05-17T12:24:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a406aa40 con 0x7ff9a40cf190 2023-05-17T12:24:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9a17fa700 1 -- 172.21.15.88:0/3336501451 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900038c0 con 0x7ff9a40cf190 2023-05-17T12:24:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.412+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a406a760 con 0x7ff9a40cf190 2023-05-17T12:24:56.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.413+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a415cb40 con 0x7ff9a40cf190 2023-05-17T12:24:56.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.414+0000 7ff9a17fa700 1 -- 172.21.15.88:0/3336501451 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff990003a20 con 0x7ff9a40cf190 2023-05-17T12:24:56.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.415+0000 7ff9a17fa700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff98806ace0 0x7ff98806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.415+0000 7ff9a17fa700 1 -- 172.21.15.88:0/3336501451 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff9900884f0 con 0x7ff9a40cf190 2023-05-17T12:24:56.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.415+0000 7ff9a8b9b700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff98806ace0 0x7ff98806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.416+0000 7ff9a8b9b700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff98806ace0 0x7ff98806d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff9980090b0 tx=0x7ff998008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:56.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.419+0000 7ff9a17fa700 1 -- 172.21.15.88:0/3336501451 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff990053980 con 0x7ff9a40cf190 2023-05-17T12:24:56.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.609+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9a4066c70 con 0x7ff9a40cf190 2023-05-17T12:24:56.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.610+0000 7ff9a17fa700 1 -- 172.21.15.88:0/3336501451 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff990056fa0 con 0x7ff9a40cf190 2023-05-17T12:24:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:24:56.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff98806ace0 msgr2=0x7ff98806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff98806ace0 0x7ff98806d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff9980090b0 tx=0x7ff998008030 comp rx=0 tx=0).stop 2023-05-17T12:24:56.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a40cf190 msgr2=0x7ff9a40c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a40cf190 0x7ff9a40c7150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c500 tx=0x7ff99000c810 comp rx=0 tx=0).stop 2023-05-17T12:24:56.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 shutdown_connections 2023-05-17T12:24:56.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff98806ace0 0x7ff98806d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9a40ccb70 0x7ff9a40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9a406c760 0x7ff9a40c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 --2- 172.21.15.88:0/3336501451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9a40cf190 0x7ff9a40c7150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 >> 172.21.15.88:0/3336501451 conn(0x7ff9a40d06f0 msgr2=0x7ff9a40b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:56.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 shutdown_connections 2023-05-17T12:24:56.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.612+0000 7ff9aadff700 1 -- 172.21.15.88:0/3336501451 wait complete. 2023-05-17T12:24:56.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:24:56.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.817+0000 7f040a5ff700 1 Processor -- start 2023-05-17T12:24:56.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.817+0000 7f040a5ff700 1 -- start start 2023-05-17T12:24:56.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.818+0000 7f040a5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f040406c760 0x7f040406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.818+0000 7f040a5ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f04040b23a0 0x7f040406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.818+0000 7f040a5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040406b4a0 con 0x7f04040cf190 2023-05-17T12:24:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.818+0000 7f040a5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040406a510 con 0x7f040406c760 2023-05-17T12:24:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.818+0000 7f040a5ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040406d070 con 0x7f04040b23a0 2023-05-17T12:24:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0403fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f040406c760 0x7f040406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0408b9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f04040cf190 0x7f0404160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34640/0 (socket says 172.21.15.88:34640) 2023-05-17T12:24:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0408b9c700 1 -- 172.21.15.88:0/382778515 learned_addr learned my addr 172.21.15.88:0/382778515 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:24:56.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f04037fe700 1 --2- 172.21.15.88:0/382778515 >> v2:172.21.15.187:3300/0 conn(0x7f04040b23a0 0x7f040406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0402ffd700 1 -- 172.21.15.88:0/382778515 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802308097 0 0) 0x7f03fc001490 con 0x7f04040cf190 2023-05-17T12:24:56.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0403fff700 1 -- 172.21.15.88:0/382778515 >> v2:172.21.15.187:3300/0 conn(0x7f04040b23a0 msgr2=0x7f040406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0403fff700 1 --2- 172.21.15.88:0/382778515 >> v2:172.21.15.187:3300/0 conn(0x7f04040b23a0 0x7f040406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0403fff700 1 -- 172.21.15.88:0/382778515 >> v1:172.21.15.88:6789/0 conn(0x7f04040cf190 legacy=0x7f0404160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0403fff700 1 -- 172.21.15.88:0/382778515 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04040cd840 con 0x7f040406c760 2023-05-17T12:24:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f04037fe700 1 --2- 172.21.15.88:0/382778515 >> v2:172.21.15.187:3300/0 conn(0x7f04040b23a0 0x7f040406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0403fff700 1 --2- 172.21.15.88:0/382778515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040406c760 0x7f040406af60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f040406c540 tx=0x7f03f4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc33115bc8e48cb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.819+0000 7f0402ffd700 1 -- 172.21.15.88:0/382778515 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4011830 con 0x7f040406c760 2023-05-17T12:24:56.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f0402ffd700 1 -- 172.21.15.88:0/382778515 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f4011990 con 0x7f040406c760 2023-05-17T12:24:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f0402ffd700 1 -- 172.21.15.88:0/382778515 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4011d20 con 0x7f040406c760 2023-05-17T12:24:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f040a5ff700 1 -- 172.21.15.88:0/382778515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040406c760 msgr2=0x7f040406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f040a5ff700 1 --2- 172.21.15.88:0/382778515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040406c760 0x7f040406af60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f040406c540 tx=0x7f03f4009b20 comp rx=0 tx=0).stop 2023-05-17T12:24:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f040a5ff700 1 -- 172.21.15.88:0/382778515 shutdown_connections 2023-05-17T12:24:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f040a5ff700 1 --2- 172.21.15.88:0/382778515 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f040406c760 0x7f040406af60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f040a5ff700 1 --2- 172.21.15.88:0/382778515 >> v2:172.21.15.187:3300/0 conn(0x7f04040b23a0 0x7f040406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f040a5ff700 1 -- 172.21.15.88:0/382778515 >> 172.21.15.88:0/382778515 conn(0x7f04040d06f0 msgr2=0x7f04040d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:56.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f040a5ff700 1 -- 172.21.15.88:0/382778515 shutdown_connections 2023-05-17T12:24:56.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.820+0000 7f040a5ff700 1 -- 172.21.15.88:0/382778515 wait complete. 2023-05-17T12:24:56.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.822+0000 7f040a5ff700 1 Processor -- start 2023-05-17T12:24:56.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.822+0000 7f040a5ff700 1 -- start start 2023-05-17T12:24:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f040a5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040406c760 0x7f0404158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f040a5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04040cf190 0x7f04041f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f040a5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04041f60f0 0x7f04040b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f040a5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04041f6590 con 0x7f04040cf190 2023-05-17T12:24:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f040a5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0404157e70 con 0x7f040406c760 2023-05-17T12:24:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f040a5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040415a5e0 con 0x7f04041f60f0 2023-05-17T12:24:56.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f04037fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04040cf190 0x7f04041f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f04037fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04040cf190 0x7f04041f5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44694/0 (socket says 172.21.15.88:44694) 2023-05-17T12:24:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f04037fe700 1 -- 172.21.15.88:0/3387519847 learned_addr learned my addr 172.21.15.88:0/3387519847 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f0403fff700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040406c760 0x7f0404158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f0408b9c700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04041f60f0 0x7f04040b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f04037fe700 1 -- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04041f60f0 msgr2=0x7f04040b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.823+0000 7f04037fe700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04041f60f0 0x7f04040b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f04037fe700 1 -- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040406c760 msgr2=0x7f0404158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f04037fe700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040406c760 0x7f0404158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f04037fe700 1 -- 172.21.15.88:0/3387519847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40094a0 con 0x7f04040cf190 2023-05-17T12:24:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f0408b9c700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04041f60f0 0x7f04040b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f04037fe700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04040cf190 0x7f04041f5bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03f800e870 tx=0x7f03f800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f0400ff9700 1 -- 172.21.15.88:0/3387519847 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8013610 con 0x7f04040cf190 2023-05-17T12:24:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f0400ff9700 1 -- 172.21.15.88:0/3387519847 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8013770 con 0x7f04040cf190 2023-05-17T12:24:56.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040406a760 con 0x7f04040cf190 2023-05-17T12:24:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f0400ff9700 1 -- 172.21.15.88:0/3387519847 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8013b20 con 0x7f04040cf190 2023-05-17T12:24:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.824+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04040cdb20 con 0x7f04040cf190 2023-05-17T12:24:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.825+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040406aa40 con 0x7f04040cf190 2023-05-17T12:24:56.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.826+0000 7f0400ff9700 1 -- 172.21.15.88:0/3387519847 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03f8013c80 con 0x7f04040cf190 2023-05-17T12:24:56.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.827+0000 7f0400ff9700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f03f006ace0 0x7f03f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:56.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.827+0000 7f0400ff9700 1 -- 172.21.15.88:0/3387519847 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f03f8088d00 con 0x7f04040cf190 2023-05-17T12:24:56.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.827+0000 7f0403fff700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f03f006ace0 0x7f03f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:56.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.828+0000 7f0403fff700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f03f006ace0 0x7f03f006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03f40090b0 tx=0x7f03f4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:56.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:56.831+0000 7f0400ff9700 1 -- 172.21.15.88:0/3387519847 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f03f8057b90 con 0x7f04040cf190 2023-05-17T12:24:57.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.028+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0404074530 con 0x7f04040cf190 2023-05-17T12:24:57.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.028+0000 7f0400ff9700 1 -- 172.21.15.88:0/3387519847 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03f8057720 con 0x7f04040cf190 2023-05-17T12:24:57.031 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:24:57.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f03f006ace0 msgr2=0x7f03f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f03f006ace0 0x7f03f006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03f40090b0 tx=0x7f03f4008030 comp rx=0 tx=0).stop 2023-05-17T12:24:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04040cf190 msgr2=0x7f04041f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04040cf190 0x7f04041f5bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03f800e870 tx=0x7f03f800eb80 comp rx=0 tx=0).stop 2023-05-17T12:24:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 shutdown_connections 2023-05-17T12:24:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f03f006ace0 0x7f03f006d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04041f60f0 0x7f04040b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040406c760 0x7f0404158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 --2- 172.21.15.88:0/3387519847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04040cf190 0x7f04041f5bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 >> 172.21.15.88:0/3387519847 conn(0x7f04040d06f0 msgr2=0x7f04040b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 shutdown_connections 2023-05-17T12:24:57.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.030+0000 7f040a5ff700 1 -- 172.21.15.88:0/3387519847 wait complete. 2023-05-17T12:24:57.050 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:24:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.232+0000 7f5f66dff700 1 Processor -- start 2023-05-17T12:24:57.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.232+0000 7f5f66dff700 1 -- start start 2023-05-17T12:24:57.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.233+0000 7f5f66dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f6015c840 0x7f5f6006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.233+0000 7f5f66dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f600cd6b0 con 0x7f5f6006b0b0 2023-05-17T12:24:57.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.233+0000 7f5f66dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f600b2460 con 0x7f5f6006c330 2023-05-17T12:24:57.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.233+0000 7f5f66dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f600cdf50 con 0x7f5f6015c840 2023-05-17T12:24:57.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f5ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5f6006b0b0 0x7f5f600cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34656/0 (socket says 172.21.15.88:34656) 2023-05-17T12:24:57.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f64b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f6015c840 0x7f5f6006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f5ffff700 1 -- 172.21.15.88:0/2547683992 learned_addr learned my addr 172.21.15.88:0/2547683992 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:24:57.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f64b9b700 1 -- 172.21.15.88:0/2547683992 >> v1:172.21.15.187:6789/0 conn(0x7f5f6006c330 legacy=0x7f5f60160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:57.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f64b9b700 1 -- 172.21.15.88:0/2547683992 >> v1:172.21.15.88:6789/0 conn(0x7f5f6006b0b0 legacy=0x7f5f600cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f64b9b700 1 -- 172.21.15.88:0/2547683992 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f600b2740 con 0x7f5f6015c840 2023-05-17T12:24:57.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f64b9b700 1 --2- 172.21.15.88:0/2547683992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 0x7f5f6006b940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009840 tx=0x7f5f54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0e7d68b260cdfc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:57.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f5f7fe700 1 -- 172.21.15.88:0/2547683992 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54004230 con 0x7f5f6015c840 2023-05-17T12:24:57.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f5f7fe700 1 -- 172.21.15.88:0/2547683992 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54004390 con 0x7f5f6015c840 2023-05-17T12:24:57.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.234+0000 7f5f5f7fe700 1 -- 172.21.15.88:0/2547683992 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540036a0 con 0x7f5f6015c840 2023-05-17T12:24:57.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.235+0000 7f5f66dff700 1 -- 172.21.15.88:0/2547683992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 msgr2=0x7f5f6006b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.235+0000 7f5f66dff700 1 --2- 172.21.15.88:0/2547683992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 0x7f5f6006b940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009840 tx=0x7f5f54009b50 comp rx=0 tx=0).stop 2023-05-17T12:24:57.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.235+0000 7f5f66dff700 1 -- 172.21.15.88:0/2547683992 shutdown_connections 2023-05-17T12:24:57.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.235+0000 7f5f66dff700 1 --2- 172.21.15.88:0/2547683992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 0x7f5f6006b940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.235+0000 7f5f66dff700 1 -- 172.21.15.88:0/2547683992 >> 172.21.15.88:0/2547683992 conn(0x7f5f600d3060 msgr2=0x7f5f600d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:57.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.235+0000 7f5f66dff700 1 -- 172.21.15.88:0/2547683992 shutdown_connections 2023-05-17T12:24:57.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.235+0000 7f5f66dff700 1 -- 172.21.15.88:0/2547683992 wait complete. 2023-05-17T12:24:57.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.237+0000 7f5f66dff700 1 Processor -- start 2023-05-17T12:24:57.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.237+0000 7f5f66dff700 1 -- start start 2023-05-17T12:24:57.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f66dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6006b0b0 0x7f5f601f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f66dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f6006c330 0x7f5f601559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f66dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 0x7f5f6015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f66dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f601e82c0 con 0x7f5f6015c840 2023-05-17T12:24:57.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f66dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f601e85a0 con 0x7f5f6006c330 2023-05-17T12:24:57.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f66dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f601e8880 con 0x7f5f6006b0b0 2023-05-17T12:24:57.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f6539c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 0x7f5f6015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f6539c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 0x7f5f6015b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44710/0 (socket says 172.21.15.88:44710) 2023-05-17T12:24:57.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f6539c700 1 -- 172.21.15.88:0/627513243 learned_addr learned my addr 172.21.15.88:0/627513243 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:57.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f5ffff700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f6006c330 0x7f5f601559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f64b9b700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6006b0b0 0x7f5f601f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f6539c700 1 -- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6006b0b0 msgr2=0x7f5f601f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f6539c700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6006b0b0 0x7f5f601f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f6539c700 1 -- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f6006c330 msgr2=0x7f5f601559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f6539c700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f6006c330 0x7f5f601559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f6539c700 1 -- 172.21.15.88:0/627513243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540094a0 con 0x7f5f6015c840 2023-05-17T12:24:57.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f5ffff700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f6006c330 0x7f5f601559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:57.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.238+0000 7f5f64b9b700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6006b0b0 0x7f5f601f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:57.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.239+0000 7f5f6539c700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 0x7f5f6015b950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800cc10 tx=0x7f5f5800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:57.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.239+0000 7f5f5d7fa700 1 -- 172.21.15.88:0/627513243 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800abb0 con 0x7f5f6015c840 2023-05-17T12:24:57.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.239+0000 7f5f5d7fa700 1 -- 172.21.15.88:0/627513243 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800ad10 con 0x7f5f6015c840 2023-05-17T12:24:57.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.239+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f600cdbe0 con 0x7f5f6015c840 2023-05-17T12:24:57.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.239+0000 7f5f5d7fa700 1 -- 172.21.15.88:0/627513243 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58012660 con 0x7f5f6015c840 2023-05-17T12:24:57.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.239+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f600cd900 con 0x7f5f6015c840 2023-05-17T12:24:57.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.240+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6015cc10 con 0x7f5f6015c840 2023-05-17T12:24:57.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.241+0000 7f5f5d7fa700 1 -- 172.21.15.88:0/627513243 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f580127c0 con 0x7f5f6015c840 2023-05-17T12:24:57.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.242+0000 7f5f5d7fa700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4406ace0 0x7f5f4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.242+0000 7f5f5d7fa700 1 -- 172.21.15.88:0/627513243 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5f58089850 con 0x7f5f6015c840 2023-05-17T12:24:57.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.242+0000 7f5f64b9b700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4406ace0 0x7f5f4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.243+0000 7f5f64b9b700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4406ace0 0x7f5f4406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f60161070 tx=0x7f5f5401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:57.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.246+0000 7f5f5d7fa700 1 -- 172.21.15.88:0/627513243 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5f58054ce0 con 0x7f5f6015c840 2023-05-17T12:24:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.482+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f60074530 con 0x7f5f6015c840 2023-05-17T12:24:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.483+0000 7f5f5d7fa700 1 -- 172.21.15.88:0/627513243 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f5f58016020 con 0x7f5f6015c840 2023-05-17T12:24:57.486 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:24:57.486 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4314,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-17T12:24:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4406ace0 msgr2=0x7f5f4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4406ace0 0x7f5f4406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f60161070 tx=0x7f5f5401c040 comp rx=0 tx=0).stop 2023-05-17T12:24:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 msgr2=0x7f5f6015b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 0x7f5f6015b950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800cc10 tx=0x7f5f5800a060 comp rx=0 tx=0).stop 2023-05-17T12:24:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 shutdown_connections 2023-05-17T12:24:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4406ace0 0x7f5f4406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f6015c840 0x7f5f6015b950 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6006b0b0 0x7f5f601f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 --2- 172.21.15.88:0/627513243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f6006c330 0x7f5f601559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 >> 172.21.15.88:0/627513243 conn(0x7f5f600d3060 msgr2=0x7f5f600b8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 shutdown_connections 2023-05-17T12:24:57.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.485+0000 7f5f66dff700 1 -- 172.21.15.88:0/627513243 wait complete. 2023-05-17T12:24:57.490 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2023-05-17T12:24:57.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:24:57.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.687+0000 7fe2955ff700 1 Processor -- start 2023-05-17T12:24:57.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.687+0000 7fe2955ff700 1 -- start start 2023-05-17T12:24:57.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.688+0000 7fe2955ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe29015c840 0x7fe29006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.688+0000 7fe2955ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe29006b0b0 0x7fe2900cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.688+0000 7fe2955ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900cd6b0 con 0x7fe29006c330 2023-05-17T12:24:57.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.688+0000 7fe2955ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900cdf50 con 0x7fe29006b0b0 2023-05-17T12:24:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.688+0000 7fe2955ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900cf860 con 0x7fe29015c840 2023-05-17T12:24:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.688+0000 7fe28e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe29006b0b0 0x7fe2900cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.688+0000 7fe28e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe29006b0b0 0x7fe2900cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44716/0 (socket says 172.21.15.88:44716) 2023-05-17T12:24:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.688+0000 7fe28e7fc700 1 -- 172.21.15.88:0/525599936 learned_addr learned my addr 172.21.15.88:0/525599936 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:57.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.688+0000 7fe28effd700 1 --2- 172.21.15.88:0/525599936 >> v2:172.21.15.187:3300/0 conn(0x7fe29015c840 0x7fe29006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.689+0000 7fe28e7fc700 1 -- 172.21.15.88:0/525599936 >> v2:172.21.15.187:3300/0 conn(0x7fe29015c840 msgr2=0x7fe29006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.689+0000 7fe28e7fc700 1 --2- 172.21.15.88:0/525599936 >> v2:172.21.15.187:3300/0 conn(0x7fe29015c840 0x7fe29006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.689+0000 7fe28e7fc700 1 -- 172.21.15.88:0/525599936 >> v1:172.21.15.187:6789/0 conn(0x7fe29006c330 legacy=0x7fe290160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.689+0000 7fe28e7fc700 1 -- 172.21.15.88:0/525599936 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900b2460 con 0x7fe29006b0b0 2023-05-17T12:24:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.689+0000 7fe28e7fc700 1 --2- 172.21.15.88:0/525599936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006b0b0 0x7fe2900cf320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe2900cfa40 tx=0x7fe284009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116c1c485bb999fb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.689+0000 7fe28dffb700 1 -- 172.21.15.88:0/525599936 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284011830 con 0x7fe29006b0b0 2023-05-17T12:24:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.689+0000 7fe28dffb700 1 -- 172.21.15.88:0/525599936 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284011990 con 0x7fe29006b0b0 2023-05-17T12:24:57.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.689+0000 7fe28dffb700 1 -- 172.21.15.88:0/525599936 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284011d20 con 0x7fe29006b0b0 2023-05-17T12:24:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.690+0000 7fe2955ff700 1 -- 172.21.15.88:0/525599936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006b0b0 msgr2=0x7fe2900cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.690+0000 7fe2955ff700 1 --2- 172.21.15.88:0/525599936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006b0b0 0x7fe2900cf320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe2900cfa40 tx=0x7fe284009bd0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.690+0000 7fe2955ff700 1 -- 172.21.15.88:0/525599936 shutdown_connections 2023-05-17T12:24:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.690+0000 7fe2955ff700 1 --2- 172.21.15.88:0/525599936 >> v2:172.21.15.187:3300/0 conn(0x7fe29015c840 0x7fe29006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.690+0000 7fe2955ff700 1 --2- 172.21.15.88:0/525599936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006b0b0 0x7fe2900cf320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.690+0000 7fe2955ff700 1 -- 172.21.15.88:0/525599936 >> 172.21.15.88:0/525599936 conn(0x7fe2900d3060 msgr2=0x7fe2900d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.690+0000 7fe2955ff700 1 -- 172.21.15.88:0/525599936 shutdown_connections 2023-05-17T12:24:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.690+0000 7fe2955ff700 1 -- 172.21.15.88:0/525599936 wait complete. 2023-05-17T12:24:57.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.692+0000 7fe2955ff700 1 Processor -- start 2023-05-17T12:24:57.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.692+0000 7fe2955ff700 1 -- start start 2023-05-17T12:24:57.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe2955ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe29006b0b0 0x7fe29015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe2955ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006c330 0x7fe2901523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe2955ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe29015c840 0x7fe2901f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe2955ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29015b940 con 0x7fe29006c330 2023-05-17T12:24:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe2955ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c8790 con 0x7fe29006b0b0 2023-05-17T12:24:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe2955ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c8a70 con 0x7fe29015c840 2023-05-17T12:24:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe28e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006c330 0x7fe2901523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe28e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006c330 0x7fe2901523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44732/0 (socket says 172.21.15.88:44732) 2023-05-17T12:24:57.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe28e7fc700 1 -- 172.21.15.88:0/3169166604 learned_addr learned my addr 172.21.15.88:0/3169166604 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe28effd700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe29006b0b0 0x7fe29015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.693+0000 7fe28f7fe700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe29015c840 0x7fe2901f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe28e7fc700 1 -- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe29015c840 msgr2=0x7fe2901f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe28e7fc700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe29015c840 0x7fe2901f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe28e7fc700 1 -- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe29006b0b0 msgr2=0x7fe29015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe28e7fc700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe29006b0b0 0x7fe29015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe28e7fc700 1 -- 172.21.15.88:0/3169166604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284009550 con 0x7fe29006c330 2023-05-17T12:24:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe28e7fc700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006c330 0x7fe2901523a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe284000c00 tx=0x7fe284004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe2777fe700 1 -- 172.21.15.88:0/3169166604 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284004480 con 0x7fe29006c330 2023-05-17T12:24:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe2777fe700 1 -- 172.21.15.88:0/3169166604 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28401f070 con 0x7fe29006c330 2023-05-17T12:24:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2900cd900 con 0x7fe29006c330 2023-05-17T12:24:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe2777fe700 1 -- 172.21.15.88:0/3169166604 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2840038e0 con 0x7fe29006c330 2023-05-17T12:24:57.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.694+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2900b2740 con 0x7fe29006c330 2023-05-17T12:24:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.695+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2900cdbe0 con 0x7fe29006c330 2023-05-17T12:24:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.696+0000 7fe2777fe700 1 -- 172.21.15.88:0/3169166604 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe284021030 con 0x7fe29006c330 2023-05-17T12:24:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.697+0000 7fe2777fe700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe27c06ace0 0x7fe27c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:57.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.697+0000 7fe2777fe700 1 -- 172.21.15.88:0/3169166604 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe28408a6d0 con 0x7fe29006c330 2023-05-17T12:24:57.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.697+0000 7fe28effd700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe27c06ace0 0x7fe27c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:57.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.698+0000 7fe28effd700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe27c06ace0 0x7fe27c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe2900c9750 tx=0x7fe280009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:57.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.701+0000 7fe2777fe700 1 -- 172.21.15.88:0/3169166604 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe284055be0 con 0x7fe29006c330 2023-05-17T12:24:57.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.898+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2900c85f0 con 0x7fe29006c330 2023-05-17T12:24:57.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.899+0000 7fe2777fe700 1 -- 172.21.15.88:0/3169166604 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14624 (secure 0 0 0) 0x7fe2900c85f0 con 0x7fe29006c330 2023-05-17T12:24:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:24:57.902 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:24:56.745182+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:24:57.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe27c06ace0 msgr2=0x7fe27c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe27c06ace0 0x7fe27c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe2900c9750 tx=0x7fe280009210 comp rx=0 tx=0).stop 2023-05-17T12:24:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006c330 msgr2=0x7fe2901523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:57.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006c330 0x7fe2901523a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe284000c00 tx=0x7fe284004750 comp rx=0 tx=0).stop 2023-05-17T12:24:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 shutdown_connections 2023-05-17T12:24:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe27c06ace0 0x7fe27c06d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe29015c840 0x7fe2901f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe29006b0b0 0x7fe29015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 --2- 172.21.15.88:0/3169166604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe29006c330 0x7fe2901523a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 >> 172.21.15.88:0/3169166604 conn(0x7fe2900d3060 msgr2=0x7fe2900cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 shutdown_connections 2023-05-17T12:24:57.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:57.901+0000 7fe2955ff700 1 -- 172.21.15.88:0/3169166604 wait complete. 2023-05-17T12:24:57.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T12:24:57.922 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:24:58.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.105+0000 7fb71efff700 1 Processor -- start 2023-05-17T12:24:58.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.105+0000 7fb71efff700 1 -- start start 2023-05-17T12:24:58.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb71efff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb71806c760 0x7fb71806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb71efff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7180b23a0 0x7fb71806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb71efff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71806b4a0 con 0x7fb7180cf190 2023-05-17T12:24:58.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb71efff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71806a510 con 0x7fb7180b23a0 2023-05-17T12:24:58.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb71efff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71806d070 con 0x7fb71806c760 2023-05-17T12:24:58.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb717fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7180b23a0 0x7fb71806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb717fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7180b23a0 0x7fb71806cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44744/0 (socket says 172.21.15.88:44744) 2023-05-17T12:24:58.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb717fff700 1 -- 172.21.15.88:0/356410465 learned_addr learned my addr 172.21.15.88:0/356410465 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:58.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb71cd9b700 1 --2- 172.21.15.88:0/356410465 >> v2:172.21.15.187:3300/0 conn(0x7fb71806c760 0x7fb71806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb717fff700 1 -- 172.21.15.88:0/356410465 >> v2:172.21.15.187:3300/0 conn(0x7fb71806c760 msgr2=0x7fb71806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:58.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb717fff700 1 --2- 172.21.15.88:0/356410465 >> v2:172.21.15.187:3300/0 conn(0x7fb71806c760 0x7fb71806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb717fff700 1 -- 172.21.15.88:0/356410465 >> v1:172.21.15.187:6789/0 conn(0x7fb7180cf190 legacy=0x7fb718160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.107+0000 7fb717fff700 1 -- 172.21.15.88:0/356410465 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180cd840 con 0x7fb7180b23a0 2023-05-17T12:24:58.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb717fff700 1 --2- 172.21.15.88:0/356410465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7180b23a0 0x7fb71806cb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7180d3a80 tx=0x7fb704009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acefecd0c38daff server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:58.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb7177fe700 1 -- 172.21.15.88:0/356410465 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704011830 con 0x7fb7180b23a0 2023-05-17T12:24:58.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb7177fe700 1 -- 172.21.15.88:0/356410465 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb704011990 con 0x7fb7180b23a0 2023-05-17T12:24:58.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb7177fe700 1 -- 172.21.15.88:0/356410465 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704011d20 con 0x7fb7180b23a0 2023-05-17T12:24:58.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb71efff700 1 -- 172.21.15.88:0/356410465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7180b23a0 msgr2=0x7fb71806cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb71efff700 1 --2- 172.21.15.88:0/356410465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7180b23a0 0x7fb71806cb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7180d3a80 tx=0x7fb704009bd0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb71efff700 1 -- 172.21.15.88:0/356410465 shutdown_connections 2023-05-17T12:24:58.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb71efff700 1 --2- 172.21.15.88:0/356410465 >> v2:172.21.15.187:3300/0 conn(0x7fb71806c760 0x7fb71806af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb71efff700 1 --2- 172.21.15.88:0/356410465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7180b23a0 0x7fb71806cb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.108+0000 7fb71efff700 1 -- 172.21.15.88:0/356410465 >> 172.21.15.88:0/356410465 conn(0x7fb7180d06f0 msgr2=0x7fb7180d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:58.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.109+0000 7fb71efff700 1 -- 172.21.15.88:0/356410465 shutdown_connections 2023-05-17T12:24:58.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.109+0000 7fb71efff700 1 -- 172.21.15.88:0/356410465 wait complete. 2023-05-17T12:24:58.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.110+0000 7fb71efff700 1 Processor -- start 2023-05-17T12:24:58.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.110+0000 7fb71efff700 1 -- start start 2023-05-17T12:24:58.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.111+0000 7fb71efff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb71806c760 0x7fb7180c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.111+0000 7fb71efff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7180cf190 0x7fb7180ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.111+0000 7fb71efff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7180b60f0 0x7fb7180cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.111+0000 7fb71efff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180cb5f0 con 0x7fb71806c760 2023-05-17T12:24:58.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.111+0000 7fb71efff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180ca970 con 0x7fb7180cf190 2023-05-17T12:24:58.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.111+0000 7fb71efff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180cac50 con 0x7fb7180b60f0 2023-05-17T12:24:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71cd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb71806c760 0x7fb7180c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71cd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb71806c760 0x7fb7180c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44754/0 (socket says 172.21.15.88:44754) 2023-05-17T12:24:58.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71cd9b700 1 -- 172.21.15.88:0/1626293997 learned_addr learned my addr 172.21.15.88:0/1626293997 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb717fff700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7180cf190 0x7fb7180ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71d59c700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7180b60f0 0x7fb7180cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71cd9b700 1 -- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7180b60f0 msgr2=0x7fb7180cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71cd9b700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7180b60f0 0x7fb7180cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71cd9b700 1 -- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7180cf190 msgr2=0x7fb7180ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71cd9b700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7180cf190 0x7fb7180ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71cd9b700 1 -- 172.21.15.88:0/1626293997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb704009550 con 0x7fb71806c760 2023-05-17T12:24:58.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb71cd9b700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb71806c760 0x7fb7180c90a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e9b0 tx=0x7fb70c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:58.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb7157fa700 1 -- 172.21.15.88:0/1626293997 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c009710 con 0x7fb71806c760 2023-05-17T12:24:58.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.112+0000 7fb7157fa700 1 -- 172.21.15.88:0/1626293997 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c00ee50 con 0x7fb71806c760 2023-05-17T12:24:58.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.113+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71806a760 con 0x7fb71806c760 2023-05-17T12:24:58.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.113+0000 7fb7157fa700 1 -- 172.21.15.88:0/1626293997 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00ca50 con 0x7fb71806c760 2023-05-17T12:24:58.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.113+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7180cdb20 con 0x7fb71806c760 2023-05-17T12:24:58.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.114+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71806aa40 con 0x7fb71806c760 2023-05-17T12:24:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.115+0000 7fb7157fa700 1 -- 172.21.15.88:0/1626293997 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb70c00cbb0 con 0x7fb71806c760 2023-05-17T12:24:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.116+0000 7fb7157fa700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6fc06ace0 0x7fb6fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.116+0000 7fb7157fa700 1 -- 172.21.15.88:0/1626293997 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb70c0891b0 con 0x7fb71806c760 2023-05-17T12:24:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.116+0000 7fb717fff700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6fc06ace0 0x7fb6fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.117+0000 7fb717fff700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6fc06ace0 0x7fb6fc06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb704009840 tx=0x7fb704008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:58.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.119+0000 7fb7157fa700 1 -- 172.21.15.88:0/1626293997 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb70c057fb0 con 0x7fb71806c760 2023-05-17T12:24:58.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.311+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7180cb860 con 0x7fb71806c760 2023-05-17T12:24:58.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.312+0000 7fb7157fa700 1 -- 172.21.15.88:0/1626293997 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb70c00ce60 con 0x7fb71806c760 2023-05-17T12:24:58.315 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:24:58.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6fc06ace0 msgr2=0x7fb6fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6fc06ace0 0x7fb6fc06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb704009840 tx=0x7fb704008030 comp rx=0 tx=0).stop 2023-05-17T12:24:58.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb71806c760 msgr2=0x7fb7180c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb71806c760 0x7fb7180c90a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e9b0 tx=0x7fb70c00ecc0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 shutdown_connections 2023-05-17T12:24:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6fc06ace0 0x7fb6fc06d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7180b60f0 0x7fb7180cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb71806c760 0x7fb7180c90a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 --2- 172.21.15.88:0/1626293997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7180cf190 0x7fb7180ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 >> 172.21.15.88:0/1626293997 conn(0x7fb7180d06f0 msgr2=0x7fb718154540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 shutdown_connections 2023-05-17T12:24:58.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.314+0000 7fb71efff700 1 -- 172.21.15.88:0/1626293997 wait complete. 2023-05-17T12:24:58.333 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:24:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.518+0000 7f30c6bff700 1 Processor -- start 2023-05-17T12:24:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.518+0000 7f30c6bff700 1 -- start start 2023-05-17T12:24:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.519+0000 7f30c6bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c006c760 0x7f30c006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.519+0000 7f30c6bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f30c00b23a0 0x7f30c006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.519+0000 7f30c6bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c006b4a0 con 0x7f30c00cf190 2023-05-17T12:24:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.519+0000 7f30c6bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c006a510 con 0x7f30c00b23a0 2023-05-17T12:24:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.519+0000 7f30c6bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c006d070 con 0x7f30c006c760 2023-05-17T12:24:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.519+0000 7f30c519c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f30c00cf190 0x7f30c0160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34666/0 (socket says 172.21.15.88:34666) 2023-05-17T12:24:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.519+0000 7f30c519c700 1 -- 172.21.15.88:0/3719421689 learned_addr learned my addr 172.21.15.88:0/3719421689 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:24:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30c499b700 1 --2- 172.21.15.88:0/3719421689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c006c760 0x7f30c006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30bffff700 1 --2- 172.21.15.88:0/3719421689 >> v2:172.21.15.187:3300/0 conn(0x7f30c00b23a0 0x7f30c006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30bf7fe700 1 -- 172.21.15.88:0/3719421689 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422998918 0 0) 0x7f30b8001490 con 0x7f30c00cf190 2023-05-17T12:24:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30bf7fe700 1 -- 172.21.15.88:0/3719421689 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30b00035b0 con 0x7f30c00cf190 2023-05-17T12:24:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30c499b700 1 -- 172.21.15.88:0/3719421689 >> v2:172.21.15.187:3300/0 conn(0x7f30c00b23a0 msgr2=0x7f30c006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30c499b700 1 --2- 172.21.15.88:0/3719421689 >> v2:172.21.15.187:3300/0 conn(0x7f30c00b23a0 0x7f30c006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30c499b700 1 -- 172.21.15.88:0/3719421689 >> v1:172.21.15.88:6789/0 conn(0x7f30c00cf190 legacy=0x7f30c0160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30bf7fe700 1 -- 172.21.15.88:0/3719421689 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3067362262 0 0) 0x7f30b00035b0 con 0x7f30c00cf190 2023-05-17T12:24:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30c499b700 1 -- 172.21.15.88:0/3719421689 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00cd840 con 0x7f30c006c760 2023-05-17T12:24:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.520+0000 7f30c499b700 1 --2- 172.21.15.88:0/3719421689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c006c760 0x7f30c006af60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009840 tx=0x7f30b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c538576a5707dd6d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30bf7fe700 1 -- 172.21.15.88:0/3719421689 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8001b80 con 0x7f30c006c760 2023-05-17T12:24:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30bf7fe700 1 -- 172.21.15.88:0/3719421689 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4004030 con 0x7f30c006c760 2023-05-17T12:24:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30bf7fe700 1 -- 172.21.15.88:0/3719421689 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40043c0 con 0x7f30c006c760 2023-05-17T12:24:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30c6bff700 1 -- 172.21.15.88:0/3719421689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c006c760 msgr2=0x7f30c006af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30c6bff700 1 --2- 172.21.15.88:0/3719421689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c006c760 0x7f30c006af60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009840 tx=0x7f30b4009b50 comp rx=0 tx=0).stop 2023-05-17T12:24:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30c6bff700 1 -- 172.21.15.88:0/3719421689 shutdown_connections 2023-05-17T12:24:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30c6bff700 1 --2- 172.21.15.88:0/3719421689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c006c760 0x7f30c006af60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30c6bff700 1 --2- 172.21.15.88:0/3719421689 >> v2:172.21.15.187:3300/0 conn(0x7f30c00b23a0 0x7f30c006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30c6bff700 1 -- 172.21.15.88:0/3719421689 >> 172.21.15.88:0/3719421689 conn(0x7f30c00d06f0 msgr2=0x7f30c00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30c6bff700 1 -- 172.21.15.88:0/3719421689 shutdown_connections 2023-05-17T12:24:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.521+0000 7f30c6bff700 1 -- 172.21.15.88:0/3719421689 wait complete. 2023-05-17T12:24:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.524+0000 7f30c6bff700 1 Processor -- start 2023-05-17T12:24:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.524+0000 7f30c6bff700 1 -- start start 2023-05-17T12:24:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.525+0000 7f30c6bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c006c760 0x7f30c00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.525+0000 7f30c6bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30c00cf190 0x7f30c01505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.525+0000 7f30c6bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c01f24c0 0x7f30c00c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.525+0000 7f30c6bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0150ae0 con 0x7f30c00cf190 2023-05-17T12:24:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.525+0000 7f30c6bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c01f29c0 con 0x7f30c006c760 2023-05-17T12:24:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.525+0000 7f30c6bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c01f2ca0 con 0x7f30c01f24c0 2023-05-17T12:24:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.525+0000 7f30bffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30c00cf190 0x7f30c01505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.525+0000 7f30bffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30c00cf190 0x7f30c01505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44766/0 (socket says 172.21.15.88:44766) 2023-05-17T12:24:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.525+0000 7f30bffff700 1 -- 172.21.15.88:0/2461288811 learned_addr learned my addr 172.21.15.88:0/2461288811 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30c499b700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c006c760 0x7f30c00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30c519c700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c01f24c0 0x7f30c00c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30bffff700 1 -- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c01f24c0 msgr2=0x7f30c00c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30bffff700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c01f24c0 0x7f30c00c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30bffff700 1 -- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c006c760 msgr2=0x7f30c00cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30bffff700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c006c760 0x7f30c00cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30bffff700 1 -- 172.21.15.88:0/2461288811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b40094a0 con 0x7f30c00cf190 2023-05-17T12:24:58.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30c499b700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c006c760 0x7f30c00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:58.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30c519c700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c01f24c0 0x7f30c00c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30bffff700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30c00cf190 0x7f30c01505a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00e9b0 tx=0x7f30ac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30bd7fa700 1 -- 172.21.15.88:0/2461288811 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac009710 con 0x7f30c00cf190 2023-05-17T12:24:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30bd7fa700 1 -- 172.21.15.88:0/2461288811 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac00c850 con 0x7f30c00cf190 2023-05-17T12:24:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c006a760 con 0x7f30c00cf190 2023-05-17T12:24:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30bd7fa700 1 -- 172.21.15.88:0/2461288811 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00cbc0 con 0x7f30c00cf190 2023-05-17T12:24:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.526+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c00cdb20 con 0x7f30c00cf190 2023-05-17T12:24:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.528+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c006aa40 con 0x7f30c00cf190 2023-05-17T12:24:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.528+0000 7f30bd7fa700 1 -- 172.21.15.88:0/2461288811 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30ac00cd20 con 0x7f30c00cf190 2023-05-17T12:24:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.529+0000 7f30bd7fa700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f30a406ace0 0x7f30a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.530+0000 7f30bd7fa700 1 -- 172.21.15.88:0/2461288811 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f30ac0891b0 con 0x7f30c00cf190 2023-05-17T12:24:58.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.530+0000 7f30c499b700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f30a406ace0 0x7f30a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.530+0000 7f30c499b700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f30a406ace0 0x7f30a406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30b40090b0 tx=0x7f30b4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:58.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.533+0000 7f30bd7fa700 1 -- 172.21.15.88:0/2461288811 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f30ac0580d0 con 0x7f30c00cf190 2023-05-17T12:24:58.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.725+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30c0074530 con 0x7f30c00cf190 2023-05-17T12:24:58.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.725+0000 7f30bd7fa700 1 -- 172.21.15.88:0/2461288811 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f30ac057c60 con 0x7f30c00cf190 2023-05-17T12:24:58.728 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:24:58.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f30a406ace0 msgr2=0x7f30a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f30a406ace0 0x7f30a406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30b40090b0 tx=0x7f30b4008030 comp rx=0 tx=0).stop 2023-05-17T12:24:58.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30c00cf190 msgr2=0x7f30c01505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30c00cf190 0x7f30c01505a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00e9b0 tx=0x7f30ac00ed70 comp rx=0 tx=0).stop 2023-05-17T12:24:58.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 shutdown_connections 2023-05-17T12:24:58.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f30a406ace0 0x7f30a406d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c01f24c0 0x7f30c00c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c006c760 0x7f30c00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 --2- 172.21.15.88:0/2461288811 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30c00cf190 0x7f30c01505a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 >> 172.21.15.88:0/2461288811 conn(0x7f30c00d06f0 msgr2=0x7f30c0152520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 shutdown_connections 2023-05-17T12:24:58.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.728+0000 7f30c6bff700 1 -- 172.21.15.88:0/2461288811 wait complete. 2023-05-17T12:24:58.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T12:24:58.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.929+0000 7f217b3ff700 1 Processor -- start 2023-05-17T12:24:58.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.929+0000 7f217b3ff700 1 -- start start 2023-05-17T12:24:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.930+0000 7f217b3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f217415c840 0x7f217406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.930+0000 7f217b3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217406b0b0 0x7f21740cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217b3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21740cd6b0 con 0x7f217406c330 2023-05-17T12:24:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217b3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21740cdf50 con 0x7f217415c840 2023-05-17T12:24:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217b3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740cf860 con 0x7f217406b0b0 2023-05-17T12:24:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217919b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f217415c840 0x7f217406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217999c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f217406c330 0x7f2174160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34680/0 (socket says 172.21.15.88:34680) 2023-05-17T12:24:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217999c700 1 -- 172.21.15.88:0/1220502912 learned_addr learned my addr 172.21.15.88:0/1220502912 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:24:58.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217899a700 1 --2- 172.21.15.88:0/1220502912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217406b0b0 0x7f21740cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217919b700 1 -- 172.21.15.88:0/1220502912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217406b0b0 msgr2=0x7f21740cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217919b700 1 --2- 172.21.15.88:0/1220502912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217406b0b0 0x7f21740cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217919b700 1 -- 172.21.15.88:0/1220502912 >> v1:172.21.15.88:6789/0 conn(0x7f217406c330 legacy=0x7f2174160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f217919b700 1 -- 172.21.15.88:0/1220502912 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21740b2460 con 0x7f217415c840 2023-05-17T12:24:58.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.931+0000 7f216bfff700 1 -- 172.21.15.88:0/1220502912 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282092463 0 0) 0x7f21740cd6b0 con 0x7f217406c330 2023-05-17T12:24:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f217919b700 1 --2- 172.21.15.88:0/1220502912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217415c840 0x7f217406b940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2170009840 tx=0x7f2170009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1f2d6c0943c28b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f216bfff700 1 -- 172.21.15.88:0/1220502912 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170011830 con 0x7f217415c840 2023-05-17T12:24:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f216bfff700 1 -- 172.21.15.88:0/1220502912 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2170011990 con 0x7f217415c840 2023-05-17T12:24:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f216bfff700 1 -- 172.21.15.88:0/1220502912 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170011d20 con 0x7f217415c840 2023-05-17T12:24:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f217b3ff700 1 -- 172.21.15.88:0/1220502912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217415c840 msgr2=0x7f217406b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f217b3ff700 1 --2- 172.21.15.88:0/1220502912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217415c840 0x7f217406b940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2170009840 tx=0x7f2170009b50 comp rx=0 tx=0).stop 2023-05-17T12:24:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f217b3ff700 1 -- 172.21.15.88:0/1220502912 shutdown_connections 2023-05-17T12:24:58.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f217b3ff700 1 --2- 172.21.15.88:0/1220502912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217415c840 0x7f217406b940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f217b3ff700 1 --2- 172.21.15.88:0/1220502912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217406b0b0 0x7f21740cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f217b3ff700 1 -- 172.21.15.88:0/1220502912 >> 172.21.15.88:0/1220502912 conn(0x7f21740d3060 msgr2=0x7f21740d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:58.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.932+0000 7f217b3ff700 1 -- 172.21.15.88:0/1220502912 shutdown_connections 2023-05-17T12:24:58.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.933+0000 7f217b3ff700 1 -- 172.21.15.88:0/1220502912 wait complete. 2023-05-17T12:24:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.934+0000 7f217b3ff700 1 Processor -- start 2023-05-17T12:24:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.934+0000 7f217b3ff700 1 -- start start 2023-05-17T12:24:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.935+0000 7f217b3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217406b0b0 0x7f21740b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.935+0000 7f217b3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217406c330 0x7f21741f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.935+0000 7f217b3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217415c840 0x7f21741f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.935+0000 7f217b3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21740b8400 con 0x7f217406b0b0 2023-05-17T12:24:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.935+0000 7f217b3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217415f710 con 0x7f217406c330 2023-05-17T12:24:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.935+0000 7f217b3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740b77f0 con 0x7f217415c840 2023-05-17T12:24:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.935+0000 7f217919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217406b0b0 0x7f21740b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.935+0000 7f217919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217406b0b0 0x7f21740b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44792/0 (socket says 172.21.15.88:44792) 2023-05-17T12:24:58.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.935+0000 7f217919b700 1 -- 172.21.15.88:0/1085946112 learned_addr learned my addr 172.21.15.88:0/1085946112 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217899a700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217406c330 0x7f21741f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217999c700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217415c840 0x7f21741f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217919b700 1 -- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217415c840 msgr2=0x7f21741f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217919b700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217415c840 0x7f21741f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217919b700 1 -- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217406c330 msgr2=0x7f21741f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217919b700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217406c330 0x7f21741f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:58.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217919b700 1 -- 172.21.15.88:0/1085946112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700094a0 con 0x7f217406b0b0 2023-05-17T12:24:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217899a700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217406c330 0x7f21741f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217919b700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217406b0b0 0x7f21740b5220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2170014040 tx=0x7f2170004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f2169ffb700 1 -- 172.21.15.88:0/1085946112 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21700038a0 con 0x7f217406b0b0 2023-05-17T12:24:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f2169ffb700 1 -- 172.21.15.88:0/1085946112 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217001e070 con 0x7f217406b0b0 2023-05-17T12:24:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f2169ffb700 1 -- 172.21.15.88:0/1085946112 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170003c20 con 0x7f217406b0b0 2023-05-17T12:24:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.936+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21740cd900 con 0x7f217406b0b0 2023-05-17T12:24:58.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.937+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21740b2740 con 0x7f217406b0b0 2023-05-17T12:24:58.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.938+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21740cdbe0 con 0x7f217406b0b0 2023-05-17T12:24:58.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.938+0000 7f2169ffb700 1 -- 172.21.15.88:0/1085946112 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f217002d450 con 0x7f217406b0b0 2023-05-17T12:24:58.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.939+0000 7f2169ffb700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f215806ace0 0x7f215806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:58.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.939+0000 7f2169ffb700 1 -- 172.21.15.88:0/1085946112 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f217008a190 con 0x7f217406b0b0 2023-05-17T12:24:58.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.940+0000 7f217899a700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f215806ace0 0x7f215806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:58.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.940+0000 7f217899a700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f215806ace0 0x7f215806d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21740b4c00 tx=0x7f2164008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:58.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:58.943+0000 7f2169ffb700 1 -- 172.21.15.88:0/1085946112 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2170055580 con 0x7f217406b0b0 2023-05-17T12:24:59.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.137+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2174074530 con 0x7f217406b0b0 2023-05-17T12:24:59.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.137+0000 7f2169ffb700 1 -- 172.21.15.88:0/1085946112 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2170058ba0 con 0x7f217406b0b0 2023-05-17T12:24:59.141 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:24:59.141 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-05-17T12:24:59.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:24:59.141 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-05-17T12:24:59.141 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-05-17T12:24:59.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:24:59.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:24:59.142 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 2, 2023-05-17T12:24:59.142 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "rbd" 2023-05-17T12:24:59.142 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:24:59.142 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-05-17T12:24:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.139+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f215806ace0 msgr2=0x7f215806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.139+0000 7f217b3ff700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f215806ace0 0x7f215806d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21740b4c00 tx=0x7f2164008040 comp rx=0 tx=0).stop 2023-05-17T12:24:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.139+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217406b0b0 msgr2=0x7f21740b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.140+0000 7f217b3ff700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217406b0b0 0x7f21740b5220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2170014040 tx=0x7f2170004750 comp rx=0 tx=0).stop 2023-05-17T12:24:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.140+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 shutdown_connections 2023-05-17T12:24:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.140+0000 7f217b3ff700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f215806ace0 0x7f215806d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.140+0000 7f217b3ff700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f217415c840 0x7f21741f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.140+0000 7f217b3ff700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f217406b0b0 0x7f21740b5220 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.140+0000 7f217b3ff700 1 --2- 172.21.15.88:0/1085946112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f217406c330 0x7f21741f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.140+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 >> 172.21.15.88:0/1085946112 conn(0x7f21740d3060 msgr2=0x7f21740cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:59.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.140+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 shutdown_connections 2023-05-17T12:24:59.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.140+0000 7f217b3ff700 1 -- 172.21.15.88:0/1085946112 wait complete. 2023-05-17T12:24:59.159 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T12:24:59.160 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-17T12:24:59.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.346+0000 7f4f265ff700 1 Processor -- start 2023-05-17T12:24:59.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.346+0000 7f4f265ff700 1 -- start start 2023-05-17T12:24:59.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.347+0000 7f4f265ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4f2015c840 0x7f4f2006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:59.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.347+0000 7f4f265ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 0x7f4f200cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:59.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.347+0000 7f4f265ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4f2006c330 0x7f4f2006c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:59.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.347+0000 7f4f265ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f200cdf50 con 0x7f4f2006c330 2023-05-17T12:24:59.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.347+0000 7f4f265ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2006ccf0 con 0x7f4f2015c840 2023-05-17T12:24:59.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.347+0000 7f4f265ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200cd6b0 con 0x7f4f2006b0b0 2023-05-17T12:24:59.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f24b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4f2006c330 0x7f4f2006c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:59.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f24b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4f2006c330 0x7f4f2006c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44800/0 (socket says 172.21.15.88:44800) 2023-05-17T12:24:59.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f24b9c700 1 -- 172.21.15.88:0/786686709 learned_addr learned my addr 172.21.15.88:0/786686709 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:59.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f1f7fe700 1 --2- 172.21.15.88:0/786686709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 0x7f4f200cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:59.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f1ffff700 1 --2- 172.21.15.88:0/786686709 >> v2:172.21.15.187:3300/0 conn(0x7f4f2015c840 0x7f4f2006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:59.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f24b9c700 1 -- 172.21.15.88:0/786686709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 msgr2=0x7f4f200cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:59.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f24b9c700 1 --2- 172.21.15.88:0/786686709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 0x7f4f200cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f24b9c700 1 -- 172.21.15.88:0/786686709 >> v2:172.21.15.187:3300/0 conn(0x7f4f2015c840 msgr2=0x7f4f2006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:24:59.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f24b9c700 1 --2- 172.21.15.88:0/786686709 >> v2:172.21.15.187:3300/0 conn(0x7f4f2015c840 0x7f4f2006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f24b9c700 1 -- 172.21.15.88:0/786686709 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200cf860 con 0x7f4f2006c330 2023-05-17T12:24:59.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f1ffff700 1 --2- 172.21.15.88:0/786686709 >> v2:172.21.15.187:3300/0 conn(0x7f4f2015c840 0x7f4f2006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:59.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f24b9c700 1 --2- 172.21.15.88:0/786686709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 0x7f4f2006c7b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f200cfa40 tx=0x7f4f1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86df651b4d5260b1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:59.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f1effd700 1 -- 172.21.15.88:0/786686709 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1800e070 con 0x7f4f2006c330 2023-05-17T12:24:59.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f1effd700 1 -- 172.21.15.88:0/786686709 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1800b9c0 con 0x7f4f2006c330 2023-05-17T12:24:59.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.348+0000 7f4f1effd700 1 -- 172.21.15.88:0/786686709 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1800bd70 con 0x7f4f2006c330 2023-05-17T12:24:59.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.349+0000 7f4f265ff700 1 -- 172.21.15.88:0/786686709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 msgr2=0x7f4f2006c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:59.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.349+0000 7f4f265ff700 1 --2- 172.21.15.88:0/786686709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 0x7f4f2006c7b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f200cfa40 tx=0x7f4f1800b330 comp rx=0 tx=0).stop 2023-05-17T12:24:59.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.349+0000 7f4f265ff700 1 -- 172.21.15.88:0/786686709 shutdown_connections 2023-05-17T12:24:59.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.349+0000 7f4f265ff700 1 --2- 172.21.15.88:0/786686709 >> v2:172.21.15.187:3300/0 conn(0x7f4f2015c840 0x7f4f2006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.349+0000 7f4f265ff700 1 --2- 172.21.15.88:0/786686709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 0x7f4f2006c7b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.349+0000 7f4f265ff700 1 --2- 172.21.15.88:0/786686709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 0x7f4f200cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.349+0000 7f4f265ff700 1 -- 172.21.15.88:0/786686709 >> 172.21.15.88:0/786686709 conn(0x7f4f200d3060 msgr2=0x7f4f200d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:24:59.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.349+0000 7f4f265ff700 1 -- 172.21.15.88:0/786686709 shutdown_connections 2023-05-17T12:24:59.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.349+0000 7f4f265ff700 1 -- 172.21.15.88:0/786686709 wait complete. 2023-05-17T12:24:59.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.351+0000 7f4f265ff700 1 Processor -- start 2023-05-17T12:24:59.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.352+0000 7f4f265ff700 1 -- start start 2023-05-17T12:24:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f265ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 0x7f4f201f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f265ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 0x7f4f2015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f265ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f2015c840 0x7f4f2014bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f265ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f201f62e0 con 0x7f4f2006c330 2023-05-17T12:24:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f265ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2015b330 con 0x7f4f2015c840 2023-05-17T12:24:59.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f265ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2015acb0 con 0x7f4f2006b0b0 2023-05-17T12:24:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f1f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 0x7f4f2015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f1f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 0x7f4f2015e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44814/0 (socket says 172.21.15.88:44814) 2023-05-17T12:24:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f1f7fe700 1 -- 172.21.15.88:0/1426878605 learned_addr learned my addr 172.21.15.88:0/1426878605 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:24:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f1ffff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 0x7f4f201f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.353+0000 7f4f24b9c700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f2015c840 0x7f4f2014bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1f7fe700 1 -- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 msgr2=0x7f4f201f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1f7fe700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 0x7f4f201f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1f7fe700 1 -- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f2015c840 msgr2=0x7f4f2014bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:24:59.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1f7fe700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f2015c840 0x7f4f2014bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:24:59.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1f7fe700 1 -- 172.21.15.88:0/1426878605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18009b30 con 0x7f4f2006c330 2023-05-17T12:24:59.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1ffff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 0x7f4f201f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:24:59.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1f7fe700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 0x7f4f2015e0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400e810 tx=0x7f4f1400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:59.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1cff9700 1 -- 172.21.15.88:0/1426878605 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14013610 con 0x7f4f2006c330 2023-05-17T12:24:59.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1cff9700 1 -- 172.21.15.88:0/1426878605 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f14013790 con 0x7f4f2006c330 2023-05-17T12:24:59.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f200b2740 con 0x7f4f2006c330 2023-05-17T12:24:59.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f1cff9700 1 -- 172.21.15.88:0/1426878605 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14013b40 con 0x7f4f2006c330 2023-05-17T12:24:59.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.354+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f200b2460 con 0x7f4f2006c330 2023-05-17T12:24:59.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.355+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f200cd900 con 0x7f4f2006c330 2023-05-17T12:24:59.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.356+0000 7f4f1cff9700 1 -- 172.21.15.88:0/1426878605 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f14013ca0 con 0x7f4f2006c330 2023-05-17T12:24:59.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.357+0000 7f4f1cff9700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4f0c06ace0 0x7f4f0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:24:59.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.357+0000 7f4f1cff9700 1 -- 172.21.15.88:0/1426878605 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4f14088d40 con 0x7f4f2006c330 2023-05-17T12:24:59.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.357+0000 7f4f1ffff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4f0c06ace0 0x7f4f0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:24:59.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.358+0000 7f4f1ffff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4f0c06ace0 0x7f4f0c06d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000c960 tx=0x7f4f10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:24:59.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.361+0000 7f4f1cff9700 1 -- 172.21.15.88:0/1426878605 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4f14057bc0 con 0x7f4f2006c330 2023-05-17T12:24:59.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:24:59.557+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4f20074530 con 0x7f4f2006c330 2023-05-17T12:25:00.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.275+0000 7f4f1cff9700 1 -- 172.21.15.88:0/1426878605 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4f140210b0 con 0x7f4f2006c330 2023-05-17T12:25:00.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4f0c06ace0 msgr2=0x7f4f0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:00.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4f0c06ace0 0x7f4f0c06d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000c960 tx=0x7f4f10008040 comp rx=0 tx=0).stop 2023-05-17T12:25:00.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 msgr2=0x7f4f2015e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:00.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 0x7f4f2015e0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400e810 tx=0x7f4f1400eb20 comp rx=0 tx=0).stop 2023-05-17T12:25:00.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 shutdown_connections 2023-05-17T12:25:00.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4f0c06ace0 0x7f4f0c06d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:00.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f2015c840 0x7f4f2014bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:00.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f2006b0b0 0x7f4f201f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:00.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 --2- 172.21.15.88:0/1426878605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4f2006c330 0x7f4f2015e0a0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400e810 tx=0x7f4f1400eb20 comp rx=0 tx=0).stop 2023-05-17T12:25:00.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.280+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 >> 172.21.15.88:0/1426878605 conn(0x7f4f200d3060 msgr2=0x7f4f200d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:00.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.282+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 shutdown_connections 2023-05-17T12:25:00.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.282+0000 7f4f265ff700 1 -- 172.21.15.88:0/1426878605 wait complete. 2023-05-17T12:25:00.286 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-05-17T12:25:00.304 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-05-17T12:25:00.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.491+0000 7f15dd3ff700 1 Processor -- start 2023-05-17T12:25:00.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.491+0000 7f15dd3ff700 1 -- start start 2023-05-17T12:25:00.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.492+0000 7f15dd3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806b0b0 0x7f15d806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:00.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.492+0000 7f15dd3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f15d806c330 0x7f15d806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:00.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.492+0000 7f15dd3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d80cd6b0 con 0x7f15d815c840 2023-05-17T12:25:00.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.492+0000 7f15dd3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d80cdf50 con 0x7f15d806c330 2023-05-17T12:25:00.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.492+0000 7f15dd3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d806ccf0 con 0x7f15d806b0b0 2023-05-17T12:25:00.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.492+0000 7f15d77fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f15d806c330 0x7f15d806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:00.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.492+0000 7f15cffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806b0b0 0x7f15d806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:00.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.492+0000 7f15cffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806b0b0 0x7f15d806b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:41154/0 (socket says 172.21.15.88:41154) 2023-05-17T12:25:00.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.492+0000 7f15cffff700 1 -- 172.21.15.88:0/1756721016 learned_addr learned my addr 172.21.15.88:0/1756721016 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:00.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15cffff700 1 -- 172.21.15.88:0/1756721016 >> v2:172.21.15.187:3300/0 conn(0x7f15d806c330 msgr2=0x7f15d806c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:00.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15cffff700 1 --2- 172.21.15.88:0/1756721016 >> v2:172.21.15.187:3300/0 conn(0x7f15d806c330 0x7f15d806c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:00.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15cffff700 1 -- 172.21.15.88:0/1756721016 >> v1:172.21.15.187:6789/0 conn(0x7f15d815c840 legacy=0x7f15d80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:00.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15cffff700 1 -- 172.21.15.88:0/1756721016 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d80b2460 con 0x7f15d806b0b0 2023-05-17T12:25:00.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15d77fe700 1 --2- 172.21.15.88:0/1756721016 >> v2:172.21.15.187:3300/0 conn(0x7f15d806c330 0x7f15d806c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:00.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15d67fc700 1 -- 172.21.15.88:0/1756721016 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570946979 0 0) 0x7f15d80cd6b0 con 0x7f15d815c840 2023-05-17T12:25:00.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15cffff700 1 --2- 172.21.15.88:0/1756721016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806b0b0 0x7f15d806b940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15c00098f0 tx=0x7f15c0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af3ef01cdd130055 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:00.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15d67fc700 1 -- 172.21.15.88:0/1756721016 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0011830 con 0x7f15d806b0b0 2023-05-17T12:25:00.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15d67fc700 1 -- 172.21.15.88:0/1756721016 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0011990 con 0x7f15d806b0b0 2023-05-17T12:25:00.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.493+0000 7f15d67fc700 1 -- 172.21.15.88:0/1756721016 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0011d20 con 0x7f15d806b0b0 2023-05-17T12:25:00.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.494+0000 7f15dd3ff700 1 -- 172.21.15.88:0/1756721016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806b0b0 msgr2=0x7f15d806b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:00.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.494+0000 7f15dd3ff700 1 --2- 172.21.15.88:0/1756721016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806b0b0 0x7f15d806b940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15c00098f0 tx=0x7f15c0009c00 comp rx=0 tx=0).stop 2023-05-17T12:25:00.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.494+0000 7f15dd3ff700 1 -- 172.21.15.88:0/1756721016 shutdown_connections 2023-05-17T12:25:00.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.494+0000 7f15dd3ff700 1 --2- 172.21.15.88:0/1756721016 >> v2:172.21.15.187:3300/0 conn(0x7f15d806c330 0x7f15d806c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:00.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.494+0000 7f15dd3ff700 1 --2- 172.21.15.88:0/1756721016 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806b0b0 0x7f15d806b940 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:00.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.494+0000 7f15dd3ff700 1 -- 172.21.15.88:0/1756721016 >> 172.21.15.88:0/1756721016 conn(0x7f15d80d3060 msgr2=0x7f15d80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:00.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.494+0000 7f15dd3ff700 1 -- 172.21.15.88:0/1756721016 shutdown_connections 2023-05-17T12:25:00.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.494+0000 7f15dd3ff700 1 -- 172.21.15.88:0/1756721016 wait complete. 2023-05-17T12:25:00.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.496+0000 7f15dd3ff700 1 Processor -- start 2023-05-17T12:25:00.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.496+0000 7f15dd3ff700 1 -- start start 2023-05-17T12:25:00.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15dd3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15d806b0b0 0x7f15d8154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:00.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15dd3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806c330 0x7f15d81f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:00.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15dd3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15d815c840 0x7f15d81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:00.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15dd3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d815ce20 con 0x7f15d815c840 2023-05-17T12:25:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15dd3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d81f6530 con 0x7f15d806b0b0 2023-05-17T12:25:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15dd3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d8157530 con 0x7f15d806c330 2023-05-17T12:25:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15d815c840 0x7f15d81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15d815c840 0x7f15d81540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44822/0 (socket says 172.21.15.88:44822) 2023-05-17T12:25:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15d6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15d806b0b0 0x7f15d8154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15d77fe700 1 -- 172.21.15.88:0/4273079243 learned_addr learned my addr 172.21.15.88:0/4273079243 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:00.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.497+0000 7f15cffff700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806c330 0x7f15d81f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15d77fe700 1 -- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806c330 msgr2=0x7f15d81f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15d77fe700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806c330 0x7f15d81f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15d77fe700 1 -- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15d806b0b0 msgr2=0x7f15d8154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15d77fe700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15d806b0b0 0x7f15d8154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15d77fe700 1 -- 172.21.15.88:0/4273079243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0009a70 con 0x7f15d815c840 2023-05-17T12:25:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15d6ffd700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15d806b0b0 0x7f15d8154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:00.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15d77fe700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15d815c840 0x7f15d81540c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15d000efc0 tx=0x7f15d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15cf7fe700 1 -- 172.21.15.88:0/4273079243 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d000ca90 con 0x7f15d815c840 2023-05-17T12:25:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15cf7fe700 1 -- 172.21.15.88:0/4273079243 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d000f040 con 0x7f15d815c840 2023-05-17T12:25:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c0009550 con 0x7f15d815c840 2023-05-17T12:25:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15cf7fe700 1 -- 172.21.15.88:0/4273079243 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d000ce10 con 0x7f15d815c840 2023-05-17T12:25:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.498+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d80cd900 con 0x7f15d815c840 2023-05-17T12:25:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.499+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d80b2740 con 0x7f15d815c840 2023-05-17T12:25:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.500+0000 7f15cf7fe700 1 -- 172.21.15.88:0/4273079243 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15d0003a20 con 0x7f15d815c840 2023-05-17T12:25:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.501+0000 7f15cf7fe700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f15b806ace0 0x7f15b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.501+0000 7f15cf7fe700 1 -- 172.21.15.88:0/4273079243 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f15d008a4c0 con 0x7f15d815c840 2023-05-17T12:25:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.502+0000 7f15d6ffd700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f15b806ace0 0x7f15b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.502+0000 7f15d6ffd700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f15b806ace0 0x7f15b806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f15c8000f60 tx=0x7f15c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.505+0000 7f15cf7fe700 1 -- 172.21.15.88:0/4273079243 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f15d0059130 con 0x7f15d815c840 2023-05-17T12:25:00.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:00.698+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f15d80cdbe0 con 0x7f15d815c840 2023-05-17T12:25:01.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.283+0000 7f15cf7fe700 1 -- 172.21.15.88:0/4273079243 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f15d00180d0 con 0x7f15d815c840 2023-05-17T12:25:01.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.293+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f15b806ace0 msgr2=0x7f15b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:01.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.294+0000 7f15dd3ff700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f15b806ace0 0x7f15b806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f15c8000f60 tx=0x7f15c8009040 comp rx=0 tx=0).stop 2023-05-17T12:25:01.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.294+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15d815c840 msgr2=0x7f15d81540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:01.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.294+0000 7f15dd3ff700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15d815c840 0x7f15d81540c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15d000efc0 tx=0x7f15d000c3a0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.294+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 shutdown_connections 2023-05-17T12:25:01.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.294+0000 7f15dd3ff700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f15b806ace0 0x7f15b806d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.294+0000 7f15dd3ff700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15d815c840 0x7f15d81540c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.294+0000 7f15dd3ff700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15d806b0b0 0x7f15d8154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.294+0000 7f15dd3ff700 1 --2- 172.21.15.88:0/4273079243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f15d806c330 0x7f15d81f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.294+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 >> 172.21.15.88:0/4273079243 conn(0x7f15d80d3060 msgr2=0x7f15d81e7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.298+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 shutdown_connections 2023-05-17T12:25:01.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.298+0000 7f15dd3ff700 1 -- 172.21.15.88:0/4273079243 wait complete. 2023-05-17T12:25:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-05-17T12:25:01.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T12:25:01.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.516+0000 7f97a77ff700 1 Processor -- start 2023-05-17T12:25:01.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.516+0000 7f97a77ff700 1 -- start start 2023-05-17T12:25:01.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.517+0000 7f97a77ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a0153d60 0x7f97a015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:01.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.517+0000 7f97a77ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97a00cdb10 0x7f97a00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.517+0000 7f97a77ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f97a00cc8f0 0x7f97a00ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.517+0000 7f97a77ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a00ce4c0 con 0x7f97a00cdb10 2023-05-17T12:25:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.517+0000 7f97a77ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a015e030 con 0x7f97a00cc8f0 2023-05-17T12:25:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.517+0000 7f97a77ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0159ed0 con 0x7f97a0153d60 2023-05-17T12:25:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a4d9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97a00cdb10 0x7f97a00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a4d9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97a00cdb10 0x7f97a00cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48414/0 (socket says 172.21.15.88:48414) 2023-05-17T12:25:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a4d9a700 1 -- 172.21.15.88:0/887127568 learned_addr learned my addr 172.21.15.88:0/887127568 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:01.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a559b700 1 --2- 172.21.15.88:0/887127568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a0153d60 0x7f97a015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a4d9a700 1 -- 172.21.15.88:0/887127568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a0153d60 msgr2=0x7f97a015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a4d9a700 1 --2- 172.21.15.88:0/887127568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a0153d60 0x7f97a015daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a4d9a700 1 -- 172.21.15.88:0/887127568 >> v2:172.21.15.187:3300/0 conn(0x7f97a00cc8f0 msgr2=0x7f97a00ccd70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a4d9a700 1 --2- 172.21.15.88:0/887127568 >> v2:172.21.15.187:3300/0 conn(0x7f97a00cc8f0 0x7f97a00ccd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a4d9a700 1 -- 172.21.15.88:0/887127568 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a015a1b0 con 0x7f97a00cdb10 2023-05-17T12:25:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.518+0000 7f97a4d9a700 1 --2- 172.21.15.88:0/887127568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a00cdb10 0x7f97a00cdf80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97a006ece0 tx=0x7f9790009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d78b4c9e99c1f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f9797fff700 1 -- 172.21.15.88:0/887127568 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790011830 con 0x7f97a00cdb10 2023-05-17T12:25:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f9797fff700 1 -- 172.21.15.88:0/887127568 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9790011990 con 0x7f97a00cdb10 2023-05-17T12:25:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f9797fff700 1 -- 172.21.15.88:0/887127568 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790011d20 con 0x7f97a00cdb10 2023-05-17T12:25:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f97a77ff700 1 -- 172.21.15.88:0/887127568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a00cdb10 msgr2=0x7f97a00cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f97a77ff700 1 --2- 172.21.15.88:0/887127568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a00cdb10 0x7f97a00cdf80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97a006ece0 tx=0x7f9790009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f97a77ff700 1 -- 172.21.15.88:0/887127568 shutdown_connections 2023-05-17T12:25:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f97a77ff700 1 --2- 172.21.15.88:0/887127568 >> v2:172.21.15.187:3300/0 conn(0x7f97a00cc8f0 0x7f97a00ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f97a77ff700 1 --2- 172.21.15.88:0/887127568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a0153d60 0x7f97a015daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f97a77ff700 1 --2- 172.21.15.88:0/887127568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a00cdb10 0x7f97a00cdf80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f97a77ff700 1 -- 172.21.15.88:0/887127568 >> 172.21.15.88:0/887127568 conn(0x7f97a00cf970 msgr2=0x7f97a00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f97a77ff700 1 -- 172.21.15.88:0/887127568 shutdown_connections 2023-05-17T12:25:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.519+0000 7f97a77ff700 1 -- 172.21.15.88:0/887127568 wait complete. 2023-05-17T12:25:01.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.521+0000 7f97a77ff700 1 Processor -- start 2023-05-17T12:25:01.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.521+0000 7f97a77ff700 1 -- start start 2023-05-17T12:25:01.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.522+0000 7f97a77ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a00cc8f0 0x7f97a0142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:01.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.522+0000 7f97a77ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97a00cdb10 0x7f97a0141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:01.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.522+0000 7f97a77ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a0153d60 0x7f97a00b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:01.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.522+0000 7f97a77ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0140900 con 0x7f97a0153d60 2023-05-17T12:25:01.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.522+0000 7f97a77ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0140b40 con 0x7f97a00cdb10 2023-05-17T12:25:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.522+0000 7f97a77ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0140e20 con 0x7f97a00cc8f0 2023-05-17T12:25:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.522+0000 7f97a5d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a0153d60 0x7f97a00b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.522+0000 7f97a5d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a0153d60 0x7f97a00b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48430/0 (socket says 172.21.15.88:48430) 2023-05-17T12:25:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.522+0000 7f97a5d9c700 1 -- 172.21.15.88:0/2819870050 learned_addr learned my addr 172.21.15.88:0/2819870050 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a4d9a700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97a00cdb10 0x7f97a0141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a559b700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a00cc8f0 0x7f97a0142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a5d9c700 1 -- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a00cc8f0 msgr2=0x7f97a0142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a5d9c700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a00cc8f0 0x7f97a0142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a5d9c700 1 -- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97a00cdb10 msgr2=0x7f97a0141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a5d9c700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97a00cdb10 0x7f97a0141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a5d9c700 1 -- 172.21.15.88:0/2819870050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790009550 con 0x7f97a0153d60 2023-05-17T12:25:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a4d9a700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97a00cdb10 0x7f97a0141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a5d9c700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a0153d60 0x7f97a00b1cb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f979800b780 tx=0x7f979800bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f9795ffb700 1 -- 172.21.15.88:0/2819870050 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800f840 con 0x7f97a0153d60 2023-05-17T12:25:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f9795ffb700 1 -- 172.21.15.88:0/2819870050 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800f9a0 con 0x7f97a0153d60 2023-05-17T12:25:01.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f9795ffb700 1 -- 172.21.15.88:0/2819870050 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800fd50 con 0x7f97a0153d60 2023-05-17T12:25:01.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.523+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a015a770 con 0x7f97a0153d60 2023-05-17T12:25:01.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.524+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a015a490 con 0x7f97a0153d60 2023-05-17T12:25:01.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.525+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a015aa50 con 0x7f97a0153d60 2023-05-17T12:25:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.526+0000 7f9795ffb700 1 -- 172.21.15.88:0/2819870050 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97980213f0 con 0x7f97a0153d60 2023-05-17T12:25:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.527+0000 7f9795ffb700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f978406ace0 0x7f978406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.527+0000 7f9795ffb700 1 -- 172.21.15.88:0/2819870050 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f9798089740 con 0x7f97a0153d60 2023-05-17T12:25:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.527+0000 7f97a559b700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f978406ace0 0x7f978406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.528+0000 7f97a559b700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f978406ace0 0x7f978406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f979c009ad0 tx=0x7f979c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:01.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.532+0000 7f9795ffb700 1 -- 172.21.15.88:0/2819870050 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9798054850 con 0x7f97a0153d60 2023-05-17T12:25:01.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.773+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f97a0074530 con 0x7f97a0153d60 2023-05-17T12:25:01.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.779+0000 7f9795ffb700 1 -- 172.21.15.88:0/2819870050 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9798057e70 con 0x7f97a0153d60 2023-05-17T12:25:01.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.783+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f978406ace0 msgr2=0x7f978406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.783+0000 7f97a77ff700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f978406ace0 0x7f978406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f979c009ad0 tx=0x7f979c008040 comp rx=0 tx=0).stop 2023-05-17T12:25:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.783+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a0153d60 msgr2=0x7f97a00b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:01.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.783+0000 7f97a77ff700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a0153d60 0x7f97a00b1cb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f979800b780 tx=0x7f979800bb40 comp rx=0 tx=0).stop 2023-05-17T12:25:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.784+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 shutdown_connections 2023-05-17T12:25:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.784+0000 7f97a77ff700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f978406ace0 0x7f978406d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.784+0000 7f97a77ff700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a0153d60 0x7f97a00b1cb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.784+0000 7f97a77ff700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97a00cc8f0 0x7f97a0142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.784+0000 7f97a77ff700 1 --2- 172.21.15.88:0/2819870050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97a00cdb10 0x7f97a0141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:01.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.784+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 >> 172.21.15.88:0/2819870050 conn(0x7f97a00cf970 msgr2=0x7f97a00cb570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:01.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.790+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 shutdown_connections 2023-05-17T12:25:01.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:01.791+0000 7f97a77ff700 1 -- 172.21.15.88:0/2819870050 wait complete. 2023-05-17T12:25:01.796 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 3 and data pool 4 2023-05-17T12:25:01.822 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-05-17T12:25:01.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-05-17T12:25:02.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.008+0000 7fd841fff700 1 Processor -- start 2023-05-17T12:25:02.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.009+0000 7fd841fff700 1 -- start start 2023-05-17T12:25:02.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd841fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd83c06b0b0 0x7fd83c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:02.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd841fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd83c06c330 0x7fd83c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:02.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd841fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c0cd6b0 con 0x7fd83c15c840 2023-05-17T12:25:02.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd841fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c0cdf50 con 0x7fd83c06c330 2023-05-17T12:25:02.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd841fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c06ccb0 con 0x7fd83c06b0b0 2023-05-17T12:25:02.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd83bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd83c06c330 0x7fd83c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:02.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd83b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd83c15c840 0x7fd83c0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41532/0 (socket says 172.21.15.88:41532) 2023-05-17T12:25:02.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd83b7fe700 1 -- 172.21.15.88:0/56979615 learned_addr learned my addr 172.21.15.88:0/56979615 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:02.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd83affd700 1 --2- 172.21.15.88:0/56979615 >> v2:172.21.15.187:3300/0 conn(0x7fd83c06b0b0 0x7fd83c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:02.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd83bfff700 1 -- 172.21.15.88:0/56979615 >> v2:172.21.15.187:3300/0 conn(0x7fd83c06b0b0 msgr2=0x7fd83c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:02.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd83bfff700 1 --2- 172.21.15.88:0/56979615 >> v2:172.21.15.187:3300/0 conn(0x7fd83c06b0b0 0x7fd83c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:02.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd83bfff700 1 -- 172.21.15.88:0/56979615 >> v1:172.21.15.88:6789/0 conn(0x7fd83c15c840 legacy=0x7fd83c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:02.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.010+0000 7fd83bfff700 1 -- 172.21.15.88:0/56979615 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0b2460 con 0x7fd83c06c330 2023-05-17T12:25:02.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.011+0000 7fd83bfff700 1 --2- 172.21.15.88:0/56979615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 0x7fd83c06c770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0cead0 tx=0x7fd83400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c04aaa4fcc43c1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:02.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.011+0000 7fd83a7fc700 1 -- 172.21.15.88:0/56979615 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400e070 con 0x7fd83c06c330 2023-05-17T12:25:02.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.011+0000 7fd83a7fc700 1 -- 172.21.15.88:0/56979615 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83400bb20 con 0x7fd83c06c330 2023-05-17T12:25:02.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.011+0000 7fd83a7fc700 1 -- 172.21.15.88:0/56979615 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834012430 con 0x7fd83c06c330 2023-05-17T12:25:02.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.011+0000 7fd841fff700 1 -- 172.21.15.88:0/56979615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 msgr2=0x7fd83c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:02.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.011+0000 7fd841fff700 1 --2- 172.21.15.88:0/56979615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 0x7fd83c06c770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0cead0 tx=0x7fd83400b330 comp rx=0 tx=0).stop 2023-05-17T12:25:02.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.012+0000 7fd841fff700 1 -- 172.21.15.88:0/56979615 shutdown_connections 2023-05-17T12:25:02.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.012+0000 7fd841fff700 1 --2- 172.21.15.88:0/56979615 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 0x7fd83c06c770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:02.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.012+0000 7fd841fff700 1 --2- 172.21.15.88:0/56979615 >> v2:172.21.15.187:3300/0 conn(0x7fd83c06b0b0 0x7fd83c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:02.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.012+0000 7fd841fff700 1 -- 172.21.15.88:0/56979615 >> 172.21.15.88:0/56979615 conn(0x7fd83c0d3060 msgr2=0x7fd83c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:02.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.012+0000 7fd841fff700 1 -- 172.21.15.88:0/56979615 shutdown_connections 2023-05-17T12:25:02.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.012+0000 7fd841fff700 1 -- 172.21.15.88:0/56979615 wait complete. 2023-05-17T12:25:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.013+0000 7fd841fff700 1 Processor -- start 2023-05-17T12:25:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.013+0000 7fd841fff700 1 -- start start 2023-05-17T12:25:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.014+0000 7fd841fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd83c06b0b0 0x7fd83c0b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:02.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.014+0000 7fd841fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 0x7fd83c158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:02.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.014+0000 7fd841fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd83c15c840 0x7fd83c15e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:02.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.014+0000 7fd841fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c1589c0 con 0x7fd83c06c330 2023-05-17T12:25:02.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.014+0000 7fd841fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c15b750 con 0x7fd83c06b0b0 2023-05-17T12:25:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.014+0000 7fd841fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c15ba30 con 0x7fd83c15c840 2023-05-17T12:25:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 0x7fd83c158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 0x7fd83c158480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48438/0 (socket says 172.21.15.88:48438) 2023-05-17T12:25:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83affd700 1 -- 172.21.15.88:0/1133344727 learned_addr learned my addr 172.21.15.88:0/1133344727 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83b7fe700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd83c06b0b0 0x7fd83c0b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83affd700 1 -- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd83c15c840 msgr2=0x7fd83c15e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83affd700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd83c15c840 0x7fd83c15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83affd700 1 -- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd83c06b0b0 msgr2=0x7fd83c0b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83affd700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd83c06b0b0 0x7fd83c0b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83affd700 1 -- 172.21.15.88:0/1133344727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834009a70 con 0x7fd83c06c330 2023-05-17T12:25:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd83affd700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 0x7fd83c158480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd83000e9b0 tx=0x7fd83000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd823fff700 1 -- 172.21.15.88:0/1133344727 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830009710 con 0x7fd83c06c330 2023-05-17T12:25:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd823fff700 1 -- 172.21.15.88:0/1133344727 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000c850 con 0x7fd83c06c330 2023-05-17T12:25:02.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.015+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c0cd900 con 0x7fd83c06c330 2023-05-17T12:25:02.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.016+0000 7fd823fff700 1 -- 172.21.15.88:0/1133344727 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000cbc0 con 0x7fd83c06c330 2023-05-17T12:25:02.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.016+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c0b2740 con 0x7fd83c06c330 2023-05-17T12:25:02.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.017+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c0cdbe0 con 0x7fd83c06c330 2023-05-17T12:25:02.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.018+0000 7fd823fff700 1 -- 172.21.15.88:0/1133344727 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd83000cd20 con 0x7fd83c06c330 2023-05-17T12:25:02.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.018+0000 7fd823fff700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd82806ace0 0x7fd82806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:02.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.019+0000 7fd823fff700 1 -- 172.21.15.88:0/1133344727 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd830089540 con 0x7fd83c06c330 2023-05-17T12:25:02.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.019+0000 7fd83b7fe700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd82806ace0 0x7fd82806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:02.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.019+0000 7fd83b7fe700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd82806ace0 0x7fd82806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd82c005910 tx=0x7fd82c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:02.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.023+0000 7fd823fff700 1 -- 172.21.15.88:0/1133344727 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd830058070 con 0x7fd83c06c330 2023-05-17T12:25:02.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.225+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd83c074530 con 0x7fd83c06c330 2023-05-17T12:25:02.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.787+0000 7fd823fff700 1 -- 172.21.15.88:0/1133344727 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd830057c00 con 0x7fd83c06c330 2023-05-17T12:25:02.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd82806ace0 msgr2=0x7fd82806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:02.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd82806ace0 0x7fd82806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd82c005910 tx=0x7fd82c009040 comp rx=0 tx=0).stop 2023-05-17T12:25:02.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 msgr2=0x7fd83c158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 0x7fd83c158480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd83000e9b0 tx=0x7fd83000ed70 comp rx=0 tx=0).stop 2023-05-17T12:25:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 shutdown_connections 2023-05-17T12:25:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd82806ace0 0x7fd82806d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd83c15c840 0x7fd83c15e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd83c06b0b0 0x7fd83c0b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 --2- 172.21.15.88:0/1133344727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd83c06c330 0x7fd83c158480 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 >> 172.21.15.88:0/1133344727 conn(0x7fd83c0d3060 msgr2=0x7fd83c06a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:02.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 shutdown_connections 2023-05-17T12:25:02.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:02.790+0000 7fd841fff700 1 -- 172.21.15.88:0/1133344727 wait complete. 2023-05-17T12:25:02.812 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T12:25:03.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.003+0000 7f81769ff700 1 Processor -- start 2023-05-17T12:25:03.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.003+0000 7f81769ff700 1 -- start start 2023-05-17T12:25:03.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.004+0000 7f81769ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81700b8770 0x7f81700cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:03.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.004+0000 7f81769ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f81700cd660 0x7f817006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:03.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.004+0000 7f81769ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f817006cd40 0x7f817006a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:03.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.004+0000 7f81769ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817006d1c0 con 0x7f81700b8770 2023-05-17T12:25:03.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.004+0000 7f81769ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81701612f0 con 0x7f81700cd660 2023-05-17T12:25:03.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.004+0000 7f81769ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8170160e60 con 0x7f817006cd40 2023-05-17T12:25:03.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.004+0000 7f816ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81700b8770 0x7f81700cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:03.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.004+0000 7f816ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81700b8770 0x7f81700cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48448/0 (socket says 172.21.15.88:48448) 2023-05-17T12:25:03.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.004+0000 7f816ffff700 1 -- 172.21.15.88:0/2851968744 learned_addr learned my addr 172.21.15.88:0/2851968744 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:03.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816f7fe700 1 --2- 172.21.15.88:0/2851968744 >> v2:172.21.15.187:3300/0 conn(0x7f81700cd660 0x7f817006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f8174f9c700 1 --2- 172.21.15.88:0/2851968744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f817006cd40 0x7f817006a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816ffff700 1 -- 172.21.15.88:0/2851968744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f817006cd40 msgr2=0x7f817006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816ffff700 1 --2- 172.21.15.88:0/2851968744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f817006cd40 0x7f817006a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816ffff700 1 -- 172.21.15.88:0/2851968744 >> v2:172.21.15.187:3300/0 conn(0x7f81700cd660 msgr2=0x7f817006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816ffff700 1 --2- 172.21.15.88:0/2851968744 >> v2:172.21.15.187:3300/0 conn(0x7f81700cd660 0x7f817006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816ffff700 1 -- 172.21.15.88:0/2851968744 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81700cde20 con 0x7f81700b8770 2023-05-17T12:25:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816f7fe700 1 --2- 172.21.15.88:0/2851968744 >> v2:172.21.15.187:3300/0 conn(0x7f81700cd660 0x7f817006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f8174f9c700 1 --2- 172.21.15.88:0/2851968744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f817006cd40 0x7f817006a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816ffff700 1 --2- 172.21.15.88:0/2851968744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700b8770 0x7f81700cf260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81700cfa60 tx=0x7f8160009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00a0d2247a3d95c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816effd700 1 -- 172.21.15.88:0/2851968744 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816000b870 con 0x7f81700b8770 2023-05-17T12:25:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816effd700 1 -- 172.21.15.88:0/2851968744 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816000b9d0 con 0x7f81700b8770 2023-05-17T12:25:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.005+0000 7f816effd700 1 -- 172.21.15.88:0/2851968744 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816000bd60 con 0x7f81700b8770 2023-05-17T12:25:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.006+0000 7f81769ff700 1 -- 172.21.15.88:0/2851968744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700b8770 msgr2=0x7f81700cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.006+0000 7f81769ff700 1 --2- 172.21.15.88:0/2851968744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700b8770 0x7f81700cf260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81700cfa60 tx=0x7f8160009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.006+0000 7f81769ff700 1 -- 172.21.15.88:0/2851968744 shutdown_connections 2023-05-17T12:25:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.006+0000 7f81769ff700 1 --2- 172.21.15.88:0/2851968744 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f817006cd40 0x7f817006a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.006+0000 7f81769ff700 1 --2- 172.21.15.88:0/2851968744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700b8770 0x7f81700cf260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.006+0000 7f81769ff700 1 --2- 172.21.15.88:0/2851968744 >> v2:172.21.15.187:3300/0 conn(0x7f81700cd660 0x7f817006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.006+0000 7f81769ff700 1 -- 172.21.15.88:0/2851968744 >> 172.21.15.88:0/2851968744 conn(0x7f81700d06e0 msgr2=0x7f81700d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.006+0000 7f81769ff700 1 -- 172.21.15.88:0/2851968744 shutdown_connections 2023-05-17T12:25:03.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.006+0000 7f81769ff700 1 -- 172.21.15.88:0/2851968744 wait complete. 2023-05-17T12:25:03.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.008+0000 7f81769ff700 1 Processor -- start 2023-05-17T12:25:03.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.008+0000 7f81769ff700 1 -- start start 2023-05-17T12:25:03.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f81769ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f817006cd40 0x7f8170151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:03.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f81769ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81700b8770 0x7f8170151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:03.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f81769ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700cd660 0x7f81701f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:03.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f81769ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817015ce80 con 0x7f81700cd660 2023-05-17T12:25:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f81769ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817015d160 con 0x7f817006cd40 2023-05-17T12:25:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f81769ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8170151ad0 con 0x7f81700b8770 2023-05-17T12:25:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f8174f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700cd660 0x7f81701f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f8174f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700cd660 0x7f81701f35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48454/0 (socket says 172.21.15.88:48454) 2023-05-17T12:25:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f8174f9c700 1 -- 172.21.15.88:0/3603183256 learned_addr learned my addr 172.21.15.88:0/3603183256 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f816ffff700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f817006cd40 0x7f8170151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:03.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f816f7fe700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81700b8770 0x7f8170151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:03.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f8174f9c700 1 -- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81700b8770 msgr2=0x7f8170151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:03.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f8174f9c700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81700b8770 0x7f8170151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:03.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f8174f9c700 1 -- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f817006cd40 msgr2=0x7f8170151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:03.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f8174f9c700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f817006cd40 0x7f8170151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:03.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f8174f9c700 1 -- 172.21.15.88:0/3603183256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8160009550 con 0x7f81700cd660 2023-05-17T12:25:03.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.010+0000 7f816f7fe700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81700b8770 0x7f8170151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:03.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.011+0000 7f8174f9c700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700cd660 0x7f81701f35f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f816800cd80 tx=0x7f816800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:03.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.011+0000 7f816cff9700 1 -- 172.21.15.88:0/3603183256 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800f480 con 0x7f81700cd660 2023-05-17T12:25:03.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.011+0000 7f816cff9700 1 -- 172.21.15.88:0/3603183256 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800f600 con 0x7f81700cd660 2023-05-17T12:25:03.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.011+0000 7f816cff9700 1 -- 172.21.15.88:0/3603183256 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800f9b0 con 0x7f81700cd660 2023-05-17T12:25:03.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.011+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8170160810 con 0x7f81700cd660 2023-05-17T12:25:03.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.011+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8170160530 con 0x7f81700cd660 2023-05-17T12:25:03.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.012+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8170160af0 con 0x7f81700cd660 2023-05-17T12:25:03.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.013+0000 7f816cff9700 1 -- 172.21.15.88:0/3603183256 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f816800b040 con 0x7f81700cd660 2023-05-17T12:25:03.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.014+0000 7f816cff9700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f815c06ace0 0x7f815c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:03.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.014+0000 7f816cff9700 1 -- 172.21.15.88:0/3603183256 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f8168089d50 con 0x7f81700cd660 2023-05-17T12:25:03.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.014+0000 7f816ffff700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f815c06ace0 0x7f815c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:03.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.015+0000 7f816ffff700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f815c06ace0 0x7f815c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8160000c00 tx=0x7f8160008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:03.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.018+0000 7f816cff9700 1 -- 172.21.15.88:0/3603183256 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8168054ca0 con 0x7f81700cd660 2023-05-17T12:25:03.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:03.214+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8170067860 con 0x7f81700cd660 2023-05-17T12:25:04.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.798+0000 7f816cff9700 1 -- 172.21.15.88:0/3603183256 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f81680582c0 con 0x7f81700cd660 2023-05-17T12:25:04.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.803+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f815c06ace0 msgr2=0x7f815c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:04.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.803+0000 7f81769ff700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f815c06ace0 0x7f815c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8160000c00 tx=0x7f8160008030 comp rx=0 tx=0).stop 2023-05-17T12:25:04.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.804+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700cd660 msgr2=0x7f81701f35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:04.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.804+0000 7f81769ff700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700cd660 0x7f81701f35f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f816800cd80 tx=0x7f816800a560 comp rx=0 tx=0).stop 2023-05-17T12:25:04.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.804+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 shutdown_connections 2023-05-17T12:25:04.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.804+0000 7f81769ff700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f815c06ace0 0x7f815c06d190 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8160000c00 tx=0x7f8160008030 comp rx=0 tx=0).stop 2023-05-17T12:25:04.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.804+0000 7f81769ff700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81700cd660 0x7f81701f35f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:04.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.804+0000 7f81769ff700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f817006cd40 0x7f8170151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:04.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.804+0000 7f81769ff700 1 --2- 172.21.15.88:0/3603183256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81700b8770 0x7f8170151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:04.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.804+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 >> 172.21.15.88:0/3603183256 conn(0x7f81700d06e0 msgr2=0x7f817015a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:04.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.807+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 shutdown_connections 2023-05-17T12:25:04.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:04.807+0000 7f81769ff700 1 -- 172.21.15.88:0/3603183256 wait complete. 2023-05-17T12:25:04.815 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data_ec' created 2023-05-17T12:25:04.834 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-05-17T12:25:05.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.021+0000 7f5932fff700 1 Processor -- start 2023-05-17T12:25:05.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.021+0000 7f5932fff700 1 -- start start 2023-05-17T12:25:05.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.022+0000 7f5932fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f592c15c840 0x7f592c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:05.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f5932fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f592c06c330 0x7f592c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f5932fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0cd6b0 con 0x7f592c06b0b0 2023-05-17T12:25:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f5932fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0cdf50 con 0x7f592c06c330 2023-05-17T12:25:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f5932fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c06ccb0 con 0x7f592c15c840 2023-05-17T12:25:05.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f593159c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f592c06c330 0x7f592c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:05.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f592bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f592c06b0b0 0x7f592c0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41534/0 (socket says 172.21.15.88:41534) 2023-05-17T12:25:05.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f592bfff700 1 -- 172.21.15.88:0/1005199024 learned_addr learned my addr 172.21.15.88:0/1005199024 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:05.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f5930d9b700 1 --2- 172.21.15.88:0/1005199024 >> v2:172.21.15.187:3300/0 conn(0x7f592c15c840 0x7f592c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:05.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f593159c700 1 -- 172.21.15.88:0/1005199024 >> v2:172.21.15.187:3300/0 conn(0x7f592c15c840 msgr2=0x7f592c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:05.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f593159c700 1 --2- 172.21.15.88:0/1005199024 >> v2:172.21.15.187:3300/0 conn(0x7f592c15c840 0x7f592c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:05.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f593159c700 1 -- 172.21.15.88:0/1005199024 >> v1:172.21.15.88:6789/0 conn(0x7f592c06b0b0 legacy=0x7f592c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:05.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f593159c700 1 -- 172.21.15.88:0/1005199024 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0b2460 con 0x7f592c06c330 2023-05-17T12:25:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.023+0000 7f592b7fe700 1 -- 172.21.15.88:0/1005199024 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859885233 0 0) 0x7f592c0cd6b0 con 0x7f592c06b0b0 2023-05-17T12:25:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f593159c700 1 --2- 172.21.15.88:0/1005199024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 0x7f592c06c770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f592c0cfa40 tx=0x7f592400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238f7eafb54f1501 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f592b7fe700 1 -- 172.21.15.88:0/1005199024 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400e070 con 0x7f592c06c330 2023-05-17T12:25:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f592b7fe700 1 -- 172.21.15.88:0/1005199024 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592400bbd0 con 0x7f592c06c330 2023-05-17T12:25:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f592b7fe700 1 -- 172.21.15.88:0/1005199024 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924012430 con 0x7f592c06c330 2023-05-17T12:25:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f5932fff700 1 -- 172.21.15.88:0/1005199024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 msgr2=0x7f592c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f5932fff700 1 --2- 172.21.15.88:0/1005199024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 0x7f592c06c770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f592c0cfa40 tx=0x7f592400b330 comp rx=0 tx=0).stop 2023-05-17T12:25:05.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f5932fff700 1 -- 172.21.15.88:0/1005199024 shutdown_connections 2023-05-17T12:25:05.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f5932fff700 1 --2- 172.21.15.88:0/1005199024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 0x7f592c06c770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:05.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f5932fff700 1 --2- 172.21.15.88:0/1005199024 >> v2:172.21.15.187:3300/0 conn(0x7f592c15c840 0x7f592c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:05.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f5932fff700 1 -- 172.21.15.88:0/1005199024 >> 172.21.15.88:0/1005199024 conn(0x7f592c0d3060 msgr2=0x7f592c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:05.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f5932fff700 1 -- 172.21.15.88:0/1005199024 shutdown_connections 2023-05-17T12:25:05.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.024+0000 7f5932fff700 1 -- 172.21.15.88:0/1005199024 wait complete. 2023-05-17T12:25:05.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.026+0000 7f5932fff700 1 Processor -- start 2023-05-17T12:25:05.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.026+0000 7f5932fff700 1 -- start start 2023-05-17T12:25:05.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f5932fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f592c06b0b0 0x7f592c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f5932fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 0x7f592c15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f5932fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592c15c840 0x7f592c15cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f5932fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c15a9b0 con 0x7f592c06c330 2023-05-17T12:25:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f5932fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c15d150 con 0x7f592c15c840 2023-05-17T12:25:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f5932fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c15d380 con 0x7f592c06b0b0 2023-05-17T12:25:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f592bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 0x7f592c15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f592bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 0x7f592c15a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48466/0 (socket says 172.21.15.88:48466) 2023-05-17T12:25:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f592bfff700 1 -- 172.21.15.88:0/1286783026 learned_addr learned my addr 172.21.15.88:0/1286783026 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.027+0000 7f593159c700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592c15c840 0x7f592c15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f5930d9b700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f592c06b0b0 0x7f592c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f592bfff700 1 -- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f592c06b0b0 msgr2=0x7f592c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f592bfff700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f592c06b0b0 0x7f592c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f592bfff700 1 -- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592c15c840 msgr2=0x7f592c15cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f592bfff700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592c15c840 0x7f592c15cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f592bfff700 1 -- 172.21.15.88:0/1286783026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5924009a70 con 0x7f592c06c330 2023-05-17T12:25:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f593159c700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592c15c840 0x7f592c15cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f5930d9b700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f592c06b0b0 0x7f592c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f592bfff700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 0x7f592c15a470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59180011e0 tx=0x7f591800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f59297fa700 1 -- 172.21.15.88:0/1286783026 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918004c80 con 0x7f592c06c330 2023-05-17T12:25:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f59297fa700 1 -- 172.21.15.88:0/1286783026 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918004e00 con 0x7f592c06c330 2023-05-17T12:25:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f59297fa700 1 -- 172.21.15.88:0/1286783026 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918007310 con 0x7f592c06c330 2023-05-17T12:25:05.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0cd900 con 0x7f592c06c330 2023-05-17T12:25:05.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.028+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c0b2740 con 0x7f592c06c330 2023-05-17T12:25:05.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.029+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c0cdbe0 con 0x7f592c06c330 2023-05-17T12:25:05.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.030+0000 7f59297fa700 1 -- 172.21.15.88:0/1286783026 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5918007470 con 0x7f592c06c330 2023-05-17T12:25:05.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.031+0000 7f59297fa700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f591006ace0 0x7f591006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:05.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.032+0000 7f59297fa700 1 -- 172.21.15.88:0/1286783026 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f5918089500 con 0x7f592c06c330 2023-05-17T12:25:05.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.032+0000 7f5930d9b700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f591006ace0 0x7f591006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:05.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.033+0000 7f5930d9b700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f591006ace0 0x7f591006d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5920007a50 tx=0x7f5920008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:05.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.036+0000 7f59297fa700 1 -- 172.21.15.88:0/1286783026 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f59180542d0 con 0x7f592c06c330 2023-05-17T12:25:05.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.228+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f592c074530 con 0x7f592c06c330 2023-05-17T12:25:05.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.805+0000 7f59297fa700 1 -- 172.21.15.88:0/1286783026 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f59180578f0 con 0x7f592c06c330 2023-05-17T12:25:05.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f591006ace0 msgr2=0x7f591006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:05.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f591006ace0 0x7f591006d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5920007a50 tx=0x7f5920008040 comp rx=0 tx=0).stop 2023-05-17T12:25:05.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 msgr2=0x7f592c15a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:05.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 0x7f592c15a470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59180011e0 tx=0x7f591800cae0 comp rx=0 tx=0).stop 2023-05-17T12:25:05.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 shutdown_connections 2023-05-17T12:25:05.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f591006ace0 0x7f591006d190 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5920007a50 tx=0x7f5920008040 comp rx=0 tx=0).stop 2023-05-17T12:25:05.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592c15c840 0x7f592c15cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:05.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f592c06b0b0 0x7f592c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:05.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 --2- 172.21.15.88:0/1286783026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f592c06c330 0x7f592c15a470 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f59180011e0 tx=0x7f591800cae0 comp rx=0 tx=0).stop 2023-05-17T12:25:05.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.817+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 >> 172.21.15.88:0/1286783026 conn(0x7f592c0d3060 msgr2=0x7f592c06a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:05.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.822+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 shutdown_connections 2023-05-17T12:25:05.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:05.826+0000 7f5932fff700 1 -- 172.21.15.88:0/1286783026 wait complete. 2023-05-17T12:25:05.839 INFO:teuthology.orchestra.run.smithi088.stderr:set pool 5 allow_ec_overwrites to true 2023-05-17T12:25:05.857 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-05-17T12:25:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.040+0000 7fb3815ff700 1 Processor -- start 2023-05-17T12:25:06.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.040+0000 7fb3815ff700 1 -- start start 2023-05-17T12:25:06.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.041+0000 7fb3815ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb37c0b23a0 0x7fb37c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.041+0000 7fb3815ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb37c0cf190 0x7fb37c160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.041+0000 7fb3815ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37c06b4a0 con 0x7fb37c06c760 2023-05-17T12:25:06.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.041+0000 7fb3815ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c06a510 con 0x7fb37c0cf190 2023-05-17T12:25:06.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.041+0000 7fb3815ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c0cd840 con 0x7fb37c0b23a0 2023-05-17T12:25:06.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.041+0000 7fb37b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb37c0cf190 0x7fb37c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.041+0000 7fb37b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb37c0cf190 0x7fb37c160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48474/0 (socket says 172.21.15.88:48474) 2023-05-17T12:25:06.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.041+0000 7fb37b7fe700 1 -- 172.21.15.88:0/1609945147 learned_addr learned my addr 172.21.15.88:0/1609945147 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.041+0000 7fb37a7fc700 1 --2- 172.21.15.88:0/1609945147 >> v2:172.21.15.187:3300/0 conn(0x7fb37c0b23a0 0x7fb37c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.042+0000 7fb37b7fe700 1 -- 172.21.15.88:0/1609945147 >> v2:172.21.15.187:3300/0 conn(0x7fb37c0b23a0 msgr2=0x7fb37c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.042+0000 7fb37b7fe700 1 --2- 172.21.15.88:0/1609945147 >> v2:172.21.15.187:3300/0 conn(0x7fb37c0b23a0 0x7fb37c06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.042+0000 7fb37b7fe700 1 -- 172.21.15.88:0/1609945147 >> v1:172.21.15.187:6789/0 conn(0x7fb37c06c760 legacy=0x7fb37c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.042+0000 7fb37b7fe700 1 -- 172.21.15.88:0/1609945147 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c0cdb20 con 0x7fb37c0cf190 2023-05-17T12:25:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.042+0000 7fb37a7fc700 1 --2- 172.21.15.88:0/1609945147 >> v2:172.21.15.187:3300/0 conn(0x7fb37c0b23a0 0x7fb37c06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.042+0000 7fb37b7fe700 1 --2- 172.21.15.88:0/1609945147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 0x7fb37c160380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb37c06c540 tx=0x7fb37400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71162171038439e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.042+0000 7fb379ffb700 1 -- 172.21.15.88:0/1609945147 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400e070 con 0x7fb37c0cf190 2023-05-17T12:25:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.042+0000 7fb379ffb700 1 -- 172.21.15.88:0/1609945147 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37400b9c0 con 0x7fb37c0cf190 2023-05-17T12:25:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.042+0000 7fb379ffb700 1 -- 172.21.15.88:0/1609945147 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400bd70 con 0x7fb37c0cf190 2023-05-17T12:25:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.043+0000 7fb3815ff700 1 -- 172.21.15.88:0/1609945147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 msgr2=0x7fb37c160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.043+0000 7fb3815ff700 1 --2- 172.21.15.88:0/1609945147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 0x7fb37c160380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb37c06c540 tx=0x7fb37400b330 comp rx=0 tx=0).stop 2023-05-17T12:25:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.043+0000 7fb3815ff700 1 -- 172.21.15.88:0/1609945147 shutdown_connections 2023-05-17T12:25:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.043+0000 7fb3815ff700 1 --2- 172.21.15.88:0/1609945147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 0x7fb37c160380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.043+0000 7fb3815ff700 1 --2- 172.21.15.88:0/1609945147 >> v2:172.21.15.187:3300/0 conn(0x7fb37c0b23a0 0x7fb37c06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.043+0000 7fb3815ff700 1 -- 172.21.15.88:0/1609945147 >> 172.21.15.88:0/1609945147 conn(0x7fb37c0d06f0 msgr2=0x7fb37c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.043+0000 7fb3815ff700 1 -- 172.21.15.88:0/1609945147 shutdown_connections 2023-05-17T12:25:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.043+0000 7fb3815ff700 1 -- 172.21.15.88:0/1609945147 wait complete. 2023-05-17T12:25:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.045+0000 7fb3815ff700 1 Processor -- start 2023-05-17T12:25:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.045+0000 7fb3815ff700 1 -- start start 2023-05-17T12:25:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb3815ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb37c06c760 0x7fb37c155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb3815ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 0x7fb37c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb3815ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0c6f30 0x7fb37c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb3815ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0cca60 con 0x7fb37c0cf190 2023-05-17T12:25:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb3815ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0ccd40 con 0x7fb37c0c6f30 2023-05-17T12:25:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb3815ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0ca1c0 con 0x7fb37c06c760 2023-05-17T12:25:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 0x7fb37c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 0x7fb37c154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48480/0 (socket says 172.21.15.88:48480) 2023-05-17T12:25:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37a7fc700 1 -- 172.21.15.88:0/2108041243 learned_addr learned my addr 172.21.15.88:0/2108041243 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37affd700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb37c06c760 0x7fb37c155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37b7fe700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0c6f30 0x7fb37c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37a7fc700 1 -- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb37c06c760 msgr2=0x7fb37c155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37a7fc700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb37c06c760 0x7fb37c155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37a7fc700 1 -- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0c6f30 msgr2=0x7fb37c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37a7fc700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0c6f30 0x7fb37c0cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37a7fc700 1 -- 172.21.15.88:0/2108041243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb374009b30 con 0x7fb37c0cf190 2023-05-17T12:25:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.046+0000 7fb37a7fc700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 0x7fb37c154f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb37000e810 tx=0x7fb37000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.047+0000 7fb3637fe700 1 -- 172.21.15.88:0/2108041243 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370013610 con 0x7fb37c0cf190 2023-05-17T12:25:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.047+0000 7fb3637fe700 1 -- 172.21.15.88:0/2108041243 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb370013770 con 0x7fb37c0cf190 2023-05-17T12:25:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.047+0000 7fb3637fe700 1 -- 172.21.15.88:0/2108041243 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370013b20 con 0x7fb37c0cf190 2023-05-17T12:25:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.047+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c06aa40 con 0x7fb37c0cf190 2023-05-17T12:25:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.047+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c06a760 con 0x7fb37c0cf190 2023-05-17T12:25:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.048+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c15cb40 con 0x7fb37c0cf190 2023-05-17T12:25:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.049+0000 7fb3637fe700 1 -- 172.21.15.88:0/2108041243 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb370013c80 con 0x7fb37c0cf190 2023-05-17T12:25:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.050+0000 7fb3637fe700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb36806ace0 0x7fb36806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.050+0000 7fb3637fe700 1 -- 172.21.15.88:0/2108041243 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fb3700895a0 con 0x7fb37c0cf190 2023-05-17T12:25:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.050+0000 7fb37affd700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb36806ace0 0x7fb36806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.051+0000 7fb37affd700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb36806ace0 0x7fb36806d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb36c000f60 tx=0x7fb36c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:06.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.054+0000 7fb3637fe700 1 -- 172.21.15.88:0/2108041243 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb370054250 con 0x7fb37c0cf190 2023-05-17T12:25:06.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.290+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb37c074530 con 0x7fb37c0cf190 2023-05-17T12:25:06.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.294+0000 7fb3637fe700 1 -- 172.21.15.88:0/2108041243 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb370057870 con 0x7fb37c0cf190 2023-05-17T12:25:06.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb36806ace0 msgr2=0x7fb36806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb36806ace0 0x7fb36806d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb36c000f60 tx=0x7fb36c009040 comp rx=0 tx=0).stop 2023-05-17T12:25:06.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 msgr2=0x7fb37c154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 0x7fb37c154f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb37000e810 tx=0x7fb37000ebd0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 shutdown_connections 2023-05-17T12:25:06.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb36806ace0 0x7fb36806d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0c6f30 0x7fb37c0cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb37c06c760 0x7fb37c155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 --2- 172.21.15.88:0/2108041243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb37c0cf190 0x7fb37c154f10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 >> 172.21.15.88:0/2108041243 conn(0x7fb37c0d06f0 msgr2=0x7fb37c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:06.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 shutdown_connections 2023-05-17T12:25:06.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.297+0000 7fb3815ff700 1 -- 172.21.15.88:0/2108041243 wait complete. 2023-05-17T12:25:06.303 INFO:teuthology.orchestra.run.smithi088.stderr:added data pool 5 to fsmap 2023-05-17T12:25:06.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:25:06.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.500+0000 7fd914bff700 1 Processor -- start 2023-05-17T12:25:06.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.500+0000 7fd914bff700 1 -- start start 2023-05-17T12:25:06.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.501+0000 7fd914bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd91015c8c0 0x7fd91006c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.501+0000 7fd914bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 0x7fd91006c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.501+0000 7fd914bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9100b5e50 con 0x7fd9100b2500 2023-05-17T12:25:06.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.501+0000 7fd914bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9101609d0 con 0x7fd91015c8c0 2023-05-17T12:25:06.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.501+0000 7fd914bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd910160cb0 con 0x7fd910160480 2023-05-17T12:25:06.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.501+0000 7fd90e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd91015c8c0 0x7fd91006c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.501+0000 7fd90e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd91015c8c0 0x7fd91006c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48486/0 (socket says 172.21.15.88:48486) 2023-05-17T12:25:06.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.501+0000 7fd90e59c700 1 -- 172.21.15.88:0/4263731930 learned_addr learned my addr 172.21.15.88:0/4263731930 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:06.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.501+0000 7fd90dd9b700 1 --2- 172.21.15.88:0/4263731930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 0x7fd91006c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.502+0000 7fd90e59c700 1 -- 172.21.15.88:0/4263731930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 msgr2=0x7fd91006c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:06.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.502+0000 7fd90e59c700 1 --2- 172.21.15.88:0/4263731930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 0x7fd91006c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.502+0000 7fd90e59c700 1 -- 172.21.15.88:0/4263731930 >> v1:172.21.15.187:6789/0 conn(0x7fd9100b2500 legacy=0x7fd91006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.502+0000 7fd90e59c700 1 -- 172.21.15.88:0/4263731930 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910160f90 con 0x7fd91015c8c0 2023-05-17T12:25:06.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.502+0000 7fd90e59c700 1 --2- 172.21.15.88:0/4263731930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd91015c8c0 0x7fd91006c260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9000098f0 tx=0x7fd900009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b02b330309529a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:06.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.502+0000 7fd90d59a700 1 -- 172.21.15.88:0/4263731930 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900011830 con 0x7fd91015c8c0 2023-05-17T12:25:06.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.502+0000 7fd90d59a700 1 -- 172.21.15.88:0/4263731930 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900011990 con 0x7fd91015c8c0 2023-05-17T12:25:06.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.502+0000 7fd90d59a700 1 -- 172.21.15.88:0/4263731930 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900011d20 con 0x7fd91015c8c0 2023-05-17T12:25:06.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.503+0000 7fd914bff700 1 -- 172.21.15.88:0/4263731930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd91015c8c0 msgr2=0x7fd91006c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.503+0000 7fd914bff700 1 --2- 172.21.15.88:0/4263731930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd91015c8c0 0x7fd91006c260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9000098f0 tx=0x7fd900009c00 comp rx=0 tx=0).stop 2023-05-17T12:25:06.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.503+0000 7fd914bff700 1 -- 172.21.15.88:0/4263731930 shutdown_connections 2023-05-17T12:25:06.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.503+0000 7fd914bff700 1 --2- 172.21.15.88:0/4263731930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd91015c8c0 0x7fd91006c260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.503+0000 7fd914bff700 1 --2- 172.21.15.88:0/4263731930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 0x7fd91006c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.503+0000 7fd914bff700 1 -- 172.21.15.88:0/4263731930 >> 172.21.15.88:0/4263731930 conn(0x7fd9100d06d0 msgr2=0x7fd9100d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:06.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.503+0000 7fd914bff700 1 -- 172.21.15.88:0/4263731930 shutdown_connections 2023-05-17T12:25:06.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.503+0000 7fd914bff700 1 -- 172.21.15.88:0/4263731930 wait complete. 2023-05-17T12:25:06.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.505+0000 7fd914bff700 1 Processor -- start 2023-05-17T12:25:06.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.505+0000 7fd914bff700 1 -- start start 2023-05-17T12:25:06.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.506+0000 7fd914bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9100b2500 0x7fd91014fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd914bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd91015c8c0 0x7fd9100c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd914bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 0x7fd9100b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd914bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100b6ea0 con 0x7fd9100b2500 2023-05-17T12:25:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd914bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100b7140 con 0x7fd91015c8c0 2023-05-17T12:25:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd914bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100b7420 con 0x7fd910160480 2023-05-17T12:25:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9100b2500 0x7fd91014fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9100b2500 0x7fd91014fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48494/0 (socket says 172.21.15.88:48494) 2023-05-17T12:25:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90e59c700 1 -- 172.21.15.88:0/3026324828 learned_addr learned my addr 172.21.15.88:0/3026324828 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90dd9b700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd91015c8c0 0x7fd9100c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90ed9d700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 0x7fd9100b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90e59c700 1 -- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 msgr2=0x7fd9100b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90e59c700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 0x7fd9100b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90e59c700 1 -- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd91015c8c0 msgr2=0x7fd9100c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90e59c700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd91015c8c0 0x7fd9100c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90e59c700 1 -- 172.21.15.88:0/3026324828 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd900009550 con 0x7fd9100b2500 2023-05-17T12:25:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90dd9b700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd91015c8c0 0x7fd9100c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.507+0000 7fd90e59c700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9100b2500 0x7fd91014fb40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd900000c00 tx=0x7fd900004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.508+0000 7fd8feffd700 1 -- 172.21.15.88:0/3026324828 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900004570 con 0x7fd9100b2500 2023-05-17T12:25:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.508+0000 7fd8feffd700 1 -- 172.21.15.88:0/3026324828 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90001f070 con 0x7fd9100b2500 2023-05-17T12:25:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.508+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9100d0bd0 con 0x7fd9100b2500 2023-05-17T12:25:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.508+0000 7fd8feffd700 1 -- 172.21.15.88:0/3026324828 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9000038c0 con 0x7fd9100b2500 2023-05-17T12:25:06.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.508+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd910161270 con 0x7fd9100b2500 2023-05-17T12:25:06.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.509+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9100b2220 con 0x7fd9100b2500 2023-05-17T12:25:06.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.510+0000 7fd8feffd700 1 -- 172.21.15.88:0/3026324828 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd900021030 con 0x7fd9100b2500 2023-05-17T12:25:06.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.511+0000 7fd8feffd700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd8f006ad10 0x7fd8f006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.511+0000 7fd8feffd700 1 -- 172.21.15.88:0/3026324828 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd90008ac10 con 0x7fd9100b2500 2023-05-17T12:25:06.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.511+0000 7fd90dd9b700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd8f006ad10 0x7fd8f006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.512+0000 7fd90dd9b700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd8f006ad10 0x7fd8f006d1c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9100b9170 tx=0x7fd904008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:06.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.515+0000 7fd8feffd700 1 -- 172.21.15.88:0/3026324828 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd9000559c0 con 0x7fd9100b2500 2023-05-17T12:25:06.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.748+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd910074530 con 0x7fd9100b2500 2023-05-17T12:25:06.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.749+0000 7fd8feffd700 1 -- 172.21.15.88:0/3026324828 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fd900015090 con 0x7fd9100b2500 2023-05-17T12:25:06.753 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:06.753 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:06.292040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-17T12:25:06.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd8f006ad10 msgr2=0x7fd8f006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd8f006ad10 0x7fd8f006d1c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9100b9170 tx=0x7fd904008040 comp rx=0 tx=0).stop 2023-05-17T12:25:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9100b2500 msgr2=0x7fd91014fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9100b2500 0x7fd91014fb40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd900000c00 tx=0x7fd900004750 comp rx=0 tx=0).stop 2023-05-17T12:25:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 shutdown_connections 2023-05-17T12:25:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd8f006ad10 0x7fd8f006d1c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd910160480 0x7fd9100b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9100b2500 0x7fd91014fb40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 --2- 172.21.15.88:0/3026324828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd91015c8c0 0x7fd9100c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 >> 172.21.15.88:0/3026324828 conn(0x7fd9100d06d0 msgr2=0x7fd91006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 shutdown_connections 2023-05-17T12:25:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.752+0000 7fd914bff700 1 -- 172.21.15.88:0/3026324828 wait complete. 2023-05-17T12:25:06.757 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 7 2023-05-17T12:25:06.773 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:06.942 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-05-17T12:25:06.939+0000 7f23893f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T12:25:06.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.954+0000 7fdb835ff700 1 Processor -- start 2023-05-17T12:25:06.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.954+0000 7fdb835ff700 1 -- start start 2023-05-17T12:25:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.955+0000 7fdb835ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdb7c15c840 0x7fdb7c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.955+0000 7fdb835ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06c330 0x7fdb7c06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.955+0000 7fdb835ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c0cd6b0 con 0x7fdb7c06b0b0 2023-05-17T12:25:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.955+0000 7fdb835ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c0cdf50 con 0x7fdb7c15c840 2023-05-17T12:25:06.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.955+0000 7fdb835ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c06ccf0 con 0x7fdb7c06c330 2023-05-17T12:25:06.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.955+0000 7fdb81b9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06c330 0x7fdb7c06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.955+0000 7fdb8139b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdb7c15c840 0x7fdb7c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.955+0000 7fdb81b9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06c330 0x7fdb7c06c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:40550/0 (socket says 172.21.15.88:40550) 2023-05-17T12:25:06.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.955+0000 7fdb81b9c700 1 -- 172.21.15.88:0/107142513 learned_addr learned my addr 172.21.15.88:0/107142513 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:06.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb81b9c700 1 -- 172.21.15.88:0/107142513 >> v2:172.21.15.187:3300/0 conn(0x7fdb7c15c840 msgr2=0x7fdb7c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:06.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb81b9c700 1 --2- 172.21.15.88:0/107142513 >> v2:172.21.15.187:3300/0 conn(0x7fdb7c15c840 0x7fdb7c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb73fff700 1 -- 172.21.15.88:0/107142513 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209407403 0 0) 0x7fdb7c0cd6b0 con 0x7fdb7c06b0b0 2023-05-17T12:25:06.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb81b9c700 1 -- 172.21.15.88:0/107142513 >> v1:172.21.15.187:6789/0 conn(0x7fdb7c06b0b0 legacy=0x7fdb7c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb81b9c700 1 -- 172.21.15.88:0/107142513 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c0b2460 con 0x7fdb7c06c330 2023-05-17T12:25:06.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb8139b700 1 --2- 172.21.15.88:0/107142513 >> v2:172.21.15.187:3300/0 conn(0x7fdb7c15c840 0x7fdb7c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:06.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb81b9c700 1 --2- 172.21.15.88:0/107142513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06c330 0x7fdb7c06c7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009e50 tx=0x7fdb7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=627f8ef4bf081d74 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:06.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb73fff700 1 -- 172.21.15.88:0/107142513 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400e070 con 0x7fdb7c06c330 2023-05-17T12:25:06.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb73fff700 1 -- 172.21.15.88:0/107142513 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400b910 con 0x7fdb7c06c330 2023-05-17T12:25:06.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.956+0000 7fdb73fff700 1 -- 172.21.15.88:0/107142513 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400bcc0 con 0x7fdb7c06c330 2023-05-17T12:25:06.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.957+0000 7fdb835ff700 1 -- 172.21.15.88:0/107142513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06c330 msgr2=0x7fdb7c06c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.957+0000 7fdb835ff700 1 --2- 172.21.15.88:0/107142513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06c330 0x7fdb7c06c7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009e50 tx=0x7fdb7400b330 comp rx=0 tx=0).stop 2023-05-17T12:25:06.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.957+0000 7fdb835ff700 1 -- 172.21.15.88:0/107142513 shutdown_connections 2023-05-17T12:25:06.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.957+0000 7fdb835ff700 1 --2- 172.21.15.88:0/107142513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06c330 0x7fdb7c06c7b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.957+0000 7fdb835ff700 1 --2- 172.21.15.88:0/107142513 >> v2:172.21.15.187:3300/0 conn(0x7fdb7c15c840 0x7fdb7c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.957+0000 7fdb835ff700 1 -- 172.21.15.88:0/107142513 >> 172.21.15.88:0/107142513 conn(0x7fdb7c0d3060 msgr2=0x7fdb7c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:06.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.957+0000 7fdb835ff700 1 -- 172.21.15.88:0/107142513 shutdown_connections 2023-05-17T12:25:06.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.957+0000 7fdb835ff700 1 -- 172.21.15.88:0/107142513 wait complete. 2023-05-17T12:25:06.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.959+0000 7fdb835ff700 1 Processor -- start 2023-05-17T12:25:06.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.960+0000 7fdb835ff700 1 -- start start 2023-05-17T12:25:06.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb835ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06b0b0 0x7fdb7c158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb835ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c06c330 0x7fdb7c160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb835ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7c15c840 0x7fdb7c1f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb835ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c160c70 con 0x7fdb7c06c330 2023-05-17T12:25:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb835ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c159150 con 0x7fdb7c15c840 2023-05-17T12:25:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb835ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c159430 con 0x7fdb7c06b0b0 2023-05-17T12:25:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb80b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c06c330 0x7fdb7c160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb80b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c06c330 0x7fdb7c160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48510/0 (socket says 172.21.15.88:48510) 2023-05-17T12:25:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb80b9a700 1 -- 172.21.15.88:0/1025801458 learned_addr learned my addr 172.21.15.88:0/1025801458 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:06.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb81b9c700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7c15c840 0x7fdb7c1f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb8139b700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06b0b0 0x7fdb7c158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb80b9a700 1 -- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06b0b0 msgr2=0x7fdb7c158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb80b9a700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06b0b0 0x7fdb7c158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb80b9a700 1 -- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7c15c840 msgr2=0x7fdb7c1f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb80b9a700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7c15c840 0x7fdb7c1f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb80b9a700 1 -- 172.21.15.88:0/1025801458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780094a0 con 0x7fdb7c06c330 2023-05-17T12:25:06.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.961+0000 7fdb81b9c700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7c15c840 0x7fdb7c1f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:06.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.962+0000 7fdb80b9a700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c06c330 0x7fdb7c160730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0011e0 tx=0x7fdb6c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:06.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.962+0000 7fdb71ffb700 1 -- 172.21.15.88:0/1025801458 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0054e0 con 0x7fdb7c06c330 2023-05-17T12:25:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.962+0000 7fdb71ffb700 1 -- 172.21.15.88:0/1025801458 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c003680 con 0x7fdb7c06c330 2023-05-17T12:25:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.962+0000 7fdb71ffb700 1 -- 172.21.15.88:0/1025801458 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c003a30 con 0x7fdb7c06c330 2023-05-17T12:25:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.962+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb74009b30 con 0x7fdb7c06c330 2023-05-17T12:25:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.962+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c0cd900 con 0x7fdb7c06c330 2023-05-17T12:25:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.963+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c0b2740 con 0x7fdb7c06c330 2023-05-17T12:25:06.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.964+0000 7fdb71ffb700 1 -- 172.21.15.88:0/1025801458 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb6c003b90 con 0x7fdb7c06c330 2023-05-17T12:25:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.965+0000 7fdb71ffb700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb6006ace0 0x7fdb6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.965+0000 7fdb71ffb700 1 -- 172.21.15.88:0/1025801458 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdb6c088c70 con 0x7fdb7c06c330 2023-05-17T12:25:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.965+0000 7fdb8139b700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb6006ace0 0x7fdb6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:06.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.966+0000 7fdb8139b700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb6006ace0 0x7fdb6006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb78009cd0 tx=0x7fdb78009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:06.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:06.969+0000 7fdb71ffb700 1 -- 172.21.15.88:0/1025801458 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdb6c053a30 con 0x7fdb7c06c330 2023-05-17T12:25:07.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.167+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb7c0cdbe0 con 0x7fdb7c06c330 2023-05-17T12:25:07.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.169+0000 7fdb71ffb700 1 -- 172.21.15.88:0/1025801458 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fdb6c017090 con 0x7fdb7c06c330 2023-05-17T12:25:07.173 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:07.173 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:07.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb6006ace0 msgr2=0x7fdb6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb6006ace0 0x7fdb6006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb78009cd0 tx=0x7fdb78009210 comp rx=0 tx=0).stop 2023-05-17T12:25:07.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c06c330 msgr2=0x7fdb7c160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c06c330 0x7fdb7c160730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0011e0 tx=0x7fdb6c00ca30 comp rx=0 tx=0).stop 2023-05-17T12:25:07.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 shutdown_connections 2023-05-17T12:25:07.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb6006ace0 0x7fdb6006d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7c15c840 0x7fdb7c1f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb7c06b0b0 0x7fdb7c158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 --2- 172.21.15.88:0/1025801458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb7c06c330 0x7fdb7c160730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 >> 172.21.15.88:0/1025801458 conn(0x7fdb7c0d3060 msgr2=0x7fdb7c0b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:07.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 shutdown_connections 2023-05-17T12:25:07.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.171+0000 7fdb835ff700 1 -- 172.21.15.88:0/1025801458 wait complete. 2023-05-17T12:25:07.192 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:07.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.372+0000 7f0cff9ff700 1 Processor -- start 2023-05-17T12:25:07.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.373+0000 7f0cff9ff700 1 -- start start 2023-05-17T12:25:07.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cff9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0cf806b0b0 0x7f0cf806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cff9ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0cf806c330 0x7f0cf806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cff9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf80cd6b0 con 0x7f0cf815c840 2023-05-17T12:25:07.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cff9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf80cdf50 con 0x7f0cf806b0b0 2023-05-17T12:25:07.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cff9ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf806ccb0 con 0x7f0cf806c330 2023-05-17T12:25:07.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cfcf9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0cf806b0b0 0x7f0cf806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cfd79b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0cf815c840 0x7f0cf80cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41540/0 (socket says 172.21.15.88:41540) 2023-05-17T12:25:07.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cfd79b700 1 -- 172.21.15.88:0/477139557 learned_addr learned my addr 172.21.15.88:0/477139557 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:07.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cfdf9c700 1 --2- 172.21.15.88:0/477139557 >> v2:172.21.15.187:3300/0 conn(0x7f0cf806c330 0x7f0cf806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cfcf9a700 1 -- 172.21.15.88:0/477139557 >> v2:172.21.15.187:3300/0 conn(0x7f0cf806c330 msgr2=0x7f0cf806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:07.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cfcf9a700 1 --2- 172.21.15.88:0/477139557 >> v2:172.21.15.187:3300/0 conn(0x7f0cf806c330 0x7f0cf806c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cfcf9a700 1 -- 172.21.15.88:0/477139557 >> v1:172.21.15.88:6789/0 conn(0x7f0cf815c840 legacy=0x7f0cf80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.374+0000 7f0cfcf9a700 1 -- 172.21.15.88:0/477139557 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80b2460 con 0x7f0cf806b0b0 2023-05-17T12:25:07.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0cfcf9a700 1 --2- 172.21.15.88:0/477139557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 0x7f0cf806b940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80d2220 tx=0x7f0ce8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c181a302c5e6bd33 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:07.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0ceffff700 1 -- 172.21.15.88:0/477139557 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8011830 con 0x7f0cf806b0b0 2023-05-17T12:25:07.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0ceffff700 1 -- 172.21.15.88:0/477139557 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce8011990 con 0x7f0cf806b0b0 2023-05-17T12:25:07.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0ceffff700 1 -- 172.21.15.88:0/477139557 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8011d20 con 0x7f0cf806b0b0 2023-05-17T12:25:07.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0cff9ff700 1 -- 172.21.15.88:0/477139557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 msgr2=0x7f0cf806b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0cff9ff700 1 --2- 172.21.15.88:0/477139557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 0x7f0cf806b940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80d2220 tx=0x7f0ce8009b20 comp rx=0 tx=0).stop 2023-05-17T12:25:07.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0cff9ff700 1 -- 172.21.15.88:0/477139557 shutdown_connections 2023-05-17T12:25:07.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0cff9ff700 1 --2- 172.21.15.88:0/477139557 >> v2:172.21.15.187:3300/0 conn(0x7f0cf806c330 0x7f0cf806c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0cff9ff700 1 --2- 172.21.15.88:0/477139557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 0x7f0cf806b940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.375+0000 7f0cff9ff700 1 -- 172.21.15.88:0/477139557 >> 172.21.15.88:0/477139557 conn(0x7f0cf80d3060 msgr2=0x7f0cf80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:07.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.376+0000 7f0cff9ff700 1 -- 172.21.15.88:0/477139557 shutdown_connections 2023-05-17T12:25:07.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.376+0000 7f0cff9ff700 1 -- 172.21.15.88:0/477139557 wait complete. 2023-05-17T12:25:07.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.377+0000 7f0cff9ff700 1 Processor -- start 2023-05-17T12:25:07.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.377+0000 7f0cff9ff700 1 -- start start 2023-05-17T12:25:07.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.378+0000 7f0cff9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 0x7f0cf80b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.378+0000 7f0cff9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cf806c330 0x7f0cf8155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.378+0000 7f0cff9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cf815c840 0x7f0cf8156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.378+0000 7f0cff9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf815c030 con 0x7f0cf806b0b0 2023-05-17T12:25:07.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.378+0000 7f0cff9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8158e60 con 0x7f0cf806c330 2023-05-17T12:25:07.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.378+0000 7f0cff9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8159100 con 0x7f0cf815c840 2023-05-17T12:25:07.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.378+0000 7f0cfd79b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 0x7f0cf80b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.378+0000 7f0cfd79b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 0x7f0cf80b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48540/0 (socket says 172.21.15.88:48540) 2023-05-17T12:25:07.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.378+0000 7f0cfd79b700 1 -- 172.21.15.88:0/3027400406 learned_addr learned my addr 172.21.15.88:0/3027400406 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:07.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cfcf9a700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cf806c330 0x7f0cf8155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cfdf9c700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cf815c840 0x7f0cf8156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cfd79b700 1 -- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cf815c840 msgr2=0x7f0cf8156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cfd79b700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cf815c840 0x7f0cf8156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cfd79b700 1 -- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cf806c330 msgr2=0x7f0cf8155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cfd79b700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cf806c330 0x7f0cf8155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cfd79b700 1 -- 172.21.15.88:0/3027400406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80094a0 con 0x7f0cf806b0b0 2023-05-17T12:25:07.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cfd79b700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 0x7f0cf80b47f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400c480 tx=0x7f0cf400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:07.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cedffb700 1 -- 172.21.15.88:0/3027400406 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4005d70 con 0x7f0cf806b0b0 2023-05-17T12:25:07.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cedffb700 1 -- 172.21.15.88:0/3027400406 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf40070d0 con 0x7f0cf806b0b0 2023-05-17T12:25:07.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf80cd900 con 0x7f0cf806b0b0 2023-05-17T12:25:07.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cedffb700 1 -- 172.21.15.88:0/3027400406 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4007440 con 0x7f0cf806b0b0 2023-05-17T12:25:07.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.379+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf80b2740 con 0x7f0cf806b0b0 2023-05-17T12:25:07.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.381+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf80cdbe0 con 0x7f0cf806b0b0 2023-05-17T12:25:07.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.381+0000 7f0cedffb700 1 -- 172.21.15.88:0/3027400406 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cf40075a0 con 0x7f0cf806b0b0 2023-05-17T12:25:07.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.382+0000 7f0cedffb700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0cdc06ace0 0x7f0cdc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.382+0000 7f0cedffb700 1 -- 172.21.15.88:0/3027400406 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0cf4088b70 con 0x7f0cf806b0b0 2023-05-17T12:25:07.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.383+0000 7f0cfcf9a700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0cdc06ace0 0x7f0cdc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.383+0000 7f0cfcf9a700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0cdc06ace0 0x7f0cdc06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80090b0 tx=0x7f0ce8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:07.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.386+0000 7f0cedffb700 1 -- 172.21.15.88:0/3027400406 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0cf40539e0 con 0x7f0cf806b0b0 2023-05-17T12:25:07.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.584+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cf8074530 con 0x7f0cf806b0b0 2023-05-17T12:25:07.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.585+0000 7f0cedffb700 1 -- 172.21.15.88:0/3027400406 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f0cf4057000 con 0x7f0cf806b0b0 2023-05-17T12:25:07.590 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:07.590 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:07.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0cdc06ace0 msgr2=0x7f0cdc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0cdc06ace0 0x7f0cdc06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80090b0 tx=0x7f0ce8008030 comp rx=0 tx=0).stop 2023-05-17T12:25:07.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 msgr2=0x7f0cf80b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 0x7f0cf80b47f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400c480 tx=0x7f0cf400c840 comp rx=0 tx=0).stop 2023-05-17T12:25:07.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 shutdown_connections 2023-05-17T12:25:07.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0cdc06ace0 0x7f0cdc06d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cf815c840 0x7f0cf8156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0cf806b0b0 0x7f0cf80b47f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 --2- 172.21.15.88:0/3027400406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cf806c330 0x7f0cf8155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 >> 172.21.15.88:0/3027400406 conn(0x7f0cf80d3060 msgr2=0x7f0cf80b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:07.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 shutdown_connections 2023-05-17T12:25:07.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.588+0000 7f0cff9ff700 1 -- 172.21.15.88:0/3027400406 wait complete. 2023-05-17T12:25:07.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:25:07.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.804+0000 7faed01ff700 1 Processor -- start 2023-05-17T12:25:07.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.804+0000 7faed01ff700 1 -- start start 2023-05-17T12:25:07.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.805+0000 7faed01ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1cd0 0x7faec80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.805+0000 7faed01ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec8161020 con 0x7faec815a3a0 2023-05-17T12:25:07.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.805+0000 7faed01ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec8160450 con 0x7faec80b1850 2023-05-17T12:25:07.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.805+0000 7faed01ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec80b2150 con 0x7faec80b1cd0 2023-05-17T12:25:07.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.805+0000 7faecdf9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faec815a3a0 0x7faec80cb1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41554/0 (socket says 172.21.15.88:41554) 2023-05-17T12:25:07.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.805+0000 7faecdf9b700 1 -- 172.21.15.88:0/3306785515 learned_addr learned my addr 172.21.15.88:0/3306785515 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:07.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.805+0000 7faece79c700 1 --2- 172.21.15.88:0/3306785515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1cd0 0x7faec80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.806+0000 7faece79c700 1 -- 172.21.15.88:0/3306785515 >> v1:172.21.15.187:6789/0 conn(0x7faec80b1850 legacy=0x7faec80ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.806+0000 7faece79c700 1 -- 172.21.15.88:0/3306785515 >> v1:172.21.15.88:6789/0 conn(0x7faec815a3a0 legacy=0x7faec80cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.806+0000 7faece79c700 1 -- 172.21.15.88:0/3306785515 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec81606f0 con 0x7faec80b1cd0 2023-05-17T12:25:07.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.806+0000 7faece79c700 1 --2- 172.21.15.88:0/3306785515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1cd0 0x7faec80ced60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faec0009dc0 tx=0x7faec000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=991678ec40626270 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:07.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.808+0000 7faeccf99700 1 -- 172.21.15.88:0/3306785515 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000e070 con 0x7faec80b1cd0 2023-05-17T12:25:07.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.808+0000 7faeccf99700 1 -- 172.21.15.88:0/3306785515 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000bbd0 con 0x7faec80b1cd0 2023-05-17T12:25:07.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.808+0000 7faeccf99700 1 -- 172.21.15.88:0/3306785515 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0012430 con 0x7faec80b1cd0 2023-05-17T12:25:07.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.809+0000 7faed01ff700 1 -- 172.21.15.88:0/3306785515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1cd0 msgr2=0x7faec80ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.809+0000 7faed01ff700 1 --2- 172.21.15.88:0/3306785515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1cd0 0x7faec80ced60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faec0009dc0 tx=0x7faec000b330 comp rx=0 tx=0).stop 2023-05-17T12:25:07.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.809+0000 7faed01ff700 1 -- 172.21.15.88:0/3306785515 shutdown_connections 2023-05-17T12:25:07.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.809+0000 7faed01ff700 1 --2- 172.21.15.88:0/3306785515 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1cd0 0x7faec80ced60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.809+0000 7faed01ff700 1 -- 172.21.15.88:0/3306785515 >> 172.21.15.88:0/3306785515 conn(0x7faec80cc850 msgr2=0x7faec80ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:07.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.809+0000 7faed01ff700 1 -- 172.21.15.88:0/3306785515 shutdown_connections 2023-05-17T12:25:07.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.809+0000 7faed01ff700 1 -- 172.21.15.88:0/3306785515 wait complete. 2023-05-17T12:25:07.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.811+0000 7faed01ff700 1 Processor -- start 2023-05-17T12:25:07.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.812+0000 7faed01ff700 1 -- start start 2023-05-17T12:25:07.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faed01ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1850 0x7faec80b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faed01ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec80b1cd0 0x7faec81536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faed01ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faec815a3a0 0x7faec815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faed01ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c7b10 con 0x7faec80b1cd0 2023-05-17T12:25:07.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faed01ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec8153c00 con 0x7faec815a3a0 2023-05-17T12:25:07.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faed01ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec815af00 con 0x7faec80b1850 2023-05-17T12:25:07.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faecd79a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec80b1cd0 0x7faec81536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faecd79a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec80b1cd0 0x7faec81536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48554/0 (socket says 172.21.15.88:48554) 2023-05-17T12:25:07.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faecd79a700 1 -- 172.21.15.88:0/4156219801 learned_addr learned my addr 172.21.15.88:0/4156219801 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:07.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faecdf9b700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1850 0x7faec80b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.813+0000 7faece79c700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faec815a3a0 0x7faec815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faecdf9b700 1 -- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faec815a3a0 msgr2=0x7faec815a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faecdf9b700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faec815a3a0 0x7faec815a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faecdf9b700 1 -- 172.21.15.88:0/4156219801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec80b1cd0 msgr2=0x7faec81536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:07.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faecdf9b700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec80b1cd0 0x7faec81536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:07.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faecdf9b700 1 -- 172.21.15.88:0/4156219801 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0009a70 con 0x7faec80b1850 2023-05-17T12:25:07.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faecd79a700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec80b1cd0 0x7faec81536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:07.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faecdf9b700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1850 0x7faec80b54e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faec400c3c0 tx=0x7faec400c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:07.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faebe7fc700 1 -- 172.21.15.88:0/4156219801 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4005b40 con 0x7faec80b1850 2023-05-17T12:25:07.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faebe7fc700 1 -- 172.21.15.88:0/4156219801 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4005ca0 con 0x7faec80b1850 2023-05-17T12:25:07.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec8160cb0 con 0x7faec80b1850 2023-05-17T12:25:07.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faebe7fc700 1 -- 172.21.15.88:0/4156219801 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec40072d0 con 0x7faec80b1850 2023-05-17T12:25:07.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.814+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec81609d0 con 0x7faec80b1850 2023-05-17T12:25:07.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.815+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec815a770 con 0x7faec80b1850 2023-05-17T12:25:07.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.816+0000 7faebe7fc700 1 -- 172.21.15.88:0/4156219801 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faec4007430 con 0x7faec80b1850 2023-05-17T12:25:07.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.817+0000 7faebe7fc700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faeac06ace0 0x7faeac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:07.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.817+0000 7faebe7fc700 1 -- 172.21.15.88:0/4156219801 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faec4088970 con 0x7faec80b1850 2023-05-17T12:25:07.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.817+0000 7faecd79a700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faeac06ace0 0x7faeac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:07.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.818+0000 7faecd79a700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faeac06ace0 0x7faeac06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faec80c7600 tx=0x7faeb8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:07.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:07.823+0000 7faebe7fc700 1 -- 172.21.15.88:0/4156219801 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faec4053740 con 0x7faec80b1850 2023-05-17T12:25:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.060+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faec80c78e0 con 0x7faec80b1850 2023-05-17T12:25:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.061+0000 7faebe7fc700 1 -- 172.21.15.88:0/4156219801 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7faec80c78e0 con 0x7faec80b1850 2023-05-17T12:25:08.065 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:08.065 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:06.292040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-17T12:25:08.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.063+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faeac06ace0 msgr2=0x7faeac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.063+0000 7faed01ff700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faeac06ace0 0x7faeac06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faec80c7600 tx=0x7faeb8009040 comp rx=0 tx=0).stop 2023-05-17T12:25:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1850 msgr2=0x7faec80b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1850 0x7faec80b54e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faec400c3c0 tx=0x7faec400c6d0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 shutdown_connections 2023-05-17T12:25:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faeac06ace0 0x7faeac06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faec815a3a0 0x7faec815a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faec80b1850 0x7faec80b54e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 --2- 172.21.15.88:0/4156219801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec80b1cd0 0x7faec81536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 >> 172.21.15.88:0/4156219801 conn(0x7faec80cc850 msgr2=0x7faec815df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 shutdown_connections 2023-05-17T12:25:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.064+0000 7faed01ff700 1 -- 172.21.15.88:0/4156219801 wait complete. 2023-05-17T12:25:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 7 2023-05-17T12:25:08.085 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.264+0000 7f7a4a3ff700 1 Processor -- start 2023-05-17T12:25:08.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.264+0000 7f7a4a3ff700 1 -- start start 2023-05-17T12:25:08.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a4a3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7a4415c840 0x7f7a4406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a4a3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a4406b0b0 0x7f7a440cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a4a3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a440cd6b0 con 0x7f7a4406c330 2023-05-17T12:25:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a4a3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a440cdf50 con 0x7f7a4406b0b0 2023-05-17T12:25:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a4a3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a440cf860 con 0x7f7a4415c840 2023-05-17T12:25:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a4899c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7a4406c330 0x7f7a44160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41560/0 (socket says 172.21.15.88:41560) 2023-05-17T12:25:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a4899c700 1 -- 172.21.15.88:0/1107004922 learned_addr learned my addr 172.21.15.88:0/1107004922 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:08.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a437fe700 1 --2- 172.21.15.88:0/1107004922 >> v2:172.21.15.88:3300/0 conn(0x7f7a4406b0b0 0x7f7a440cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a43fff700 1 --2- 172.21.15.88:0/1107004922 >> v2:172.21.15.187:3300/0 conn(0x7f7a4415c840 0x7f7a4406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a42ffd700 1 -- 172.21.15.88:0/1107004922 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058628214 0 0) 0x7f7a440cd6b0 con 0x7f7a4406c330 2023-05-17T12:25:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a42ffd700 1 -- 172.21.15.88:0/1107004922 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a2c0035b0 con 0x7f7a4406c330 2023-05-17T12:25:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a437fe700 1 -- 172.21.15.88:0/1107004922 >> v2:172.21.15.187:3300/0 conn(0x7f7a4415c840 msgr2=0x7f7a4406b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a437fe700 1 --2- 172.21.15.88:0/1107004922 >> v2:172.21.15.187:3300/0 conn(0x7f7a4415c840 0x7f7a4406b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a437fe700 1 -- 172.21.15.88:0/1107004922 >> v1:172.21.15.88:6789/0 conn(0x7f7a4406c330 legacy=0x7f7a44160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.266+0000 7f7a437fe700 1 -- 172.21.15.88:0/1107004922 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a440b2460 con 0x7f7a4406b0b0 2023-05-17T12:25:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a437fe700 1 --2- 172.21.15.88:0/1107004922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 0x7f7a440cf320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a440cfa40 tx=0x7f7a38009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0dbea2b088fe18 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a42ffd700 1 -- 172.21.15.88:0/1107004922 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38011830 con 0x7f7a4406b0b0 2023-05-17T12:25:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a42ffd700 1 -- 172.21.15.88:0/1107004922 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a38011990 con 0x7f7a4406b0b0 2023-05-17T12:25:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a42ffd700 1 -- 172.21.15.88:0/1107004922 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38011d20 con 0x7f7a4406b0b0 2023-05-17T12:25:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/1107004922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 msgr2=0x7f7a440cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a4a3ff700 1 --2- 172.21.15.88:0/1107004922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 0x7f7a440cf320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a440cfa40 tx=0x7f7a38009b20 comp rx=0 tx=0).stop 2023-05-17T12:25:08.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/1107004922 shutdown_connections 2023-05-17T12:25:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a4a3ff700 1 --2- 172.21.15.88:0/1107004922 >> v2:172.21.15.187:3300/0 conn(0x7f7a4415c840 0x7f7a4406b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a4a3ff700 1 --2- 172.21.15.88:0/1107004922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 0x7f7a440cf320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.267+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/1107004922 >> 172.21.15.88:0/1107004922 conn(0x7f7a440d3060 msgr2=0x7f7a440d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.268+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/1107004922 shutdown_connections 2023-05-17T12:25:08.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.268+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/1107004922 wait complete. 2023-05-17T12:25:08.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.270+0000 7f7a4a3ff700 1 Processor -- start 2023-05-17T12:25:08.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.270+0000 7f7a4a3ff700 1 -- start start 2023-05-17T12:25:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.271+0000 7f7a4a3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 0x7f7a441f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.271+0000 7f7a4a3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a4406c330 0x7f7a44159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.271+0000 7f7a4a3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a4415c840 0x7f7a4415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.271+0000 7f7a4a3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a441f5c50 con 0x7f7a4406b0b0 2023-05-17T12:25:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.271+0000 7f7a4a3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a44158e10 con 0x7f7a4406c330 2023-05-17T12:25:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.271+0000 7f7a4a3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a441590f0 con 0x7f7a4415c840 2023-05-17T12:25:08.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.271+0000 7f7a43fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 0x7f7a441f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a43fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 0x7f7a441f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48564/0 (socket says 172.21.15.88:48564) 2023-05-17T12:25:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a43fff700 1 -- 172.21.15.88:0/532762742 learned_addr learned my addr 172.21.15.88:0/532762742 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a4899c700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a4415c840 0x7f7a4415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a437fe700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a4406c330 0x7f7a44159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a43fff700 1 -- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a4415c840 msgr2=0x7f7a4415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a43fff700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a4415c840 0x7f7a4415a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a43fff700 1 -- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a4406c330 msgr2=0x7f7a44159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a43fff700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a4406c330 0x7f7a44159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a43fff700 1 -- 172.21.15.88:0/532762742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380094a0 con 0x7f7a4406b0b0 2023-05-17T12:25:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a43fff700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 0x7f7a441f1b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400d800 tx=0x7f7a3400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a40ff9700 1 -- 172.21.15.88:0/532762742 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340125f0 con 0x7f7a4406b0b0 2023-05-17T12:25:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a40ff9700 1 -- 172.21.15.88:0/532762742 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a34012750 con 0x7f7a4406b0b0 2023-05-17T12:25:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a440cd900 con 0x7f7a4406b0b0 2023-05-17T12:25:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a40ff9700 1 -- 172.21.15.88:0/532762742 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34012b00 con 0x7f7a4406b0b0 2023-05-17T12:25:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.272+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a440b2740 con 0x7f7a4406b0b0 2023-05-17T12:25:08.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.273+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a440cdbe0 con 0x7f7a4406b0b0 2023-05-17T12:25:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.274+0000 7f7a40ff9700 1 -- 172.21.15.88:0/532762742 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a34012c60 con 0x7f7a4406b0b0 2023-05-17T12:25:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.275+0000 7f7a40ff9700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a3006ace0 0x7f7a3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.275+0000 7f7a40ff9700 1 -- 172.21.15.88:0/532762742 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7a34089bf0 con 0x7f7a4406b0b0 2023-05-17T12:25:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.275+0000 7f7a437fe700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a3006ace0 0x7f7a3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.276+0000 7f7a437fe700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a3006ace0 0x7f7a3006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7a380090b0 tx=0x7f7a38008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.279+0000 7f7a40ff9700 1 -- 172.21.15.88:0/532762742 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7a34054910 con 0x7f7a4406b0b0 2023-05-17T12:25:08.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.473+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a440c6fa0 con 0x7f7a4406b0b0 2023-05-17T12:25:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.474+0000 7f7a40ff9700 1 -- 172.21.15.88:0/532762742 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f7a34057f30 con 0x7f7a4406b0b0 2023-05-17T12:25:08.478 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:08.479 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:08.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a3006ace0 msgr2=0x7f7a3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:08.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a3006ace0 0x7f7a3006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7a380090b0 tx=0x7f7a38008030 comp rx=0 tx=0).stop 2023-05-17T12:25:08.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 msgr2=0x7f7a441f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:08.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 0x7f7a441f1b30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400d800 tx=0x7f7a3400dbc0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 shutdown_connections 2023-05-17T12:25:08.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7a3006ace0 0x7f7a3006d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a4415c840 0x7f7a4415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a4406b0b0 0x7f7a441f1b30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 --2- 172.21.15.88:0/532762742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a4406c330 0x7f7a44159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:08.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 >> 172.21.15.88:0/532762742 conn(0x7f7a440d3060 msgr2=0x7f7a4406c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:08.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 shutdown_connections 2023-05-17T12:25:08.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:08.477+0000 7f7a4a3ff700 1 -- 172.21.15.88:0/532762742 wait complete. 2023-05-17T12:25:08.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T12:25:01.775684+0000', 'modified': '2023-05-17T12:25:06.292040+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4314}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4314': {'gid': 4314, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6837/1857408255', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6835', 'nonce': 1857408255}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 1857408255}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-05-17T12:25:08.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T12:25:08.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-17T12:25:09.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.083+0000 7fa43afff700 1 Processor -- start 2023-05-17T12:25:09.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.083+0000 7fa43afff700 1 -- start start 2023-05-17T12:25:09.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa43afff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa43415ca90 0x7fa4340cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa43afff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa434160f90 0x7fa43406c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa43afff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa43406ca50 0x7fa43406a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa43afff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43406ced0 con 0x7fa43415ca90 2023-05-17T12:25:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa43afff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4340cde90 con 0x7fa43406ca50 2023-05-17T12:25:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa43afff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43415d270 con 0x7fa434160f90 2023-05-17T12:25:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa438d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa43415ca90 0x7fa4340cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa438d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa43415ca90 0x7fa4340cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48578/0 (socket says 172.21.15.88:48578) 2023-05-17T12:25:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa438d9b700 1 -- 172.21.15.88:0/4285636609 learned_addr learned my addr 172.21.15.88:0/4285636609 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa42bfff700 1 --2- 172.21.15.88:0/4285636609 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa434160f90 0x7fa43406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.085+0000 7fa43959c700 1 --2- 172.21.15.88:0/4285636609 >> v2:172.21.15.187:3300/0 conn(0x7fa43406ca50 0x7fa43406a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa438d9b700 1 -- 172.21.15.88:0/4285636609 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa434160f90 msgr2=0x7fa43406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa438d9b700 1 --2- 172.21.15.88:0/4285636609 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa434160f90 0x7fa43406c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa438d9b700 1 -- 172.21.15.88:0/4285636609 >> v2:172.21.15.187:3300/0 conn(0x7fa43406ca50 msgr2=0x7fa43406a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa438d9b700 1 --2- 172.21.15.88:0/4285636609 >> v2:172.21.15.187:3300/0 conn(0x7fa43406ca50 0x7fa43406a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa438d9b700 1 -- 172.21.15.88:0/4285636609 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43415d550 con 0x7fa43415ca90 2023-05-17T12:25:09.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa43959c700 1 --2- 172.21.15.88:0/4285636609 >> v2:172.21.15.187:3300/0 conn(0x7fa43406ca50 0x7fa43406a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:09.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa438d9b700 1 --2- 172.21.15.88:0/4285636609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa43415ca90 0x7fa4340cd800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa4340ca210 tx=0x7fa430009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2366317306d8cbda server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa42b7fe700 1 -- 172.21.15.88:0/4285636609 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430011830 con 0x7fa43415ca90 2023-05-17T12:25:09.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa42b7fe700 1 -- 172.21.15.88:0/4285636609 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430011990 con 0x7fa43415ca90 2023-05-17T12:25:09.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.086+0000 7fa42b7fe700 1 -- 172.21.15.88:0/4285636609 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430011d20 con 0x7fa43415ca90 2023-05-17T12:25:09.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.087+0000 7fa43afff700 1 -- 172.21.15.88:0/4285636609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa43415ca90 msgr2=0x7fa4340cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.087+0000 7fa43afff700 1 --2- 172.21.15.88:0/4285636609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa43415ca90 0x7fa4340cd800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa4340ca210 tx=0x7fa430009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.087+0000 7fa43afff700 1 -- 172.21.15.88:0/4285636609 shutdown_connections 2023-05-17T12:25:09.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.087+0000 7fa43afff700 1 --2- 172.21.15.88:0/4285636609 >> v2:172.21.15.187:3300/0 conn(0x7fa43406ca50 0x7fa43406a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.087+0000 7fa43afff700 1 --2- 172.21.15.88:0/4285636609 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa43415ca90 0x7fa4340cd800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.087+0000 7fa43afff700 1 --2- 172.21.15.88:0/4285636609 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa434160f90 0x7fa43406c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.087+0000 7fa43afff700 1 -- 172.21.15.88:0/4285636609 >> 172.21.15.88:0/4285636609 conn(0x7fa4340d3ed0 msgr2=0x7fa4340cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:09.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.087+0000 7fa43afff700 1 -- 172.21.15.88:0/4285636609 shutdown_connections 2023-05-17T12:25:09.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.087+0000 7fa43afff700 1 -- 172.21.15.88:0/4285636609 wait complete. 2023-05-17T12:25:09.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.089+0000 7fa43afff700 1 Processor -- start 2023-05-17T12:25:09.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.089+0000 7fa43afff700 1 -- start start 2023-05-17T12:25:09.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa43afff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa43406ca50 0x7fa434153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa43afff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa43415ca90 0x7fa4341f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa43afff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa434160f90 0x7fa434155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa43afff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4341f3c20 con 0x7fa434160f90 2023-05-17T12:25:09.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa43afff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4341f3010 con 0x7fa43406ca50 2023-05-17T12:25:09.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa43afff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4341f32f0 con 0x7fa43415ca90 2023-05-17T12:25:09.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa43959c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa434160f90 0x7fa434155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa43959c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa434160f90 0x7fa434155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48590/0 (socket says 172.21.15.88:48590) 2023-05-17T12:25:09.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa43959c700 1 -- 172.21.15.88:0/1866049961 learned_addr learned my addr 172.21.15.88:0/1866049961 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:09.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa438d9b700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa43406ca50 0x7fa434153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.090+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa43415ca90 0x7fa4341f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa43959c700 1 -- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa43415ca90 msgr2=0x7fa4341f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa43959c700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa43415ca90 0x7fa4341f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa43959c700 1 -- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa43406ca50 msgr2=0x7fa434153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa43959c700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa43406ca50 0x7fa434153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa43959c700 1 -- 172.21.15.88:0/1866049961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430009550 con 0x7fa434160f90 2023-05-17T12:25:09.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa43959c700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa434160f90 0x7fa434155a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa42c007e10 tx=0x7fa42c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa4297fa700 1 -- 172.21.15.88:0/1866049961 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c00dd20 con 0x7fa434160f90 2023-05-17T12:25:09.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa4297fa700 1 -- 172.21.15.88:0/1866049961 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c00f040 con 0x7fa434160f90 2023-05-17T12:25:09.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa43afff700 1 -- 172.21.15.88:0/1866049961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4341613e0 con 0x7fa434160f90 2023-05-17T12:25:09.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa4297fa700 1 -- 172.21.15.88:0/1866049961 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c003c60 con 0x7fa434160f90 2023-05-17T12:25:09.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.091+0000 7fa43afff700 1 -- 172.21.15.88:0/1866049961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43415d830 con 0x7fa434160f90 2023-05-17T12:25:09.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.093+0000 7fa4297fa700 1 -- 172.21.15.88:0/1866049961 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa42c004030 con 0x7fa434160f90 2023-05-17T12:25:09.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.094+0000 7fa4297fa700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa42006ace0 0x7fa42006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.095+0000 7fa4297fa700 1 -- 172.21.15.88:0/1866049961 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa42c089770 con 0x7fa434160f90 2023-05-17T12:25:09.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.095+0000 7fa438d9b700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa42006ace0 0x7fa42006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.096+0000 7fa438d9b700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa42006ace0 0x7fa42006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa430009c10 tx=0x7fa430008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.098+0000 7fa44e949b80 1 Processor -- start 2023-05-17T12:25:09.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.098+0000 7fa44e949b80 1 -- start start 2023-05-17T12:25:09.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81ecf70 0x55a0b81ed340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81a3e80 0x55a0b81a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa44e949b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b8119a50 con 0x55a0b81bc960 2023-05-17T12:25:09.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa44e949b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b808f600 con 0x55a0b81ecf70 2023-05-17T12:25:09.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa44e949b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b80fe790 con 0x55a0b81a3e80 2023-05-17T12:25:09.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81e97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48604/0 (socket says 172.21.15.88:48604) 2023-05-17T12:25:09.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa42bfff700 1 -- 172.21.15.88:0/1677930185 learned_addr learned my addr 172.21.15.88:0/1677930185 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:09.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa438d9b700 1 --2- 172.21.15.88:0/1677930185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81ecf70 0x55a0b81ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa43959c700 1 --2- 172.21.15.88:0/1677930185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81a3e80 0x55a0b81a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa42bfff700 1 -- 172.21.15.88:0/1677930185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81a3e80 msgr2=0x55a0b81a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1677930185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81a3e80 0x55a0b81a0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa42bfff700 1 -- 172.21.15.88:0/1677930185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81ecf70 msgr2=0x55a0b81ed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1677930185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81ecf70 0x55a0b81ed340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.100+0000 7fa42bfff700 1 -- 172.21.15.88:0/1677930185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0b7eeb790 con 0x55a0b81bc960 2023-05-17T12:25:09.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.101+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1677930185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81e97b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa424009c20 tx=0x7fa424009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3564a78f70d7980c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.101+0000 7fa41a7fc700 1 -- 172.21.15.88:0/1677930185 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424004300 con 0x55a0b81bc960 2023-05-17T12:25:09.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.101+0000 7fa41a7fc700 1 -- 172.21.15.88:0/1677930185 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424004460 con 0x55a0b81bc960 2023-05-17T12:25:09.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.101+0000 7fa41a7fc700 1 -- 172.21.15.88:0/1677930185 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011b40 con 0x55a0b81bc960 2023-05-17T12:25:09.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 -- 172.21.15.88:0/1677930185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 msgr2=0x55a0b81e97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1677930185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81e97b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa424009c20 tx=0x7fa424009f30 comp rx=0 tx=0).stop 2023-05-17T12:25:09.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 -- 172.21.15.88:0/1677930185 shutdown_connections 2023-05-17T12:25:09.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1677930185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81a3e80 0x55a0b81a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1677930185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81ecf70 0x55a0b81ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1677930185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81e97b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 -- 172.21.15.88:0/1677930185 >> 172.21.15.88:0/1677930185 conn(0x55a0b819b480 msgr2=0x55a0b81eb900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:09.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 -- 172.21.15.88:0/1677930185 shutdown_connections 2023-05-17T12:25:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 -- 172.21.15.88:0/1677930185 wait complete. 2023-05-17T12:25:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.102+0000 7fa44e949b80 1 -- start start 2023-05-17T12:25:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.103+0000 7fa44e949b80 1 Processor -- start 2023-05-17T12:25:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81a3e80 0x55a0b81faa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81bc960 0x55a0b81bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 0x55a0b819f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa44e949b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b80f7a60 con 0x55a0b81a3e80 2023-05-17T12:25:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa44e949b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b8093ad0 con 0x55a0b81bc960 2023-05-17T12:25:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa44e949b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b8093770 con 0x55a0b81ecf70 2023-05-17T12:25:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa44e949b80 10 client.0 _ll_register_callbacks cb 0x55a0b80efa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T12:25:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa438d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81a3e80 0x55a0b81faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa438d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81a3e80 0x55a0b81faa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48616/0 (socket says 172.21.15.88:48616) 2023-05-17T12:25:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa438d9b700 1 -- 172.21.15.88:0/1553955415 learned_addr learned my addr 172.21.15.88:0/1553955415 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa43959c700 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 0x55a0b819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81bc960 0x55a0b81bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa438d9b700 1 -- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 msgr2=0x55a0b819f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa438d9b700 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 0x55a0b819f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa438d9b700 1 -- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81bc960 msgr2=0x55a0b81bb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa438d9b700 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81bc960 0x55a0b81bb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.104+0000 7fa438d9b700 1 -- 172.21.15.88:0/1553955415 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa424009820 con 0x55a0b81a3e80 2023-05-17T12:25:09.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa438d9b700 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81a3e80 0x55a0b81faa60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa430013000 tx=0x7fa4300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb27a9d3e57d55 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa4137fe700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-05-17T12:25:09.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa4137fe700 1 -- 172.21.15.88:0/1553955415 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430020070 con 0x55a0b81a3e80 2023-05-17T12:25:09.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa4137fe700 1 -- 172.21.15.88:0/1553955415 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa430003970 con 0x55a0b81a3e80 2023-05-17T12:25:09.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa44e949b80 1 -- 172.21.15.88:0/1553955415 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0b8198a90 con 0x55a0b81a3e80 2023-05-17T12:25:09.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa4137fe700 1 -- 172.21.15.88:0/1553955415 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa430003b30 con 0x55a0b81a3e80 2023-05-17T12:25:09.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa44e949b80 10 client.4461 fetch_fsmap learned FSMap version 7 2023-05-17T12:25:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa44e949b80 1 -- 172.21.15.88:0/1553955415 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a0b80be2e0 con 0x55a0b81a3e80 2023-05-17T12:25:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa4137fe700 1 -- 172.21.15.88:0/1553955415 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a0b8198a90 con 0x55a0b81a3e80 2023-05-17T12:25:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa4137fe700 1 -- 172.21.15.88:0/1553955415 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa430030070 con 0x55a0b81a3e80 2023-05-17T12:25:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa44e949b80 10 client.4461 fetch_fsmap finished waiting for FSMap version 7 2023-05-17T12:25:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa44e949b80 10 client.4461 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T12:25:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa44e949b80 20 client.4461 populate_metadata read hostname 'smithi088' 2023-05-17T12:25:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.105+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x55a0b81fea00 0x55a0b81fedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.106+0000 7fa44e949b80 4 client.4461 mds_command: new command op to 4314 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T12:25:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.106+0000 7fa44e949b80 1 -- 172.21.15.88:0/1553955415 --> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0b81754b0 con 0x55a0b81fea00 2023-05-17T12:25:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.106+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x55a0b81fea00 0x55a0b81fedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.107+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x55a0b81fea00 0x55a0b81fedd0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=220018f960cf4926 server_cookie=f42585f44668a2bf in_seq=0 out_seq=0 2023-05-17T12:25:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.107+0000 7fa4137fe700 10 client.4461 ms_handle_connect on v2:172.21.15.187:6835/1857408255 2023-05-17T12:25:09.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.107+0000 7fa4137fe700 1 -- 172.21.15.88:0/1553955415 <== mds.0 v2:172.21.15.187:6835/1857408255 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a0b81754b0 con 0x55a0b81fea00 2023-05-17T12:25:09.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.107+0000 7fa4137fe700 10 client.4461 handle_command_reply: tid=0 2023-05-17T12:25:09.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.107+0000 7fa44e949b80 1 client.4461 shutdown 2023-05-17T12:25:09.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 -- 172.21.15.88:0/1553955415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81a3e80 msgr2=0x55a0b81faa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81a3e80 0x55a0b81faa60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa430013000 tx=0x7fa4300047c0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 -- 172.21.15.88:0/1553955415 shutdown_connections 2023-05-17T12:25:09.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 0x55a0b819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81a3e80 0x55a0b81faa60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x55a0b81fea00 0x55a0b81fedd0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1553955415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81bc960 0x55a0b81bb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa4137fe700 0 client.4461 ms_handle_reset on v2:172.21.15.187:6835/1857408255 2023-05-17T12:25:09.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 -- 172.21.15.88:0/1553955415 >> 172.21.15.88:0/1553955415 conn(0x55a0b819b480 msgr2=0x55a0b81ed340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:09.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 -- 172.21.15.88:0/1553955415 shutdown_connections 2023-05-17T12:25:09.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 1 -- 172.21.15.88:0/1553955415 wait complete. 2023-05-17T12:25:09.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.108+0000 7fa44e949b80 20 client.4461 trim_cache size 0 max 16384 2023-05-17T12:25:09.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.126+0000 7fa44e949b80 1 Processor -- start 2023-05-17T12:25:09.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.126+0000 7fa44e949b80 1 -- start start 2023-05-17T12:25:09.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81a3e80 0x55a0b81eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81ecf70 0x55a0b81eb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa44e949b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b7eec390 con 0x55a0b81bc960 2023-05-17T12:25:09.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa44e949b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b820df50 con 0x55a0b81ecf70 2023-05-17T12:25:09.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa44e949b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b81e9420 con 0x55a0b81a3e80 2023-05-17T12:25:09.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ea2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48624/0 (socket says 172.21.15.88:48624) 2023-05-17T12:25:09.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa42bfff700 1 -- 172.21.15.88:0/1679032191 learned_addr learned my addr 172.21.15.88:0/1679032191 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:09.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa42bfff700 1 -- 172.21.15.88:0/1679032191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81a3e80 msgr2=0x55a0b81eacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1679032191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81a3e80 0x55a0b81eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa42bfff700 1 -- 172.21.15.88:0/1679032191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81ecf70 msgr2=0x55a0b81eb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1679032191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81ecf70 0x55a0b81eb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.127+0000 7fa42bfff700 1 -- 172.21.15.88:0/1679032191 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0b81cec70 con 0x55a0b81bc960 2023-05-17T12:25:09.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa42bfff700 1 --2- 172.21.15.88:0/1679032191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ea2d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa424018000 tx=0x7fa424016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa63ee2463d788e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa41affd700 1 -- 172.21.15.88:0/1679032191 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424025040 con 0x55a0b81bc960 2023-05-17T12:25:09.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa41affd700 1 -- 172.21.15.88:0/1679032191 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42402b5b0 con 0x55a0b81bc960 2023-05-17T12:25:09.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa41affd700 1 -- 172.21.15.88:0/1679032191 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42402bc00 con 0x55a0b81bc960 2023-05-17T12:25:09.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa44e949b80 1 -- 172.21.15.88:0/1679032191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 msgr2=0x55a0b81ea2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1679032191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ea2d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa424018000 tx=0x7fa424016000 comp rx=0 tx=0).stop 2023-05-17T12:25:09.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa44e949b80 1 -- 172.21.15.88:0/1679032191 shutdown_connections 2023-05-17T12:25:09.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1679032191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81ecf70 0x55a0b81eb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1679032191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81a3e80 0x55a0b81eacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa44e949b80 1 --2- 172.21.15.88:0/1679032191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ea2d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.128+0000 7fa44e949b80 1 -- 172.21.15.88:0/1679032191 >> 172.21.15.88:0/1679032191 conn(0x55a0b819b480 msgr2=0x55a0b81ec630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:09.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.129+0000 7fa44e949b80 1 -- 172.21.15.88:0/1679032191 shutdown_connections 2023-05-17T12:25:09.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.129+0000 7fa44e949b80 1 -- 172.21.15.88:0/1679032191 wait complete. 2023-05-17T12:25:09.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.129+0000 7fa44e949b80 1 -- start start 2023-05-17T12:25:09.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.129+0000 7fa44e949b80 1 Processor -- start 2023-05-17T12:25:09.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.130+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81a3e80 0x55a0b82531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.130+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ba080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.130+0000 7fa44e949b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 0x55a0b81d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.130+0000 7fa44e949b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b81ee330 con 0x55a0b81bc960 2023-05-17T12:25:09.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.130+0000 7fa44e949b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b81d1010 con 0x55a0b81a3e80 2023-05-17T12:25:09.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.130+0000 7fa44e949b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b81edb20 con 0x55a0b81ecf70 2023-05-17T12:25:09.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.130+0000 7fa44e949b80 10 client.0 _ll_register_callbacks cb 0x55a0b80efa60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T12:25:09.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.130+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ba080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48634/0 (socket says 172.21.15.88:48634) 2023-05-17T12:25:09.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa42bfff700 1 -- 172.21.15.88:0/3149135162 learned_addr learned my addr 172.21.15.88:0/3149135162 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:09.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa438d9b700 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81a3e80 0x55a0b82531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa43959c700 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 0x55a0b81d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa42bfff700 1 -- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 msgr2=0x55a0b81d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa42bfff700 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 0x55a0b81d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa42bfff700 1 -- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81a3e80 msgr2=0x55a0b82531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa42bfff700 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81a3e80 0x55a0b82531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa42bfff700 1 -- 172.21.15.88:0/3149135162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0b7eeb790 con 0x55a0b81bc960 2023-05-17T12:25:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa43959c700 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 0x55a0b81d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:09.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa42bfff700 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ba080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa42402e040 tx=0x7fa4240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea3f0005f3454c9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa4137fe700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-05-17T12:25:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa4137fe700 1 -- 172.21.15.88:0/3149135162 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424025040 con 0x55a0b81bc960 2023-05-17T12:25:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa4137fe700 1 -- 172.21.15.88:0/3149135162 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa42402bbc0 con 0x55a0b81bc960 2023-05-17T12:25:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.131+0000 7fa44e949b80 1 -- 172.21.15.88:0/3149135162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa424004460 con 0x55a0b81bc960 2023-05-17T12:25:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa4137fe700 1 -- 172.21.15.88:0/3149135162 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa42402bd80 con 0x55a0b81bc960 2023-05-17T12:25:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa44e949b80 10 client.4467 fetch_fsmap learned FSMap version 7 2023-05-17T12:25:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa44e949b80 1 -- 172.21.15.88:0/3149135162 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a0b7fd80a0 con 0x55a0b81bc960 2023-05-17T12:25:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa4137fe700 1 -- 172.21.15.88:0/3149135162 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424004460 con 0x55a0b81bc960 2023-05-17T12:25:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa4137fe700 1 -- 172.21.15.88:0/3149135162 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa424032070 con 0x55a0b81bc960 2023-05-17T12:25:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa44e949b80 10 client.4467 fetch_fsmap finished waiting for FSMap version 7 2023-05-17T12:25:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa44e949b80 10 client.4467 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T12:25:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa44e949b80 20 client.4467 populate_metadata read hostname 'smithi088' 2023-05-17T12:25:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa44e949b80 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x55a0b824c950 0x55a0b81a28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa44e949b80 4 client.4467 mds_command: new command op to 4314 tid=0[{"prefix": "status"}] 2023-05-17T12:25:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa44e949b80 1 -- 172.21.15.88:0/3149135162 --> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a0b80f0ba0 con 0x55a0b824c950 2023-05-17T12:25:09.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.132+0000 7fa438d9b700 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x55a0b824c950 0x55a0b81a28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.133+0000 7fa4137fe700 10 client.4467 ms_handle_connect on v2:172.21.15.187:6835/1857408255 2023-05-17T12:25:09.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.133+0000 7fa438d9b700 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x55a0b824c950 0x55a0b81a28c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c135b44054d92b3 server_cookie=680304b99c4bfd0e in_seq=0 out_seq=0 2023-05-17T12:25:09.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.133+0000 7fa4137fe700 1 -- 172.21.15.88:0/3149135162 <== mds.0 v2:172.21.15.187:6835/1857408255 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55a0b80f0ba0 con 0x55a0b824c950 2023-05-17T12:25:09.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.133+0000 7fa4137fe700 10 client.4467 handle_command_reply: tid=0 2023-05-17T12:25:09.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.133+0000 7fa44e949b80 1 client.4467 shutdown 2023-05-17T12:25:09.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.133+0000 7fa44e949b80 1 -- 172.21.15.88:0/3149135162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 msgr2=0x55a0b81ba080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ba080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa42402e040 tx=0x7fa4240047c0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 1 -- 172.21.15.88:0/3149135162 shutdown_connections 2023-05-17T12:25:09.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55a0b81ecf70 0x55a0b81d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x55a0b824c950 0x55a0b81a28c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a0b81a3e80 0x55a0b82531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 1 --2- 172.21.15.88:0/3149135162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55a0b81bc960 0x55a0b81ba080 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa42402e040 tx=0x7fa4240047c0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa4137fe700 0 client.4467 ms_handle_reset on v2:172.21.15.187:6835/1857408255 2023-05-17T12:25:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 1 -- 172.21.15.88:0/3149135162 >> 172.21.15.88:0/3149135162 conn(0x55a0b819b480 msgr2=0x55a0b81ea410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 1 -- 172.21.15.88:0/3149135162 shutdown_connections 2023-05-17T12:25:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 1 -- 172.21.15.88:0/3149135162 wait complete. 2023-05-17T12:25:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa44e949b80 20 client.4467 trim_cache size 0 max 16384 2023-05-17T12:25:09.147 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-05-17T12:25:09.147 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "5fe2c233-5aa8-47bb-8675-a47cef3664c7", 2023-05-17T12:25:09.147 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-05-17T12:25:09.147 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4314, 2023-05-17T12:25:09.147 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-05-17T12:25:09.147 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-05-17T12:25:09.148 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-05-17T12:25:09.148 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 7.3562748920000001, 2023-05-17T12:25:09.148 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 7, 2023-05-17T12:25:09.148 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 27, 2023-05-17T12:25:09.148 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 26, 2023-05-17T12:25:09.149 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 13.200985795999999 2023-05-17T12:25:09.149 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-05-17T12:25:09.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa43afff700 1 -- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa42006ace0 msgr2=0x7fa42006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa43afff700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa42006ace0 0x7fa42006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa430009c10 tx=0x7fa430008030 comp rx=0 tx=0).stop 2023-05-17T12:25:09.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa43afff700 1 -- 172.21.15.88:0/1866049961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa434160f90 msgr2=0x7fa434155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.134+0000 7fa43afff700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa434160f90 0x7fa434155a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa42c007e10 tx=0x7fa42c00d3b0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.135+0000 7fa43afff700 1 -- 172.21.15.88:0/1866049961 shutdown_connections 2023-05-17T12:25:09.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.135+0000 7fa43afff700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa42006ace0 0x7fa42006d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.135+0000 7fa43afff700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa434160f90 0x7fa434155a00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.135+0000 7fa43afff700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa43406ca50 0x7fa434153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.135+0000 7fa43afff700 1 --2- 172.21.15.88:0/1866049961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa43415ca90 0x7fa4341f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.135+0000 7fa43afff700 1 -- 172.21.15.88:0/1866049961 >> 172.21.15.88:0/1866049961 conn(0x7fa4340d3ed0 msgr2=0x7fa4340cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:09.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.135+0000 7fa43afff700 1 -- 172.21.15.88:0/1866049961 shutdown_connections 2023-05-17T12:25:09.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.135+0000 7fa43afff700 1 -- 172.21.15.88:0/1866049961 wait complete. 2023-05-17T12:25:09.154 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-17T12:25:09.155 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-17T12:25:09.156 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T12:25:09.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.341+0000 7f98d71ff700 1 Processor -- start 2023-05-17T12:25:09.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.341+0000 7f98d71ff700 1 -- start start 2023-05-17T12:25:09.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.342+0000 7f98d71ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98d006b0b0 0x7f98d006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.342+0000 7f98d71ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98d006c330 0x7f98d006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.342+0000 7f98d71ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d00cd6b0 con 0x7f98d015c840 2023-05-17T12:25:09.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98d71ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d00cdf50 con 0x7f98d006c330 2023-05-17T12:25:09.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98d71ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d006ccb0 con 0x7f98d006b0b0 2023-05-17T12:25:09.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98d4f9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f98d015c840 0x7f98d00cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41566/0 (socket says 172.21.15.88:41566) 2023-05-17T12:25:09.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98d4f9b700 1 -- 172.21.15.88:0/1605022571 learned_addr learned my addr 172.21.15.88:0/1605022571 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:09.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98d579c700 1 --2- 172.21.15.88:0/1605022571 >> v2:172.21.15.88:3300/0 conn(0x7f98d006c330 0x7f98d006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98cffff700 1 --2- 172.21.15.88:0/1605022571 >> v2:172.21.15.187:3300/0 conn(0x7f98d006b0b0 0x7f98d006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98cf7fe700 1 -- 172.21.15.88:0/1605022571 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314718212 0 0) 0x7f98d00cd6b0 con 0x7f98d015c840 2023-05-17T12:25:09.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98cf7fe700 1 -- 172.21.15.88:0/1605022571 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c00035b0 con 0x7f98d015c840 2023-05-17T12:25:09.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98d579c700 1 -- 172.21.15.88:0/1605022571 >> v2:172.21.15.187:3300/0 conn(0x7f98d006b0b0 msgr2=0x7f98d006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:09.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98d579c700 1 --2- 172.21.15.88:0/1605022571 >> v2:172.21.15.187:3300/0 conn(0x7f98d006b0b0 0x7f98d006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98d579c700 1 -- 172.21.15.88:0/1605022571 >> v1:172.21.15.88:6789/0 conn(0x7f98d015c840 legacy=0x7f98d00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.343+0000 7f98d579c700 1 -- 172.21.15.88:0/1605022571 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00b2460 con 0x7f98d006c330 2023-05-17T12:25:09.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98d579c700 1 --2- 172.21.15.88:0/1605022571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d006c330 0x7f98d006c770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f98d00cead0 tx=0x7f98c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afb6963f39d0d6c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98cf7fe700 1 -- 172.21.15.88:0/1605022571 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c800e070 con 0x7f98d006c330 2023-05-17T12:25:09.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98cf7fe700 1 -- 172.21.15.88:0/1605022571 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c800bb20 con 0x7f98d006c330 2023-05-17T12:25:09.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98cf7fe700 1 -- 172.21.15.88:0/1605022571 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8012430 con 0x7f98d006c330 2023-05-17T12:25:09.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98d71ff700 1 -- 172.21.15.88:0/1605022571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d006c330 msgr2=0x7f98d006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98d71ff700 1 --2- 172.21.15.88:0/1605022571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d006c330 0x7f98d006c770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f98d00cead0 tx=0x7f98c800b330 comp rx=0 tx=0).stop 2023-05-17T12:25:09.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98d71ff700 1 -- 172.21.15.88:0/1605022571 shutdown_connections 2023-05-17T12:25:09.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98d71ff700 1 --2- 172.21.15.88:0/1605022571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d006c330 0x7f98d006c770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98d71ff700 1 --2- 172.21.15.88:0/1605022571 >> v2:172.21.15.187:3300/0 conn(0x7f98d006b0b0 0x7f98d006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98d71ff700 1 -- 172.21.15.88:0/1605022571 >> 172.21.15.88:0/1605022571 conn(0x7f98d00d3060 msgr2=0x7f98d00d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:09.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98d71ff700 1 -- 172.21.15.88:0/1605022571 shutdown_connections 2023-05-17T12:25:09.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.344+0000 7f98d71ff700 1 -- 172.21.15.88:0/1605022571 wait complete. 2023-05-17T12:25:09.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.346+0000 7f98d71ff700 1 Processor -- start 2023-05-17T12:25:09.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.346+0000 7f98d71ff700 1 -- start start 2023-05-17T12:25:09.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98d71ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d006b0b0 0x7f98d01f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98d71ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d006c330 0x7f98d01f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98d71ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d015c840 0x7f98d015ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98d71ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d015c100 con 0x7f98d015c840 2023-05-17T12:25:09.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98d71ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d01f54a0 con 0x7f98d006c330 2023-05-17T12:25:09.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98d71ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d015f440 con 0x7f98d006b0b0 2023-05-17T12:25:09.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98d579c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d015c840 0x7f98d015ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98d579c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d015c840 0x7f98d015ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48648/0 (socket says 172.21.15.88:48648) 2023-05-17T12:25:09.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98cffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d006c330 0x7f98d01f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.347+0000 7f98d579c700 1 -- 172.21.15.88:0/2017010721 learned_addr learned my addr 172.21.15.88:0/2017010721 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:09.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98d4f9b700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d006b0b0 0x7f98d01f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98d579c700 1 -- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d006b0b0 msgr2=0x7f98d01f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98d579c700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d006b0b0 0x7f98d01f20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98d579c700 1 -- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d006c330 msgr2=0x7f98d01f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98d579c700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d006c330 0x7f98d01f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98d579c700 1 -- 172.21.15.88:0/2017010721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8009a70 con 0x7f98d015c840 2023-05-17T12:25:09.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98cffff700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d006c330 0x7f98d01f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:09.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98d579c700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d015c840 0x7f98d015ef00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98c8014040 tx=0x7f98c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98cd7fa700 1 -- 172.21.15.88:0/2017010721 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8012430 con 0x7f98d015c840 2023-05-17T12:25:09.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98cd7fa700 1 -- 172.21.15.88:0/2017010721 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8020070 con 0x7f98d015c840 2023-05-17T12:25:09.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d00cd900 con 0x7f98d015c840 2023-05-17T12:25:09.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.348+0000 7f98cd7fa700 1 -- 172.21.15.88:0/2017010721 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c80098f0 con 0x7f98d015c840 2023-05-17T12:25:09.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.349+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d00b2740 con 0x7f98d015c840 2023-05-17T12:25:09.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.350+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d00cdbe0 con 0x7f98d015c840 2023-05-17T12:25:09.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.350+0000 7f98cd7fa700 1 -- 172.21.15.88:0/2017010721 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98c8004040 con 0x7f98d015c840 2023-05-17T12:25:09.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.351+0000 7f98cd7fa700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f98b406ace0 0x7f98b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:09.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.352+0000 7f98cd7fa700 1 -- 172.21.15.88:0/2017010721 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f98c8022070 con 0x7f98d015c840 2023-05-17T12:25:09.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.352+0000 7f98d4f9b700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f98b406ace0 0x7f98b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:09.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.353+0000 7f98d4f9b700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f98b406ace0 0x7f98b406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f98c4007fd0 tx=0x7f98c4007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:09.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.356+0000 7f98cd7fa700 1 -- 172.21.15.88:0/2017010721 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f98c8059af0 con 0x7f98d015c840 2023-05-17T12:25:09.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.606+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f98d006ba20 con 0x7f98d015c840 2023-05-17T12:25:09.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.607+0000 7f98cd7fa700 1 -- 172.21.15.88:0/2017010721 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f98c8059680 con 0x7f98d015c840 2023-05-17T12:25:09.611 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-17T12:25:09.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f98b406ace0 msgr2=0x7f98b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f98b406ace0 0x7f98b406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f98c4007fd0 tx=0x7f98c4007dc0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d015c840 msgr2=0x7f98d015ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:09.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d015c840 0x7f98d015ef00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98c8014040 tx=0x7f98c8004ad0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 shutdown_connections 2023-05-17T12:25:09.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f98b406ace0 0x7f98b406d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98d015c840 0x7f98d015ef00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d006b0b0 0x7f98d01f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 --2- 172.21.15.88:0/2017010721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d006c330 0x7f98d01f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:09.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 >> 172.21.15.88:0/2017010721 conn(0x7f98d00d3060 msgr2=0x7f98d00b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:09.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.609+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 shutdown_connections 2023-05-17T12:25:09.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:09.610+0000 7f98d71ff700 1 -- 172.21.15.88:0/2017010721 wait complete. 2023-05-17T12:25:09.630 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-05-17T12:25:09.631 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T12:25:09.631 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-05-17T12:25:09.631 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-05-17T12:25:09.632 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-17T12:25:09.632 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-05-17T12:25:09.632 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T12:25:09.632 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T12:25:09.633 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-05-17T12:25:09.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:09.633 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-05-17T12:25:09.675 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:25:09.676 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:25:09.676 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:25:09.676 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:09.676 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-05-17T12:25:09.676 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:09.676 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:09.677 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:09.677 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-05-17T12:25:09.677 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:09.677 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:09.677 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-05-17T12:25:09.677 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:09.677 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:09.677 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T12:25:09.678 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:09.678 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-17T12:25:09.678 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42181sec preferred_lft 42181sec 2023-05-17T12:25:09.678 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-05-17T12:25:09.678 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:09.679 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-17T12:25:09.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:09.679 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:09.680 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:09.680 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-05-17T12:25:09.680 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-05-17T12:25:09.680 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-05-17T12:25:09.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-17T12:25:09.681 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:10.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:10.804 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T12:25:10.910 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-05-17T12:25:10.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:10.913 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-05-17T12:25:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-05-17T12:25:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T12:25:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-17T12:25:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-17T12:25:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T12:25:10.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:10.987 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:10.988 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:10.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-17T12:25:10.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-17T12:25:10.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-17T12:25:10.989 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:11.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:11.651 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-05-17T12:25:11.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:11.693 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-05-17T12:25:11.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:11.775 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:11.775 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:11.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-17T12:25:11.776 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-05-17T12:25:11.776 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:11.943 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-05-17T12:25:11.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:11.944 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:11.944 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:11.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-05-17T12:25:11.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-17T12:25:11.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-05-17T12:25:11.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-05-17T12:25:11.946 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-05-17T12:25:11.946 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:12.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:12.192 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:12.193 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:12.193 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-05-17T12:25:12.193 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-05-17T12:25:12.193 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:12.358 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-05-17T12:25:12.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:12.359 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-05-17T12:25:12.401 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-05-17T12:25:12.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:12.402 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-05-17T12:25:12.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-05-17T12:25:12.584 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:12.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:12.648 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:12.650 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:12.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:12.651 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-05-17T12:25:12.692 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-17T12:25:12.693 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-05-17T12:25:12.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-05-17T12:25:12.802 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:12.802 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:12.865 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:12.867 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:12.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:12.869 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-05-17T12:25:12.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:2023-05-17T12:25:12.921+0000 7f1ef8b795c0 -1 init, newargv = 0x558169936920 newargc=15 2023-05-17T12:25:12.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[140765]: starting ceph client 2023-05-17T12:25:12.935 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[140765]: starting fuse 2023-05-17T12:25:14.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-05-17T12:25:14.084 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:14.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:14.147 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:14.149 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:14.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:14.151 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-05-17T12:25:14.194 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-05-17T12:25:14.194 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-05-17T12:25:14.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T12:25:14.196 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-05-17T12:25:14.196 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-05-17T12:25:14.197 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-05-17T12:25:14.198 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-05-17T12:25:14.198 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:14.199 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-05-17T12:25:14.199 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-05-17T12:25:14.200 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-05-17T12:25:14.201 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-05-17T12:25:14.201 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:14.202 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-05-17T12:25:14.202 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-05-17T12:25:14.203 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-05-17T12:25:14.203 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-05-17T12:25:14.204 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:14.204 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-05-17T12:25:14.205 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T12:25:14.206 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T12:25:14.206 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T12:25:14.207 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-05-17T12:25:14.207 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-05-17T12:25:14.208 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-05-17T12:25:14.209 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T12:25:14.209 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:14.210 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.admin")) 2023-05-17T12:25:14.211 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-05-17T12:25:14.368 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.admin.140765.asok 2023-05-17T12:25:14.545 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.140765.asok 2023-05-17T12:25:14.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:14.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.140765.asok status 2023-05-17T12:25:14.758 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-05-17T12:25:14.759 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-05-17T12:25:14.759 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb", 2023-05-17T12:25:14.759 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev)", 2023-05-17T12:25:14.759 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "admin", 2023-05-17T12:25:14.759 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-05-17T12:25:14.759 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-05-17T12:25:14.760 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "140765", 2023-05-17T12:25:14.760 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-05-17T12:25:14.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:14.760 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-05-17T12:25:14.760 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-05-17T12:25:14.760 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4485, 2023-05-17T12:25:14.760 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-05-17T12:25:14.760 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-05-17T12:25:14.761 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-05-17T12:25:14.761 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4485 2023-05-17T12:25:14.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:14.761 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-05-17T12:25:14.761 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-05-17T12:25:14.761 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-05-17T12:25:14.761 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 794329413 2023-05-17T12:25:14.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:25:14.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:14.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-05-17T12:25:14.762 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-05-17T12:25:14.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-05-17T12:25:14.762 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 794329413 2023-05-17T12:25:14.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:14.762 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4485 192.168.0.1:0/794329413", 2023-05-17T12:25:14.763 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/794329413", 2023-05-17T12:25:14.763 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-05-17T12:25:14.763 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 7, 2023-05-17T12:25:14.763 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 27, 2023-05-17T12:25:14.763 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-05-17T12:25:14.763 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-05-17T12:25:14.763 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-05-17T12:25:14.763 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-05-17T12:25:14.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:14.772 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-05-17T12:25:14.772 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-05-17T12:25:14.814 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-05-17T12:25:14.814 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-05-17T12:25:14.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:14.815 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-05-17T12:25:14.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:14.942 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-05-17T12:25:15.059 INFO:teuthology.orchestra.run.smithi088.stdout:# file: . 2023-05-17T12:25:15.060 INFO:teuthology.orchestra.run.smithi088.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-05-17T12:25:15.060 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:15.061 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:25:15.061 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:25:15.108 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:15.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.334+0000 7f0d449ff700 1 Processor -- start 2023-05-17T12:25:15.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.334+0000 7f0d449ff700 1 -- start start 2023-05-17T12:25:15.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d449ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d400b89a0 0x7f0d4006af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d449ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0d4006c760 0x7f0d4006cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d449ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d400cf990 con 0x7f0d40160450 2023-05-17T12:25:15.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d449ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4006d110 con 0x7f0d4006c760 2023-05-17T12:25:15.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d449ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400d0c80 con 0x7f0d400b89a0 2023-05-17T12:25:15.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d3ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0d40160450 0x7f0d401608d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44496/0 (socket says 172.21.15.88:44496) 2023-05-17T12:25:15.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d3ed9d700 1 -- 172.21.15.88:0/643841805 learned_addr learned my addr 172.21.15.88:0/643841805 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:15.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d37fff700 1 --2- 172.21.15.88:0/643841805 >> v2:172.21.15.187:3300/0 conn(0x7f0d4006c760 0x7f0d4006cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d3e59c700 1 --2- 172.21.15.88:0/643841805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d400b89a0 0x7f0d4006af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d3dd9b700 1 -- 172.21.15.88:0/643841805 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322234629 0 0) 0x7f0d38001490 con 0x7f0d40160450 2023-05-17T12:25:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.336+0000 7f0d3dd9b700 1 -- 172.21.15.88:0/643841805 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d2c0035b0 con 0x7f0d40160450 2023-05-17T12:25:15.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d3e59c700 1 -- 172.21.15.88:0/643841805 >> v2:172.21.15.187:3300/0 conn(0x7f0d4006c760 msgr2=0x7f0d4006cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:15.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d3e59c700 1 --2- 172.21.15.88:0/643841805 >> v2:172.21.15.187:3300/0 conn(0x7f0d4006c760 0x7f0d4006cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d3dd9b700 1 -- 172.21.15.88:0/643841805 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2189008292 0 0) 0x7f0d2c0035b0 con 0x7f0d40160450 2023-05-17T12:25:15.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d3e59c700 1 -- 172.21.15.88:0/643841805 >> v1:172.21.15.88:6789/0 conn(0x7f0d40160450 legacy=0x7f0d401608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d3e59c700 1 -- 172.21.15.88:0/643841805 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4006b460 con 0x7f0d400b89a0 2023-05-17T12:25:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d37fff700 1 --2- 172.21.15.88:0/643841805 >> v2:172.21.15.187:3300/0 conn(0x7f0d4006c760 0x7f0d4006cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d3e59c700 1 --2- 172.21.15.88:0/643841805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d400b89a0 0x7f0d4006af20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009840 tx=0x7f0d30009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66850341b31f26d6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:15.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d3dd9b700 1 -- 172.21.15.88:0/643841805 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38001b80 con 0x7f0d400b89a0 2023-05-17T12:25:15.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d3dd9b700 1 -- 172.21.15.88:0/643841805 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d30004030 con 0x7f0d400b89a0 2023-05-17T12:25:15.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.337+0000 7f0d3dd9b700 1 -- 172.21.15.88:0/643841805 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300043c0 con 0x7f0d400b89a0 2023-05-17T12:25:15.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.338+0000 7f0d449ff700 1 -- 172.21.15.88:0/643841805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d400b89a0 msgr2=0x7f0d4006af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.338+0000 7f0d449ff700 1 --2- 172.21.15.88:0/643841805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d400b89a0 0x7f0d4006af20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009840 tx=0x7f0d30009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:15.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.338+0000 7f0d449ff700 1 -- 172.21.15.88:0/643841805 shutdown_connections 2023-05-17T12:25:15.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.338+0000 7f0d449ff700 1 --2- 172.21.15.88:0/643841805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d400b89a0 0x7f0d4006af20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.338+0000 7f0d449ff700 1 --2- 172.21.15.88:0/643841805 >> v2:172.21.15.187:3300/0 conn(0x7f0d4006c760 0x7f0d4006cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.338+0000 7f0d449ff700 1 -- 172.21.15.88:0/643841805 >> 172.21.15.88:0/643841805 conn(0x7f0d400d0790 msgr2=0x7f0d400d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:15.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.338+0000 7f0d449ff700 1 -- 172.21.15.88:0/643841805 shutdown_connections 2023-05-17T12:25:15.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.338+0000 7f0d449ff700 1 -- 172.21.15.88:0/643841805 wait complete. 2023-05-17T12:25:15.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.340+0000 7f0d449ff700 1 Processor -- start 2023-05-17T12:25:15.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.340+0000 7f0d449ff700 1 -- start start 2023-05-17T12:25:15.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d449ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d4006c760 0x7f0d401f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d449ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d400b89a0 0x7f0d4015e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d449ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d40160450 0x7f0d400d2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d449ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401f5c10 con 0x7f0d4006c760 2023-05-17T12:25:15.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d449ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4015e740 con 0x7f0d400b89a0 2023-05-17T12:25:15.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d449ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4015ef50 con 0x7f0d40160450 2023-05-17T12:25:15.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d3e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d4006c760 0x7f0d401f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d3e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d4006c760 0x7f0d401f56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56188/0 (socket says 172.21.15.88:56188) 2023-05-17T12:25:15.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d3e59c700 1 -- 172.21.15.88:0/2538353264 learned_addr learned my addr 172.21.15.88:0/2538353264 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d37fff700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d400b89a0 0x7f0d4015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d3ed9d700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d40160450 0x7f0d400d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d3e59c700 1 -- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d40160450 msgr2=0x7f0d400d2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d3e59c700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d40160450 0x7f0d400d2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d3e59c700 1 -- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d400b89a0 msgr2=0x7f0d4015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d3e59c700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d400b89a0 0x7f0d4015e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.341+0000 7f0d3e59c700 1 -- 172.21.15.88:0/2538353264 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d280094a0 con 0x7f0d4006c760 2023-05-17T12:25:15.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.342+0000 7f0d3e59c700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d4006c760 0x7f0d401f56d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000a010 tx=0x7f0d30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:15.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.342+0000 7f0d36ffd700 1 -- 172.21.15.88:0/2538353264 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30003ae0 con 0x7f0d4006c760 2023-05-17T12:25:15.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.342+0000 7f0d36ffd700 1 -- 172.21.15.88:0/2538353264 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3001f070 con 0x7f0d4006c760 2023-05-17T12:25:15.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.342+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d300094a0 con 0x7f0d4006c760 2023-05-17T12:25:15.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.342+0000 7f0d36ffd700 1 -- 172.21.15.88:0/2538353264 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30003ea0 con 0x7f0d4006c760 2023-05-17T12:25:15.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.342+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d400cd8a0 con 0x7f0d4006c760 2023-05-17T12:25:15.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.343+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d400cf6b0 con 0x7f0d4006c760 2023-05-17T12:25:15.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.344+0000 7f0d36ffd700 1 -- 172.21.15.88:0/2538353264 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d30021030 con 0x7f0d4006c760 2023-05-17T12:25:15.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.345+0000 7f0d36ffd700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0d2006ace0 0x7f0d2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.345+0000 7f0d36ffd700 1 -- 172.21.15.88:0/2538353264 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d3008a940 con 0x7f0d4006c760 2023-05-17T12:25:15.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.345+0000 7f0d37fff700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0d2006ace0 0x7f0d2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.346+0000 7f0d37fff700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0d2006ace0 0x7f0d2006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d4015abf0 tx=0x7f0d28009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:15.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.349+0000 7f0d36ffd700 1 -- 172.21.15.88:0/2538353264 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0d300556f0 con 0x7f0d4006c760 2023-05-17T12:25:15.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.543+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d400cdb80 con 0x7f0d4006c760 2023-05-17T12:25:15.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.544+0000 7f0d36ffd700 1 -- 172.21.15.88:0/2538353264 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f0d30058d10 con 0x7f0d4006c760 2023-05-17T12:25:15.548 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:15.549 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:15.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.546+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0d2006ace0 msgr2=0x7f0d2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.546+0000 7f0d449ff700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0d2006ace0 0x7f0d2006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d4015abf0 tx=0x7f0d28009210 comp rx=0 tx=0).stop 2023-05-17T12:25:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.546+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d4006c760 msgr2=0x7f0d401f56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.546+0000 7f0d449ff700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d4006c760 0x7f0d401f56d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000a010 tx=0x7f0d30004750 comp rx=0 tx=0).stop 2023-05-17T12:25:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.546+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 shutdown_connections 2023-05-17T12:25:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.547+0000 7f0d449ff700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0d2006ace0 0x7f0d2006d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.547+0000 7f0d449ff700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d40160450 0x7f0d400d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.547+0000 7f0d449ff700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d4006c760 0x7f0d401f56d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.547+0000 7f0d449ff700 1 --2- 172.21.15.88:0/2538353264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d400b89a0 0x7f0d4015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.547+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 >> 172.21.15.88:0/2538353264 conn(0x7f0d400d0790 msgr2=0x7f0d40160890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:15.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.547+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 shutdown_connections 2023-05-17T12:25:15.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.547+0000 7f0d449ff700 1 -- 172.21.15.88:0/2538353264 wait complete. 2023-05-17T12:25:15.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:25:15.570 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:25:15.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.754+0000 7f64d27ff700 1 Processor -- start 2023-05-17T12:25:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.754+0000 7f64d27ff700 1 -- start start 2023-05-17T12:25:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64d27ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f64cc0b23a0 0x7f64cc06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64d27ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 0x7f64cc160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64d27ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc06b4a0 con 0x7f64cc06c760 2023-05-17T12:25:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64d27ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc06a510 con 0x7f64cc0b23a0 2023-05-17T12:25:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64d27ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0cd840 con 0x7f64cc0cf190 2023-05-17T12:25:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64d0d9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 0x7f64cc160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64c3fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f64cc0b23a0 0x7f64cc06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64c3fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f64cc0b23a0 0x7f64cc06af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:57036/0 (socket says 172.21.15.88:57036) 2023-05-17T12:25:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64c3fff700 1 -- 172.21.15.88:0/3269315321 learned_addr learned my addr 172.21.15.88:0/3269315321 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.755+0000 7f64cbfff700 1 --1- 172.21.15.88:0/3269315321 >> v1:172.21.15.187:6789/0 conn(0x7f64cc06c760 0x7f64cc06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40450/0 (socket says 172.21.15.88:40450) 2023-05-17T12:25:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.756+0000 7f64c3fff700 1 -- 172.21.15.88:0/3269315321 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 msgr2=0x7f64cc160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.756+0000 7f64c3fff700 1 --2- 172.21.15.88:0/3269315321 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 0x7f64cc160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.756+0000 7f64c3fff700 1 -- 172.21.15.88:0/3269315321 >> v1:172.21.15.187:6789/0 conn(0x7f64cc06c760 legacy=0x7f64cc06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.756+0000 7f64c3fff700 1 -- 172.21.15.88:0/3269315321 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0cdb20 con 0x7f64cc0b23a0 2023-05-17T12:25:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.756+0000 7f64cb7fe700 1 -- 172.21.15.88:0/3269315321 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117288340 0 0) 0x7f64bc001110 con 0x7f64cc06c760 2023-05-17T12:25:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.756+0000 7f64c3fff700 1 --2- 172.21.15.88:0/3269315321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64cc0b23a0 0x7f64cc06af60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f64b40098f0 tx=0x7f64b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5894fd8bd8d14fee server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:15.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.756+0000 7f64cb7fe700 1 -- 172.21.15.88:0/3269315321 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4011830 con 0x7f64cc0b23a0 2023-05-17T12:25:15.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.756+0000 7f64cb7fe700 1 -- 172.21.15.88:0/3269315321 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4011990 con 0x7f64cc0b23a0 2023-05-17T12:25:15.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.756+0000 7f64cb7fe700 1 -- 172.21.15.88:0/3269315321 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4011d20 con 0x7f64cc0b23a0 2023-05-17T12:25:15.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.757+0000 7f64d27ff700 1 -- 172.21.15.88:0/3269315321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64cc0b23a0 msgr2=0x7f64cc06af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.757+0000 7f64d27ff700 1 --2- 172.21.15.88:0/3269315321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64cc0b23a0 0x7f64cc06af60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f64b40098f0 tx=0x7f64b4009c00 comp rx=0 tx=0).stop 2023-05-17T12:25:15.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.757+0000 7f64d27ff700 1 -- 172.21.15.88:0/3269315321 shutdown_connections 2023-05-17T12:25:15.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.757+0000 7f64d27ff700 1 --2- 172.21.15.88:0/3269315321 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 0x7f64cc160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.757+0000 7f64d27ff700 1 --2- 172.21.15.88:0/3269315321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64cc0b23a0 0x7f64cc06af60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.757+0000 7f64d27ff700 1 -- 172.21.15.88:0/3269315321 >> 172.21.15.88:0/3269315321 conn(0x7f64cc0d06f0 msgr2=0x7f64cc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:15.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.757+0000 7f64d27ff700 1 -- 172.21.15.88:0/3269315321 shutdown_connections 2023-05-17T12:25:15.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.757+0000 7f64d27ff700 1 -- 172.21.15.88:0/3269315321 wait complete. 2023-05-17T12:25:15.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.759+0000 7f64d27ff700 1 Processor -- start 2023-05-17T12:25:15.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.759+0000 7f64d27ff700 1 -- start start 2023-05-17T12:25:15.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64d27ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64cc06c760 0x7f64cc0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64d27ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 0x7f64cc0b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64d27ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64cc0d0d30 0x7f64cc1f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64d27ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0b2ef0 con 0x7f64cc06c760 2023-05-17T12:25:15.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64d27ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0b3120 con 0x7f64cc0d0d30 2023-05-17T12:25:15.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64d27ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0b3400 con 0x7f64cc0cf190 2023-05-17T12:25:15.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64cbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64cc06c760 0x7f64cc0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64cbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64cc06c760 0x7f64cc0c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56204/0 (socket says 172.21.15.88:56204) 2023-05-17T12:25:15.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64cbfff700 1 -- 172.21.15.88:0/2988606451 learned_addr learned my addr 172.21.15.88:0/2988606451 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:15.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64c3fff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 0x7f64cc0b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.760+0000 7f64d0d9c700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64cc0d0d30 0x7f64cc1f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64cbfff700 1 -- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 msgr2=0x7f64cc0b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64cbfff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 0x7f64cc0b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64cbfff700 1 -- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64cc0d0d30 msgr2=0x7f64cc1f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64cbfff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64cc0d0d30 0x7f64cc1f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64cbfff700 1 -- 172.21.15.88:0/2988606451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b4009550 con 0x7f64cc06c760 2023-05-17T12:25:15.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64cbfff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64cc06c760 0x7f64cc0c8860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c550 tx=0x7f64bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:15.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64c97fa700 1 -- 172.21.15.88:0/2988606451 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc004c80 con 0x7f64cc06c760 2023-05-17T12:25:15.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64c97fa700 1 -- 172.21.15.88:0/2988606451 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc004e00 con 0x7f64cc06c760 2023-05-17T12:25:15.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc06aa40 con 0x7f64cc06c760 2023-05-17T12:25:15.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64c97fa700 1 -- 172.21.15.88:0/2988606451 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc007310 con 0x7f64cc06c760 2023-05-17T12:25:15.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.761+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc06a760 con 0x7f64cc06c760 2023-05-17T12:25:15.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.762+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc15cb40 con 0x7f64cc06c760 2023-05-17T12:25:15.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.763+0000 7f64c97fa700 1 -- 172.21.15.88:0/2988606451 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64bc007470 con 0x7f64cc06c760 2023-05-17T12:25:15.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.765+0000 7f64c97fa700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f64ac06ace0 0x7f64ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:15.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.765+0000 7f64c97fa700 1 -- 172.21.15.88:0/2988606451 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f64bc0891a0 con 0x7f64cc06c760 2023-05-17T12:25:15.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.765+0000 7f64c3fff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f64ac06ace0 0x7f64ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:15.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.766+0000 7f64c3fff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f64ac06ace0 0x7f64ac06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009c40 tx=0x7f64b4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:15.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.769+0000 7f64c97fa700 1 -- 172.21.15.88:0/2988606451 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f64bc053f50 con 0x7f64cc06c760 2023-05-17T12:25:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.961+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64cc06b4a0 con 0x7f64cc06c760 2023-05-17T12:25:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.962+0000 7f64c97fa700 1 -- 172.21.15.88:0/2988606451 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64cc06b4a0 con 0x7f64cc06c760 2023-05-17T12:25:15.966 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:25:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f64ac06ace0 msgr2=0x7f64ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f64ac06ace0 0x7f64ac06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009c40 tx=0x7f64b4008030 comp rx=0 tx=0).stop 2023-05-17T12:25:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64cc06c760 msgr2=0x7f64cc0c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64cc06c760 0x7f64cc0c8860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c550 tx=0x7f64bc00c860 comp rx=0 tx=0).stop 2023-05-17T12:25:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 shutdown_connections 2023-05-17T12:25:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f64ac06ace0 0x7f64ac06d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64cc0d0d30 0x7f64cc1f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64cc06c760 0x7f64cc0c8860 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 --2- 172.21.15.88:0/2988606451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64cc0cf190 0x7f64cc0b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 >> 172.21.15.88:0/2988606451 conn(0x7f64cc0d06f0 msgr2=0x7f64cc0b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 shutdown_connections 2023-05-17T12:25:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:15.964+0000 7f64d27ff700 1 -- 172.21.15.88:0/2988606451 wait complete. 2023-05-17T12:25:15.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:25:16.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.166+0000 7f3a547ff700 1 Processor -- start 2023-05-17T12:25:16.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.167+0000 7f3a547ff700 1 -- start start 2023-05-17T12:25:16.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.168+0000 7f3a547ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3a4c0c99e0 0x7f3a4c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.168+0000 7f3a547ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c06a720 con 0x7f3a4c1421a0 2023-05-17T12:25:16.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a547ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c06aa00 con 0x7f3a4c0cd270 2023-05-17T12:25:16.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a547ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c06a510 con 0x7f3a4c0c99e0 2023-05-17T12:25:16.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a5259b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3a4c1421a0 0x7f3a4c06e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44504/0 (socket says 172.21.15.88:44504) 2023-05-17T12:25:16.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a5259b700 1 -- 172.21.15.88:0/4162190480 learned_addr learned my addr 172.21.15.88:0/4162190480 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:16.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51d9a700 1 --2- 172.21.15.88:0/4162190480 >> v2:172.21.15.187:3300/0 conn(0x7f3a4c0c99e0 0x7f3a4c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903716709 0 0) 0x7f3a4c06a720 con 0x7f3a4c1421a0 2023-05-17T12:25:16.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a380046c0 con 0x7f3a4c1421a0 2023-05-17T12:25:16.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2380066993 0 0) 0x7f3a380046c0 con 0x7f3a4c1421a0 2023-05-17T12:25:16.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 >> v2:172.21.15.187:3300/0 conn(0x7f3a4c0c99e0 msgr2=0x7f3a4c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 --2- 172.21.15.88:0/4162190480 >> v2:172.21.15.187:3300/0 conn(0x7f3a4c0c99e0 0x7f3a4c0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 >> v1:172.21.15.187:6789/0 conn(0x7f3a4c0cd270 legacy=0x7f3a4c0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c06ace0 con 0x7f3a4c1421a0 2023-05-17T12:25:16.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f3a48001670 con 0x7f3a4c1421a0 2023-05-17T12:25:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 >> v1:172.21.15.88:6789/0 conn(0x7f3a4c1421a0 legacy=0x7f3a4c06e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.169+0000 7f3a51599700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a38004b10 0x7f3a38004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a51599700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a38005960 0x7f3a38005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a51599700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38006310 0x7f3a380034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c06a510 con 0x7f3a38006310 2023-05-17T12:25:16.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38003c20 con 0x7f3a38004b10 2023-05-17T12:25:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a38003d90 con 0x7f3a38005960 2023-05-17T12:25:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a52d9c700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38006310 0x7f3a380034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a5259b700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a38004b10 0x7f3a38004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a51d9a700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a38005960 0x7f3a38005dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a52d9c700 1 -- 172.21.15.88:0/4162190480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a38005960 msgr2=0x7f3a38005dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a52d9c700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a38005960 0x7f3a38005dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a52d9c700 1 -- 172.21.15.88:0/4162190480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a38004b10 msgr2=0x7f3a38004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a52d9c700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a38004b10 0x7f3a38004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a52d9c700 1 -- 172.21.15.88:0/4162190480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a380046c0 con 0x7f3a38006310 2023-05-17T12:25:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a52d9c700 1 -- 172.21.15.88:0/4162190480 reap_dead start 2023-05-17T12:25:16.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.170+0000 7f3a52d9c700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38006310 0x7f3a380034d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400c190 tx=0x7f3a38006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2713677839cafdd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:16.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44001db0 con 0x7f3a38006310 2023-05-17T12:25:16.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400ccf0 con 0x7f3a38006310 2023-05-17T12:25:16.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a51599700 1 -- 172.21.15.88:0/4162190480 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44003c40 con 0x7f3a38006310 2023-05-17T12:25:16.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a547ff700 1 -- 172.21.15.88:0/4162190480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38006310 msgr2=0x7f3a380034d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a547ff700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38006310 0x7f3a380034d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400c190 tx=0x7f3a38006990 comp rx=0 tx=0).stop 2023-05-17T12:25:16.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a547ff700 1 -- 172.21.15.88:0/4162190480 shutdown_connections 2023-05-17T12:25:16.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a547ff700 1 --2- 172.21.15.88:0/4162190480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a38006310 0x7f3a380034d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a547ff700 1 -- 172.21.15.88:0/4162190480 >> 172.21.15.88:0/4162190480 conn(0x7f3a4c0cf970 msgr2=0x7f3a4c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:16.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a547ff700 1 -- 172.21.15.88:0/4162190480 shutdown_connections 2023-05-17T12:25:16.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.171+0000 7f3a547ff700 1 -- 172.21.15.88:0/4162190480 wait complete. 2023-05-17T12:25:16.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.173+0000 7f3a547ff700 1 Processor -- start 2023-05-17T12:25:16.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.173+0000 7f3a547ff700 1 -- start start 2023-05-17T12:25:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.174+0000 7f3a547ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a38006310 0x7f3a4c150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.174+0000 7f3a547ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a4c1407e0 0x7f3a4c140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.174+0000 7f3a547ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a4c151200 0x7f3a4c151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.174+0000 7f3a547ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c141190 con 0x7f3a4c151200 2023-05-17T12:25:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.174+0000 7f3a547ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c151fa0 con 0x7f3a4c1407e0 2023-05-17T12:25:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.174+0000 7f3a547ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c152280 con 0x7f3a38006310 2023-05-17T12:25:16.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.174+0000 7f3a52d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a4c151200 0x7f3a4c151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.174+0000 7f3a52d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a4c151200 0x7f3a4c151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56232/0 (socket says 172.21.15.88:56232) 2023-05-17T12:25:16.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.174+0000 7f3a52d9c700 1 -- 172.21.15.88:0/1615747277 learned_addr learned my addr 172.21.15.88:0/1615747277 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:16.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a5259b700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a38006310 0x7f3a4c150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a51d9a700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a4c1407e0 0x7f3a4c140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a52d9c700 1 -- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a38006310 msgr2=0x7f3a4c150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a52d9c700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a38006310 0x7f3a4c150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a52d9c700 1 -- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a4c1407e0 msgr2=0x7f3a4c140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a52d9c700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a4c1407e0 0x7f3a4c140c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a52d9c700 1 -- 172.21.15.88:0/1615747277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c142570 con 0x7f3a4c151200 2023-05-17T12:25:16.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a51d9a700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a4c1407e0 0x7f3a4c140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:16.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a52d9c700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a4c151200 0x7f3a4c151670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c06d420 tx=0x7f3a440014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:16.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a42ffd700 1 -- 172.21.15.88:0/1615747277 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44005070 con 0x7f3a4c151200 2023-05-17T12:25:16.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a42ffd700 1 -- 172.21.15.88:0/1615747277 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440051f0 con 0x7f3a4c151200 2023-05-17T12:25:16.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c06afc0 con 0x7f3a4c151200 2023-05-17T12:25:16.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a42ffd700 1 -- 172.21.15.88:0/1615747277 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a440055a0 con 0x7f3a4c151200 2023-05-17T12:25:16.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.175+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c142a50 con 0x7f3a4c151200 2023-05-17T12:25:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.177+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c074530 con 0x7f3a4c151200 2023-05-17T12:25:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.177+0000 7f3a42ffd700 1 -- 172.21.15.88:0/1615747277 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a44005700 con 0x7f3a4c151200 2023-05-17T12:25:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.178+0000 7f3a42ffd700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3a3006ace0 0x7f3a3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.179+0000 7f3a42ffd700 1 -- 172.21.15.88:0/1615747277 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3a4408a9b0 con 0x7f3a4c151200 2023-05-17T12:25:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.179+0000 7f3a5259b700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3a3006ace0 0x7f3a3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.180+0000 7f3a5259b700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3a3006ace0 0x7f3a3006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3a48001c90 tx=0x7f3a48001b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.183+0000 7f3a42ffd700 1 -- 172.21.15.88:0/1615747277 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3a44055800 con 0x7f3a4c151200 2023-05-17T12:25:16.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.374+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a4c06d6f0 con 0x7f3a4c151200 2023-05-17T12:25:16.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.375+0000 7f3a42ffd700 1 -- 172.21.15.88:0/1615747277 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a44058e20 con 0x7f3a4c151200 2023-05-17T12:25:16.379 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:25:16.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3a3006ace0 msgr2=0x7f3a3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3a3006ace0 0x7f3a3006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3a48001c90 tx=0x7f3a48001b20 comp rx=0 tx=0).stop 2023-05-17T12:25:16.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a4c151200 msgr2=0x7f3a4c151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a4c151200 0x7f3a4c151670 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c06d420 tx=0x7f3a440014a0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 shutdown_connections 2023-05-17T12:25:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3a3006ace0 0x7f3a3006d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a4c151200 0x7f3a4c151670 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a38006310 0x7f3a4c150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 --2- 172.21.15.88:0/1615747277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a4c1407e0 0x7f3a4c140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 >> 172.21.15.88:0/1615747277 conn(0x7f3a4c0cf970 msgr2=0x7f3a4c13ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 shutdown_connections 2023-05-17T12:25:16.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.377+0000 7f3a547ff700 1 -- 172.21.15.88:0/1615747277 wait complete. 2023-05-17T12:25:16.398 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:25:16.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.581+0000 7fae353ff700 1 Processor -- start 2023-05-17T12:25:16.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.581+0000 7fae353ff700 1 -- start start 2023-05-17T12:25:16.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae353ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae3006c760 0x7fae3006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae353ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae300cf190 0x7fae30160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae353ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3006b4a0 con 0x7fae300b23a0 2023-05-17T12:25:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae353ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3006a510 con 0x7fae300cf190 2023-05-17T12:25:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae353ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300cd840 con 0x7fae3006c760 2023-05-17T12:25:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae2f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae300cf190 0x7fae30160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae2f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae300cf190 0x7fae30160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56242/0 (socket says 172.21.15.88:56242) 2023-05-17T12:25:16.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae2f7fe700 1 -- 172.21.15.88:0/3950067770 learned_addr learned my addr 172.21.15.88:0/3950067770 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:16.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae2effd700 1 --2- 172.21.15.88:0/3950067770 >> v2:172.21.15.187:3300/0 conn(0x7fae3006c760 0x7fae3006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae2f7fe700 1 -- 172.21.15.88:0/3950067770 >> v2:172.21.15.187:3300/0 conn(0x7fae3006c760 msgr2=0x7fae3006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae2f7fe700 1 --2- 172.21.15.88:0/3950067770 >> v2:172.21.15.187:3300/0 conn(0x7fae3006c760 0x7fae3006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae2f7fe700 1 -- 172.21.15.88:0/3950067770 >> v1:172.21.15.187:6789/0 conn(0x7fae300b23a0 legacy=0x7fae3006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.583+0000 7fae2f7fe700 1 -- 172.21.15.88:0/3950067770 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300cdb20 con 0x7fae300cf190 2023-05-17T12:25:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae2f7fe700 1 --2- 172.21.15.88:0/3950067770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cf190 0x7fae30160380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae300d3a80 tx=0x7fae2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70c537bb84c6564 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae2e7fc700 1 -- 172.21.15.88:0/3950067770 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800e070 con 0x7fae300cf190 2023-05-17T12:25:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae2e7fc700 1 -- 172.21.15.88:0/3950067770 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2800b9c0 con 0x7fae300cf190 2023-05-17T12:25:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae2e7fc700 1 -- 172.21.15.88:0/3950067770 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800bd70 con 0x7fae300cf190 2023-05-17T12:25:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae353ff700 1 -- 172.21.15.88:0/3950067770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cf190 msgr2=0x7fae30160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae353ff700 1 --2- 172.21.15.88:0/3950067770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cf190 0x7fae30160380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fae300d3a80 tx=0x7fae2800b330 comp rx=0 tx=0).stop 2023-05-17T12:25:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae353ff700 1 -- 172.21.15.88:0/3950067770 shutdown_connections 2023-05-17T12:25:16.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae353ff700 1 --2- 172.21.15.88:0/3950067770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cf190 0x7fae30160380 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae353ff700 1 --2- 172.21.15.88:0/3950067770 >> v2:172.21.15.187:3300/0 conn(0x7fae3006c760 0x7fae3006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.584+0000 7fae353ff700 1 -- 172.21.15.88:0/3950067770 >> 172.21.15.88:0/3950067770 conn(0x7fae300d06f0 msgr2=0x7fae300d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:16.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.585+0000 7fae353ff700 1 -- 172.21.15.88:0/3950067770 shutdown_connections 2023-05-17T12:25:16.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.585+0000 7fae353ff700 1 -- 172.21.15.88:0/3950067770 wait complete. 2023-05-17T12:25:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.587+0000 7fae353ff700 1 Processor -- start 2023-05-17T12:25:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.587+0000 7fae353ff700 1 -- start start 2023-05-17T12:25:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.588+0000 7fae353ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3006c760 0x7fae30144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.588+0000 7fae353ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae300cf190 0x7fae301467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.588+0000 7fae353ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cc3d0 0x7fae300cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.588+0000 7fae353ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae300ccd80 con 0x7fae300cc3d0 2023-05-17T12:25:16.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.588+0000 7fae353ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae301454b0 con 0x7fae3006c760 2023-05-17T12:25:16.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.588+0000 7fae353ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae30145750 con 0x7fae300cf190 2023-05-17T12:25:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.588+0000 7fae2f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cc3d0 0x7fae300cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae2effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3006c760 0x7fae30144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae2f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cc3d0 0x7fae300cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56248/0 (socket says 172.21.15.88:56248) 2023-05-17T12:25:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae2f7fe700 1 -- 172.21.15.88:0/1522537071 learned_addr learned my addr 172.21.15.88:0/1522537071 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:16.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae27fff700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae300cf190 0x7fae301467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae2f7fe700 1 -- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae300cf190 msgr2=0x7fae301467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae2f7fe700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae300cf190 0x7fae301467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae2f7fe700 1 -- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3006c760 msgr2=0x7fae30144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae2f7fe700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3006c760 0x7fae30144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae2f7fe700 1 -- 172.21.15.88:0/1522537071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28009b30 con 0x7fae300cc3d0 2023-05-17T12:25:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae2f7fe700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cc3d0 0x7fae300cc840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae3006c6b0 tx=0x7fae28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:16.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae277fe700 1 -- 172.21.15.88:0/1522537071 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28004880 con 0x7fae300cc3d0 2023-05-17T12:25:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae277fe700 1 -- 172.21.15.88:0/1522537071 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280099b0 con 0x7fae300cc3d0 2023-05-17T12:25:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3006aa40 con 0x7fae300cc3d0 2023-05-17T12:25:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.589+0000 7fae277fe700 1 -- 172.21.15.88:0/1522537071 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2801b670 con 0x7fae300cc3d0 2023-05-17T12:25:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.590+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3006a760 con 0x7fae300cc3d0 2023-05-17T12:25:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.591+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3015cb40 con 0x7fae300cc3d0 2023-05-17T12:25:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.591+0000 7fae277fe700 1 -- 172.21.15.88:0/1522537071 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae2801b7d0 con 0x7fae300cc3d0 2023-05-17T12:25:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.592+0000 7fae277fe700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae1006ace0 0x7fae1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.592+0000 7fae277fe700 1 -- 172.21.15.88:0/1522537071 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fae2808af70 con 0x7fae300cc3d0 2023-05-17T12:25:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.593+0000 7fae2effd700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae1006ace0 0x7fae1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:16.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.593+0000 7fae2effd700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae1006ace0 0x7fae1006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae20006b20 tx=0x7fae20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:16.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.597+0000 7fae277fe700 1 -- 172.21.15.88:0/1522537071 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fae28055d20 con 0x7fae300cc3d0 2023-05-17T12:25:16.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.789+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae30074530 con 0x7fae300cc3d0 2023-05-17T12:25:16.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.789+0000 7fae277fe700 1 -- 172.21.15.88:0/1522537071 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae28059340 con 0x7fae300cc3d0 2023-05-17T12:25:16.793 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:25:16.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae1006ace0 msgr2=0x7fae1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae1006ace0 0x7fae1006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae20006b20 tx=0x7fae20008040 comp rx=0 tx=0).stop 2023-05-17T12:25:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cc3d0 msgr2=0x7fae300cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cc3d0 0x7fae300cc840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae3006c6b0 tx=0x7fae28004ad0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 shutdown_connections 2023-05-17T12:25:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae1006ace0 0x7fae1006d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae300cc3d0 0x7fae300cc840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae3006c760 0x7fae30144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 --2- 172.21.15.88:0/1522537071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae300cf190 0x7fae301467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 >> 172.21.15.88:0/1522537071 conn(0x7fae300d06f0 msgr2=0x7fae3006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 shutdown_connections 2023-05-17T12:25:16.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.792+0000 7fae353ff700 1 -- 172.21.15.88:0/1522537071 wait complete. 2023-05-17T12:25:16.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:25:16.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.996+0000 7fc9febff700 1 Processor -- start 2023-05-17T12:25:17.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.996+0000 7fc9febff700 1 -- start start 2023-05-17T12:25:17.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.997+0000 7fc9febff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9f80b23a0 0x7fc9f806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.997+0000 7fc9febff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc9f80cf190 0x7fc9f8160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.997+0000 7fc9febff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f806b4a0 con 0x7fc9f806c760 2023-05-17T12:25:17.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.997+0000 7fc9febff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f806a510 con 0x7fc9f80b23a0 2023-05-17T12:25:17.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.997+0000 7fc9febff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f80cd840 con 0x7fc9f80cf190 2023-05-17T12:25:17.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.997+0000 7fc9f7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9f80b23a0 0x7fc9f806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.997+0000 7fc9fc99b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc9f806c760 0x7fc9f806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44518/0 (socket says 172.21.15.88:44518) 2023-05-17T12:25:17.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.997+0000 7fc9fc99b700 1 -- 172.21.15.88:0/326942878 learned_addr learned my addr 172.21.15.88:0/326942878 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:17.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.997+0000 7fc9f7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9f80b23a0 0x7fc9f806af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56258/0 (socket says 172.21.15.88:56258) 2023-05-17T12:25:17.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9fd19c700 1 --2- 172.21.15.88:0/326942878 >> v2:172.21.15.187:3300/0 conn(0x7fc9f80cf190 0x7fc9f8160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9f77fe700 1 -- 172.21.15.88:0/326942878 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844396790 0 0) 0x7fc9ec001110 con 0x7fc9f806c760 2023-05-17T12:25:17.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9f7fff700 1 -- 172.21.15.88:0/326942878 >> v2:172.21.15.187:3300/0 conn(0x7fc9f80cf190 msgr2=0x7fc9f8160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:17.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9f7fff700 1 --2- 172.21.15.88:0/326942878 >> v2:172.21.15.187:3300/0 conn(0x7fc9f80cf190 0x7fc9f8160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9f7fff700 1 -- 172.21.15.88:0/326942878 >> v1:172.21.15.88:6789/0 conn(0x7fc9f806c760 legacy=0x7fc9f806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9f7fff700 1 -- 172.21.15.88:0/326942878 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f80cdb20 con 0x7fc9f80b23a0 2023-05-17T12:25:17.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9f7fff700 1 --2- 172.21.15.88:0/326942878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b23a0 0x7fc9f806af60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9f808c360 tx=0x7fc9e4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d7b9a9a260bdcb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:17.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9f77fe700 1 -- 172.21.15.88:0/326942878 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4011830 con 0x7fc9f80b23a0 2023-05-17T12:25:17.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9f77fe700 1 -- 172.21.15.88:0/326942878 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e4011990 con 0x7fc9f80b23a0 2023-05-17T12:25:17.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.998+0000 7fc9f77fe700 1 -- 172.21.15.88:0/326942878 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4011d20 con 0x7fc9f80b23a0 2023-05-17T12:25:17.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.999+0000 7fc9febff700 1 -- 172.21.15.88:0/326942878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b23a0 msgr2=0x7fc9f806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.999+0000 7fc9febff700 1 --2- 172.21.15.88:0/326942878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b23a0 0x7fc9f806af60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9f808c360 tx=0x7fc9e4009b20 comp rx=0 tx=0).stop 2023-05-17T12:25:17.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.999+0000 7fc9febff700 1 -- 172.21.15.88:0/326942878 shutdown_connections 2023-05-17T12:25:17.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.999+0000 7fc9febff700 1 --2- 172.21.15.88:0/326942878 >> v2:172.21.15.187:3300/0 conn(0x7fc9f80cf190 0x7fc9f8160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.999+0000 7fc9febff700 1 --2- 172.21.15.88:0/326942878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b23a0 0x7fc9f806af60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.999+0000 7fc9febff700 1 -- 172.21.15.88:0/326942878 >> 172.21.15.88:0/326942878 conn(0x7fc9f80d06f0 msgr2=0x7fc9f80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:17.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.999+0000 7fc9febff700 1 -- 172.21.15.88:0/326942878 shutdown_connections 2023-05-17T12:25:17.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:16.999+0000 7fc9febff700 1 -- 172.21.15.88:0/326942878 wait complete. 2023-05-17T12:25:17.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.001+0000 7fc9febff700 1 Processor -- start 2023-05-17T12:25:17.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.001+0000 7fc9febff700 1 -- start start 2023-05-17T12:25:17.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9febff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9f806c760 0x7fc9f8152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9febff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9f80cf190 0x7fc9f80b8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9febff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b8590 0x7fc9f80cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9febff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f80b8a10 con 0x7fc9f80b8590 2023-05-17T12:25:17.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9febff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f80c8120 con 0x7fc9f80cf190 2023-05-17T12:25:17.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9febff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f80cab50 con 0x7fc9f806c760 2023-05-17T12:25:17.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9fd19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b8590 0x7fc9f80cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9fd19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b8590 0x7fc9f80cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56262/0 (socket says 172.21.15.88:56262) 2023-05-17T12:25:17.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9fd19c700 1 -- 172.21.15.88:0/1868554614 learned_addr learned my addr 172.21.15.88:0/1868554614 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:17.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9fc99b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9f806c760 0x7fc9f8152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9f7fff700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9f80cf190 0x7fc9f80b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9fd19c700 1 -- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9f806c760 msgr2=0x7fc9f8152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9fd19c700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9f806c760 0x7fc9f8152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9fd19c700 1 -- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9f80cf190 msgr2=0x7fc9f80b8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9fd19c700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9f80cf190 0x7fc9f80b8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.003+0000 7fc9fd19c700 1 -- 172.21.15.88:0/1868554614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e40094a0 con 0x7fc9f80b8590 2023-05-17T12:25:17.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.004+0000 7fc9fd19c700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b8590 0x7fc9f80cc570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0007e90 tx=0x7fc9f000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:17.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.004+0000 7fc9f57fa700 1 -- 172.21.15.88:0/1868554614 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f000ed30 con 0x7fc9f80b8590 2023-05-17T12:25:17.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.004+0000 7fc9f57fa700 1 -- 172.21.15.88:0/1868554614 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f000ee90 con 0x7fc9f80b8590 2023-05-17T12:25:17.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.004+0000 7fc9f57fa700 1 -- 172.21.15.88:0/1868554614 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0014660 con 0x7fc9f80b8590 2023-05-17T12:25:17.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.004+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f806aa40 con 0x7fc9f80b8590 2023-05-17T12:25:17.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.004+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f806a760 con 0x7fc9f80b8590 2023-05-17T12:25:17.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.005+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f815cb40 con 0x7fc9f80b8590 2023-05-17T12:25:17.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.006+0000 7fc9f57fa700 1 -- 172.21.15.88:0/1868554614 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9f00147c0 con 0x7fc9f80b8590 2023-05-17T12:25:17.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.007+0000 7fc9f57fa700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc9dc06ace0 0x7fc9dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.007+0000 7fc9f57fa700 1 -- 172.21.15.88:0/1868554614 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc9f0089ce0 con 0x7fc9f80b8590 2023-05-17T12:25:17.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.008+0000 7fc9fc99b700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc9dc06ace0 0x7fc9dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.008+0000 7fc9fc99b700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc9dc06ace0 0x7fc9dc06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec000f60 tx=0x7fc9ec007c20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:17.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.011+0000 7fc9f57fa700 1 -- 172.21.15.88:0/1868554614 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc9f0054be0 con 0x7fc9f80b8590 2023-05-17T12:25:17.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.203+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9f80cd4f0 con 0x7fc9f80b8590 2023-05-17T12:25:17.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.203+0000 7fc9f57fa700 1 -- 172.21.15.88:0/1868554614 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9f0058200 con 0x7fc9f80b8590 2023-05-17T12:25:17.208 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:25:17.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc9dc06ace0 msgr2=0x7fc9dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc9dc06ace0 0x7fc9dc06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec000f60 tx=0x7fc9ec007c20 comp rx=0 tx=0).stop 2023-05-17T12:25:17.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b8590 msgr2=0x7fc9f80cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b8590 0x7fc9f80cc570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0007e90 tx=0x7fc9f000e3c0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 shutdown_connections 2023-05-17T12:25:17.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc9dc06ace0 0x7fc9dc06d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f80b8590 0x7fc9f80cc570 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9f806c760 0x7fc9f8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 --2- 172.21.15.88:0/1868554614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9f80cf190 0x7fc9f80b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 >> 172.21.15.88:0/1868554614 conn(0x7fc9f80d06f0 msgr2=0x7fc9f815a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:17.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 shutdown_connections 2023-05-17T12:25:17.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.206+0000 7fc9febff700 1 -- 172.21.15.88:0/1868554614 wait complete. 2023-05-17T12:25:17.227 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:25:17.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.414+0000 7fd3fbdff700 1 Processor -- start 2023-05-17T12:25:17.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.414+0000 7fd3fbdff700 1 -- start start 2023-05-17T12:25:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.415+0000 7fd3fbdff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd3f406c760 0x7fd3f406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.415+0000 7fd3fbdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f40b23a0 0x7fd3f406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.415+0000 7fd3fbdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f406b4a0 con 0x7fd3f40cf190 2023-05-17T12:25:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.415+0000 7fd3fbdff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f406a510 con 0x7fd3f406c760 2023-05-17T12:25:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.415+0000 7fd3fbdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f406d070 con 0x7fd3f40b23a0 2023-05-17T12:25:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.415+0000 7fd3f9b9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd3f406c760 0x7fd3f406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.415+0000 7fd3f939a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f40b23a0 0x7fd3f406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.415+0000 7fd3f9b9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd3f406c760 0x7fd3f406af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:57126/0 (socket says 172.21.15.88:57126) 2023-05-17T12:25:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.415+0000 7fd3f9b9b700 1 -- 172.21.15.88:0/3167971023 learned_addr learned my addr 172.21.15.88:0/3167971023 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.416+0000 7fd3f9b9b700 1 -- 172.21.15.88:0/3167971023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f40b23a0 msgr2=0x7fd3f406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.416+0000 7fd3f9b9b700 1 --2- 172.21.15.88:0/3167971023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f40b23a0 0x7fd3f406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.416+0000 7fd3f9b9b700 1 -- 172.21.15.88:0/3167971023 >> v1:172.21.15.187:6789/0 conn(0x7fd3f40cf190 legacy=0x7fd3f4160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.416+0000 7fd3f9b9b700 1 -- 172.21.15.88:0/3167971023 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f40cd840 con 0x7fd3f406c760 2023-05-17T12:25:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.416+0000 7fd3f9b9b700 1 --2- 172.21.15.88:0/3167971023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3f406c760 0x7fd3f406af60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098f0 tx=0x7fd3f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5087c9c54381bccb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.416+0000 7fd3f8b99700 1 -- 172.21.15.88:0/3167971023 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0011830 con 0x7fd3f406c760 2023-05-17T12:25:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.416+0000 7fd3f8b99700 1 -- 172.21.15.88:0/3167971023 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f0011990 con 0x7fd3f406c760 2023-05-17T12:25:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.417+0000 7fd3f8b99700 1 -- 172.21.15.88:0/3167971023 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0011d20 con 0x7fd3f406c760 2023-05-17T12:25:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.417+0000 7fd3fbdff700 1 -- 172.21.15.88:0/3167971023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3f406c760 msgr2=0x7fd3f406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.417+0000 7fd3fbdff700 1 --2- 172.21.15.88:0/3167971023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3f406c760 0x7fd3f406af60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098f0 tx=0x7fd3f0009c00 comp rx=0 tx=0).stop 2023-05-17T12:25:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.417+0000 7fd3fbdff700 1 -- 172.21.15.88:0/3167971023 shutdown_connections 2023-05-17T12:25:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.417+0000 7fd3fbdff700 1 --2- 172.21.15.88:0/3167971023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3f406c760 0x7fd3f406af60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.417+0000 7fd3fbdff700 1 --2- 172.21.15.88:0/3167971023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f40b23a0 0x7fd3f406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.417+0000 7fd3fbdff700 1 -- 172.21.15.88:0/3167971023 >> 172.21.15.88:0/3167971023 conn(0x7fd3f40d06f0 msgr2=0x7fd3f40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:17.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.417+0000 7fd3fbdff700 1 -- 172.21.15.88:0/3167971023 shutdown_connections 2023-05-17T12:25:17.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.417+0000 7fd3fbdff700 1 -- 172.21.15.88:0/3167971023 wait complete. 2023-05-17T12:25:17.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.419+0000 7fd3fbdff700 1 Processor -- start 2023-05-17T12:25:17.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.419+0000 7fd3fbdff700 1 -- start start 2023-05-17T12:25:17.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3fbdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f406c760 0x7fd3f41f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3fbdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3f40cf190 0x7fd3f41e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3fbdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3f40ca120 0x7fd3f40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3fbdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f415aa40 con 0x7fd3f40ca120 2023-05-17T12:25:17.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3fbdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f41e7800 con 0x7fd3f40cf190 2023-05-17T12:25:17.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3fbdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4147ce0 con 0x7fd3f406c760 2023-05-17T12:25:17.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3fa39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3f40ca120 0x7fd3f40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3fa39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3f40ca120 0x7fd3f40cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56274/0 (socket says 172.21.15.88:56274) 2023-05-17T12:25:17.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3fa39c700 1 -- 172.21.15.88:0/1108150379 learned_addr learned my addr 172.21.15.88:0/1108150379 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:17.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3f939a700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3f40cf190 0x7fd3f41e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.420+0000 7fd3f9b9b700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f406c760 0x7fd3f41f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3fa39c700 1 -- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f406c760 msgr2=0x7fd3f41f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3fa39c700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f406c760 0x7fd3f41f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3fa39c700 1 -- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3f40cf190 msgr2=0x7fd3f41e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3fa39c700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3f40cf190 0x7fd3f41e72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3fa39c700 1 -- 172.21.15.88:0/1108150379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0009550 con 0x7fd3f40ca120 2023-05-17T12:25:17.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3fa39c700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3f40ca120 0x7fd3f40cbc70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00cc80 tx=0x7fd3ec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:17.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3ea7fc700 1 -- 172.21.15.88:0/1108150379 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec003c00 con 0x7fd3f40ca120 2023-05-17T12:25:17.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3ea7fc700 1 -- 172.21.15.88:0/1108150379 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec003d60 con 0x7fd3f40ca120 2023-05-17T12:25:17.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3ea7fc700 1 -- 172.21.15.88:0/1108150379 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00aaa0 con 0x7fd3f40ca120 2023-05-17T12:25:17.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f406a760 con 0x7fd3f40ca120 2023-05-17T12:25:17.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.421+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f40cdb20 con 0x7fd3f40ca120 2023-05-17T12:25:17.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.422+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f406aa40 con 0x7fd3f40ca120 2023-05-17T12:25:17.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.423+0000 7fd3ea7fc700 1 -- 172.21.15.88:0/1108150379 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd3ec00ac00 con 0x7fd3f40ca120 2023-05-17T12:25:17.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.425+0000 7fd3ea7fc700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd3d806ace0 0x7fd3d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.425+0000 7fd3ea7fc700 1 -- 172.21.15.88:0/1108150379 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd3ec089520 con 0x7fd3f40ca120 2023-05-17T12:25:17.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.425+0000 7fd3f9b9b700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd3d806ace0 0x7fd3d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.426+0000 7fd3f9b9b700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd3d806ace0 0x7fd3d806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0014040 tx=0x7fd3f0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:17.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.429+0000 7fd3ea7fc700 1 -- 172.21.15.88:0/1108150379 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd3ec0542d0 con 0x7fd3f40ca120 2023-05-17T12:25:17.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.623+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd3f406b4a0 con 0x7fd3f40ca120 2023-05-17T12:25:17.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.623+0000 7fd3ea7fc700 1 -- 172.21.15.88:0/1108150379 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd3f406b4a0 con 0x7fd3f40ca120 2023-05-17T12:25:17.628 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:25:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd3d806ace0 msgr2=0x7fd3d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd3d806ace0 0x7fd3d806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0014040 tx=0x7fd3f0008030 comp rx=0 tx=0).stop 2023-05-17T12:25:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3f40ca120 msgr2=0x7fd3f40cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3f40ca120 0x7fd3f40cbc70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00cc80 tx=0x7fd3ec00cf90 comp rx=0 tx=0).stop 2023-05-17T12:25:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 shutdown_connections 2023-05-17T12:25:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd3d806ace0 0x7fd3d806d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3f40ca120 0x7fd3f40cbc70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3f406c760 0x7fd3f41f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 --2- 172.21.15.88:0/1108150379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3f40cf190 0x7fd3f41e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 >> 172.21.15.88:0/1108150379 conn(0x7fd3f40d06f0 msgr2=0x7fd3f40c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:17.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 shutdown_connections 2023-05-17T12:25:17.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.626+0000 7fd3fbdff700 1 -- 172.21.15.88:0/1108150379 wait complete. 2023-05-17T12:25:17.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:25:17.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.831+0000 7fb2109ff700 1 Processor -- start 2023-05-17T12:25:17.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.831+0000 7fb2109ff700 1 -- start start 2023-05-17T12:25:17.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.832+0000 7fb2109ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 0x7fb20c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.832+0000 7fb2109ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb20c160f90 0x7fb20c0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.832+0000 7fb2109ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c0cde90 con 0x7fb20c15ca90 2023-05-17T12:25:17.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.832+0000 7fb2109ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c15d270 con 0x7fb20c160f90 2023-05-17T12:25:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.832+0000 7fb2109ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15d550 con 0x7fb20c06cc20 2023-05-17T12:25:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.832+0000 7fb20a59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb20c15ca90 0x7fb20c06c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44532/0 (socket says 172.21.15.88:44532) 2023-05-17T12:25:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.832+0000 7fb20a59c700 1 -- 172.21.15.88:0/637434871 learned_addr learned my addr 172.21.15.88:0/637434871 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.832+0000 7fb20ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb20c160f90 0x7fb20c0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.832+0000 7fb209d9b700 1 --2- 172.21.15.88:0/637434871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 0x7fb20c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20959a700 1 -- 172.21.15.88:0/637434871 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705283232 0 0) 0x7fb20c0cde90 con 0x7fb20c15ca90 2023-05-17T12:25:17.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20959a700 1 -- 172.21.15.88:0/637434871 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1f40035b0 con 0x7fb20c15ca90 2023-05-17T12:25:17.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20ad9d700 1 -- 172.21.15.88:0/637434871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 msgr2=0x7fb20c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:17.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20ad9d700 1 --2- 172.21.15.88:0/637434871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 0x7fb20c0cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20ad9d700 1 -- 172.21.15.88:0/637434871 >> v1:172.21.15.88:6789/0 conn(0x7fb20c15ca90 legacy=0x7fb20c06c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20ad9d700 1 -- 172.21.15.88:0/637434871 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c15d830 con 0x7fb20c160f90 2023-05-17T12:25:17.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20ad9d700 1 --2- 172.21.15.88:0/637434871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 0x7fb20c0d0d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb204009d90 tx=0x7fb20400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cad429af344d76 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20959a700 1 -- 172.21.15.88:0/637434871 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400e070 con 0x7fb20c160f90 2023-05-17T12:25:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20959a700 1 -- 172.21.15.88:0/637434871 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20400bb20 con 0x7fb20c160f90 2023-05-17T12:25:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.833+0000 7fb20959a700 1 -- 172.21.15.88:0/637434871 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204012430 con 0x7fb20c160f90 2023-05-17T12:25:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.834+0000 7fb2109ff700 1 -- 172.21.15.88:0/637434871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 msgr2=0x7fb20c0d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.834+0000 7fb2109ff700 1 --2- 172.21.15.88:0/637434871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 0x7fb20c0d0d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb204009d90 tx=0x7fb20400b330 comp rx=0 tx=0).stop 2023-05-17T12:25:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.834+0000 7fb2109ff700 1 -- 172.21.15.88:0/637434871 shutdown_connections 2023-05-17T12:25:17.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.834+0000 7fb2109ff700 1 --2- 172.21.15.88:0/637434871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 0x7fb20c0d0d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.834+0000 7fb2109ff700 1 --2- 172.21.15.88:0/637434871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 0x7fb20c0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.834+0000 7fb2109ff700 1 -- 172.21.15.88:0/637434871 >> 172.21.15.88:0/637434871 conn(0x7fb20c0d3ed0 msgr2=0x7fb20c0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.834+0000 7fb2109ff700 1 -- 172.21.15.88:0/637434871 shutdown_connections 2023-05-17T12:25:17.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.834+0000 7fb2109ff700 1 -- 172.21.15.88:0/637434871 wait complete. 2023-05-17T12:25:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.835+0000 7fb2109ff700 1 Processor -- start 2023-05-17T12:25:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.836+0000 7fb2109ff700 1 -- start start 2023-05-17T12:25:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.836+0000 7fb2109ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 0x7fb20c0b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.836+0000 7fb2109ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb20c15ca90 0x7fb20c0c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb2109ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 0x7fb20c159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb2109ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c158ae0 con 0x7fb20c160f90 2023-05-17T12:25:17.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb2109ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c158dc0 con 0x7fb20c15ca90 2023-05-17T12:25:17.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb2109ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c1590a0 con 0x7fb20c06cc20 2023-05-17T12:25:17.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 0x7fb20c159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 0x7fb20c159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56292/0 (socket says 172.21.15.88:56292) 2023-05-17T12:25:17.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20ad9d700 1 -- 172.21.15.88:0/4134292761 learned_addr learned my addr 172.21.15.88:0/4134292761 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:17.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20a59c700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 0x7fb20c0b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb209d9b700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb20c15ca90 0x7fb20c0c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20ad9d700 1 -- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 msgr2=0x7fb20c0b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20ad9d700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 0x7fb20c0b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20ad9d700 1 -- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb20c15ca90 msgr2=0x7fb20c0c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20ad9d700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb20c15ca90 0x7fb20c0c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20ad9d700 1 -- 172.21.15.88:0/4134292761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204009a70 con 0x7fb20c160f90 2023-05-17T12:25:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.837+0000 7fb20ad9d700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 0x7fb20c159b80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb204014040 tx=0x7fb204004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.838+0000 7fb1faffd700 1 -- 172.21.15.88:0/4134292761 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204012430 con 0x7fb20c160f90 2023-05-17T12:25:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.838+0000 7fb1faffd700 1 -- 172.21.15.88:0/4134292761 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204020070 con 0x7fb20c160f90 2023-05-17T12:25:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.838+0000 7fb1faffd700 1 -- 172.21.15.88:0/4134292761 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204003ea0 con 0x7fb20c160f90 2023-05-17T12:25:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.838+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c15dd50 con 0x7fb20c160f90 2023-05-17T12:25:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.838+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c1613f0 con 0x7fb20c160f90 2023-05-17T12:25:17.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.839+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c15ce60 con 0x7fb20c160f90 2023-05-17T12:25:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.840+0000 7fb1faffd700 1 -- 172.21.15.88:0/4134292761 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb204004280 con 0x7fb20c160f90 2023-05-17T12:25:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.840+0000 7fb1faffd700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb1ec06ace0 0x7fb1ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.840+0000 7fb1faffd700 1 -- 172.21.15.88:0/4134292761 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb204022070 con 0x7fb20c160f90 2023-05-17T12:25:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.841+0000 7fb20a59c700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb1ec06ace0 0x7fb1ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.841+0000 7fb20a59c700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb1ec06ace0 0x7fb1ec06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0011e0 tx=0x7fb1fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:17.845+0000 7fb1faffd700 1 -- 172.21.15.88:0/4134292761 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb2040562c0 con 0x7fb20c160f90 2023-05-17T12:25:18.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.053+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb20c074530 con 0x7fb20c160f90 2023-05-17T12:25:18.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.053+0000 7fb1faffd700 1 -- 172.21.15.88:0/4134292761 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb2040598e0 con 0x7fb20c160f90 2023-05-17T12:25:18.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb1ec06ace0 msgr2=0x7fb1ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb1ec06ace0 0x7fb1ec06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0011e0 tx=0x7fb1fc009040 comp rx=0 tx=0).stop 2023-05-17T12:25:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 msgr2=0x7fb20c159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 0x7fb20c159b80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb204014040 tx=0x7fb204004ad0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 shutdown_connections 2023-05-17T12:25:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb1ec06ace0 0x7fb1ec06d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb20c160f90 0x7fb20c159b80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb20c06cc20 0x7fb20c0b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 --2- 172.21.15.88:0/4134292761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb20c15ca90 0x7fb20c0c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.055+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 >> 172.21.15.88:0/4134292761 conn(0x7fb20c0d3ed0 msgr2=0x7fb20c0d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.056+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 shutdown_connections 2023-05-17T12:25:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.056+0000 7fb2109ff700 1 -- 172.21.15.88:0/4134292761 wait complete. 2023-05-17T12:25:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:25:18.077 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:25:18.077 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:25:18.118 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:18.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.340+0000 7f80ac3ff700 1 Processor -- start 2023-05-17T12:25:18.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.340+0000 7f80ac3ff700 1 -- start start 2023-05-17T12:25:18.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.341+0000 7f80ac3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80a406b0b0 0x7f80a406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.341+0000 7f80ac3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f80a406c330 0x7f80a406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.341+0000 7f80ac3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a40cd6b0 con 0x7f80a415c840 2023-05-17T12:25:18.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.341+0000 7f80ac3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a40cdf50 con 0x7f80a406b0b0 2023-05-17T12:25:18.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.341+0000 7f80ac3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a406ccb0 con 0x7f80a406c330 2023-05-17T12:25:18.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.341+0000 7f80a999a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80a406b0b0 0x7f80a406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.341+0000 7f80aa19b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f80a415c840 0x7f80a40cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44542/0 (socket says 172.21.15.88:44542) 2023-05-17T12:25:18.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.341+0000 7f80aa19b700 1 -- 172.21.15.88:0/292163110 learned_addr learned my addr 172.21.15.88:0/292163110 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:18.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80aa99c700 1 --2- 172.21.15.88:0/292163110 >> v2:172.21.15.187:3300/0 conn(0x7f80a406c330 0x7f80a406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80a999a700 1 -- 172.21.15.88:0/292163110 >> v2:172.21.15.187:3300/0 conn(0x7f80a406c330 msgr2=0x7f80a406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80a999a700 1 --2- 172.21.15.88:0/292163110 >> v2:172.21.15.187:3300/0 conn(0x7f80a406c330 0x7f80a406c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80a999a700 1 -- 172.21.15.88:0/292163110 >> v1:172.21.15.88:6789/0 conn(0x7f80a415c840 legacy=0x7f80a40cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80a999a700 1 -- 172.21.15.88:0/292163110 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a40b2460 con 0x7f80a406b0b0 2023-05-17T12:25:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80aa99c700 1 --2- 172.21.15.88:0/292163110 >> v2:172.21.15.187:3300/0 conn(0x7f80a406c330 0x7f80a406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80a9199700 1 -- 172.21.15.88:0/292163110 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424875597 0 0) 0x7f80a40cd6b0 con 0x7f80a415c840 2023-05-17T12:25:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80a999a700 1 --2- 172.21.15.88:0/292163110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 0x7f80a406b940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f80a40d2220 tx=0x7f8094009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcf09b2afd0ddfa server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:18.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80a9199700 1 -- 172.21.15.88:0/292163110 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094011830 con 0x7f80a406b0b0 2023-05-17T12:25:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80a9199700 1 -- 172.21.15.88:0/292163110 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8094011990 con 0x7f80a406b0b0 2023-05-17T12:25:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.342+0000 7f80a9199700 1 -- 172.21.15.88:0/292163110 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094011d20 con 0x7f80a406b0b0 2023-05-17T12:25:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.343+0000 7f80ac3ff700 1 -- 172.21.15.88:0/292163110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 msgr2=0x7f80a406b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.343+0000 7f80ac3ff700 1 --2- 172.21.15.88:0/292163110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 0x7f80a406b940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f80a40d2220 tx=0x7f8094009b20 comp rx=0 tx=0).stop 2023-05-17T12:25:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.343+0000 7f80ac3ff700 1 -- 172.21.15.88:0/292163110 shutdown_connections 2023-05-17T12:25:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.343+0000 7f80ac3ff700 1 --2- 172.21.15.88:0/292163110 >> v2:172.21.15.187:3300/0 conn(0x7f80a406c330 0x7f80a406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.343+0000 7f80ac3ff700 1 --2- 172.21.15.88:0/292163110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 0x7f80a406b940 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.343+0000 7f80ac3ff700 1 -- 172.21.15.88:0/292163110 >> 172.21.15.88:0/292163110 conn(0x7f80a40d3060 msgr2=0x7f80a40d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:18.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.343+0000 7f80ac3ff700 1 -- 172.21.15.88:0/292163110 shutdown_connections 2023-05-17T12:25:18.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.343+0000 7f80ac3ff700 1 -- 172.21.15.88:0/292163110 wait complete. 2023-05-17T12:25:18.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.345+0000 7f80ac3ff700 1 Processor -- start 2023-05-17T12:25:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.345+0000 7f80ac3ff700 1 -- start start 2023-05-17T12:25:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80ac3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 0x7f80a40b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80ac3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a406c330 0x7f80a415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80ac3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a415c840 0x7f80a4157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80ac3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40b4bf0 con 0x7f80a406b0b0 2023-05-17T12:25:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80ac3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40b5550 con 0x7f80a415c840 2023-05-17T12:25:18.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80ac3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40b3f70 con 0x7f80a406c330 2023-05-17T12:25:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 0x7f80a40b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 0x7f80a40b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56314/0 (socket says 172.21.15.88:56314) 2023-05-17T12:25:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa19b700 1 -- 172.21.15.88:0/2238072566 learned_addr learned my addr 172.21.15.88:0/2238072566 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa99c700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a415c840 0x7f80a4157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80a999a700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a406c330 0x7f80a415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa19b700 1 -- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a406c330 msgr2=0x7f80a415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa19b700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a406c330 0x7f80a415aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa19b700 1 -- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a415c840 msgr2=0x7f80a4157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa19b700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a415c840 0x7f80a4157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa19b700 1 -- 172.21.15.88:0/2238072566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940094a0 con 0x7f80a406b0b0 2023-05-17T12:25:18.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80a999a700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a406c330 0x7f80a415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:18.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.346+0000 7f80aa99c700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a415c840 0x7f80a4157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:18.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.347+0000 7f80aa19b700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 0x7f80a40b5010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80a000c550 tx=0x7f80a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:18.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.347+0000 7f809affd700 1 -- 172.21.15.88:0/2238072566 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0004c80 con 0x7f80a406b0b0 2023-05-17T12:25:18.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.347+0000 7f809affd700 1 -- 172.21.15.88:0/2238072566 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a0004e00 con 0x7f80a406b0b0 2023-05-17T12:25:18.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.347+0000 7f809affd700 1 -- 172.21.15.88:0/2238072566 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0007310 con 0x7f80a406b0b0 2023-05-17T12:25:18.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.347+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a40cd900 con 0x7f80a406b0b0 2023-05-17T12:25:18.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.347+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a40b2740 con 0x7f80a406b0b0 2023-05-17T12:25:18.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.348+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a40cdbe0 con 0x7f80a406b0b0 2023-05-17T12:25:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.349+0000 7f809affd700 1 -- 172.21.15.88:0/2238072566 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80a0007470 con 0x7f80a406b0b0 2023-05-17T12:25:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.350+0000 7f809affd700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f808806ace0 0x7f808806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.350+0000 7f809affd700 1 -- 172.21.15.88:0/2238072566 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f80a00894c0 con 0x7f80a406b0b0 2023-05-17T12:25:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.350+0000 7f80a999a700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f808806ace0 0x7f808806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.351+0000 7f80a999a700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f808806ace0 0x7f808806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f80940090b0 tx=0x7f8094008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:18.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.354+0000 7f809affd700 1 -- 172.21.15.88:0/2238072566 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f80a0054270 con 0x7f80a406b0b0 2023-05-17T12:25:18.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.549+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80a40b4d30 con 0x7f80a406b0b0 2023-05-17T12:25:18.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.550+0000 7f809affd700 1 -- 172.21.15.88:0/2238072566 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f80a40b4d30 con 0x7f80a406b0b0 2023-05-17T12:25:18.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:18.554 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:18.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f808806ace0 msgr2=0x7f808806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f808806ace0 0x7f808806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f80940090b0 tx=0x7f8094008030 comp rx=0 tx=0).stop 2023-05-17T12:25:18.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 msgr2=0x7f80a40b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 0x7f80a40b5010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80a000c550 tx=0x7f80a000c910 comp rx=0 tx=0).stop 2023-05-17T12:25:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 shutdown_connections 2023-05-17T12:25:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f808806ace0 0x7f808806d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a415c840 0x7f80a4157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a406b0b0 0x7f80a40b5010 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 --2- 172.21.15.88:0/2238072566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a406c330 0x7f80a415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 >> 172.21.15.88:0/2238072566 conn(0x7f80a40d3060 msgr2=0x7f80a406a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 shutdown_connections 2023-05-17T12:25:18.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.552+0000 7f80ac3ff700 1 -- 172.21.15.88:0/2238072566 wait complete. 2023-05-17T12:25:18.573 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:25:18.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:25:18.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.757+0000 7f3df9dff700 1 Processor -- start 2023-05-17T12:25:18.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.757+0000 7f3df9dff700 1 -- start start 2023-05-17T12:25:18.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.758+0000 7f3df9dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3df40b23a0 0x7f3df406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.758+0000 7f3df9dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3df40cf190 0x7f3df4160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.758+0000 7f3df9dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df406b4a0 con 0x7f3df406c760 2023-05-17T12:25:18.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.758+0000 7f3df9dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df406a510 con 0x7f3df40b23a0 2023-05-17T12:25:18.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.758+0000 7f3df9dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df40cd840 con 0x7f3df40cf190 2023-05-17T12:25:18.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df2ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3df40b23a0 0x7f3df406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df2ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3df40b23a0 0x7f3df406af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56330/0 (socket says 172.21.15.88:56330) 2023-05-17T12:25:18.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df2ffd700 1 -- 172.21.15.88:0/4151114525 learned_addr learned my addr 172.21.15.88:0/4151114525 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:18.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df3fff700 1 --2- 172.21.15.88:0/4151114525 >> v2:172.21.15.187:3300/0 conn(0x7f3df40cf190 0x7f3df4160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df2ffd700 1 -- 172.21.15.88:0/4151114525 >> v2:172.21.15.187:3300/0 conn(0x7f3df40cf190 msgr2=0x7f3df4160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:18.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df2ffd700 1 --2- 172.21.15.88:0/4151114525 >> v2:172.21.15.187:3300/0 conn(0x7f3df40cf190 0x7f3df4160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df2ffd700 1 -- 172.21.15.88:0/4151114525 >> v1:172.21.15.187:6789/0 conn(0x7f3df406c760 legacy=0x7f3df406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:18.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df2ffd700 1 -- 172.21.15.88:0/4151114525 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df40cdb20 con 0x7f3df40b23a0 2023-05-17T12:25:18.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df2ffd700 1 --2- 172.21.15.88:0/4151114525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df40b23a0 0x7f3df406af60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3df408c360 tx=0x7f3de8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c5a7c28dfcc9d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:18.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.759+0000 7f3df27fc700 1 -- 172.21.15.88:0/4151114525 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8004230 con 0x7f3df40b23a0 2023-05-17T12:25:18.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df27fc700 1 -- 172.21.15.88:0/4151114525 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de8004390 con 0x7f3df40b23a0 2023-05-17T12:25:18.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df27fc700 1 -- 172.21.15.88:0/4151114525 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de80036a0 con 0x7f3df40b23a0 2023-05-17T12:25:18.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df9dff700 1 -- 172.21.15.88:0/4151114525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df40b23a0 msgr2=0x7f3df406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df9dff700 1 --2- 172.21.15.88:0/4151114525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df40b23a0 0x7f3df406af60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3df408c360 tx=0x7f3de8009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df9dff700 1 -- 172.21.15.88:0/4151114525 shutdown_connections 2023-05-17T12:25:18.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df9dff700 1 --2- 172.21.15.88:0/4151114525 >> v2:172.21.15.187:3300/0 conn(0x7f3df40cf190 0x7f3df4160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df9dff700 1 --2- 172.21.15.88:0/4151114525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df40b23a0 0x7f3df406af60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df9dff700 1 -- 172.21.15.88:0/4151114525 >> 172.21.15.88:0/4151114525 conn(0x7f3df40d06f0 msgr2=0x7f3df40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:18.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df9dff700 1 -- 172.21.15.88:0/4151114525 shutdown_connections 2023-05-17T12:25:18.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.760+0000 7f3df9dff700 1 -- 172.21.15.88:0/4151114525 wait complete. 2023-05-17T12:25:18.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.762+0000 7f3df9dff700 1 Processor -- start 2023-05-17T12:25:18.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.762+0000 7f3df9dff700 1 -- start start 2023-05-17T12:25:18.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df9dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df406c760 0x7f3df40b8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df9dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3df40cf190 0x7f3df4152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df9dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3df40cccf0 0x7f3df41e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df9dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40b8d50 con 0x7f3df406c760 2023-05-17T12:25:18.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df9dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4152bb0 con 0x7f3df40cccf0 2023-05-17T12:25:18.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df9dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df41e7340 con 0x7f3df40cf190 2023-05-17T12:25:18.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df406c760 0x7f3df40b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df406c760 0x7f3df40b8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56346/0 (socket says 172.21.15.88:56346) 2023-05-17T12:25:18.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df37fe700 1 -- 172.21.15.88:0/866812810 learned_addr learned my addr 172.21.15.88:0/866812810 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:18.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df3fff700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3df40cccf0 0x7f3df41e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df2ffd700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3df40cf190 0x7f3df4152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df37fe700 1 -- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3df40cf190 msgr2=0x7f3df4152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df37fe700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3df40cf190 0x7f3df4152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df37fe700 1 -- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3df40cccf0 msgr2=0x7f3df41e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df37fe700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3df40cccf0 0x7f3df41e83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.763+0000 7f3df37fe700 1 -- 172.21.15.88:0/866812810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8009550 con 0x7f3df406c760 2023-05-17T12:25:18.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.764+0000 7f3df37fe700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df406c760 0x7f3df40b8810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3de400c4d0 tx=0x7f3de400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.764+0000 7f3ddbfff700 1 -- 172.21.15.88:0/866812810 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4011790 con 0x7f3df406c760 2023-05-17T12:25:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.764+0000 7f3ddbfff700 1 -- 172.21.15.88:0/866812810 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de40118f0 con 0x7f3df406c760 2023-05-17T12:25:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.764+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df406aa40 con 0x7f3df406c760 2023-05-17T12:25:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.764+0000 7f3ddbfff700 1 -- 172.21.15.88:0/866812810 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4011ca0 con 0x7f3df406c760 2023-05-17T12:25:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.764+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df406a760 con 0x7f3df406c760 2023-05-17T12:25:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.765+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df415cb40 con 0x7f3df406c760 2023-05-17T12:25:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.766+0000 7f3ddbfff700 1 -- 172.21.15.88:0/866812810 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3de401c460 con 0x7f3df406c760 2023-05-17T12:25:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.767+0000 7f3ddbfff700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3de006ace0 0x7f3de006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.767+0000 7f3ddbfff700 1 -- 172.21.15.88:0/866812810 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3de40895c0 con 0x7f3df406c760 2023-05-17T12:25:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.767+0000 7f3df2ffd700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3de006ace0 0x7f3de006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.768+0000 7f3df2ffd700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3de006ace0 0x7f3de006d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009130 tx=0x7f3de8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.771+0000 7f3ddbfff700 1 -- 172.21.15.88:0/866812810 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3de4054370 con 0x7f3df406c760 2023-05-17T12:25:18.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.965+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3df4074530 con 0x7f3df406c760 2023-05-17T12:25:18.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.966+0000 7f3ddbfff700 1 -- 172.21.15.88:0/866812810 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3de4057990 con 0x7f3df406c760 2023-05-17T12:25:18.970 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:25:18.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3de006ace0 msgr2=0x7f3de006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3de006ace0 0x7f3de006d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009130 tx=0x7f3de8008030 comp rx=0 tx=0).stop 2023-05-17T12:25:18.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df406c760 msgr2=0x7f3df40b8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:18.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df406c760 0x7f3df40b8810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3de400c4d0 tx=0x7f3de400c890 comp rx=0 tx=0).stop 2023-05-17T12:25:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 shutdown_connections 2023-05-17T12:25:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3de006ace0 0x7f3de006d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3df40cccf0 0x7f3df41e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3df406c760 0x7f3df40b8810 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 --2- 172.21.15.88:0/866812810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3df40cf190 0x7f3df4152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 >> 172.21.15.88:0/866812810 conn(0x7f3df40d06f0 msgr2=0x7f3df40d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 shutdown_connections 2023-05-17T12:25:18.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:18.968+0000 7f3df9dff700 1 -- 172.21.15.88:0/866812810 wait complete. 2023-05-17T12:25:18.989 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:25:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.171+0000 7fbfebbff700 1 Processor -- start 2023-05-17T12:25:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.171+0000 7fbfebbff700 1 -- start start 2023-05-17T12:25:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.172+0000 7fbfebbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbfe4160550 0x7fbfe41609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.172+0000 7fbfebbff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe40d0fa0 con 0x7fbfe415c9f0 2023-05-17T12:25:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.172+0000 7fbfebbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe40cda60 con 0x7fbfe40d1a60 2023-05-17T12:25:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.172+0000 7fbfebbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe4160f10 con 0x7fbfe4160550 2023-05-17T12:25:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe919a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbfe4160550 0x7fbfe41609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe919a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbfe4160550 0x7fbfe41609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56358/0 (socket says 172.21.15.88:56358) 2023-05-17T12:25:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe999b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbfe415c9f0 0x7fbfe40d0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44554/0 (socket says 172.21.15.88:44554) 2023-05-17T12:25:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe919a700 1 -- 172.21.15.88:0/2628450205 learned_addr learned my addr 172.21.15.88:0/2628450205 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe919a700 1 -- 172.21.15.88:0/2628450205 >> v1:172.21.15.187:6789/0 conn(0x7fbfe40d1a60 legacy=0x7fbfe40d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe919a700 1 -- 172.21.15.88:0/2628450205 >> v1:172.21.15.88:6789/0 conn(0x7fbfe415c9f0 legacy=0x7fbfe40d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe919a700 1 -- 172.21.15.88:0/2628450205 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe40cdd40 con 0x7fbfe4160550 2023-05-17T12:25:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe8999700 1 -- 172.21.15.88:0/2628450205 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751677425 0 0) 0x7fbfe40d0fa0 con 0x7fbfe415c9f0 2023-05-17T12:25:19.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe919a700 1 --2- 172.21.15.88:0/2628450205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 0x7fbfe41609d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40098f0 tx=0x7fbfd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c043a58eb1491c65 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:19.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.173+0000 7fbfe8999700 1 -- 172.21.15.88:0/2628450205 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd400b8a0 con 0x7fbfe4160550 2023-05-17T12:25:19.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.174+0000 7fbfe8999700 1 -- 172.21.15.88:0/2628450205 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd400ba00 con 0x7fbfe4160550 2023-05-17T12:25:19.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.174+0000 7fbfe8999700 1 -- 172.21.15.88:0/2628450205 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd400bd90 con 0x7fbfe4160550 2023-05-17T12:25:19.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.174+0000 7fbfebbff700 1 -- 172.21.15.88:0/2628450205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 msgr2=0x7fbfe41609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.174+0000 7fbfebbff700 1 --2- 172.21.15.88:0/2628450205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 0x7fbfe41609d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40098f0 tx=0x7fbfd4009c00 comp rx=0 tx=0).stop 2023-05-17T12:25:19.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.174+0000 7fbfebbff700 1 -- 172.21.15.88:0/2628450205 shutdown_connections 2023-05-17T12:25:19.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.174+0000 7fbfebbff700 1 --2- 172.21.15.88:0/2628450205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 0x7fbfe41609d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.174+0000 7fbfebbff700 1 -- 172.21.15.88:0/2628450205 >> 172.21.15.88:0/2628450205 conn(0x7fbfe40d3d30 msgr2=0x7fbfe40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:19.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.174+0000 7fbfebbff700 1 -- 172.21.15.88:0/2628450205 shutdown_connections 2023-05-17T12:25:19.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.174+0000 7fbfebbff700 1 -- 172.21.15.88:0/2628450205 wait complete. 2023-05-17T12:25:19.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.176+0000 7fbfebbff700 1 Processor -- start 2023-05-17T12:25:19.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.177+0000 7fbfebbff700 1 -- start start 2023-05-17T12:25:19.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfebbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfe40d1a60 0x7fbfe4153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfebbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfe415c9f0 0x7fbfe40b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfebbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 0x7fbfe40c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfebbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40c7dd0 con 0x7fbfe4160550 2023-05-17T12:25:19.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfebbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40c80b0 con 0x7fbfe415c9f0 2023-05-17T12:25:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfebbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40c8390 con 0x7fbfe40d1a60 2023-05-17T12:25:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfea19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 0x7fbfe40c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfea19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 0x7fbfe40c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56368/0 (socket says 172.21.15.88:56368) 2023-05-17T12:25:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfea19c700 1 -- 172.21.15.88:0/1574940642 learned_addr learned my addr 172.21.15.88:0/1574940642 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfe999b700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfe40d1a60 0x7fbfe4153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.178+0000 7fbfe919a700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfe415c9f0 0x7fbfe40b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfea19c700 1 -- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfe40d1a60 msgr2=0x7fbfe4153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfea19c700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfe40d1a60 0x7fbfe4153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfea19c700 1 -- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfe415c9f0 msgr2=0x7fbfe40b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfea19c700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfe415c9f0 0x7fbfe40b85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfea19c700 1 -- 172.21.15.88:0/1574940642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009550 con 0x7fbfe4160550 2023-05-17T12:25:19.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfea19c700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 0x7fbfe40c8e70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00cc50 tx=0x7fbfdc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:19.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfda7fc700 1 -- 172.21.15.88:0/1574940642 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc003c00 con 0x7fbfe4160550 2023-05-17T12:25:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfda7fc700 1 -- 172.21.15.88:0/1574940642 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc003d60 con 0x7fbfe4160550 2023-05-17T12:25:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe40d1540 con 0x7fbfe4160550 2023-05-17T12:25:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfda7fc700 1 -- 172.21.15.88:0/1574940642 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00aab0 con 0x7fbfe4160550 2023-05-17T12:25:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.179+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe40d1260 con 0x7fbfe4160550 2023-05-17T12:25:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.180+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe415cdc0 con 0x7fbfe4160550 2023-05-17T12:25:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.181+0000 7fbfda7fc700 1 -- 172.21.15.88:0/1574940642 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbfdc00ac10 con 0x7fbfe4160550 2023-05-17T12:25:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.182+0000 7fbfda7fc700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbfc806ace0 0x7fbfc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.182+0000 7fbfda7fc700 1 -- 172.21.15.88:0/1574940642 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbfdc0897a0 con 0x7fbfe4160550 2023-05-17T12:25:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.183+0000 7fbfe999b700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbfc806ace0 0x7fbfc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.183+0000 7fbfe999b700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbfc806ace0 0x7fbfc806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0007b10 tx=0x7fbfe0007a60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:19.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.186+0000 7fbfda7fc700 1 -- 172.21.15.88:0/1574940642 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbfdc0544c0 con 0x7fbfe4160550 2023-05-17T12:25:19.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.381+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbfe4074530 con 0x7fbfe4160550 2023-05-17T12:25:19.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.381+0000 7fbfda7fc700 1 -- 172.21.15.88:0/1574940642 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbfdc057ae0 con 0x7fbfe4160550 2023-05-17T12:25:19.385 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:25:19.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbfc806ace0 msgr2=0x7fbfc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbfc806ace0 0x7fbfc806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0007b10 tx=0x7fbfe0007a60 comp rx=0 tx=0).stop 2023-05-17T12:25:19.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 msgr2=0x7fbfe40c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 0x7fbfe40c8e70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00cc50 tx=0x7fbfdc00cf60 comp rx=0 tx=0).stop 2023-05-17T12:25:19.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 shutdown_connections 2023-05-17T12:25:19.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbfc806ace0 0x7fbfc806d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbfe4160550 0x7fbfe40c8e70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfe40d1a60 0x7fbfe4153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 --2- 172.21.15.88:0/1574940642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfe415c9f0 0x7fbfe40b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 >> 172.21.15.88:0/1574940642 conn(0x7fbfe40d3d30 msgr2=0x7fbfe4159700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:19.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.383+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 shutdown_connections 2023-05-17T12:25:19.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.384+0000 7fbfebbff700 1 -- 172.21.15.88:0/1574940642 wait complete. 2023-05-17T12:25:19.405 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:25:19.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.589+0000 7f33f91ff700 1 Processor -- start 2023-05-17T12:25:19.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.590+0000 7f33f91ff700 1 -- start start 2023-05-17T12:25:19.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.591+0000 7f33f91ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33f406c760 0x7f33f406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.591+0000 7f33f91ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40cf190 0x7f33f4160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.591+0000 7f33f91ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f406b4a0 con 0x7f33f40b23a0 2023-05-17T12:25:19.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.591+0000 7f33f91ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f406a510 con 0x7f33f406c760 2023-05-17T12:25:19.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.591+0000 7f33f91ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40cd840 con 0x7f33f40cf190 2023-05-17T12:25:19.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.591+0000 7f33f2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33f406c760 0x7f33f406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.591+0000 7f33f2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f33f406c760 0x7f33f406af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56382/0 (socket says 172.21.15.88:56382) 2023-05-17T12:25:19.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.591+0000 7f33f2d9d700 1 -- 172.21.15.88:0/30689121 learned_addr learned my addr 172.21.15.88:0/30689121 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:19.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.591+0000 7f33f359e700 1 --2- 172.21.15.88:0/30689121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40cf190 0x7f33f4160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.592+0000 7f33f2d9d700 1 -- 172.21.15.88:0/30689121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40cf190 msgr2=0x7f33f4160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:19.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.592+0000 7f33f2d9d700 1 --2- 172.21.15.88:0/30689121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40cf190 0x7f33f4160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.592+0000 7f33f2d9d700 1 -- 172.21.15.88:0/30689121 >> v1:172.21.15.187:6789/0 conn(0x7f33f40b23a0 legacy=0x7f33f406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.592+0000 7f33f2d9d700 1 -- 172.21.15.88:0/30689121 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40cdb20 con 0x7f33f406c760 2023-05-17T12:25:19.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.592+0000 7f33f359e700 1 --2- 172.21.15.88:0/30689121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40cf190 0x7f33f4160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:19.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.592+0000 7f33f2d9d700 1 --2- 172.21.15.88:0/30689121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f406c760 0x7f33f406af60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f33e40098f0 tx=0x7f33e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f6f46d56776de2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:19.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.592+0000 7f33f259c700 1 -- 172.21.15.88:0/30689121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400b8a0 con 0x7f33f406c760 2023-05-17T12:25:19.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.592+0000 7f33f259c700 1 -- 172.21.15.88:0/30689121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e400ba00 con 0x7f33f406c760 2023-05-17T12:25:19.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.592+0000 7f33f259c700 1 -- 172.21.15.88:0/30689121 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400bd90 con 0x7f33f406c760 2023-05-17T12:25:19.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.593+0000 7f33f91ff700 1 -- 172.21.15.88:0/30689121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f406c760 msgr2=0x7f33f406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.593+0000 7f33f91ff700 1 --2- 172.21.15.88:0/30689121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f406c760 0x7f33f406af60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f33e40098f0 tx=0x7f33e4009c00 comp rx=0 tx=0).stop 2023-05-17T12:25:19.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.593+0000 7f33f91ff700 1 -- 172.21.15.88:0/30689121 shutdown_connections 2023-05-17T12:25:19.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.593+0000 7f33f91ff700 1 --2- 172.21.15.88:0/30689121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40cf190 0x7f33f4160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.593+0000 7f33f91ff700 1 --2- 172.21.15.88:0/30689121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f406c760 0x7f33f406af60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.593+0000 7f33f91ff700 1 -- 172.21.15.88:0/30689121 >> 172.21.15.88:0/30689121 conn(0x7f33f40d06f0 msgr2=0x7f33f40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:19.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.593+0000 7f33f91ff700 1 -- 172.21.15.88:0/30689121 shutdown_connections 2023-05-17T12:25:19.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.593+0000 7f33f91ff700 1 -- 172.21.15.88:0/30689121 wait complete. 2023-05-17T12:25:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.594+0000 7f33f91ff700 1 Processor -- start 2023-05-17T12:25:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.595+0000 7f33f91ff700 1 -- start start 2023-05-17T12:25:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.595+0000 7f33f91ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f406c760 0x7f33f41f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.595+0000 7f33f91ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f40cf190 0x7f33f40ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f91ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f415aaf0 0x7f33f415af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f91ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f415b4b0 con 0x7f33f415aaf0 2023-05-17T12:25:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f91ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f41457e0 con 0x7f33f40cf190 2023-05-17T12:25:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f91ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4145a30 con 0x7f33f406c760 2023-05-17T12:25:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f415aaf0 0x7f33f415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f415aaf0 0x7f33f415af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56392/0 (socket says 172.21.15.88:56392) 2023-05-17T12:25:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f359e700 1 -- 172.21.15.88:0/870766047 learned_addr learned my addr 172.21.15.88:0/870766047 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33ebfff700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f40cf190 0x7f33f40ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f2d9d700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f406c760 0x7f33f41f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f359e700 1 -- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f406c760 msgr2=0x7f33f41f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f359e700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f406c760 0x7f33f41f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f359e700 1 -- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f40cf190 msgr2=0x7f33f40ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f359e700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f40cf190 0x7f33f40ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f359e700 1 -- 172.21.15.88:0/870766047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4009550 con 0x7f33f415aaf0 2023-05-17T12:25:19.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.596+0000 7f33f359e700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f415aaf0 0x7f33f415af70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007ea0 tx=0x7f33ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:19.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.597+0000 7f33eb7fe700 1 -- 172.21.15.88:0/870766047 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00de70 con 0x7f33f415aaf0 2023-05-17T12:25:19.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.597+0000 7f33eb7fe700 1 -- 172.21.15.88:0/870766047 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec00f040 con 0x7f33f415aaf0 2023-05-17T12:25:19.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.597+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f406aa40 con 0x7f33f415aaf0 2023-05-17T12:25:19.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.597+0000 7f33eb7fe700 1 -- 172.21.15.88:0/870766047 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec003c60 con 0x7f33f415aaf0 2023-05-17T12:25:19.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.597+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f406a760 con 0x7f33f415aaf0 2023-05-17T12:25:19.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.598+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f415cb40 con 0x7f33f415aaf0 2023-05-17T12:25:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.599+0000 7f33eb7fe700 1 -- 172.21.15.88:0/870766047 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33ec004030 con 0x7f33f415aaf0 2023-05-17T12:25:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.599+0000 7f33eb7fe700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f33d406ace0 0x7f33d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.600+0000 7f33eb7fe700 1 -- 172.21.15.88:0/870766047 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f33ec089980 con 0x7f33f415aaf0 2023-05-17T12:25:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.600+0000 7f33f2d9d700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f33d406ace0 0x7f33d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.600+0000 7f33f2d9d700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f33d406ace0 0x7f33d406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009c40 tx=0x7f33e4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:19.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.604+0000 7f33eb7fe700 1 -- 172.21.15.88:0/870766047 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f33ec0546a0 con 0x7f33f415aaf0 2023-05-17T12:25:19.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.797+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33f4074530 con 0x7f33f415aaf0 2023-05-17T12:25:19.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.798+0000 7f33eb7fe700 1 -- 172.21.15.88:0/870766047 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33ec057cc0 con 0x7f33f415aaf0 2023-05-17T12:25:19.802 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:25:19.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f33d406ace0 msgr2=0x7f33d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f33d406ace0 0x7f33d406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009c40 tx=0x7f33e4008030 comp rx=0 tx=0).stop 2023-05-17T12:25:19.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f415aaf0 msgr2=0x7f33f415af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:19.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f415aaf0 0x7f33f415af70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007ea0 tx=0x7f33ec00d3b0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 shutdown_connections 2023-05-17T12:25:19.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f33d406ace0 0x7f33d406d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33f415aaf0 0x7f33f415af70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f406c760 0x7f33f41f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 --2- 172.21.15.88:0/870766047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f40cf190 0x7f33f40ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:19.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 >> 172.21.15.88:0/870766047 conn(0x7f33f40d06f0 msgr2=0x7f33f406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:19.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 shutdown_connections 2023-05-17T12:25:19.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:19.800+0000 7f33f91ff700 1 -- 172.21.15.88:0/870766047 wait complete. 2023-05-17T12:25:19.821 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:25:20.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.004+0000 7efe54dff700 1 Processor -- start 2023-05-17T12:25:20.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.005+0000 7efe54dff700 1 -- start start 2023-05-17T12:25:20.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe54dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe5006c760 0x7efe5006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe54dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efe500b23a0 0x7efe5006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe54dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5006b4a0 con 0x7efe500cf190 2023-05-17T12:25:20.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe54dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5006a510 con 0x7efe5006c760 2023-05-17T12:25:20.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe54dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5006d070 con 0x7efe500b23a0 2023-05-17T12:25:20.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe4e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe5006c760 0x7efe5006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe4e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efe5006c760 0x7efe5006af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56408/0 (socket says 172.21.15.88:56408) 2023-05-17T12:25:20.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe4e59c700 1 -- 172.21.15.88:0/1981855820 learned_addr learned my addr 172.21.15.88:0/1981855820 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:20.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe47fff700 1 --2- 172.21.15.88:0/1981855820 >> v2:172.21.15.187:3300/0 conn(0x7efe500b23a0 0x7efe5006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe4e59c700 1 -- 172.21.15.88:0/1981855820 >> v2:172.21.15.187:3300/0 conn(0x7efe500b23a0 msgr2=0x7efe5006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:20.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe4e59c700 1 --2- 172.21.15.88:0/1981855820 >> v2:172.21.15.187:3300/0 conn(0x7efe500b23a0 0x7efe5006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe4e59c700 1 -- 172.21.15.88:0/1981855820 >> v1:172.21.15.187:6789/0 conn(0x7efe500cf190 legacy=0x7efe50160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.006+0000 7efe4e59c700 1 -- 172.21.15.88:0/1981855820 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe500cd840 con 0x7efe5006c760 2023-05-17T12:25:20.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.007+0000 7efe4e59c700 1 --2- 172.21.15.88:0/1981855820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe5006c760 0x7efe5006af60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efe5006c540 tx=0x7efe40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea410db500d9308 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:20.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.007+0000 7efe4dd9b700 1 -- 172.21.15.88:0/1981855820 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40011830 con 0x7efe5006c760 2023-05-17T12:25:20.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.007+0000 7efe4dd9b700 1 -- 172.21.15.88:0/1981855820 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe40011990 con 0x7efe5006c760 2023-05-17T12:25:20.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.007+0000 7efe4dd9b700 1 -- 172.21.15.88:0/1981855820 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40011d20 con 0x7efe5006c760 2023-05-17T12:25:20.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.008+0000 7efe54dff700 1 -- 172.21.15.88:0/1981855820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe5006c760 msgr2=0x7efe5006af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.008+0000 7efe54dff700 1 --2- 172.21.15.88:0/1981855820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe5006c760 0x7efe5006af60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efe5006c540 tx=0x7efe40009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.008+0000 7efe54dff700 1 -- 172.21.15.88:0/1981855820 shutdown_connections 2023-05-17T12:25:20.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.008+0000 7efe54dff700 1 --2- 172.21.15.88:0/1981855820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe5006c760 0x7efe5006af60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.008+0000 7efe54dff700 1 --2- 172.21.15.88:0/1981855820 >> v2:172.21.15.187:3300/0 conn(0x7efe500b23a0 0x7efe5006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.008+0000 7efe54dff700 1 -- 172.21.15.88:0/1981855820 >> 172.21.15.88:0/1981855820 conn(0x7efe500d06f0 msgr2=0x7efe500d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:20.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.008+0000 7efe54dff700 1 -- 172.21.15.88:0/1981855820 shutdown_connections 2023-05-17T12:25:20.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.008+0000 7efe54dff700 1 -- 172.21.15.88:0/1981855820 wait complete. 2023-05-17T12:25:20.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.010+0000 7efe54dff700 1 Processor -- start 2023-05-17T12:25:20.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.010+0000 7efe54dff700 1 -- start start 2023-05-17T12:25:20.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.011+0000 7efe54dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe5006c760 0x7efe500cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.011+0000 7efe54dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500cf190 0x7efe500cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.011+0000 7efe54dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe500cc2d0 0x7efe50152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.011+0000 7efe54dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe500ccf50 con 0x7efe500cf190 2023-05-17T12:25:20.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.011+0000 7efe54dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe500c8960 con 0x7efe500cc2d0 2023-05-17T12:25:20.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.011+0000 7efe54dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe500ca250 con 0x7efe5006c760 2023-05-17T12:25:20.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe47fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500cf190 0x7efe500cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe47fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500cf190 0x7efe500cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56420/0 (socket says 172.21.15.88:56420) 2023-05-17T12:25:20.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe47fff700 1 -- 172.21.15.88:0/2417990403 learned_addr learned my addr 172.21.15.88:0/2417990403 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:20.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe4e59c700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe5006c760 0x7efe500cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe4ed9d700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe500cc2d0 0x7efe50152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe47fff700 1 -- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe5006c760 msgr2=0x7efe500cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe47fff700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe5006c760 0x7efe500cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe47fff700 1 -- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe500cc2d0 msgr2=0x7efe50152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe47fff700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe500cc2d0 0x7efe50152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe47fff700 1 -- 172.21.15.88:0/2417990403 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40009550 con 0x7efe500cf190 2023-05-17T12:25:20.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe4e59c700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe5006c760 0x7efe500cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:20.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe4ed9d700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe500cc2d0 0x7efe50152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:20.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe47fff700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500cf190 0x7efe500cbd90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e9b0 tx=0x7efe3800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:20.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.012+0000 7efe46ffd700 1 -- 172.21.15.88:0/2417990403 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38009710 con 0x7efe500cf190 2023-05-17T12:25:20.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.013+0000 7efe46ffd700 1 -- 172.21.15.88:0/2417990403 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3800c850 con 0x7efe500cf190 2023-05-17T12:25:20.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.013+0000 7efe46ffd700 1 -- 172.21.15.88:0/2417990403 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800cbc0 con 0x7efe500cf190 2023-05-17T12:25:20.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.013+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5006a760 con 0x7efe500cf190 2023-05-17T12:25:20.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.013+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe500cdb20 con 0x7efe500cf190 2023-05-17T12:25:20.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.014+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5006aa40 con 0x7efe500cf190 2023-05-17T12:25:20.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.015+0000 7efe46ffd700 1 -- 172.21.15.88:0/2417990403 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe3800cd20 con 0x7efe500cf190 2023-05-17T12:25:20.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.015+0000 7efe46ffd700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efe3006ace0 0x7efe3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.016+0000 7efe46ffd700 1 -- 172.21.15.88:0/2417990403 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efe380898f0 con 0x7efe500cf190 2023-05-17T12:25:20.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.016+0000 7efe4e59c700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efe3006ace0 0x7efe3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.016+0000 7efe4e59c700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efe3006ace0 0x7efe3006d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe40009c10 tx=0x7efe40008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:20.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.020+0000 7efe46ffd700 1 -- 172.21.15.88:0/2417990403 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efe38058130 con 0x7efe500cf190 2023-05-17T12:25:20.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.210+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe50074530 con 0x7efe500cf190 2023-05-17T12:25:20.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.211+0000 7efe46ffd700 1 -- 172.21.15.88:0/2417990403 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7efe38057cc0 con 0x7efe500cf190 2023-05-17T12:25:20.215 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:25:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efe3006ace0 msgr2=0x7efe3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efe3006ace0 0x7efe3006d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe40009c10 tx=0x7efe40008030 comp rx=0 tx=0).stop 2023-05-17T12:25:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500cf190 msgr2=0x7efe500cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500cf190 0x7efe500cbd90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e9b0 tx=0x7efe3800ed70 comp rx=0 tx=0).stop 2023-05-17T12:25:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 shutdown_connections 2023-05-17T12:25:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efe3006ace0 0x7efe3006d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe500cc2d0 0x7efe50152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe5006c760 0x7efe500cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 --2- 172.21.15.88:0/2417990403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe500cf190 0x7efe500cbd90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 >> 172.21.15.88:0/2417990403 conn(0x7efe500d06f0 msgr2=0x7efe500b62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:20.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 shutdown_connections 2023-05-17T12:25:20.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.213+0000 7efe54dff700 1 -- 172.21.15.88:0/2417990403 wait complete. 2023-05-17T12:25:20.234 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:25:20.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.420+0000 7f57e5dff700 1 Processor -- start 2023-05-17T12:25:20.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.420+0000 7f57e5dff700 1 -- start start 2023-05-17T12:25:20.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.422+0000 7f57e5dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f57e006af60 0x7f57e0160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.422+0000 7f57e5dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e006a510 con 0x7f57e00b23a0 2023-05-17T12:25:20.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.422+0000 7f57e5dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e00cf8a0 con 0x7f57e006c760 2023-05-17T12:25:20.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.422+0000 7f57e5dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e00cd840 con 0x7f57e006af60 2023-05-17T12:25:20.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.422+0000 7f57d7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f57e00b23a0 0x7f57e00cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44568/0 (socket says 172.21.15.88:44568) 2023-05-17T12:25:20.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.422+0000 7f57d7fff700 1 -- 172.21.15.88:0/2464756713 learned_addr learned my addr 172.21.15.88:0/2464756713 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:20.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.422+0000 7f57dffff700 1 --2- 172.21.15.88:0/2464756713 >> v2:172.21.15.187:3300/0 conn(0x7f57e006af60 0x7f57e0160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.422+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526682107 0 0) 0x7f57e006a510 con 0x7f57e00b23a0 2023-05-17T12:25:20.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.422+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57cc0035b0 con 0x7f57e00b23a0 2023-05-17T12:25:20.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3893585642 0 0) 0x7f57cc0035b0 con 0x7f57e00b23a0 2023-05-17T12:25:20.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 >> v2:172.21.15.187:3300/0 conn(0x7f57e006af60 msgr2=0x7f57e0160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:20.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 --2- 172.21.15.88:0/2464756713 >> v2:172.21.15.187:3300/0 conn(0x7f57e006af60 0x7f57e0160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 >> v1:172.21.15.187:6789/0 conn(0x7f57e006c760 legacy=0x7f57e006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00cdb20 con 0x7f57e00b23a0 2023-05-17T12:25:20.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f57c8001670 con 0x7f57e00b23a0 2023-05-17T12:25:20.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 >> v1:172.21.15.88:6789/0 conn(0x7f57e00b23a0 legacy=0x7f57e00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57cc003a00 0x7f57cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc004850 0x7f57cc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57cc005200 0x7f57cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00cd840 con 0x7f57cc004850 2023-05-17T12:25:20.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc00c060 con 0x7f57cc005200 2023-05-17T12:25:20.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc00c220 con 0x7f57cc003a00 2023-05-17T12:25:20.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57d7fff700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc004850 0x7f57cc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57df7fe700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57cc003a00 0x7f57cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57dffff700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57cc005200 0x7f57cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57d7fff700 1 -- 172.21.15.88:0/2464756713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57cc003a00 msgr2=0x7f57cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:20.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57d7fff700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57cc003a00 0x7f57cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57d7fff700 1 -- 172.21.15.88:0/2464756713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57cc005200 msgr2=0x7f57cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:20.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57d7fff700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57cc005200 0x7f57cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57d7fff700 1 -- 172.21.15.88:0/2464756713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0035b0 con 0x7f57cc004850 2023-05-17T12:25:20.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.423+0000 7f57dffff700 1 -- 172.21.15.88:0/2464756713 reap_dead start 2023-05-17T12:25:20.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.424+0000 7f57d7fff700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc004850 0x7f57cc004cc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c210 tx=0x7f57cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b46a05d267ba82a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:20.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.424+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8007b70 con 0x7f57cc004850 2023-05-17T12:25:20.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.424+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c800cd70 con 0x7f57cc004850 2023-05-17T12:25:20.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.424+0000 7f57deffd700 1 -- 172.21.15.88:0/2464756713 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8005ba0 con 0x7f57cc004850 2023-05-17T12:25:20.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.424+0000 7f57e5dff700 1 -- 172.21.15.88:0/2464756713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc004850 msgr2=0x7f57cc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.424+0000 7f57e5dff700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc004850 0x7f57cc004cc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c210 tx=0x7f57cc005880 comp rx=0 tx=0).stop 2023-05-17T12:25:20.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.424+0000 7f57e5dff700 1 -- 172.21.15.88:0/2464756713 shutdown_connections 2023-05-17T12:25:20.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.424+0000 7f57e5dff700 1 --2- 172.21.15.88:0/2464756713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57cc004850 0x7f57cc004cc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.424+0000 7f57e5dff700 1 -- 172.21.15.88:0/2464756713 >> 172.21.15.88:0/2464756713 conn(0x7f57e00d06f0 msgr2=0x7f57e00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:20.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.425+0000 7f57e5dff700 1 -- 172.21.15.88:0/2464756713 shutdown_connections 2023-05-17T12:25:20.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.425+0000 7f57e5dff700 1 -- 172.21.15.88:0/2464756713 wait complete. 2023-05-17T12:25:20.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.426+0000 7f57e5dff700 1 Processor -- start 2023-05-17T12:25:20.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.426+0000 7f57e5dff700 1 -- start start 2023-05-17T12:25:20.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.427+0000 7f57e5dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57cc004850 0x7f57e01f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.427+0000 7f57e5dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00b8840 0x7f57e01e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.427+0000 7f57e5dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e0150430 0x7f57e00b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.427+0000 7f57e5dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01e5060 con 0x7f57e00b8840 2023-05-17T12:25:20.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.427+0000 7f57e5dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01e5300 con 0x7f57e0150430 2023-05-17T12:25:20.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.427+0000 7f57e5dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01e55e0 con 0x7f57cc004850 2023-05-17T12:25:20.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.427+0000 7f57d7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00b8840 0x7f57e01e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.427+0000 7f57d7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00b8840 0x7f57e01e63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56444/0 (socket says 172.21.15.88:56444) 2023-05-17T12:25:20.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.427+0000 7f57d7fff700 1 -- 172.21.15.88:0/1508999871 learned_addr learned my addr 172.21.15.88:0/1508999871 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:20.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57dffff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e0150430 0x7f57e00b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57df7fe700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57cc004850 0x7f57e01f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57d7fff700 1 -- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57cc004850 msgr2=0x7f57e01f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57d7fff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57cc004850 0x7f57e01f2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57d7fff700 1 -- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e0150430 msgr2=0x7f57e00b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57d7fff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e0150430 0x7f57e00b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57d7fff700 1 -- 172.21.15.88:0/1508999871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e006aa40 con 0x7f57e00b8840 2023-05-17T12:25:20.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57d7fff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00b8840 0x7f57e01e63a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c800 tx=0x7f57c8001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:20.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57dcff9700 1 -- 172.21.15.88:0/1508999871 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8000ed0 con 0x7f57e00b8840 2023-05-17T12:25:20.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57dcff9700 1 -- 172.21.15.88:0/1508999871 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c80070d0 con 0x7f57e00b8840 2023-05-17T12:25:20.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57dcff9700 1 -- 172.21.15.88:0/1508999871 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8007480 con 0x7f57e00b8840 2023-05-17T12:25:20.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e006a760 con 0x7f57e00b8840 2023-05-17T12:25:20.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.428+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e015cb40 con 0x7f57e00b8840 2023-05-17T12:25:20.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.429+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e00d3760 con 0x7f57e00b8840 2023-05-17T12:25:20.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.430+0000 7f57dcff9700 1 -- 172.21.15.88:0/1508999871 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f57c80075e0 con 0x7f57e00b8840 2023-05-17T12:25:20.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.431+0000 7f57dcff9700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f57c006ace0 0x7f57c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.431+0000 7f57dcff9700 1 -- 172.21.15.88:0/1508999871 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f57c808aa10 con 0x7f57e00b8840 2023-05-17T12:25:20.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.431+0000 7f57df7fe700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f57c006ace0 0x7f57c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.432+0000 7f57df7fe700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f57c006ace0 0x7f57c006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57e006d830 tx=0x7f57d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:20.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.435+0000 7f57dcff9700 1 -- 172.21.15.88:0/1508999871 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f57c80557c0 con 0x7f57e00b8840 2023-05-17T12:25:20.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.627+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f57e01e5060 con 0x7f57e00b8840 2023-05-17T12:25:20.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.628+0000 7f57dcff9700 1 -- 172.21.15.88:0/1508999871 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f57c8010300 con 0x7f57e00b8840 2023-05-17T12:25:20.632 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:25:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f57c006ace0 msgr2=0x7f57c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f57c006ace0 0x7f57c006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f57e006d830 tx=0x7f57d0009040 comp rx=0 tx=0).stop 2023-05-17T12:25:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00b8840 msgr2=0x7f57e01e63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00b8840 0x7f57e01e63a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c800 tx=0x7f57c8001930 comp rx=0 tx=0).stop 2023-05-17T12:25:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 shutdown_connections 2023-05-17T12:25:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f57c006ace0 0x7f57c006d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57e0150430 0x7f57e00b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57cc004850 0x7f57e01f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 --2- 172.21.15.88:0/1508999871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57e00b8840 0x7f57e01e63a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 >> 172.21.15.88:0/1508999871 conn(0x7f57e00d06f0 msgr2=0x7f57e01e7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:20.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 shutdown_connections 2023-05-17T12:25:20.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.630+0000 7f57e5dff700 1 -- 172.21.15.88:0/1508999871 wait complete. 2023-05-17T12:25:20.651 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:25:20.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.831+0000 7fb645bff700 1 Processor -- start 2023-05-17T12:25:20.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.831+0000 7fb645bff700 1 -- start start 2023-05-17T12:25:20.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.832+0000 7fb645bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb64006ddb0 0x7fb640070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.832+0000 7fb645bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb6400714b0 0x7fb6400b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.832+0000 7fb645bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb640071910 con 0x7fb640159b70 2023-05-17T12:25:20.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.832+0000 7fb645bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb640159f40 con 0x7fb64006ddb0 2023-05-17T12:25:20.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.832+0000 7fb645bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64006d080 con 0x7fb6400714b0 2023-05-17T12:25:20.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.832+0000 7fb63effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb64006ddb0 0x7fb640070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.832+0000 7fb63effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb64006ddb0 0x7fb640070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56448/0 (socket says 172.21.15.88:56448) 2023-05-17T12:25:20.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.832+0000 7fb63effd700 1 -- 172.21.15.88:0/891568726 learned_addr learned my addr 172.21.15.88:0/891568726 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:20.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63ffff700 1 --2- 172.21.15.88:0/891568726 >> v2:172.21.15.187:3300/0 conn(0x7fb6400714b0 0x7fb6400b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63effd700 1 -- 172.21.15.88:0/891568726 >> v2:172.21.15.187:3300/0 conn(0x7fb6400714b0 msgr2=0x7fb6400b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:20.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63effd700 1 --2- 172.21.15.88:0/891568726 >> v2:172.21.15.187:3300/0 conn(0x7fb6400714b0 0x7fb6400b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63effd700 1 -- 172.21.15.88:0/891568726 >> v1:172.21.15.187:6789/0 conn(0x7fb640159b70 legacy=0x7fb6400cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:20.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63effd700 1 -- 172.21.15.88:0/891568726 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64006d920 con 0x7fb64006ddb0 2023-05-17T12:25:20.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63ffff700 1 --2- 172.21.15.88:0/891568726 >> v2:172.21.15.187:3300/0 conn(0x7fb6400714b0 0x7fb6400b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:20.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63effd700 1 --2- 172.21.15.88:0/891568726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb64006ddb0 0x7fb640070f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098f0 tx=0x7fb634009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0b290a9b3df168 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:20.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63e7fc700 1 -- 172.21.15.88:0/891568726 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634004230 con 0x7fb64006ddb0 2023-05-17T12:25:20.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63e7fc700 1 -- 172.21.15.88:0/891568726 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634004390 con 0x7fb64006ddb0 2023-05-17T12:25:20.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.833+0000 7fb63e7fc700 1 -- 172.21.15.88:0/891568726 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340036a0 con 0x7fb64006ddb0 2023-05-17T12:25:20.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.834+0000 7fb645bff700 1 -- 172.21.15.88:0/891568726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb64006ddb0 msgr2=0x7fb640070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.834+0000 7fb645bff700 1 --2- 172.21.15.88:0/891568726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb64006ddb0 0x7fb640070f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098f0 tx=0x7fb634009c00 comp rx=0 tx=0).stop 2023-05-17T12:25:20.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.834+0000 7fb645bff700 1 -- 172.21.15.88:0/891568726 shutdown_connections 2023-05-17T12:25:20.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.834+0000 7fb645bff700 1 --2- 172.21.15.88:0/891568726 >> v2:172.21.15.187:3300/0 conn(0x7fb6400714b0 0x7fb6400b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.834+0000 7fb645bff700 1 --2- 172.21.15.88:0/891568726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb64006ddb0 0x7fb640070f70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.834+0000 7fb645bff700 1 -- 172.21.15.88:0/891568726 >> 172.21.15.88:0/891568726 conn(0x7fb6400b1530 msgr2=0x7fb6400ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:20.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.834+0000 7fb645bff700 1 -- 172.21.15.88:0/891568726 shutdown_connections 2023-05-17T12:25:20.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.834+0000 7fb645bff700 1 -- 172.21.15.88:0/891568726 wait complete. 2023-05-17T12:25:20.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.836+0000 7fb645bff700 1 Processor -- start 2023-05-17T12:25:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.837+0000 7fb645bff700 1 -- start start 2023-05-17T12:25:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb645bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb64006ddb0 0x7fb640158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb645bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6400714b0 0x7fb6400c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb645bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb640159b70 0x7fb6401460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb645bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401f2810 con 0x7fb640159b70 2023-05-17T12:25:20.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb645bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400b35b0 con 0x7fb6400714b0 2023-05-17T12:25:20.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb645bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401465e0 con 0x7fb64006ddb0 2023-05-17T12:25:20.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb640159b70 0x7fb6401460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb640159b70 0x7fb6401460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56454/0 (socket says 172.21.15.88:56454) 2023-05-17T12:25:20.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63ffff700 1 -- 172.21.15.88:0/2055216270 learned_addr learned my addr 172.21.15.88:0/2055216270 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:20.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63effd700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6400714b0 0x7fb6400c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63f7fe700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb64006ddb0 0x7fb640158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63ffff700 1 -- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb64006ddb0 msgr2=0x7fb640158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63ffff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb64006ddb0 0x7fb640158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63ffff700 1 -- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6400714b0 msgr2=0x7fb6400c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:20.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63ffff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6400714b0 0x7fb6400c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:20.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63ffff700 1 -- 172.21.15.88:0/2055216270 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634009550 con 0x7fb640159b70 2023-05-17T12:25:20.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63effd700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6400714b0 0x7fb6400c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:20.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.838+0000 7fb63f7fe700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb64006ddb0 0x7fb640158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:20.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.839+0000 7fb63ffff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb640159b70 0x7fb6401460a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb63800cef0 tx=0x7fb63800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:20.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.839+0000 7fb627fff700 1 -- 172.21.15.88:0/2055216270 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800ae50 con 0x7fb640159b70 2023-05-17T12:25:20.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.839+0000 7fb627fff700 1 -- 172.21.15.88:0/2055216270 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638015440 con 0x7fb640159b70 2023-05-17T12:25:20.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.839+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64006d2d0 con 0x7fb640159b70 2023-05-17T12:25:20.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.839+0000 7fb627fff700 1 -- 172.21.15.88:0/2055216270 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380157f0 con 0x7fb640159b70 2023-05-17T12:25:20.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.839+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6400ce930 con 0x7fb640159b70 2023-05-17T12:25:20.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.840+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64006d5b0 con 0x7fb640159b70 2023-05-17T12:25:20.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.841+0000 7fb627fff700 1 -- 172.21.15.88:0/2055216270 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb63800d430 con 0x7fb640159b70 2023-05-17T12:25:20.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.842+0000 7fb627fff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb62c06ace0 0x7fb62c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:20.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.842+0000 7fb627fff700 1 -- 172.21.15.88:0/2055216270 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb638089d40 con 0x7fb640159b70 2023-05-17T12:25:20.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.842+0000 7fb63f7fe700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb62c06ace0 0x7fb62c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:20.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.843+0000 7fb63f7fe700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb62c06ace0 0x7fb62c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb630006fd0 tx=0x7fb630008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:20.846+0000 7fb627fff700 1 -- 172.21.15.88:0/2055216270 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb638054b90 con 0x7fb640159b70 2023-05-17T12:25:21.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.059+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb640074530 con 0x7fb640159b70 2023-05-17T12:25:21.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.059+0000 7fb627fff700 1 -- 172.21.15.88:0/2055216270 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb63801a080 con 0x7fb640159b70 2023-05-17T12:25:21.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.061+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb62c06ace0 msgr2=0x7fb62c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.061+0000 7fb645bff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb62c06ace0 0x7fb62c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb630006fd0 tx=0x7fb630008040 comp rx=0 tx=0).stop 2023-05-17T12:25:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.061+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb640159b70 msgr2=0x7fb6401460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.061+0000 7fb645bff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb640159b70 0x7fb6401460a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb63800cef0 tx=0x7fb63800a340 comp rx=0 tx=0).stop 2023-05-17T12:25:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.062+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 shutdown_connections 2023-05-17T12:25:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.062+0000 7fb645bff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb62c06ace0 0x7fb62c06d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.062+0000 7fb645bff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb640159b70 0x7fb6401460a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:21.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.062+0000 7fb645bff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb64006ddb0 0x7fb640158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.062+0000 7fb645bff700 1 --2- 172.21.15.88:0/2055216270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6400714b0 0x7fb6400c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.062+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 >> 172.21.15.88:0/2055216270 conn(0x7fb6400b1530 msgr2=0x7fb6400cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.062+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 shutdown_connections 2023-05-17T12:25:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:21.062+0000 7fb645bff700 1 -- 172.21.15.88:0/2055216270 wait complete. 2023-05-17T12:25:21.067 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:25:21.082 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-05-17T12:25:21.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:21.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-05-17T12:25:21.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[140765]: fuse finished with error 0 and tester_r 0 2023-05-17T12:25:21.147 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T12:25:24.136 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:25:24.141 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:25:27.248 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T12:25:27.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:27.249 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-05-17T12:25:27.313 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:27.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.498+0000 7f021759e700 1 Processor -- start 2023-05-17T12:25:27.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.498+0000 7f021759e700 1 -- start start 2023-05-17T12:25:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f021759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021815d250 0x7f02180cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f021759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02180d09f0 0x7f02180b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f021759e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f02180b4e70 0x7f02181604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f021759e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02180b52f0 con 0x7f02180d09f0 2023-05-17T12:25:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f021759e700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02180cdc20 con 0x7f02180b4e70 2023-05-17T12:25:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f021759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021815d620 con 0x7f021815d250 2023-05-17T12:25:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f020dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02180d09f0 0x7f02180b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f020dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f02180d09f0 0x7f02180b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50162/0 (socket says 172.21.15.88:50162) 2023-05-17T12:25:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f020dd9b700 1 -- 172.21.15.88:0/3029206629 learned_addr learned my addr 172.21.15.88:0/3029206629 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f021659c700 1 --2- 172.21.15.88:0/3029206629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021815d250 0x7f02180cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.499+0000 7f0216d9d700 1 --2- 172.21.15.88:0/3029206629 >> v2:172.21.15.187:3300/0 conn(0x7f02180b4e70 0x7f02181604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f020dd9b700 1 -- 172.21.15.88:0/3029206629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021815d250 msgr2=0x7f02180cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f020dd9b700 1 --2- 172.21.15.88:0/3029206629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021815d250 0x7f02180cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f020dd9b700 1 -- 172.21.15.88:0/3029206629 >> v2:172.21.15.187:3300/0 conn(0x7f02180b4e70 msgr2=0x7f02181604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f020dd9b700 1 --2- 172.21.15.88:0/3029206629 >> v2:172.21.15.187:3300/0 conn(0x7f02180b4e70 0x7f02181604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f020dd9b700 1 -- 172.21.15.88:0/3029206629 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021815db90 con 0x7f02180d09f0 2023-05-17T12:25:27.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f021659c700 1 --2- 172.21.15.88:0/3029206629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021815d250 0x7f02180cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:27.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f020dd9b700 1 --2- 172.21.15.88:0/3029206629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02180d09f0 0x7f02180b4930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f02180d0400 tx=0x7f0200009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b4d320cc5269ba server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:27.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f0215d9b700 1 -- 172.21.15.88:0/3029206629 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200011830 con 0x7f02180d09f0 2023-05-17T12:25:27.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f0215d9b700 1 -- 172.21.15.88:0/3029206629 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200011990 con 0x7f02180d09f0 2023-05-17T12:25:27.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.500+0000 7f0215d9b700 1 -- 172.21.15.88:0/3029206629 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200011d20 con 0x7f02180d09f0 2023-05-17T12:25:27.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.501+0000 7f021759e700 1 -- 172.21.15.88:0/3029206629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02180d09f0 msgr2=0x7f02180b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:27.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.501+0000 7f021759e700 1 --2- 172.21.15.88:0/3029206629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02180d09f0 0x7f02180b4930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f02180d0400 tx=0x7f0200009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.501+0000 7f021759e700 1 -- 172.21.15.88:0/3029206629 shutdown_connections 2023-05-17T12:25:27.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.501+0000 7f021759e700 1 --2- 172.21.15.88:0/3029206629 >> v2:172.21.15.187:3300/0 conn(0x7f02180b4e70 0x7f02181604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.501+0000 7f021759e700 1 --2- 172.21.15.88:0/3029206629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021815d250 0x7f02180cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.501+0000 7f021759e700 1 --2- 172.21.15.88:0/3029206629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02180d09f0 0x7f02180b4930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.501+0000 7f021759e700 1 -- 172.21.15.88:0/3029206629 >> 172.21.15.88:0/3029206629 conn(0x7f02180d3b40 msgr2=0x7f02180cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:27.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.501+0000 7f021759e700 1 -- 172.21.15.88:0/3029206629 shutdown_connections 2023-05-17T12:25:27.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.501+0000 7f021759e700 1 -- 172.21.15.88:0/3029206629 wait complete. 2023-05-17T12:25:27.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.503+0000 7f021759e700 1 Processor -- start 2023-05-17T12:25:27.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.503+0000 7f021759e700 1 -- start start 2023-05-17T12:25:27.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f021759e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02180b4e70 0x7f02180ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f021759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02180d09f0 0x7f02180b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f021759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021815d250 0x7f0218142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f021759e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02180b3b30 con 0x7f021815d250 2023-05-17T12:25:27.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f021759e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02180cd100 con 0x7f02180d09f0 2023-05-17T12:25:27.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f021759e700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0218152440 con 0x7f02180b4e70 2023-05-17T12:25:27.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f0216d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021815d250 0x7f0218142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f0216d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021815d250 0x7f0218142fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50170/0 (socket says 172.21.15.88:50170) 2023-05-17T12:25:27.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f0216d9d700 1 -- 172.21.15.88:0/1265333742 learned_addr learned my addr 172.21.15.88:0/1265333742 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:27.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f0216d9d700 1 -- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02180b4e70 msgr2=0x7f02180ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:27.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f0216d9d700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02180b4e70 0x7f02180ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f0216d9d700 1 -- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02180d09f0 msgr2=0x7f02180b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:27.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f0216d9d700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02180d09f0 0x7f02180b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.504+0000 7f0216d9d700 1 -- 172.21.15.88:0/1265333742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200009550 con 0x7f021815d250 2023-05-17T12:25:27.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.505+0000 7f0216d9d700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021815d250 0x7f0218142fd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f021000e820 tx=0x7f021000ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:27.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.505+0000 7f020f7fe700 1 -- 172.21.15.88:0/1265333742 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210009530 con 0x7f021815d250 2023-05-17T12:25:27.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.505+0000 7f020f7fe700 1 -- 172.21.15.88:0/1265333742 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0210013680 con 0x7f021815d250 2023-05-17T12:25:27.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.505+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02180cd5a0 con 0x7f021815d250 2023-05-17T12:25:27.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.505+0000 7f020f7fe700 1 -- 172.21.15.88:0/1265333742 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210013a10 con 0x7f021815d250 2023-05-17T12:25:27.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.505+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02180d0e60 con 0x7f021815d250 2023-05-17T12:25:27.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.506+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021815d8b0 con 0x7f021815d250 2023-05-17T12:25:27.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.507+0000 7f020f7fe700 1 -- 172.21.15.88:0/1265333742 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0210013b70 con 0x7f021815d250 2023-05-17T12:25:27.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.508+0000 7f020f7fe700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f01f806ace0 0x7f01f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.508+0000 7f020f7fe700 1 -- 172.21.15.88:0/1265333742 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0210089690 con 0x7f021815d250 2023-05-17T12:25:27.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.508+0000 7f021659c700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f01f806ace0 0x7f01f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.509+0000 7f021659c700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f01f806ace0 0x7f01f806d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0208009f50 tx=0x7f02080094a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:27.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.512+0000 7f020f7fe700 1 -- 172.21.15.88:0/1265333742 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0210057e40 con 0x7f021815d250 2023-05-17T12:25:27.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.705+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02180d2cb0 con 0x7f021815d250 2023-05-17T12:25:27.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.706+0000 7f020f7fe700 1 -- 172.21.15.88:0/1265333742 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f02100579d0 con 0x7f021815d250 2023-05-17T12:25:27.710 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:27.711 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:27.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.708+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f01f806ace0 msgr2=0x7f01f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.708+0000 7f021759e700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f01f806ace0 0x7f01f806d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0208009f50 tx=0x7f02080094a0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.708+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021815d250 msgr2=0x7f0218142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.708+0000 7f021759e700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021815d250 0x7f0218142fd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f021000e820 tx=0x7f021000ebe0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.709+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 shutdown_connections 2023-05-17T12:25:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.709+0000 7f021759e700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f01f806ace0 0x7f01f806d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.709+0000 7f021759e700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021815d250 0x7f0218142fd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.709+0000 7f021759e700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02180b4e70 0x7f02180ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.709+0000 7f021759e700 1 --2- 172.21.15.88:0/1265333742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02180d09f0 0x7f02180b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.709+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 >> 172.21.15.88:0/1265333742 conn(0x7f02180d3b40 msgr2=0x7f021806a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.709+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 shutdown_connections 2023-05-17T12:25:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.709+0000 7f021759e700 1 -- 172.21.15.88:0/1265333742 wait complete. 2023-05-17T12:25:27.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:27.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.911+0000 7fc8a79ff700 1 Processor -- start 2023-05-17T12:25:27.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.911+0000 7fc8a79ff700 1 -- start start 2023-05-17T12:25:27.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a006ce70 0x7fc8a006af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a79ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8a00d1110 0x7fc8a00d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a79ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00cf990 con 0x7fc8a00b89a0 2023-05-17T12:25:27.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a79ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a00d0c80 con 0x7fc8a00d1110 2023-05-17T12:25:27.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a006b460 con 0x7fc8a006ce70 2023-05-17T12:25:27.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a5f9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8a00d1110 0x7fc8a00d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a5f9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8a00d1110 0x7fc8a00d1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50180/0 (socket says 172.21.15.88:50180) 2023-05-17T12:25:27.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a5f9c700 1 -- 172.21.15.88:0/2886016563 learned_addr learned my addr 172.21.15.88:0/2886016563 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:27.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a4f9a700 1 --2- 172.21.15.88:0/2886016563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a006ce70 0x7fc8a006af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a5f9c700 1 -- 172.21.15.88:0/2886016563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a006ce70 msgr2=0x7fc8a006af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:27.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a5f9c700 1 --2- 172.21.15.88:0/2886016563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a006ce70 0x7fc8a006af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a5f9c700 1 -- 172.21.15.88:0/2886016563 >> v1:172.21.15.187:6789/0 conn(0x7fc8a00b89a0 legacy=0x7fc8a006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:27.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a5f9c700 1 -- 172.21.15.88:0/2886016563 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00cf6b0 con 0x7fc8a00d1110 2023-05-17T12:25:27.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.913+0000 7fc8a4f9a700 1 --2- 172.21.15.88:0/2886016563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a006ce70 0x7fc8a006af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:27.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc8a5f9c700 1 --2- 172.21.15.88:0/2886016563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 0x7fc8a00d1590 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc898009e50 tx=0x7fc89800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f1620b30f3fd1a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:27.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc897fff700 1 -- 172.21.15.88:0/2886016563 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800e070 con 0x7fc8a00d1110 2023-05-17T12:25:27.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc897fff700 1 -- 172.21.15.88:0/2886016563 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89800b9c0 con 0x7fc8a00d1110 2023-05-17T12:25:27.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc897fff700 1 -- 172.21.15.88:0/2886016563 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800bd70 con 0x7fc8a00d1110 2023-05-17T12:25:27.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc8a79ff700 1 -- 172.21.15.88:0/2886016563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 msgr2=0x7fc8a00d1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:27.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc8a79ff700 1 --2- 172.21.15.88:0/2886016563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 0x7fc8a00d1590 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc898009e50 tx=0x7fc89800b330 comp rx=0 tx=0).stop 2023-05-17T12:25:27.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc8a79ff700 1 -- 172.21.15.88:0/2886016563 shutdown_connections 2023-05-17T12:25:27.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc8a79ff700 1 --2- 172.21.15.88:0/2886016563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 0x7fc8a00d1590 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc8a79ff700 1 --2- 172.21.15.88:0/2886016563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a006ce70 0x7fc8a006af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.914+0000 7fc8a79ff700 1 -- 172.21.15.88:0/2886016563 >> 172.21.15.88:0/2886016563 conn(0x7fc8a00d0790 msgr2=0x7fc8a00d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:27.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.915+0000 7fc8a79ff700 1 -- 172.21.15.88:0/2886016563 shutdown_connections 2023-05-17T12:25:27.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.915+0000 7fc8a79ff700 1 -- 172.21.15.88:0/2886016563 wait complete. 2023-05-17T12:25:27.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.916+0000 7fc8a79ff700 1 Processor -- start 2023-05-17T12:25:27.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.916+0000 7fc8a79ff700 1 -- start start 2023-05-17T12:25:27.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8a006ce70 0x7fc8a00cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a00b89a0 0x7fc8a01531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 0x7fc8a01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00ccb90 con 0x7fc8a00d1110 2023-05-17T12:25:27.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00cb5b0 con 0x7fc8a006ce70 2023-05-17T12:25:27.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00cb890 con 0x7fc8a00b89a0 2023-05-17T12:25:27.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a5f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 0x7fc8a01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a5f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 0x7fc8a01536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50186/0 (socket says 172.21.15.88:50186) 2023-05-17T12:25:27.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a5f9c700 1 -- 172.21.15.88:0/1361845800 learned_addr learned my addr 172.21.15.88:0/1361845800 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a579b700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8a006ce70 0x7fc8a00cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.917+0000 7fc8a4f9a700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a00b89a0 0x7fc8a01531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc8a5f9c700 1 -- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a00b89a0 msgr2=0x7fc8a01531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc8a5f9c700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a00b89a0 0x7fc8a01531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc8a5f9c700 1 -- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8a006ce70 msgr2=0x7fc8a00cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc8a5f9c700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8a006ce70 0x7fc8a00cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:27.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc8a5f9c700 1 -- 172.21.15.88:0/1361845800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898009b30 con 0x7fc8a00d1110 2023-05-17T12:25:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc8a5f9c700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 0x7fc8a01536f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8a006c6b0 tx=0x7fc898004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc895ffb700 1 -- 172.21.15.88:0/1361845800 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898004800 con 0x7fc8a00d1110 2023-05-17T12:25:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc895ffb700 1 -- 172.21.15.88:0/1361845800 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc898004960 con 0x7fc8a00d1110 2023-05-17T12:25:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a00cdb80 con 0x7fc8a00d1110 2023-05-17T12:25:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.918+0000 7fc895ffb700 1 -- 172.21.15.88:0/1361845800 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89801c680 con 0x7fc8a00d1110 2023-05-17T12:25:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.919+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a00cd8a0 con 0x7fc8a00d1110 2023-05-17T12:25:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.919+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a00d2c70 con 0x7fc8a00d1110 2023-05-17T12:25:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.920+0000 7fc895ffb700 1 -- 172.21.15.88:0/1361845800 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc89801c7e0 con 0x7fc8a00d1110 2023-05-17T12:25:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.921+0000 7fc895ffb700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc88406ace0 0x7fc88406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.921+0000 7fc895ffb700 1 -- 172.21.15.88:0/1361845800 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc89808b350 con 0x7fc8a00d1110 2023-05-17T12:25:27.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.922+0000 7fc8a579b700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc88406ace0 0x7fc88406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:27.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.922+0000 7fc8a579b700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc88406ace0 0x7fc88406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc89c007fd0 tx=0x7fc89c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:27.926+0000 7fc895ffb700 1 -- 172.21.15.88:0/1361845800 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc898056100 con 0x7fc8a00d1110 2023-05-17T12:25:28.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.121+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8a0074530 con 0x7fc8a00d1110 2023-05-17T12:25:28.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.122+0000 7fc895ffb700 1 -- 172.21.15.88:0/1361845800 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fc898059720 con 0x7fc8a00d1110 2023-05-17T12:25:28.126 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:28.127 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:28.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc88406ace0 msgr2=0x7fc88406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:28.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc88406ace0 0x7fc88406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc89c007fd0 tx=0x7fc89c009040 comp rx=0 tx=0).stop 2023-05-17T12:25:28.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 msgr2=0x7fc8a01536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:28.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 0x7fc8a01536f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8a006c6b0 tx=0x7fc898004ad0 comp rx=0 tx=0).stop 2023-05-17T12:25:28.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 shutdown_connections 2023-05-17T12:25:28.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc88406ace0 0x7fc88406d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:28.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8a00d1110 0x7fc8a01536f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:28.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8a006ce70 0x7fc8a00cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:28.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 --2- 172.21.15.88:0/1361845800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8a00b89a0 0x7fc8a01531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:28.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 >> 172.21.15.88:0/1361845800 conn(0x7fc8a00d0790 msgr2=0x7fc8a00661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:28.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 shutdown_connections 2023-05-17T12:25:28.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.125+0000 7fc8a79ff700 1 -- 172.21.15.88:0/1361845800 wait complete. 2023-05-17T12:25:28.146 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T12:25:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.330+0000 7fa5913ff700 1 Processor -- start 2023-05-17T12:25:28.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.331+0000 7fa5913ff700 1 -- start start 2023-05-17T12:25:28.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa5913ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0b23a0 0x7fa58c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:28.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa5913ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c06b4a0 con 0x7fa58c06c760 2023-05-17T12:25:28.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa5913ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58c06a510 con 0x7fa58c0cf190 2023-05-17T12:25:28.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa5913ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0cd840 con 0x7fa58c0b23a0 2023-05-17T12:25:28.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa58affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa58c06c760 0x7fa58c06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51404/0 (socket says 172.21.15.88:51404) 2023-05-17T12:25:28.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa58affd700 1 -- 172.21.15.88:0/776487323 learned_addr learned my addr 172.21.15.88:0/776487323 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:28.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa58a7fc700 1 --2- 172.21.15.88:0/776487323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0b23a0 0x7fa58c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa589ffb700 1 -- 172.21.15.88:0/776487323 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748068074 0 0) 0x7fa57c001110 con 0x7fa58c06c760 2023-05-17T12:25:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa589ffb700 1 -- 172.21.15.88:0/776487323 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5740035b0 con 0x7fa58c06c760 2023-05-17T12:25:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.332+0000 7fa589ffb700 1 -- 172.21.15.88:0/776487323 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168700522 0 0) 0x7fa58c06a510 con 0x7fa58c0cf190 2023-05-17T12:25:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.333+0000 7fa589ffb700 1 -- 172.21.15.88:0/776487323 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa57c001110 con 0x7fa58c0cf190 2023-05-17T12:25:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.333+0000 7fa58a7fc700 1 -- 172.21.15.88:0/776487323 >> v1:172.21.15.187:6789/0 conn(0x7fa58c0cf190 legacy=0x7fa58c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:28.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.333+0000 7fa589ffb700 1 -- 172.21.15.88:0/776487323 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1990921959 0 0) 0x7fa5740035b0 con 0x7fa58c06c760 2023-05-17T12:25:28.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.333+0000 7fa58a7fc700 1 -- 172.21.15.88:0/776487323 >> v1:172.21.15.88:6789/0 conn(0x7fa58c06c760 legacy=0x7fa58c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:28.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.333+0000 7fa58a7fc700 1 -- 172.21.15.88:0/776487323 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0cdb20 con 0x7fa58c0b23a0 2023-05-17T12:25:28.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.333+0000 7fa58a7fc700 1 --2- 172.21.15.88:0/776487323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0b23a0 0x7fa58c06af60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa580009870 tx=0x7fa580009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b44c9b895315f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:28.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.333+0000 7fa589ffb700 1 -- 172.21.15.88:0/776487323 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c001800 con 0x7fa58c0b23a0 2023-05-17T12:25:28.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.333+0000 7fa589ffb700 1 -- 172.21.15.88:0/776487323 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa580004030 con 0x7fa58c0b23a0 2023-05-17T12:25:28.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.333+0000 7fa589ffb700 1 -- 172.21.15.88:0/776487323 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800043c0 con 0x7fa58c0b23a0 2023-05-17T12:25:28.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.334+0000 7fa5913ff700 1 -- 172.21.15.88:0/776487323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0b23a0 msgr2=0x7fa58c06af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:28.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.334+0000 7fa5913ff700 1 --2- 172.21.15.88:0/776487323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0b23a0 0x7fa58c06af60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa580009870 tx=0x7fa580009b80 comp rx=0 tx=0).stop 2023-05-17T12:25:28.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.334+0000 7fa5913ff700 1 -- 172.21.15.88:0/776487323 shutdown_connections 2023-05-17T12:25:28.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.334+0000 7fa5913ff700 1 --2- 172.21.15.88:0/776487323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0b23a0 0x7fa58c06af60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:28.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.334+0000 7fa5913ff700 1 -- 172.21.15.88:0/776487323 >> 172.21.15.88:0/776487323 conn(0x7fa58c0d06f0 msgr2=0x7fa58c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:28.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.334+0000 7fa5913ff700 1 -- 172.21.15.88:0/776487323 shutdown_connections 2023-05-17T12:25:28.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.334+0000 7fa5913ff700 1 -- 172.21.15.88:0/776487323 wait complete. 2023-05-17T12:25:28.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.335+0000 7fa5913ff700 1 Processor -- start 2023-05-17T12:25:28.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.336+0000 7fa5913ff700 1 -- start start 2023-05-17T12:25:28.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.336+0000 7fa5913ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa58c06c760 0x7fa58c157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:28.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.336+0000 7fa5913ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0cf190 0x7fa58c0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.336+0000 7fa5913ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa58c0c9110 0x7fa58c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa5913ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c158a60 con 0x7fa58c06c760 2023-05-17T12:25:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa5913ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c1e6400 con 0x7fa58c0c9110 2023-05-17T12:25:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa5913ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c0c9eb0 con 0x7fa58c0cf190 2023-05-17T12:25:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa58c06c760 0x7fa58c157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa58c06c760 0x7fa58c157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50198/0 (socket says 172.21.15.88:50198) 2023-05-17T12:25:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58affd700 1 -- 172.21.15.88:0/2405543573 learned_addr learned my addr 172.21.15.88:0/2405543573 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:28.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58a7fc700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0cf190 0x7fa58c0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:28.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58b7fe700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa58c0c9110 0x7fa58c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:28.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58affd700 1 -- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0cf190 msgr2=0x7fa58c0c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:28.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58affd700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0cf190 0x7fa58c0c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:28.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58affd700 1 -- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa58c0c9110 msgr2=0x7fa58c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:28.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58affd700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa58c0c9110 0x7fa58c15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:28.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58affd700 1 -- 172.21.15.88:0/2405543573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5800094a0 con 0x7fa58c06c760 2023-05-17T12:25:28.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.337+0000 7fa58affd700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa58c06c760 0x7fa58c157950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00c780 tx=0x7fa57c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.338+0000 7fa5737fe700 1 -- 172.21.15.88:0/2405543573 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c004c80 con 0x7fa58c06c760 2023-05-17T12:25:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.338+0000 7fa5737fe700 1 -- 172.21.15.88:0/2405543573 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c004de0 con 0x7fa58c06c760 2023-05-17T12:25:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.338+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58c06aa40 con 0x7fa58c06c760 2023-05-17T12:25:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.338+0000 7fa5737fe700 1 -- 172.21.15.88:0/2405543573 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c007310 con 0x7fa58c06c760 2023-05-17T12:25:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.338+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c06a760 con 0x7fa58c06c760 2023-05-17T12:25:28.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.339+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58c15cb40 con 0x7fa58c06c760 2023-05-17T12:25:28.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.340+0000 7fa5737fe700 1 -- 172.21.15.88:0/2405543573 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa57c007470 con 0x7fa58c06c760 2023-05-17T12:25:28.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.341+0000 7fa5737fe700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa57806ace0 0x7fa57806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:28.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.341+0000 7fa5737fe700 1 -- 172.21.15.88:0/2405543573 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa57c088cb0 con 0x7fa58c06c760 2023-05-17T12:25:28.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.341+0000 7fa58a7fc700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa57806ace0 0x7fa57806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:28.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.342+0000 7fa58a7fc700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa57806ace0 0x7fa57806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa5800090b0 tx=0x7fa580013040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:28.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.345+0000 7fa5737fe700 1 -- 172.21.15.88:0/2405543573 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa57c053a60 con 0x7fa58c06c760 2023-05-17T12:25:28.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:28.582+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa58c06b4a0 con 0x7fa58c06c760 2023-05-17T12:25:29.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.328+0000 7fa5737fe700 1 -- 172.21.15.88:0/2405543573 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa58c06b4a0 con 0x7fa58c06c760 2023-05-17T12:25:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa57806ace0 msgr2=0x7fa57806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa57806ace0 0x7fa57806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa5800090b0 tx=0x7fa580013040 comp rx=0 tx=0).stop 2023-05-17T12:25:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa58c06c760 msgr2=0x7fa58c157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa58c06c760 0x7fa58c157950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00c780 tx=0x7fa57c00cb40 comp rx=0 tx=0).stop 2023-05-17T12:25:29.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 shutdown_connections 2023-05-17T12:25:29.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa57806ace0 0x7fa57806d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:29.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa58c0c9110 0x7fa58c15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:29.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa58c06c760 0x7fa58c157950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:29.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 --2- 172.21.15.88:0/2405543573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa58c0cf190 0x7fa58c0c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:29.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 >> 172.21.15.88:0/2405543573 conn(0x7fa58c0d06f0 msgr2=0x7fa58c15a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:29.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 shutdown_connections 2023-05-17T12:25:29.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.331+0000 7fa5913ff700 1 -- 172.21.15.88:0/2405543573 wait complete. 2023-05-17T12:25:29.353 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-05-17T12:25:29.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T12:25:29.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.541+0000 7efd605ff700 1 Processor -- start 2023-05-17T12:25:29.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.541+0000 7efd605ff700 1 -- start start 2023-05-17T12:25:29.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.542+0000 7efd605ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd5806c760 0x7efd5806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:29.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.542+0000 7efd605ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5806b4a0 con 0x7efd580cf190 2023-05-17T12:25:29.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.542+0000 7efd605ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5806a510 con 0x7efd580b23a0 2023-05-17T12:25:29.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.542+0000 7efd605ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580cd840 con 0x7efd5806c760 2023-05-17T12:25:29.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.542+0000 7efd5e39b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd5806c760 0x7efd5806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:29.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.542+0000 7efd5eb9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efd580cf190 0x7efd58160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51410/0 (socket says 172.21.15.88:51410) 2023-05-17T12:25:29.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.542+0000 7efd5eb9c700 1 -- 172.21.15.88:0/203123388 learned_addr learned my addr 172.21.15.88:0/203123388 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:29.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.543+0000 7efd5e39b700 1 -- 172.21.15.88:0/203123388 >> v1:172.21.15.187:6789/0 conn(0x7efd580b23a0 legacy=0x7efd5806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:29.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.543+0000 7efd5e39b700 1 -- 172.21.15.88:0/203123388 >> v1:172.21.15.88:6789/0 conn(0x7efd580cf190 legacy=0x7efd58160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:29.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.543+0000 7efd5e39b700 1 -- 172.21.15.88:0/203123388 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580cdb20 con 0x7efd5806c760 2023-05-17T12:25:29.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.543+0000 7efd5e39b700 1 --2- 172.21.15.88:0/203123388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 0x7efd5806af60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efd54009840 tx=0x7efd54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f40a8943f337b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:29.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.543+0000 7efd5d399700 1 -- 172.21.15.88:0/203123388 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011830 con 0x7efd5806c760 2023-05-17T12:25:29.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.543+0000 7efd5d399700 1 -- 172.21.15.88:0/203123388 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54011990 con 0x7efd5806c760 2023-05-17T12:25:29.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.543+0000 7efd5d399700 1 -- 172.21.15.88:0/203123388 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011d20 con 0x7efd5806c760 2023-05-17T12:25:29.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.544+0000 7efd605ff700 1 -- 172.21.15.88:0/203123388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 msgr2=0x7efd5806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:29.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.544+0000 7efd605ff700 1 --2- 172.21.15.88:0/203123388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 0x7efd5806af60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efd54009840 tx=0x7efd54009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:29.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.544+0000 7efd605ff700 1 -- 172.21.15.88:0/203123388 shutdown_connections 2023-05-17T12:25:29.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.544+0000 7efd605ff700 1 --2- 172.21.15.88:0/203123388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 0x7efd5806af60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:29.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.544+0000 7efd605ff700 1 -- 172.21.15.88:0/203123388 >> 172.21.15.88:0/203123388 conn(0x7efd580d06f0 msgr2=0x7efd580d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:29.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.544+0000 7efd605ff700 1 -- 172.21.15.88:0/203123388 shutdown_connections 2023-05-17T12:25:29.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.544+0000 7efd605ff700 1 -- 172.21.15.88:0/203123388 wait complete. 2023-05-17T12:25:29.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.546+0000 7efd605ff700 1 Processor -- start 2023-05-17T12:25:29.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.546+0000 7efd605ff700 1 -- start start 2023-05-17T12:25:29.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd605ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 0x7efd58159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:29.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd605ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd580cf190 0x7efd5815af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:29.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd605ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd581f2270 0x7efd580d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:29.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd605ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5815b440 con 0x7efd5806c760 2023-05-17T12:25:29.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd605ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd581f2b00 con 0x7efd581f2270 2023-05-17T12:25:29.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd605ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd581f2de0 con 0x7efd580cf190 2023-05-17T12:25:29.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd5e39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 0x7efd58159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:29.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd5e39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 0x7efd58159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50216/0 (socket says 172.21.15.88:50216) 2023-05-17T12:25:29.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd5e39b700 1 -- 172.21.15.88:0/552032450 learned_addr learned my addr 172.21.15.88:0/552032450 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:29.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd5e39b700 1 -- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd580cf190 msgr2=0x7efd5815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:29.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd5e39b700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd580cf190 0x7efd5815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:29.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd5e39b700 1 -- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd581f2270 msgr2=0x7efd580d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:29.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd5e39b700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd581f2270 0x7efd580d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:29.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.547+0000 7efd5e39b700 1 -- 172.21.15.88:0/552032450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd540094a0 con 0x7efd5806c760 2023-05-17T12:25:29.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.548+0000 7efd5e39b700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 0x7efd58159ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efd540090b0 tx=0x7efd54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:29.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.548+0000 7efd4effd700 1 -- 172.21.15.88:0/552032450 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd540038a0 con 0x7efd5806c760 2023-05-17T12:25:29.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.548+0000 7efd4effd700 1 -- 172.21.15.88:0/552032450 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5401f070 con 0x7efd5806c760 2023-05-17T12:25:29.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.548+0000 7efd4effd700 1 -- 172.21.15.88:0/552032450 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54003c60 con 0x7efd5806c760 2023-05-17T12:25:29.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.548+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5806aa40 con 0x7efd5806c760 2023-05-17T12:25:29.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.548+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5806a760 con 0x7efd5806c760 2023-05-17T12:25:29.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.549+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5815cb40 con 0x7efd5806c760 2023-05-17T12:25:29.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.550+0000 7efd4effd700 1 -- 172.21.15.88:0/552032450 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd5401a430 con 0x7efd5806c760 2023-05-17T12:25:29.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.551+0000 7efd4effd700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efd3c06ace0 0x7efd3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:29.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.551+0000 7efd4effd700 1 -- 172.21.15.88:0/552032450 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd54021070 con 0x7efd5806c760 2023-05-17T12:25:29.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.551+0000 7efd5db9a700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efd3c06ace0 0x7efd3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:29.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.552+0000 7efd5db9a700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efd3c06ace0 0x7efd3c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd48000f60 tx=0x7efd48007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:29.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.555+0000 7efd4effd700 1 -- 172.21.15.88:0/552032450 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efd54056090 con 0x7efd5806c760 2023-05-17T12:25:29.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:29.789+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efd58074530 con 0x7efd5806c760 2023-05-17T12:25:30.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.337+0000 7efd4effd700 1 -- 172.21.15.88:0/552032450 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7efd540596b0 con 0x7efd5806c760 2023-05-17T12:25:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efd3c06ace0 msgr2=0x7efd3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efd3c06ace0 0x7efd3c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd48000f60 tx=0x7efd48007a40 comp rx=0 tx=0).stop 2023-05-17T12:25:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 msgr2=0x7efd58159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 0x7efd58159ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efd540090b0 tx=0x7efd54004750 comp rx=0 tx=0).stop 2023-05-17T12:25:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 shutdown_connections 2023-05-17T12:25:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efd3c06ace0 0x7efd3c06d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd581f2270 0x7efd580d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd5806c760 0x7efd58159ee0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 --2- 172.21.15.88:0/552032450 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd580cf190 0x7efd5815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 >> 172.21.15.88:0/552032450 conn(0x7efd580d06f0 msgr2=0x7efd580b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 shutdown_connections 2023-05-17T12:25:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.340+0000 7efd605ff700 1 -- 172.21.15.88:0/552032450 wait complete. 2023-05-17T12:25:30.361 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-17T12:25:30.361 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:25:30.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.543+0000 7fc4567ff700 1 Processor -- start 2023-05-17T12:25:30.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.543+0000 7fc4567ff700 1 -- start start 2023-05-17T12:25:30.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.544+0000 7fc4567ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc45006b0b0 0x7fc45006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:30.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.544+0000 7fc4567ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45006c330 0x7fc45006c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:30.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.544+0000 7fc4567ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4500cd6b0 con 0x7fc45015c840 2023-05-17T12:25:30.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.544+0000 7fc4567ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4500cdf50 con 0x7fc45006b0b0 2023-05-17T12:25:30.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.544+0000 7fc4567ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45006ccf0 con 0x7fc45006c330 2023-05-17T12:25:30.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.544+0000 7fc44ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc45015c840 0x7fc4500cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51422/0 (socket says 172.21.15.88:51422) 2023-05-17T12:25:30.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.544+0000 7fc447fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc45006b0b0 0x7fc45006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:30.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.544+0000 7fc44ffff700 1 -- 172.21.15.88:0/2882263755 learned_addr learned my addr 172.21.15.88:0/2882263755 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:30.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.544+0000 7fc454d9c700 1 --2- 172.21.15.88:0/2882263755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45006c330 0x7fc45006c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:30.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc447fff700 1 -- 172.21.15.88:0/2882263755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45006c330 msgr2=0x7fc45006c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:30.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc447fff700 1 --2- 172.21.15.88:0/2882263755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45006c330 0x7fc45006c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc447fff700 1 -- 172.21.15.88:0/2882263755 >> v1:172.21.15.88:6789/0 conn(0x7fc45015c840 legacy=0x7fc4500cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc447fff700 1 -- 172.21.15.88:0/2882263755 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500b2460 con 0x7fc45006b0b0 2023-05-17T12:25:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc454d9c700 1 --2- 172.21.15.88:0/2882263755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45006c330 0x7fc45006c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc44f7fe700 1 -- 172.21.15.88:0/2882263755 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233967840 0 0) 0x7fc4500cd6b0 con 0x7fc45015c840 2023-05-17T12:25:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc447fff700 1 --2- 172.21.15.88:0/2882263755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006b0b0 0x7fc45006b940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc438009840 tx=0x7fc438009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918ce5d6ac599458 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc44f7fe700 1 -- 172.21.15.88:0/2882263755 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438011830 con 0x7fc45006b0b0 2023-05-17T12:25:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc44f7fe700 1 -- 172.21.15.88:0/2882263755 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc438011990 con 0x7fc45006b0b0 2023-05-17T12:25:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.545+0000 7fc44f7fe700 1 -- 172.21.15.88:0/2882263755 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438011d20 con 0x7fc45006b0b0 2023-05-17T12:25:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.546+0000 7fc4567ff700 1 -- 172.21.15.88:0/2882263755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006b0b0 msgr2=0x7fc45006b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.546+0000 7fc4567ff700 1 --2- 172.21.15.88:0/2882263755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006b0b0 0x7fc45006b940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc438009840 tx=0x7fc438009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.546+0000 7fc4567ff700 1 -- 172.21.15.88:0/2882263755 shutdown_connections 2023-05-17T12:25:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.546+0000 7fc4567ff700 1 --2- 172.21.15.88:0/2882263755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45006c330 0x7fc45006c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.546+0000 7fc4567ff700 1 --2- 172.21.15.88:0/2882263755 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006b0b0 0x7fc45006b940 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.546+0000 7fc4567ff700 1 -- 172.21.15.88:0/2882263755 >> 172.21.15.88:0/2882263755 conn(0x7fc4500d3060 msgr2=0x7fc4500d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.546+0000 7fc4567ff700 1 -- 172.21.15.88:0/2882263755 shutdown_connections 2023-05-17T12:25:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.546+0000 7fc4567ff700 1 -- 172.21.15.88:0/2882263755 wait complete. 2023-05-17T12:25:30.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.547+0000 7fc4567ff700 1 Processor -- start 2023-05-17T12:25:30.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.548+0000 7fc4567ff700 1 -- start start 2023-05-17T12:25:30.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.548+0000 7fc4567ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc45006b0b0 0x7fc4500b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:30.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.548+0000 7fc4567ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006c330 0x7fc4501f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:30.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.548+0000 7fc4567ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45015c840 0x7fc450148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:30.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc4567ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500b2fd0 con 0x7fc45006c330 2023-05-17T12:25:30.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc4567ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500b39a0 con 0x7fc45006b0b0 2023-05-17T12:25:30.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc4567ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45015dc60 con 0x7fc45015c840 2023-05-17T12:25:30.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc447fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006c330 0x7fc4501f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:30.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc447fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006c330 0x7fc4501f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50236/0 (socket says 172.21.15.88:50236) 2023-05-17T12:25:30.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc447fff700 1 -- 172.21.15.88:0/1485603621 learned_addr learned my addr 172.21.15.88:0/1485603621 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:30.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc447fff700 1 -- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45015c840 msgr2=0x7fc450148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc447fff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45015c840 0x7fc450148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc447fff700 1 -- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc45006b0b0 msgr2=0x7fc4500b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc447fff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc45006b0b0 0x7fc4500b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc447fff700 1 -- 172.21.15.88:0/1485603621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4380094a0 con 0x7fc45006c330 2023-05-17T12:25:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.549+0000 7fc447fff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006c330 0x7fc4501f1920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc4380090b0 tx=0x7fc438004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.550+0000 7fc44d7fa700 1 -- 172.21.15.88:0/1485603621 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380038a0 con 0x7fc45006c330 2023-05-17T12:25:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.550+0000 7fc44d7fa700 1 -- 172.21.15.88:0/1485603621 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43801f070 con 0x7fc45006c330 2023-05-17T12:25:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.550+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4500cd900 con 0x7fc45006c330 2023-05-17T12:25:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.550+0000 7fc44d7fa700 1 -- 172.21.15.88:0/1485603621 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438003c20 con 0x7fc45006c330 2023-05-17T12:25:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.550+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4500b2740 con 0x7fc45006c330 2023-05-17T12:25:30.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.551+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4500cdbe0 con 0x7fc45006c330 2023-05-17T12:25:30.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.552+0000 7fc44d7fa700 1 -- 172.21.15.88:0/1485603621 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc43801a430 con 0x7fc45006c330 2023-05-17T12:25:30.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.553+0000 7fc44d7fa700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc43006ace0 0x7fc43006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:30.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.553+0000 7fc44d7fa700 1 -- 172.21.15.88:0/1485603621 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc438021070 con 0x7fc45006c330 2023-05-17T12:25:30.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.553+0000 7fc44ffff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc43006ace0 0x7fc43006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:30.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.554+0000 7fc44ffff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc43006ace0 0x7fc43006d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc440001610 tx=0x7fc4400079f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.557+0000 7fc44d7fa700 1 -- 172.21.15.88:0/1485603621 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc438055f90 con 0x7fc45006c330 2023-05-17T12:25:30.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.793+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4500b3110 con 0x7fc45006c330 2023-05-17T12:25:30.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.794+0000 7fc44d7fa700 1 -- 172.21.15.88:0/1485603621 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fc4500b3110 con 0x7fc45006c330 2023-05-17T12:25:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:30.797 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:30.331217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T12:25:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc43006ace0 msgr2=0x7fc43006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc43006ace0 0x7fc43006d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc440001610 tx=0x7fc4400079f0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006c330 msgr2=0x7fc4501f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006c330 0x7fc4501f1920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc4380090b0 tx=0x7fc438004750 comp rx=0 tx=0).stop 2023-05-17T12:25:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 shutdown_connections 2023-05-17T12:25:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc43006ace0 0x7fc43006d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45015c840 0x7fc450148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc45006b0b0 0x7fc4500b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 --2- 172.21.15.88:0/1485603621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc45006c330 0x7fc4501f1920 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 >> 172.21.15.88:0/1485603621 conn(0x7fc4500d3060 msgr2=0x7fc45006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 shutdown_connections 2023-05-17T12:25:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.796+0000 7fc4567ff700 1 -- 172.21.15.88:0/1485603621 wait complete. 2023-05-17T12:25:30.801 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-05-17T12:25:30.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:31.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.997+0000 7fb0bd9ff700 1 Processor -- start 2023-05-17T12:25:31.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.997+0000 7fb0bd9ff700 1 -- start start 2023-05-17T12:25:31.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0bd9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0b815c840 0x7fb0b806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0bd9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b80cd6b0 con 0x7fb0b806c330 2023-05-17T12:25:31.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0bd9ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b80b2460 con 0x7fb0b806b0b0 2023-05-17T12:25:31.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0bd9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b80cdf50 con 0x7fb0b815c840 2023-05-17T12:25:31.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0b77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb0b806c330 0x7fb0b8160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51886/0 (socket says 172.21.15.88:51886) 2023-05-17T12:25:31.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0b77fe700 1 -- 172.21.15.88:0/2773249145 learned_addr learned my addr 172.21.15.88:0/2773249145 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:31.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0b6ffd700 1 --2- 172.21.15.88:0/2773249145 >> v2:172.21.15.88:3300/0 conn(0x7fb0b815c840 0x7fb0b806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0b67fc700 1 -- 172.21.15.88:0/2773249145 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94300296 0 0) 0x7fb0b80cd6b0 con 0x7fb0b806c330 2023-05-17T12:25:31.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0b67fc700 1 -- 172.21.15.88:0/2773249145 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0a40035b0 con 0x7fb0b806c330 2023-05-17T12:25:31.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0b6ffd700 1 -- 172.21.15.88:0/2773249145 >> v1:172.21.15.187:6789/0 conn(0x7fb0b806b0b0 legacy=0x7fb0b80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:30.999+0000 7fb0b6ffd700 1 -- 172.21.15.88:0/2773249145 >> v1:172.21.15.88:6789/0 conn(0x7fb0b806c330 legacy=0x7fb0b8160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0b6ffd700 1 -- 172.21.15.88:0/2773249145 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80b2740 con 0x7fb0b815c840 2023-05-17T12:25:31.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0b6ffd700 1 --2- 172.21.15.88:0/2773249145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b815c840 0x7fb0b806b940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009840 tx=0x7fb0a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bd86379278ee6e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:31.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0b67fc700 1 -- 172.21.15.88:0/2773249145 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011830 con 0x7fb0b815c840 2023-05-17T12:25:31.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0b67fc700 1 -- 172.21.15.88:0/2773249145 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8011990 con 0x7fb0b815c840 2023-05-17T12:25:31.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0b67fc700 1 -- 172.21.15.88:0/2773249145 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011d20 con 0x7fb0b815c840 2023-05-17T12:25:31.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2773249145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b815c840 msgr2=0x7fb0b806b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0bd9ff700 1 --2- 172.21.15.88:0/2773249145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b815c840 0x7fb0b806b940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009840 tx=0x7fb0a8009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:31.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2773249145 shutdown_connections 2023-05-17T12:25:31.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0bd9ff700 1 --2- 172.21.15.88:0/2773249145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b815c840 0x7fb0b806b940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.000+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2773249145 >> 172.21.15.88:0/2773249145 conn(0x7fb0b80d3060 msgr2=0x7fb0b80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:31.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.001+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2773249145 shutdown_connections 2023-05-17T12:25:31.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.001+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2773249145 wait complete. 2023-05-17T12:25:31.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.002+0000 7fb0bd9ff700 1 Processor -- start 2023-05-17T12:25:31.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.002+0000 7fb0bd9ff700 1 -- start start 2023-05-17T12:25:31.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.003+0000 7fb0bd9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0b806b0b0 0x7fb0b80c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.003+0000 7fb0bd9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b806c330 0x7fb0b8145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.003+0000 7fb0bd9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0b815c840 0x7fb0b815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.003+0000 7fb0bd9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80b3b50 con 0x7fb0b806c330 2023-05-17T12:25:31.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.003+0000 7fb0bd9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80b46d0 con 0x7fb0b806b0b0 2023-05-17T12:25:31.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.003+0000 7fb0bd9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80b3da0 con 0x7fb0b815c840 2023-05-17T12:25:31.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0affff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b806c330 0x7fb0b8145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0affff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b806c330 0x7fb0b8145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37160/0 (socket says 172.21.15.88:37160) 2023-05-17T12:25:31.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0affff700 1 -- 172.21.15.88:0/2530957617 learned_addr learned my addr 172.21.15.88:0/2530957617 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:31.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0b6ffd700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0b806b0b0 0x7fb0b80c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0b77fe700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0b815c840 0x7fb0b815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0affff700 1 -- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0b815c840 msgr2=0x7fb0b815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0affff700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0b815c840 0x7fb0b815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0affff700 1 -- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0b806b0b0 msgr2=0x7fb0b80c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0affff700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0b806b0b0 0x7fb0b80c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0affff700 1 -- 172.21.15.88:0/2530957617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80094a0 con 0x7fb0b806c330 2023-05-17T12:25:31.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0affff700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b806c330 0x7fb0b8145c40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c4d0 tx=0x7fb0a000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:31.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0b4ff9700 1 -- 172.21.15.88:0/2530957617 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000cea0 con 0x7fb0b806c330 2023-05-17T12:25:31.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.004+0000 7fb0b4ff9700 1 -- 172.21.15.88:0/2530957617 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a00052d0 con 0x7fb0b806c330 2023-05-17T12:25:31.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.005+0000 7fb0b4ff9700 1 -- 172.21.15.88:0/2530957617 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0003680 con 0x7fb0b806c330 2023-05-17T12:25:31.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.005+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b80cdbe0 con 0x7fb0b806c330 2023-05-17T12:25:31.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.005+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b80cd900 con 0x7fb0b806c330 2023-05-17T12:25:31.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.006+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b815cc10 con 0x7fb0b806c330 2023-05-17T12:25:31.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.007+0000 7fb0b4ff9700 1 -- 172.21.15.88:0/2530957617 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb0a00037e0 con 0x7fb0b806c330 2023-05-17T12:25:31.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.007+0000 7fb0b4ff9700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb09806ace0 0x7fb09806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.008+0000 7fb0b4ff9700 1 -- 172.21.15.88:0/2530957617 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb0a0088930 con 0x7fb0b806c330 2023-05-17T12:25:31.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.008+0000 7fb0b6ffd700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb09806ace0 0x7fb09806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.009+0000 7fb0b6ffd700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb09806ace0 0x7fb09806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80090b0 tx=0x7fb0a8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:31.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.012+0000 7fb0b4ff9700 1 -- 172.21.15.88:0/2530957617 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb0a0053790 con 0x7fb0b806c330 2023-05-17T12:25:31.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.207+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0b80b4840 con 0x7fb0b806c330 2023-05-17T12:25:31.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.208+0000 7fb0b4ff9700 1 -- 172.21.15.88:0/2530957617 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fb0a0056db0 con 0x7fb0b806c330 2023-05-17T12:25:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:31.212 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:31.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb09806ace0 msgr2=0x7fb09806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb09806ace0 0x7fb09806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80090b0 tx=0x7fb0a8008030 comp rx=0 tx=0).stop 2023-05-17T12:25:31.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b806c330 msgr2=0x7fb0b8145c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b806c330 0x7fb0b8145c40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c4d0 tx=0x7fb0a000c7e0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 shutdown_connections 2023-05-17T12:25:31.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb09806ace0 0x7fb09806d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0b815c840 0x7fb0b815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0b806b0b0 0x7fb0b80c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 --2- 172.21.15.88:0/2530957617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0b806c330 0x7fb0b8145c40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 >> 172.21.15.88:0/2530957617 conn(0x7fb0b80d3060 msgr2=0x7fb0b80b8610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:31.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 shutdown_connections 2023-05-17T12:25:31.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.211+0000 7fb0bd9ff700 1 -- 172.21.15.88:0/2530957617 wait complete. 2023-05-17T12:25:31.231 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T12:25:31.232 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T12:25:31.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.414+0000 7f727e3ff700 1 Processor -- start 2023-05-17T12:25:31.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.414+0000 7f727e3ff700 1 -- start start 2023-05-17T12:25:31.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.415+0000 7f727e3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f727815c840 0x7f727806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.415+0000 7f727e3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72780cd6b0 con 0x7f727806b0b0 2023-05-17T12:25:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.415+0000 7f727e3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72780b2460 con 0x7f727806c330 2023-05-17T12:25:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.415+0000 7f727e3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72780cdf50 con 0x7f727815c840 2023-05-17T12:25:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.415+0000 7f7277fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f727815c840 0x7f727806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.415+0000 7f726ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f727806b0b0 0x7f72780cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51890/0 (socket says 172.21.15.88:51890) 2023-05-17T12:25:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.415+0000 7f726ffff700 1 -- 172.21.15.88:0/2570310528 learned_addr learned my addr 172.21.15.88:0/2570310528 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.415+0000 7f7277fff700 1 -- 172.21.15.88:0/2570310528 >> v1:172.21.15.187:6789/0 conn(0x7f727806c330 legacy=0x7f7278160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.415+0000 7f72777fe700 1 -- 172.21.15.88:0/2570310528 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183050343 0 0) 0x7f72780cd6b0 con 0x7f727806b0b0 2023-05-17T12:25:31.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.416+0000 7f7277fff700 1 -- 172.21.15.88:0/2570310528 >> v1:172.21.15.88:6789/0 conn(0x7f727806b0b0 legacy=0x7f72780cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.416+0000 7f7277fff700 1 -- 172.21.15.88:0/2570310528 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72780b2740 con 0x7f727815c840 2023-05-17T12:25:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.416+0000 7f7277fff700 1 --2- 172.21.15.88:0/2570310528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727815c840 0x7f727806b940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7268009840 tx=0x7f7268009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7798a8b3b0b3ecf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.416+0000 7f72777fe700 1 -- 172.21.15.88:0/2570310528 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268011830 con 0x7f727815c840 2023-05-17T12:25:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.416+0000 7f72777fe700 1 -- 172.21.15.88:0/2570310528 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7268011990 con 0x7f727815c840 2023-05-17T12:25:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.416+0000 7f72777fe700 1 -- 172.21.15.88:0/2570310528 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268011d20 con 0x7f727815c840 2023-05-17T12:25:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.417+0000 7f727e3ff700 1 -- 172.21.15.88:0/2570310528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727815c840 msgr2=0x7f727806b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.417+0000 7f727e3ff700 1 --2- 172.21.15.88:0/2570310528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727815c840 0x7f727806b940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7268009840 tx=0x7f7268009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.417+0000 7f727e3ff700 1 -- 172.21.15.88:0/2570310528 shutdown_connections 2023-05-17T12:25:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.417+0000 7f727e3ff700 1 --2- 172.21.15.88:0/2570310528 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727815c840 0x7f727806b940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.417+0000 7f727e3ff700 1 -- 172.21.15.88:0/2570310528 >> 172.21.15.88:0/2570310528 conn(0x7f72780d3060 msgr2=0x7f72780d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.417+0000 7f727e3ff700 1 -- 172.21.15.88:0/2570310528 shutdown_connections 2023-05-17T12:25:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.417+0000 7f727e3ff700 1 -- 172.21.15.88:0/2570310528 wait complete. 2023-05-17T12:25:31.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.418+0000 7f727e3ff700 1 Processor -- start 2023-05-17T12:25:31.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.419+0000 7f727e3ff700 1 -- start start 2023-05-17T12:25:31.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.419+0000 7f727e3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727806b0b0 0x7f72781f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f727e3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727806c330 0x7f7278159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f727e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727815c840 0x7f727815e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f727e3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727815cf60 con 0x7f727806b0b0 2023-05-17T12:25:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f727e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72781f3300 con 0x7f727815c840 2023-05-17T12:25:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f727e3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7278159f70 con 0x7f727806c330 2023-05-17T12:25:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f7277fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727806b0b0 0x7f72781f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f7277fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727806b0b0 0x7f72781f2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37190/0 (socket says 172.21.15.88:37190) 2023-05-17T12:25:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f7277fff700 1 -- 172.21.15.88:0/728141773 learned_addr learned my addr 172.21.15.88:0/728141773 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f726ffff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727806c330 0x7f7278159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f727c99c700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727815c840 0x7f727815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f7277fff700 1 -- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727806c330 msgr2=0x7f7278159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f7277fff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727806c330 0x7f7278159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f7277fff700 1 -- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727815c840 msgr2=0x7f727815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f7277fff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727815c840 0x7f727815e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f7277fff700 1 -- 172.21.15.88:0/728141773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680094a0 con 0x7f727806b0b0 2023-05-17T12:25:31.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f726ffff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727806c330 0x7f7278159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:31.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.420+0000 7f7277fff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727806b0b0 0x7f72781f2dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72780d3d00 tx=0x7f7268004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:31.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.421+0000 7f72757fa700 1 -- 172.21.15.88:0/728141773 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726801a8c0 con 0x7f727806b0b0 2023-05-17T12:25:31.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.421+0000 7f72757fa700 1 -- 172.21.15.88:0/728141773 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726801aa20 con 0x7f727806b0b0 2023-05-17T12:25:31.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.421+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72780cdbe0 con 0x7f727806b0b0 2023-05-17T12:25:31.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.421+0000 7f72757fa700 1 -- 172.21.15.88:0/728141773 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726801ad90 con 0x7f727806b0b0 2023-05-17T12:25:31.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.421+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72780cd900 con 0x7f727806b0b0 2023-05-17T12:25:31.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.422+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72781582d0 con 0x7f727806b0b0 2023-05-17T12:25:31.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.423+0000 7f72757fa700 1 -- 172.21.15.88:0/728141773 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7268022070 con 0x7f727806b0b0 2023-05-17T12:25:31.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.423+0000 7f72757fa700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f725806ace0 0x7f725806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.424+0000 7f72757fa700 1 -- 172.21.15.88:0/728141773 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f726808a9f0 con 0x7f727806b0b0 2023-05-17T12:25:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.424+0000 7f726ffff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f725806ace0 0x7f725806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.425+0000 7f726ffff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f725806ace0 0x7f725806d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72780b1680 tx=0x7f7260009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.428+0000 7f72757fa700 1 -- 172.21.15.88:0/728141773 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7268055970 con 0x7f727806b0b0 2023-05-17T12:25:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.621+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 --> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f727815cc10 con 0x7f725806ace0 2023-05-17T12:25:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.635+0000 7f72757fa700 1 -- 172.21.15.88:0/728141773 <== mgr.4106 v2:172.21.15.187:6832/2490620069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367295 (secure 0 0 0) 0x7f727815cc10 con 0x7f725806ace0 2023-05-17T12:25:31.642 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:31.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f725806ace0 msgr2=0x7f725806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f725806ace0 0x7f725806d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72780b1680 tx=0x7f7260009040 comp rx=0 tx=0).stop 2023-05-17T12:25:31.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727806b0b0 msgr2=0x7f72781f2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727806b0b0 0x7f72781f2dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72780d3d00 tx=0x7f7268004750 comp rx=0 tx=0).stop 2023-05-17T12:25:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 shutdown_connections 2023-05-17T12:25:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f725806ace0 0x7f725806d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727815c840 0x7f727815e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727806b0b0 0x7f72781f2dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 --2- 172.21.15.88:0/728141773 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727806c330 0x7f7278159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 >> 172.21.15.88:0/728141773 conn(0x7f72780d3060 msgr2=0x7f727806a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 shutdown_connections 2023-05-17T12:25:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.640+0000 7f727e3ff700 1 -- 172.21.15.88:0/728141773 wait complete. 2023-05-17T12:25:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-05-17T12:25:31.660 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-05-17T12:25:31.455485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67560,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907160,"statfs":{"total":773094113280,"available":773024931840,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003725"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296789+0000","last_change":"2023-05-17T12:25:01.795822+0000","last_active":"2023-05-17T12:25:06.296789+0000","last_peered":"2023-05-17T12:25:06.296789+0000","last_clean":"2023-05-17T12:25:06.296789+0000","last_became_active":"2023-05-17T12:25:01.795035+0000","last_became_peered":"2023-05-17T12:25:01.795035+0000","last_unstale":"2023-05-17T12:25:06.296789+0000","last_undegraded":"2023-05-17T12:25:06.296789+0000","last_fullsized":"2023-05-17T12:25:06.296789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:29:24.037566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299680+0000","last_change":"2023-05-17T12:25:01.804268+0000","last_active":"2023-05-17T12:25:06.299680+0000","last_peered":"2023-05-17T12:25:06.299680+0000","last_clean":"2023-05-17T12:25:06.299680+0000","last_became_active":"2023-05-17T12:25:01.803974+0000","last_became_peered":"2023-05-17T12:25:01.803974+0000","last_unstale":"2023-05-17T12:25:06.299680+0000","last_undegraded":"2023-05-17T12:25:06.299680+0000","last_fullsized":"2023-05-17T12:25:06.299680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:16.838754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996137+0000","last_change":"2023-05-17T12:25:01.808847+0000","last_active":"2023-05-17T12:25:06.996137+0000","last_peered":"2023-05-17T12:25:06.996137+0000","last_clean":"2023-05-17T12:25:06.996137+0000","last_became_active":"2023-05-17T12:25:01.808039+0000","last_became_peered":"2023-05-17T12:25:01.808039+0000","last_unstale":"2023-05-17T12:25:06.996137+0000","last_undegraded":"2023-05-17T12:25:06.996137+0000","last_fullsized":"2023-05-17T12:25:06.996137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:34:11.837824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298571+0000","last_change":"2023-05-17T12:25:01.804061+0000","last_active":"2023-05-17T12:25:06.298571+0000","last_peered":"2023-05-17T12:25:06.298571+0000","last_clean":"2023-05-17T12:25:06.298571+0000","last_became_active":"2023-05-17T12:25:01.803700+0000","last_became_peered":"2023-05-17T12:25:01.803700+0000","last_unstale":"2023-05-17T12:25:06.298571+0000","last_undegraded":"2023-05-17T12:25:06.298571+0000","last_fullsized":"2023-05-17T12:25:06.298571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:13:33.437413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325509+0000","last_change":"2023-05-17T12:25:01.799019+0000","last_active":"2023-05-17T12:25:06.325509+0000","last_peered":"2023-05-17T12:25:06.325509+0000","last_clean":"2023-05-17T12:25:06.325509+0000","last_became_active":"2023-05-17T12:25:01.798806+0000","last_became_peered":"2023-05-17T12:25:01.798806+0000","last_unstale":"2023-05-17T12:25:06.325509+0000","last_undegraded":"2023-05-17T12:25:06.325509+0000","last_fullsized":"2023-05-17T12:25:06.325509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995568+0000","last_change":"2023-05-17T12:25:01.803257+0000","last_active":"2023-05-17T12:25:06.995568+0000","last_peered":"2023-05-17T12:25:06.995568+0000","last_clean":"2023-05-17T12:25:06.995568+0000","last_became_active":"2023-05-17T12:25:01.802691+0000","last_became_peered":"2023-05-17T12:25:01.802691+0000","last_unstale":"2023-05-17T12:25:06.995568+0000","last_undegraded":"2023-05-17T12:25:06.995568+0000","last_fullsized":"2023-05-17T12:25:06.995568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:19:39.033646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996181+0000","last_change":"2023-05-17T12:25:01.806572+0000","last_active":"2023-05-17T12:25:06.996181+0000","last_peered":"2023-05-17T12:25:06.996181+0000","last_clean":"2023-05-17T12:25:06.996181+0000","last_became_active":"2023-05-17T12:25:01.806281+0000","last_became_peered":"2023-05-17T12:25:01.806281+0000","last_unstale":"2023-05-17T12:25:06.996181+0000","last_undegraded":"2023-05-17T12:25:06.996181+0000","last_fullsized":"2023-05-17T12:25:06.996181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:56:53.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299059+0000","last_change":"2023-05-17T12:25:01.803927+0000","last_active":"2023-05-17T12:25:06.299059+0000","last_peered":"2023-05-17T12:25:06.299059+0000","last_clean":"2023-05-17T12:25:06.299059+0000","last_became_active":"2023-05-17T12:25:01.803617+0000","last_became_peered":"2023-05-17T12:25:01.803617+0000","last_unstale":"2023-05-17T12:25:06.299059+0000","last_undegraded":"2023-05-17T12:25:06.299059+0000","last_fullsized":"2023-05-17T12:25:06.299059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:22.759151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325614+0000","last_change":"2023-05-17T12:25:01.799177+0000","last_active":"2023-05-17T12:25:06.325614+0000","last_peered":"2023-05-17T12:25:06.325614+0000","last_clean":"2023-05-17T12:25:06.325614+0000","last_became_active":"2023-05-17T12:25:01.798532+0000","last_became_peered":"2023-05-17T12:25:01.798532+0000","last_unstale":"2023-05-17T12:25:06.325614+0000","last_undegraded":"2023-05-17T12:25:06.325614+0000","last_fullsized":"2023-05-17T12:25:06.325614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:22.299274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299922+0000","last_change":"2023-05-17T12:25:01.798406+0000","last_active":"2023-05-17T12:25:06.299922+0000","last_peered":"2023-05-17T12:25:06.299922+0000","last_clean":"2023-05-17T12:25:06.299922+0000","last_became_active":"2023-05-17T12:25:01.798107+0000","last_became_peered":"2023-05-17T12:25:01.798107+0000","last_unstale":"2023-05-17T12:25:06.299922+0000","last_undegraded":"2023-05-17T12:25:06.299922+0000","last_fullsized":"2023-05-17T12:25:06.299922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:56.325526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996483+0000","last_change":"2023-05-17T12:25:01.810494+0000","last_active":"2023-05-17T12:25:06.996483+0000","last_peered":"2023-05-17T12:25:06.996483+0000","last_clean":"2023-05-17T12:25:06.996483+0000","last_became_active":"2023-05-17T12:25:01.810141+0000","last_became_peered":"2023-05-17T12:25:01.810141+0000","last_unstale":"2023-05-17T12:25:06.996483+0000","last_undegraded":"2023-05-17T12:25:06.996483+0000","last_fullsized":"2023-05-17T12:25:06.996483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:55:47.642675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296559+0000","last_change":"2023-05-17T12:25:01.810500+0000","last_active":"2023-05-17T12:25:06.296559+0000","last_peered":"2023-05-17T12:25:06.296559+0000","last_clean":"2023-05-17T12:25:06.296559+0000","last_became_active":"2023-05-17T12:25:01.810218+0000","last_became_peered":"2023-05-17T12:25:01.810218+0000","last_unstale":"2023-05-17T12:25:06.296559+0000","last_undegraded":"2023-05-17T12:25:06.296559+0000","last_fullsized":"2023-05-17T12:25:06.296559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:25.158644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296403+0000","last_change":"2023-05-17T12:25:01.795337+0000","last_active":"2023-05-17T12:25:06.296403+0000","last_peered":"2023-05-17T12:25:06.296403+0000","last_clean":"2023-05-17T12:25:06.296403+0000","last_became_active":"2023-05-17T12:25:01.795015+0000","last_became_peered":"2023-05-17T12:25:01.795015+0000","last_unstale":"2023-05-17T12:25:06.296403+0000","last_undegraded":"2023-05-17T12:25:06.296403+0000","last_fullsized":"2023-05-17T12:25:06.296403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:08:00.351240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298545+0000","last_change":"2023-05-17T12:25:01.794491+0000","last_active":"2023-05-17T12:25:06.298545+0000","last_peered":"2023-05-17T12:25:06.298545+0000","last_clean":"2023-05-17T12:25:06.298545+0000","last_became_active":"2023-05-17T12:25:01.794195+0000","last_became_peered":"2023-05-17T12:25:01.794195+0000","last_unstale":"2023-05-17T12:25:06.298545+0000","last_undegraded":"2023-05-17T12:25:06.298545+0000","last_fullsized":"2023-05-17T12:25:06.298545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:42:56.633809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995720+0000","last_change":"2023-05-17T12:25:01.806504+0000","last_active":"2023-05-17T12:25:06.995720+0000","last_peered":"2023-05-17T12:25:06.995720+0000","last_clean":"2023-05-17T12:25:06.995720+0000","last_became_active":"2023-05-17T12:25:01.806169+0000","last_became_peered":"2023-05-17T12:25:01.806169+0000","last_unstale":"2023-05-17T12:25:06.995720+0000","last_undegraded":"2023-05-17T12:25:06.995720+0000","last_fullsized":"2023-05-17T12:25:06.995720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995025+0000","last_change":"2023-05-17T12:25:01.810537+0000","last_active":"2023-05-17T12:25:06.995025+0000","last_peered":"2023-05-17T12:25:06.995025+0000","last_clean":"2023-05-17T12:25:06.995025+0000","last_became_active":"2023-05-17T12:25:01.809999+0000","last_became_peered":"2023-05-17T12:25:01.809999+0000","last_unstale":"2023-05-17T12:25:06.995025+0000","last_undegraded":"2023-05-17T12:25:06.995025+0000","last_fullsized":"2023-05-17T12:25:06.995025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:02:23.504157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325601+0000","last_change":"2023-05-17T12:25:01.798577+0000","last_active":"2023-05-17T12:25:06.325601+0000","last_peered":"2023-05-17T12:25:06.325601+0000","last_clean":"2023-05-17T12:25:06.325601+0000","last_became_active":"2023-05-17T12:25:01.798348+0000","last_became_peered":"2023-05-17T12:25:01.798348+0000","last_unstale":"2023-05-17T12:25:06.325601+0000","last_undegraded":"2023-05-17T12:25:06.325601+0000","last_fullsized":"2023-05-17T12:25:06.325601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996347+0000","last_change":"2023-05-17T12:25:01.810349+0000","last_active":"2023-05-17T12:25:06.996347+0000","last_peered":"2023-05-17T12:25:06.996347+0000","last_clean":"2023-05-17T12:25:06.996347+0000","last_became_active":"2023-05-17T12:25:01.809853+0000","last_became_peered":"2023-05-17T12:25:01.809853+0000","last_unstale":"2023-05-17T12:25:06.996347+0000","last_undegraded":"2023-05-17T12:25:06.996347+0000","last_fullsized":"2023-05-17T12:25:06.996347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:04:42.761172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296403+0000","last_change":"2023-05-17T12:25:01.811973+0000","last_active":"2023-05-17T12:25:06.296403+0000","last_peered":"2023-05-17T12:25:06.296403+0000","last_clean":"2023-05-17T12:25:06.296403+0000","last_became_active":"2023-05-17T12:25:01.811764+0000","last_became_peered":"2023-05-17T12:25:01.811764+0000","last_unstale":"2023-05-17T12:25:06.296403+0000","last_undegraded":"2023-05-17T12:25:06.296403+0000","last_fullsized":"2023-05-17T12:25:06.296403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:59:51.442756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995789+0000","last_change":"2023-05-17T12:25:01.812104+0000","last_active":"2023-05-17T12:25:06.995789+0000","last_peered":"2023-05-17T12:25:06.995789+0000","last_clean":"2023-05-17T12:25:06.995789+0000","last_became_active":"2023-05-17T12:25:01.811782+0000","last_became_peered":"2023-05-17T12:25:01.811782+0000","last_unstale":"2023-05-17T12:25:06.995789+0000","last_undegraded":"2023-05-17T12:25:06.995789+0000","last_fullsized":"2023-05-17T12:25:06.995789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:27:46.682969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995644+0000","last_change":"2023-05-17T12:25:01.800327+0000","last_active":"2023-05-17T12:25:06.995644+0000","last_peered":"2023-05-17T12:25:06.995644+0000","last_clean":"2023-05-17T12:25:06.995644+0000","last_became_active":"2023-05-17T12:25:01.799859+0000","last_became_peered":"2023-05-17T12:25:01.799859+0000","last_unstale":"2023-05-17T12:25:06.995644+0000","last_undegraded":"2023-05-17T12:25:06.995644+0000","last_fullsized":"2023-05-17T12:25:06.995644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:22.299274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325260+0000","last_change":"2023-05-17T12:25:01.804627+0000","last_active":"2023-05-17T12:25:06.325260+0000","last_peered":"2023-05-17T12:25:06.325260+0000","last_clean":"2023-05-17T12:25:06.325260+0000","last_became_active":"2023-05-17T12:25:01.804355+0000","last_became_peered":"2023-05-17T12:25:01.804355+0000","last_unstale":"2023-05-17T12:25:06.325260+0000","last_undegraded":"2023-05-17T12:25:06.325260+0000","last_fullsized":"2023-05-17T12:25:06.325260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:58.149661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994004+0000","last_change":"2023-05-17T12:25:01.795597+0000","last_active":"2023-05-17T12:25:06.994004+0000","last_peered":"2023-05-17T12:25:06.994004+0000","last_clean":"2023-05-17T12:25:06.994004+0000","last_became_active":"2023-05-17T12:25:01.794994+0000","last_became_peered":"2023-05-17T12:25:01.794994+0000","last_unstale":"2023-05-17T12:25:06.994004+0000","last_undegraded":"2023-05-17T12:25:06.994004+0000","last_fullsized":"2023-05-17T12:25:06.994004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995908+0000","last_change":"2023-05-17T12:25:01.799968+0000","last_active":"2023-05-17T12:25:06.995908+0000","last_peered":"2023-05-17T12:25:06.995908+0000","last_clean":"2023-05-17T12:25:06.995908+0000","last_became_active":"2023-05-17T12:25:01.799673+0000","last_became_peered":"2023-05-17T12:25:01.799673+0000","last_unstale":"2023-05-17T12:25:06.995908+0000","last_undegraded":"2023-05-17T12:25:06.995908+0000","last_fullsized":"2023-05-17T12:25:06.995908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:01.358359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494793+0000","last_change":"2023-05-17T12:25:01.808781+0000","last_active":"2023-05-17T12:25:06.494793+0000","last_peered":"2023-05-17T12:25:06.494793+0000","last_clean":"2023-05-17T12:25:06.494793+0000","last_became_active":"2023-05-17T12:25:01.808497+0000","last_became_peered":"2023-05-17T12:25:01.808497+0000","last_unstale":"2023-05-17T12:25:06.494793+0000","last_undegraded":"2023-05-17T12:25:06.494793+0000","last_fullsized":"2023-05-17T12:25:06.494793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.495101+0000","last_change":"2023-05-17T12:25:01.799943+0000","last_active":"2023-05-17T12:25:06.495101+0000","last_peered":"2023-05-17T12:25:06.495101+0000","last_clean":"2023-05-17T12:25:06.495101+0000","last_became_active":"2023-05-17T12:25:01.799590+0000","last_became_peered":"2023-05-17T12:25:01.799590+0000","last_unstale":"2023-05-17T12:25:06.495101+0000","last_undegraded":"2023-05-17T12:25:06.495101+0000","last_fullsized":"2023-05-17T12:25:06.495101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299616+0000","last_change":"2023-05-17T12:25:01.809762+0000","last_active":"2023-05-17T12:25:06.299616+0000","last_peered":"2023-05-17T12:25:06.299616+0000","last_clean":"2023-05-17T12:25:06.299616+0000","last_became_active":"2023-05-17T12:25:01.809453+0000","last_became_peered":"2023-05-17T12:25:01.809453+0000","last_unstale":"2023-05-17T12:25:06.299616+0000","last_undegraded":"2023-05-17T12:25:06.299616+0000","last_fullsized":"2023-05-17T12:25:06.299616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996398+0000","last_change":"2023-05-17T12:25:05.826281+0000","last_active":"2023-05-17T12:25:06.996398+0000","last_peered":"2023-05-17T12:25:06.996398+0000","last_clean":"2023-05-17T12:25:06.996398+0000","last_became_active":"2023-05-17T12:25:05.825799+0000","last_became_peered":"2023-05-17T12:25:05.825799+0000","last_unstale":"2023-05-17T12:25:06.996398+0000","last_undegraded":"2023-05-17T12:25:06.996398+0000","last_fullsized":"2023-05-17T12:25:06.996398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:29:56.321361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995190+0000","last_change":"2023-05-17T12:25:01.309876+0000","last_active":"2023-05-17T12:25:06.995190+0000","last_peered":"2023-05-17T12:25:06.995190+0000","last_clean":"2023-05-17T12:25:06.995190+0000","last_became_active":"2023-05-17T12:25:01.307886+0000","last_became_peered":"2023-05-17T12:25:01.307886+0000","last_unstale":"2023-05-17T12:25:06.995190+0000","last_undegraded":"2023-05-17T12:25:06.995190+0000","last_fullsized":"2023-05-17T12:25:06.995190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:18:49.877888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994778+0000","last_change":"2023-05-17T12:25:01.803127+0000","last_active":"2023-05-17T12:25:06.994778+0000","last_peered":"2023-05-17T12:25:06.994778+0000","last_clean":"2023-05-17T12:25:06.994778+0000","last_became_active":"2023-05-17T12:25:01.802844+0000","last_became_peered":"2023-05-17T12:25:01.802844+0000","last_unstale":"2023-05-17T12:25:06.994778+0000","last_undegraded":"2023-05-17T12:25:06.994778+0000","last_fullsized":"2023-05-17T12:25:06.994778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:52:59.526969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298648+0000","last_change":"2023-05-17T12:25:05.828211+0000","last_active":"2023-05-17T12:25:06.298648+0000","last_peered":"2023-05-17T12:25:06.298648+0000","last_clean":"2023-05-17T12:25:06.298648+0000","last_became_active":"2023-05-17T12:25:05.827748+0000","last_became_peered":"2023-05-17T12:25:05.827748+0000","last_unstale":"2023-05-17T12:25:06.298648+0000","last_undegraded":"2023-05-17T12:25:06.298648+0000","last_fullsized":"2023-05-17T12:25:06.298648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:07:33.893870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.493925+0000","last_change":"2023-05-17T12:25:01.302947+0000","last_active":"2023-05-17T12:25:06.493925+0000","last_peered":"2023-05-17T12:25:06.493925+0000","last_clean":"2023-05-17T12:25:06.493925+0000","last_became_active":"2023-05-17T12:25:01.302640+0000","last_became_peered":"2023-05-17T12:25:01.302640+0000","last_unstale":"2023-05-17T12:25:06.493925+0000","last_undegraded":"2023-05-17T12:25:06.493925+0000","last_fullsized":"2023-05-17T12:25:06.493925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:46:32.251609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325638+0000","last_change":"2023-05-17T12:25:01.810080+0000","last_active":"2023-05-17T12:25:06.325638+0000","last_peered":"2023-05-17T12:25:06.325638+0000","last_clean":"2023-05-17T12:25:06.325638+0000","last_became_active":"2023-05-17T12:25:01.808787+0000","last_became_peered":"2023-05-17T12:25:01.808787+0000","last_unstale":"2023-05-17T12:25:06.325638+0000","last_undegraded":"2023-05-17T12:25:06.325638+0000","last_fullsized":"2023-05-17T12:25:06.325638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325836+0000","last_change":"2023-05-17T12:25:05.831211+0000","last_active":"2023-05-17T12:25:06.325836+0000","last_peered":"2023-05-17T12:25:06.325836+0000","last_clean":"2023-05-17T12:25:06.325836+0000","last_became_active":"2023-05-17T12:25:05.830823+0000","last_became_peered":"2023-05-17T12:25:05.830823+0000","last_unstale":"2023-05-17T12:25:06.325836+0000","last_undegraded":"2023-05-17T12:25:06.325836+0000","last_fullsized":"2023-05-17T12:25:06.325836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:04.874650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994157+0000","last_change":"2023-05-17T12:25:01.304687+0000","last_active":"2023-05-17T12:25:06.994157+0000","last_peered":"2023-05-17T12:25:06.994157+0000","last_clean":"2023-05-17T12:25:06.994157+0000","last_became_active":"2023-05-17T12:25:01.304242+0000","last_became_peered":"2023-05-17T12:25:01.304242+0000","last_unstale":"2023-05-17T12:25:06.994157+0000","last_undegraded":"2023-05-17T12:25:06.994157+0000","last_fullsized":"2023-05-17T12:25:06.994157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:27.380050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298774+0000","last_change":"2023-05-17T12:25:01.807436+0000","last_active":"2023-05-17T12:25:06.298774+0000","last_peered":"2023-05-17T12:25:06.298774+0000","last_clean":"2023-05-17T12:25:06.298774+0000","last_became_active":"2023-05-17T12:25:01.807174+0000","last_became_peered":"2023-05-17T12:25:01.807174+0000","last_unstale":"2023-05-17T12:25:06.298774+0000","last_undegraded":"2023-05-17T12:25:06.298774+0000","last_fullsized":"2023-05-17T12:25:06.298774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:53:31.008703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298892+0000","last_change":"2023-05-17T12:25:05.833027+0000","last_active":"2023-05-17T12:25:06.298892+0000","last_peered":"2023-05-17T12:25:06.298892+0000","last_clean":"2023-05-17T12:25:06.298892+0000","last_became_active":"2023-05-17T12:25:05.832612+0000","last_became_peered":"2023-05-17T12:25:05.832612+0000","last_unstale":"2023-05-17T12:25:06.298892+0000","last_undegraded":"2023-05-17T12:25:06.298892+0000","last_fullsized":"2023-05-17T12:25:06.298892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:55:06.307490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325684+0000","last_change":"2023-05-17T12:25:01.310559+0000","last_active":"2023-05-17T12:25:06.325684+0000","last_peered":"2023-05-17T12:25:06.325684+0000","last_clean":"2023-05-17T12:25:06.325684+0000","last_became_active":"2023-05-17T12:25:01.310250+0000","last_became_peered":"2023-05-17T12:25:01.310250+0000","last_unstale":"2023-05-17T12:25:06.325684+0000","last_undegraded":"2023-05-17T12:25:06.325684+0000","last_fullsized":"2023-05-17T12:25:06.325684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:15.832901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994111+0000","last_change":"2023-05-17T12:25:01.805412+0000","last_active":"2023-05-17T12:25:06.994111+0000","last_peered":"2023-05-17T12:25:06.994111+0000","last_clean":"2023-05-17T12:25:06.994111+0000","last_became_active":"2023-05-17T12:25:01.805151+0000","last_became_peered":"2023-05-17T12:25:01.805151+0000","last_unstale":"2023-05-17T12:25:06.994111+0000","last_undegraded":"2023-05-17T12:25:06.994111+0000","last_fullsized":"2023-05-17T12:25:06.994111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995226+0000","last_change":"2023-05-17T12:25:05.838900+0000","last_active":"2023-05-17T12:25:06.995226+0000","last_peered":"2023-05-17T12:25:06.995226+0000","last_clean":"2023-05-17T12:25:06.995226+0000","last_became_active":"2023-05-17T12:25:05.838472+0000","last_became_peered":"2023-05-17T12:25:05.838472+0000","last_unstale":"2023-05-17T12:25:06.995226+0000","last_undegraded":"2023-05-17T12:25:06.995226+0000","last_fullsized":"2023-05-17T12:25:06.995226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:33.512949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299849+0000","last_change":"2023-05-17T12:25:01.303641+0000","last_active":"2023-05-17T12:25:06.299849+0000","last_peered":"2023-05-17T12:25:06.299849+0000","last_clean":"2023-05-17T12:25:06.299849+0000","last_became_active":"2023-05-17T12:25:01.303288+0000","last_became_peered":"2023-05-17T12:25:01.303288+0000","last_unstale":"2023-05-17T12:25:06.299849+0000","last_undegraded":"2023-05-17T12:25:06.299849+0000","last_fullsized":"2023-05-17T12:25:06.299849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:41.485809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994071+0000","last_change":"2023-05-17T12:25:01.813134+0000","last_active":"2023-05-17T12:25:06.994071+0000","last_peered":"2023-05-17T12:25:06.994071+0000","last_clean":"2023-05-17T12:25:06.994071+0000","last_became_active":"2023-05-17T12:25:01.812890+0000","last_became_peered":"2023-05-17T12:25:01.812890+0000","last_unstale":"2023-05-17T12:25:06.994071+0000","last_undegraded":"2023-05-17T12:25:06.994071+0000","last_fullsized":"2023-05-17T12:25:06.994071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994712+0000","last_change":"2023-05-17T12:25:05.825529+0000","last_active":"2023-05-17T12:25:06.994712+0000","last_peered":"2023-05-17T12:25:06.994712+0000","last_clean":"2023-05-17T12:25:06.994712+0000","last_became_active":"2023-05-17T12:25:05.825141+0000","last_became_peered":"2023-05-17T12:25:05.825141+0000","last_unstale":"2023-05-17T12:25:06.994712+0000","last_undegraded":"2023-05-17T12:25:06.994712+0000","last_fullsized":"2023-05-17T12:25:06.994712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:01.828288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995416+0000","last_change":"2023-05-17T12:25:01.312424+0000","last_active":"2023-05-17T12:25:06.995416+0000","last_peered":"2023-05-17T12:25:06.995416+0000","last_clean":"2023-05-17T12:25:06.995416+0000","last_became_active":"2023-05-17T12:25:01.312124+0000","last_became_peered":"2023-05-17T12:25:01.312124+0000","last_unstale":"2023-05-17T12:25:06.995416+0000","last_undegraded":"2023-05-17T12:25:06.995416+0000","last_fullsized":"2023-05-17T12:25:06.995416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:15.832901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494444+0000","last_change":"2023-05-17T12:25:01.808707+0000","last_active":"2023-05-17T12:25:06.494444+0000","last_peered":"2023-05-17T12:25:06.494444+0000","last_clean":"2023-05-17T12:25:06.494444+0000","last_became_active":"2023-05-17T12:25:01.808370+0000","last_became_peered":"2023-05-17T12:25:01.808370+0000","last_unstale":"2023-05-17T12:25:06.494444+0000","last_undegraded":"2023-05-17T12:25:06.494444+0000","last_fullsized":"2023-05-17T12:25:06.494444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:58.149661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494050+0000","last_change":"2023-05-17T12:25:05.828428+0000","last_active":"2023-05-17T12:25:06.494050+0000","last_peered":"2023-05-17T12:25:06.494050+0000","last_clean":"2023-05-17T12:25:06.494050+0000","last_became_active":"2023-05-17T12:25:05.828056+0000","last_became_peered":"2023-05-17T12:25:05.828056+0000","last_unstale":"2023-05-17T12:25:06.494050+0000","last_undegraded":"2023-05-17T12:25:06.494050+0000","last_fullsized":"2023-05-17T12:25:06.494050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:09:51.971442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:21.144736+0000","last_change":"2023-05-17T12:25:01.303424+0000","last_active":"2023-05-17T12:25:21.144736+0000","last_peered":"2023-05-17T12:25:21.144736+0000","last_clean":"2023-05-17T12:25:21.144736+0000","last_became_active":"2023-05-17T12:25:01.303056+0000","last_became_peered":"2023-05-17T12:25:01.303056+0000","last_unstale":"2023-05-17T12:25:21.144736+0000","last_undegraded":"2023-05-17T12:25:21.144736+0000","last_fullsized":"2023-05-17T12:25:21.144736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:08:00.689474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996178+0000","last_change":"2023-05-17T12:25:01.812617+0000","last_active":"2023-05-17T12:25:06.996178+0000","last_peered":"2023-05-17T12:25:06.996178+0000","last_clean":"2023-05-17T12:25:06.996178+0000","last_became_active":"2023-05-17T12:25:01.811849+0000","last_became_peered":"2023-05-17T12:25:01.811849+0000","last_unstale":"2023-05-17T12:25:06.996178+0000","last_undegraded":"2023-05-17T12:25:06.996178+0000","last_fullsized":"2023-05-17T12:25:06.996178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:45:31.781166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299814+0000","last_change":"2023-05-17T12:25:05.830416+0000","last_active":"2023-05-17T12:25:06.299814+0000","last_peered":"2023-05-17T12:25:06.299814+0000","last_clean":"2023-05-17T12:25:06.299814+0000","last_became_active":"2023-05-17T12:25:05.829972+0000","last_became_peered":"2023-05-17T12:25:05.829972+0000","last_unstale":"2023-05-17T12:25:06.299814+0000","last_undegraded":"2023-05-17T12:25:06.299814+0000","last_fullsized":"2023-05-17T12:25:06.299814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:04.874650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995420+0000","last_change":"2023-05-17T12:25:01.307020+0000","last_active":"2023-05-17T12:25:06.995420+0000","last_peered":"2023-05-17T12:25:06.995420+0000","last_clean":"2023-05-17T12:25:06.995420+0000","last_became_active":"2023-05-17T12:25:01.306785+0000","last_became_peered":"2023-05-17T12:25:01.306785+0000","last_unstale":"2023-05-17T12:25:06.995420+0000","last_undegraded":"2023-05-17T12:25:06.995420+0000","last_fullsized":"2023-05-17T12:25:06.995420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:45.367692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994598+0000","last_change":"2023-05-17T12:25:01.803384+0000","last_active":"2023-05-17T12:25:06.994598+0000","last_peered":"2023-05-17T12:25:06.994598+0000","last_clean":"2023-05-17T12:25:06.994598+0000","last_became_active":"2023-05-17T12:25:01.803098+0000","last_became_peered":"2023-05-17T12:25:01.803098+0000","last_unstale":"2023-05-17T12:25:06.994598+0000","last_undegraded":"2023-05-17T12:25:06.994598+0000","last_fullsized":"2023-05-17T12:25:06.994598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:56.325526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994382+0000","last_change":"2023-05-17T12:25:05.832871+0000","last_active":"2023-05-17T12:25:06.994382+0000","last_peered":"2023-05-17T12:25:06.994382+0000","last_clean":"2023-05-17T12:25:06.994382+0000","last_became_active":"2023-05-17T12:25:05.832188+0000","last_became_peered":"2023-05-17T12:25:05.832188+0000","last_unstale":"2023-05-17T12:25:06.994382+0000","last_undegraded":"2023-05-17T12:25:06.994382+0000","last_fullsized":"2023-05-17T12:25:06.994382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:09.673142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325005+0000","last_change":"2023-05-17T12:25:01.299295+0000","last_active":"2023-05-17T12:25:06.325005+0000","last_peered":"2023-05-17T12:25:06.325005+0000","last_clean":"2023-05-17T12:25:06.325005+0000","last_became_active":"2023-05-17T12:25:01.298965+0000","last_became_peered":"2023-05-17T12:25:01.298965+0000","last_unstale":"2023-05-17T12:25:06.325005+0000","last_undegraded":"2023-05-17T12:25:06.325005+0000","last_fullsized":"2023-05-17T12:25:06.325005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:53.614694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299614+0000","last_change":"2023-05-17T12:25:01.809638+0000","last_active":"2023-05-17T12:25:06.299614+0000","last_peered":"2023-05-17T12:25:06.299614+0000","last_clean":"2023-05-17T12:25:06.299614+0000","last_became_active":"2023-05-17T12:25:01.809317+0000","last_became_peered":"2023-05-17T12:25:01.809317+0000","last_unstale":"2023-05-17T12:25:06.299614+0000","last_undegraded":"2023-05-17T12:25:06.299614+0000","last_fullsized":"2023-05-17T12:25:06.299614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994585+0000","last_change":"2023-05-17T12:25:05.834920+0000","last_active":"2023-05-17T12:25:06.994585+0000","last_peered":"2023-05-17T12:25:06.994585+0000","last_clean":"2023-05-17T12:25:06.994585+0000","last_became_active":"2023-05-17T12:25:05.834577+0000","last_became_peered":"2023-05-17T12:25:05.834577+0000","last_unstale":"2023-05-17T12:25:06.994585+0000","last_undegraded":"2023-05-17T12:25:06.994585+0000","last_fullsized":"2023-05-17T12:25:06.994585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:46.007953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995874+0000","last_change":"2023-05-17T12:25:01.307004+0000","last_active":"2023-05-17T12:25:06.995874+0000","last_peered":"2023-05-17T12:25:06.995874+0000","last_clean":"2023-05-17T12:25:06.995874+0000","last_became_active":"2023-05-17T12:25:01.306682+0000","last_became_peered":"2023-05-17T12:25:01.306682+0000","last_unstale":"2023-05-17T12:25:06.995874+0000","last_undegraded":"2023-05-17T12:25:06.995874+0000","last_fullsized":"2023-05-17T12:25:06.995874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325659+0000","last_change":"2023-05-17T12:25:01.798105+0000","last_active":"2023-05-17T12:25:06.325659+0000","last_peered":"2023-05-17T12:25:06.325659+0000","last_clean":"2023-05-17T12:25:06.325659+0000","last_became_active":"2023-05-17T12:25:01.797871+0000","last_became_peered":"2023-05-17T12:25:01.797871+0000","last_unstale":"2023-05-17T12:25:06.325659+0000","last_undegraded":"2023-05-17T12:25:06.325659+0000","last_fullsized":"2023-05-17T12:25:06.325659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299751+0000","last_change":"2023-05-17T12:25:05.830239+0000","last_active":"2023-05-17T12:25:06.299751+0000","last_peered":"2023-05-17T12:25:06.299751+0000","last_clean":"2023-05-17T12:25:06.299751+0000","last_became_active":"2023-05-17T12:25:05.829812+0000","last_became_peered":"2023-05-17T12:25:05.829812+0000","last_unstale":"2023-05-17T12:25:06.299751+0000","last_undegraded":"2023-05-17T12:25:06.299751+0000","last_fullsized":"2023-05-17T12:25:06.299751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:42.636103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298742+0000","last_change":"2023-05-17T12:25:01.301970+0000","last_active":"2023-05-17T12:25:06.298742+0000","last_peered":"2023-05-17T12:25:06.298742+0000","last_clean":"2023-05-17T12:25:06.298742+0000","last_became_active":"2023-05-17T12:25:01.301645+0000","last_became_peered":"2023-05-17T12:25:01.301645+0000","last_unstale":"2023-05-17T12:25:06.298742+0000","last_undegraded":"2023-05-17T12:25:06.298742+0000","last_fullsized":"2023-05-17T12:25:06.298742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:01:41.050026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994656+0000","last_change":"2023-05-17T12:25:01.814151+0000","last_active":"2023-05-17T12:25:06.994656+0000","last_peered":"2023-05-17T12:25:06.994656+0000","last_clean":"2023-05-17T12:25:06.994656+0000","last_became_active":"2023-05-17T12:25:01.813749+0000","last_became_peered":"2023-05-17T12:25:01.813749+0000","last_unstale":"2023-05-17T12:25:06.994656+0000","last_undegraded":"2023-05-17T12:25:06.994656+0000","last_fullsized":"2023-05-17T12:25:06.994656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:56:53.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996349+0000","last_change":"2023-05-17T12:25:05.841929+0000","last_active":"2023-05-17T12:25:06.996349+0000","last_peered":"2023-05-17T12:25:06.996349+0000","last_clean":"2023-05-17T12:25:06.996349+0000","last_became_active":"2023-05-17T12:25:05.841487+0000","last_became_peered":"2023-05-17T12:25:05.841487+0000","last_unstale":"2023-05-17T12:25:06.996349+0000","last_undegraded":"2023-05-17T12:25:06.996349+0000","last_fullsized":"2023-05-17T12:25:06.996349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:01.828288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996446+0000","last_change":"2023-05-17T12:25:01.304576+0000","last_active":"2023-05-17T12:25:06.996446+0000","last_peered":"2023-05-17T12:25:06.996446+0000","last_clean":"2023-05-17T12:25:06.996446+0000","last_became_active":"2023-05-17T12:25:01.304198+0000","last_became_peered":"2023-05-17T12:25:01.304198+0000","last_unstale":"2023-05-17T12:25:06.996446+0000","last_undegraded":"2023-05-17T12:25:06.996446+0000","last_fullsized":"2023-05-17T12:25:06.996446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:11.601219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298936+0000","last_change":"2023-05-17T12:25:01.802054+0000","last_active":"2023-05-17T12:25:06.298936+0000","last_peered":"2023-05-17T12:25:06.298936+0000","last_clean":"2023-05-17T12:25:06.298936+0000","last_became_active":"2023-05-17T12:25:01.801727+0000","last_became_peered":"2023-05-17T12:25:01.801727+0000","last_unstale":"2023-05-17T12:25:06.298936+0000","last_undegraded":"2023-05-17T12:25:06.298936+0000","last_fullsized":"2023-05-17T12:25:06.298936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:24.353901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296090+0000","last_change":"2023-05-17T12:25:05.831343+0000","last_active":"2023-05-17T12:25:06.296090+0000","last_peered":"2023-05-17T12:25:06.296090+0000","last_clean":"2023-05-17T12:25:06.296090+0000","last_became_active":"2023-05-17T12:25:05.830962+0000","last_became_peered":"2023-05-17T12:25:05.830962+0000","last_unstale":"2023-05-17T12:25:06.296090+0000","last_undegraded":"2023-05-17T12:25:06.296090+0000","last_fullsized":"2023-05-17T12:25:06.296090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:31:26.034991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996563+0000","last_change":"2023-05-17T12:25:01.307148+0000","last_active":"2023-05-17T12:25:06.996563+0000","last_peered":"2023-05-17T12:25:06.996563+0000","last_clean":"2023-05-17T12:25:06.996563+0000","last_became_active":"2023-05-17T12:25:01.306796+0000","last_became_peered":"2023-05-17T12:25:01.306796+0000","last_unstale":"2023-05-17T12:25:06.996563+0000","last_undegraded":"2023-05-17T12:25:06.996563+0000","last_fullsized":"2023-05-17T12:25:06.996563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:40:08.139475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995053+0000","last_change":"2023-05-17T12:25:01.810661+0000","last_active":"2023-05-17T12:25:06.995053+0000","last_peered":"2023-05-17T12:25:06.995053+0000","last_clean":"2023-05-17T12:25:06.995053+0000","last_became_active":"2023-05-17T12:25:01.810315+0000","last_became_peered":"2023-05-17T12:25:01.810315+0000","last_unstale":"2023-05-17T12:25:06.995053+0000","last_undegraded":"2023-05-17T12:25:06.995053+0000","last_fullsized":"2023-05-17T12:25:06.995053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:11:45.271597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296256+0000","last_change":"2023-05-17T12:25:05.827003+0000","last_active":"2023-05-17T12:25:06.296256+0000","last_peered":"2023-05-17T12:25:06.296256+0000","last_clean":"2023-05-17T12:25:06.296256+0000","last_became_active":"2023-05-17T12:25:05.826640+0000","last_became_peered":"2023-05-17T12:25:05.826640+0000","last_unstale":"2023-05-17T12:25:06.296256+0000","last_undegraded":"2023-05-17T12:25:06.296256+0000","last_fullsized":"2023-05-17T12:25:06.296256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:46:35.905087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995688+0000","last_change":"2023-05-17T12:25:01.309404+0000","last_active":"2023-05-17T12:25:06.995688+0000","last_peered":"2023-05-17T12:25:06.995688+0000","last_clean":"2023-05-17T12:25:06.995688+0000","last_became_active":"2023-05-17T12:25:01.309104+0000","last_became_peered":"2023-05-17T12:25:01.309104+0000","last_unstale":"2023-05-17T12:25:06.995688+0000","last_undegraded":"2023-05-17T12:25:06.995688+0000","last_fullsized":"2023-05-17T12:25:06.995688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:17.774402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298561+0000","last_change":"2023-05-17T12:25:01.806638+0000","last_active":"2023-05-17T12:25:06.298561+0000","last_peered":"2023-05-17T12:25:06.298561+0000","last_clean":"2023-05-17T12:25:06.298561+0000","last_became_active":"2023-05-17T12:25:01.806398+0000","last_became_peered":"2023-05-17T12:25:01.806398+0000","last_unstale":"2023-05-17T12:25:06.298561+0000","last_undegraded":"2023-05-17T12:25:06.298561+0000","last_fullsized":"2023-05-17T12:25:06.298561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:32:04.677765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296330+0000","last_change":"2023-05-17T12:25:05.825320+0000","last_active":"2023-05-17T12:25:06.296330+0000","last_peered":"2023-05-17T12:25:06.296330+0000","last_clean":"2023-05-17T12:25:06.296330+0000","last_became_active":"2023-05-17T12:25:05.824918+0000","last_became_peered":"2023-05-17T12:25:05.824918+0000","last_unstale":"2023-05-17T12:25:06.296330+0000","last_undegraded":"2023-05-17T12:25:06.296330+0000","last_fullsized":"2023-05-17T12:25:06.296330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:12:01.541988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298981+0000","last_change":"2023-05-17T12:25:01.311086+0000","last_active":"2023-05-17T12:25:06.298981+0000","last_peered":"2023-05-17T12:25:06.298981+0000","last_clean":"2023-05-17T12:25:06.298981+0000","last_became_active":"2023-05-17T12:25:01.310778+0000","last_became_peered":"2023-05-17T12:25:01.310778+0000","last_unstale":"2023-05-17T12:25:06.298981+0000","last_undegraded":"2023-05-17T12:25:06.298981+0000","last_fullsized":"2023-05-17T12:25:06.298981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:57.143808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325238+0000","last_change":"2023-05-17T12:25:01.803984+0000","last_active":"2023-05-17T12:25:06.325238+0000","last_peered":"2023-05-17T12:25:06.325238+0000","last_clean":"2023-05-17T12:25:06.325238+0000","last_became_active":"2023-05-17T12:25:01.803655+0000","last_became_peered":"2023-05-17T12:25:01.803655+0000","last_unstale":"2023-05-17T12:25:06.325238+0000","last_undegraded":"2023-05-17T12:25:06.325238+0000","last_fullsized":"2023-05-17T12:25:06.325238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:24.353901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296620+0000","last_change":"2023-05-17T12:25:05.827683+0000","last_active":"2023-05-17T12:25:06.296620+0000","last_peered":"2023-05-17T12:25:06.296620+0000","last_clean":"2023-05-17T12:25:06.296620+0000","last_became_active":"2023-05-17T12:25:05.827247+0000","last_became_peered":"2023-05-17T12:25:05.827247+0000","last_unstale":"2023-05-17T12:25:06.296620+0000","last_undegraded":"2023-05-17T12:25:06.296620+0000","last_fullsized":"2023-05-17T12:25:06.296620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:26:50.186275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994317+0000","last_change":"2023-05-17T12:25:01.302898+0000","last_active":"2023-05-17T12:25:06.994317+0000","last_peered":"2023-05-17T12:25:06.994317+0000","last_clean":"2023-05-17T12:25:06.994317+0000","last_became_active":"2023-05-17T12:25:01.302511+0000","last_became_peered":"2023-05-17T12:25:01.302511+0000","last_unstale":"2023-05-17T12:25:06.994317+0000","last_undegraded":"2023-05-17T12:25:06.994317+0000","last_fullsized":"2023-05-17T12:25:06.994317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:00.352507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995431+0000","last_change":"2023-05-17T12:25:01.809822+0000","last_active":"2023-05-17T12:25:06.995431+0000","last_peered":"2023-05-17T12:25:06.995431+0000","last_clean":"2023-05-17T12:25:06.995431+0000","last_became_active":"2023-05-17T12:25:01.809341+0000","last_became_peered":"2023-05-17T12:25:01.809341+0000","last_unstale":"2023-05-17T12:25:06.995431+0000","last_undegraded":"2023-05-17T12:25:06.995431+0000","last_fullsized":"2023-05-17T12:25:06.995431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:55:38.616795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494179+0000","last_change":"2023-05-17T12:25:05.823841+0000","last_active":"2023-05-17T12:25:06.494179+0000","last_peered":"2023-05-17T12:25:06.494179+0000","last_clean":"2023-05-17T12:25:06.494179+0000","last_became_active":"2023-05-17T12:25:05.823477+0000","last_became_peered":"2023-05-17T12:25:05.823477+0000","last_unstale":"2023-05-17T12:25:06.494179+0000","last_undegraded":"2023-05-17T12:25:06.494179+0000","last_fullsized":"2023-05-17T12:25:06.494179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:35:08.935796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298699+0000","last_change":"2023-05-17T12:25:01.304712+0000","last_active":"2023-05-17T12:25:06.298699+0000","last_peered":"2023-05-17T12:25:06.298699+0000","last_clean":"2023-05-17T12:25:06.298699+0000","last_became_active":"2023-05-17T12:25:01.304393+0000","last_became_peered":"2023-05-17T12:25:01.304393+0000","last_unstale":"2023-05-17T12:25:06.298699+0000","last_undegraded":"2023-05-17T12:25:06.298699+0000","last_fullsized":"2023-05-17T12:25:06.298699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:26:28.248372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995773+0000","last_change":"2023-05-17T12:25:01.798453+0000","last_active":"2023-05-17T12:25:06.995773+0000","last_peered":"2023-05-17T12:25:06.995773+0000","last_clean":"2023-05-17T12:25:06.995773+0000","last_became_active":"2023-05-17T12:25:01.798156+0000","last_became_peered":"2023-05-17T12:25:01.798156+0000","last_unstale":"2023-05-17T12:25:06.995773+0000","last_undegraded":"2023-05-17T12:25:06.995773+0000","last_fullsized":"2023-05-17T12:25:06.995773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:43.116514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299389+0000","last_change":"2023-05-17T12:25:05.830481+0000","last_active":"2023-05-17T12:25:06.299389+0000","last_peered":"2023-05-17T12:25:06.299389+0000","last_clean":"2023-05-17T12:25:06.299389+0000","last_became_active":"2023-05-17T12:25:05.829790+0000","last_became_peered":"2023-05-17T12:25:05.829790+0000","last_unstale":"2023-05-17T12:25:06.299389+0000","last_undegraded":"2023-05-17T12:25:06.299389+0000","last_fullsized":"2023-05-17T12:25:06.299389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:49.889835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995559+0000","last_change":"2023-05-17T12:25:01.303346+0000","last_active":"2023-05-17T12:25:06.995559+0000","last_peered":"2023-05-17T12:25:06.995559+0000","last_clean":"2023-05-17T12:25:06.995559+0000","last_became_active":"2023-05-17T12:25:01.303010+0000","last_became_peered":"2023-05-17T12:25:01.303010+0000","last_unstale":"2023-05-17T12:25:06.995559+0000","last_undegraded":"2023-05-17T12:25:06.995559+0000","last_fullsized":"2023-05-17T12:25:06.995559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:05:24.193334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996498+0000","last_change":"2023-05-17T12:25:01.812147+0000","last_active":"2023-05-17T12:25:06.996498+0000","last_peered":"2023-05-17T12:25:06.996498+0000","last_clean":"2023-05-17T12:25:06.996498+0000","last_became_active":"2023-05-17T12:25:01.811794+0000","last_became_peered":"2023-05-17T12:25:01.811794+0000","last_unstale":"2023-05-17T12:25:06.996498+0000","last_undegraded":"2023-05-17T12:25:06.996498+0000","last_fullsized":"2023-05-17T12:25:06.996498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:21:08.368476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996608+0000","last_change":"2023-05-17T12:25:05.825191+0000","last_active":"2023-05-17T12:25:06.996608+0000","last_peered":"2023-05-17T12:25:06.996608+0000","last_clean":"2023-05-17T12:25:06.996608+0000","last_became_active":"2023-05-17T12:25:05.824783+0000","last_became_peered":"2023-05-17T12:25:05.824783+0000","last_unstale":"2023-05-17T12:25:06.996608+0000","last_undegraded":"2023-05-17T12:25:06.996608+0000","last_fullsized":"2023-05-17T12:25:06.996608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:37.899306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994023+0000","last_change":"2023-05-17T12:25:01.308187+0000","last_active":"2023-05-17T12:25:06.994023+0000","last_peered":"2023-05-17T12:25:06.994023+0000","last_clean":"2023-05-17T12:25:06.994023+0000","last_became_active":"2023-05-17T12:25:01.307806+0000","last_became_peered":"2023-05-17T12:25:01.307806+0000","last_unstale":"2023-05-17T12:25:06.994023+0000","last_undegraded":"2023-05-17T12:25:06.994023+0000","last_fullsized":"2023-05-17T12:25:06.994023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:28.990806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494856+0000","last_change":"2023-05-17T12:25:01.801432+0000","last_active":"2023-05-17T12:25:06.494856+0000","last_peered":"2023-05-17T12:25:06.494856+0000","last_clean":"2023-05-17T12:25:06.494856+0000","last_became_active":"2023-05-17T12:25:01.801009+0000","last_became_peered":"2023-05-17T12:25:01.801009+0000","last_unstale":"2023-05-17T12:25:06.494856+0000","last_undegraded":"2023-05-17T12:25:06.494856+0000","last_fullsized":"2023-05-17T12:25:06.494856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325252+0000","last_change":"2023-05-17T12:25:05.822949+0000","last_active":"2023-05-17T12:25:06.325252+0000","last_peered":"2023-05-17T12:25:06.325252+0000","last_clean":"2023-05-17T12:25:06.325252+0000","last_became_active":"2023-05-17T12:25:05.822299+0000","last_became_peered":"2023-05-17T12:25:05.822299+0000","last_unstale":"2023-05-17T12:25:06.325252+0000","last_undegraded":"2023-05-17T12:25:06.325252+0000","last_fullsized":"2023-05-17T12:25:06.325252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:43:00.150100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494254+0000","last_change":"2023-05-17T12:24:55.792670+0000","last_active":"2023-05-17T12:25:06.494254+0000","last_peered":"2023-05-17T12:25:06.494254+0000","last_clean":"2023-05-17T12:25:06.494254+0000","last_became_active":"2023-05-17T12:24:55.792363+0000","last_became_peered":"2023-05-17T12:24:55.792363+0000","last_unstale":"2023-05-17T12:25:06.494254+0000","last_undegraded":"2023-05-17T12:25:06.494254+0000","last_fullsized":"2023-05-17T12:25:06.494254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:48.078768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299528+0000","last_change":"2023-05-17T12:25:01.311296+0000","last_active":"2023-05-17T12:25:06.299528+0000","last_peered":"2023-05-17T12:25:06.299528+0000","last_clean":"2023-05-17T12:25:06.299528+0000","last_became_active":"2023-05-17T12:25:01.310946+0000","last_became_peered":"2023-05-17T12:25:01.310946+0000","last_unstale":"2023-05-17T12:25:06.299528+0000","last_undegraded":"2023-05-17T12:25:06.299528+0000","last_fullsized":"2023-05-17T12:25:06.299528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:21.293421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494247+0000","last_change":"2023-05-17T12:25:01.798812+0000","last_active":"2023-05-17T12:25:06.494247+0000","last_peered":"2023-05-17T12:25:06.494247+0000","last_clean":"2023-05-17T12:25:06.494247+0000","last_became_active":"2023-05-17T12:25:01.798536+0000","last_became_peered":"2023-05-17T12:25:01.798536+0000","last_unstale":"2023-05-17T12:25:06.494247+0000","last_undegraded":"2023-05-17T12:25:06.494247+0000","last_fullsized":"2023-05-17T12:25:06.494247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:52:17.557383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325259+0000","last_change":"2023-05-17T12:25:05.830657+0000","last_active":"2023-05-17T12:25:06.325259+0000","last_peered":"2023-05-17T12:25:06.325259+0000","last_clean":"2023-05-17T12:25:06.325259+0000","last_became_active":"2023-05-17T12:25:05.830173+0000","last_became_peered":"2023-05-17T12:25:05.830173+0000","last_unstale":"2023-05-17T12:25:06.325259+0000","last_undegraded":"2023-05-17T12:25:06.325259+0000","last_fullsized":"2023-05-17T12:25:06.325259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:29:01.854184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298702+0000","last_change":"2023-05-17T12:24:55.754074+0000","last_active":"2023-05-17T12:25:06.298702+0000","last_peered":"2023-05-17T12:25:06.298702+0000","last_clean":"2023-05-17T12:25:06.298702+0000","last_became_active":"2023-05-17T12:24:55.753544+0000","last_became_peered":"2023-05-17T12:24:55.753544+0000","last_unstale":"2023-05-17T12:25:06.298702+0000","last_undegraded":"2023-05-17T12:25:06.298702+0000","last_fullsized":"2023-05-17T12:25:06.298702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:28:51.796115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995192+0000","last_change":"2023-05-17T12:25:01.305764+0000","last_active":"2023-05-17T12:25:06.995192+0000","last_peered":"2023-05-17T12:25:06.995192+0000","last_clean":"2023-05-17T12:25:06.995192+0000","last_became_active":"2023-05-17T12:25:01.304391+0000","last_became_peered":"2023-05-17T12:25:01.304391+0000","last_unstale":"2023-05-17T12:25:06.995192+0000","last_undegraded":"2023-05-17T12:25:06.995192+0000","last_fullsized":"2023-05-17T12:25:06.995192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:59:10.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494223+0000","last_change":"2023-05-17T12:25:01.796749+0000","last_active":"2023-05-17T12:25:06.494223+0000","last_peered":"2023-05-17T12:25:06.494223+0000","last_clean":"2023-05-17T12:25:06.494223+0000","last_became_active":"2023-05-17T12:25:01.796483+0000","last_became_peered":"2023-05-17T12:25:01.796483+0000","last_unstale":"2023-05-17T12:25:06.494223+0000","last_undegraded":"2023-05-17T12:25:06.494223+0000","last_fullsized":"2023-05-17T12:25:06.494223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:41:28.654953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296765+0000","last_change":"2023-05-17T12:25:05.831371+0000","last_active":"2023-05-17T12:25:06.296765+0000","last_peered":"2023-05-17T12:25:06.296765+0000","last_clean":"2023-05-17T12:25:06.296765+0000","last_became_active":"2023-05-17T12:25:05.830975+0000","last_became_peered":"2023-05-17T12:25:05.830975+0000","last_unstale":"2023-05-17T12:25:06.296765+0000","last_undegraded":"2023-05-17T12:25:06.296765+0000","last_fullsized":"2023-05-17T12:25:06.296765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:20.938620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296249+0000","last_change":"2023-05-17T12:24:56.008501+0000","last_active":"2023-05-17T12:25:06.296249+0000","last_peered":"2023-05-17T12:25:06.296249+0000","last_clean":"2023-05-17T12:25:06.296249+0000","last_became_active":"2023-05-17T12:24:56.008203+0000","last_became_peered":"2023-05-17T12:24:56.008203+0000","last_unstale":"2023-05-17T12:25:06.296249+0000","last_undegraded":"2023-05-17T12:25:06.296249+0000","last_fullsized":"2023-05-17T12:25:06.296249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:04:51.599706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.493981+0000","last_change":"2023-05-17T12:25:01.301806+0000","last_active":"2023-05-17T12:25:06.493981+0000","last_peered":"2023-05-17T12:25:06.493981+0000","last_clean":"2023-05-17T12:25:06.493981+0000","last_became_active":"2023-05-17T12:25:01.301537+0000","last_became_peered":"2023-05-17T12:25:01.301537+0000","last_unstale":"2023-05-17T12:25:06.493981+0000","last_undegraded":"2023-05-17T12:25:06.493981+0000","last_fullsized":"2023-05-17T12:25:06.493981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:34:24.246684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494836+0000","last_change":"2023-05-17T12:25:01.801261+0000","last_active":"2023-05-17T12:25:06.494836+0000","last_peered":"2023-05-17T12:25:06.494836+0000","last_clean":"2023-05-17T12:25:06.494836+0000","last_became_active":"2023-05-17T12:25:01.800721+0000","last_became_peered":"2023-05-17T12:25:01.800721+0000","last_unstale":"2023-05-17T12:25:06.494836+0000","last_undegraded":"2023-05-17T12:25:06.494836+0000","last_fullsized":"2023-05-17T12:25:06.494836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:29.996659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996033+0000","last_change":"2023-05-17T12:25:05.844206+0000","last_active":"2023-05-17T12:25:06.996033+0000","last_peered":"2023-05-17T12:25:06.996033+0000","last_clean":"2023-05-17T12:25:06.996033+0000","last_became_active":"2023-05-17T12:25:05.843845+0000","last_became_peered":"2023-05-17T12:25:05.843845+0000","last_unstale":"2023-05-17T12:25:06.996033+0000","last_undegraded":"2023-05-17T12:25:06.996033+0000","last_fullsized":"2023-05-17T12:25:06.996033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:46.007953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299370+0000","last_change":"2023-05-17T12:24:55.753963+0000","last_active":"2023-05-17T12:25:06.299370+0000","last_peered":"2023-05-17T12:25:06.299370+0000","last_clean":"2023-05-17T12:25:06.299370+0000","last_became_active":"2023-05-17T12:24:55.753582+0000","last_became_peered":"2023-05-17T12:24:55.753582+0000","last_unstale":"2023-05-17T12:25:06.299370+0000","last_undegraded":"2023-05-17T12:25:06.299370+0000","last_fullsized":"2023-05-17T12:25:06.299370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995510+0000","last_change":"2023-05-17T12:24:48.829166+0000","last_active":"2023-05-17T12:25:06.995510+0000","last_peered":"2023-05-17T12:25:06.995510+0000","last_clean":"2023-05-17T12:25:06.995510+0000","last_became_active":"2023-05-17T12:24:48.828767+0000","last_became_peered":"2023-05-17T12:24:48.828767+0000","last_unstale":"2023-05-17T12:25:06.995510+0000","last_undegraded":"2023-05-17T12:25:06.995510+0000","last_fullsized":"2023-05-17T12:25:06.995510+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_clean_scrub_stamp":"2023-05-17T12:24:47.688706+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:18.612053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994251+0000","last_change":"2023-05-17T12:25:01.310793+0000","last_active":"2023-05-17T12:25:06.994251+0000","last_peered":"2023-05-17T12:25:06.994251+0000","last_clean":"2023-05-17T12:25:06.994251+0000","last_became_active":"2023-05-17T12:25:01.310471+0000","last_became_peered":"2023-05-17T12:25:01.310471+0000","last_unstale":"2023-05-17T12:25:06.994251+0000","last_undegraded":"2023-05-17T12:25:06.994251+0000","last_fullsized":"2023-05-17T12:25:06.994251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:21.293421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299111+0000","last_change":"2023-05-17T12:25:01.813237+0000","last_active":"2023-05-17T12:25:06.299111+0000","last_peered":"2023-05-17T12:25:06.299111+0000","last_clean":"2023-05-17T12:25:06.299111+0000","last_became_active":"2023-05-17T12:25:01.812856+0000","last_became_peered":"2023-05-17T12:25:01.812856+0000","last_unstale":"2023-05-17T12:25:06.299111+0000","last_undegraded":"2023-05-17T12:25:06.299111+0000","last_fullsized":"2023-05-17T12:25:06.299111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:03:48.424581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299344+0000","last_change":"2023-05-17T12:25:05.831353+0000","last_active":"2023-05-17T12:25:06.299344+0000","last_peered":"2023-05-17T12:25:06.299344+0000","last_clean":"2023-05-17T12:25:06.299344+0000","last_became_active":"2023-05-17T12:25:05.830895+0000","last_became_peered":"2023-05-17T12:25:05.830895+0000","last_unstale":"2023-05-17T12:25:06.299344+0000","last_undegraded":"2023-05-17T12:25:06.299344+0000","last_fullsized":"2023-05-17T12:25:06.299344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:33.512949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996042+0000","last_change":"2023-05-17T12:24:55.756595+0000","last_active":"2023-05-17T12:25:06.996042+0000","last_peered":"2023-05-17T12:25:06.996042+0000","last_clean":"2023-05-17T12:25:06.996042+0000","last_became_active":"2023-05-17T12:24:55.756274+0000","last_became_peered":"2023-05-17T12:24:55.756274+0000","last_unstale":"2023-05-17T12:25:06.996042+0000","last_undegraded":"2023-05-17T12:25:06.996042+0000","last_fullsized":"2023-05-17T12:25:06.996042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:49.783748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.324875+0000","last_change":"2023-05-17T12:25:01.304992+0000","last_active":"2023-05-17T12:25:06.324875+0000","last_peered":"2023-05-17T12:25:06.324875+0000","last_clean":"2023-05-17T12:25:06.324875+0000","last_became_active":"2023-05-17T12:25:01.304670+0000","last_became_peered":"2023-05-17T12:25:01.304670+0000","last_unstale":"2023-05-17T12:25:06.324875+0000","last_undegraded":"2023-05-17T12:25:06.324875+0000","last_fullsized":"2023-05-17T12:25:06.324875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:52:16.551530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325454+0000","last_change":"2023-05-17T12:25:01.804023+0000","last_active":"2023-05-17T12:25:06.325454+0000","last_peered":"2023-05-17T12:25:06.325454+0000","last_clean":"2023-05-17T12:25:06.325454+0000","last_became_active":"2023-05-17T12:25:01.803777+0000","last_became_peered":"2023-05-17T12:25:01.803777+0000","last_unstale":"2023-05-17T12:25:06.325454+0000","last_undegraded":"2023-05-17T12:25:06.325454+0000","last_fullsized":"2023-05-17T12:25:06.325454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:29.996659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298944+0000","last_change":"2023-05-17T12:25:05.834950+0000","last_active":"2023-05-17T12:25:06.298944+0000","last_peered":"2023-05-17T12:25:06.298944+0000","last_clean":"2023-05-17T12:25:06.298944+0000","last_became_active":"2023-05-17T12:25:05.833927+0000","last_became_peered":"2023-05-17T12:25:05.833927+0000","last_unstale":"2023-05-17T12:25:06.298944+0000","last_undegraded":"2023-05-17T12:25:06.298944+0000","last_fullsized":"2023-05-17T12:25:06.298944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:43:29.212877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995514+0000","last_change":"2023-05-17T12:24:55.792994+0000","last_active":"2023-05-17T12:25:06.995514+0000","last_peered":"2023-05-17T12:25:06.995514+0000","last_clean":"2023-05-17T12:25:06.995514+0000","last_became_active":"2023-05-17T12:24:55.792597+0000","last_became_peered":"2023-05-17T12:24:55.792597+0000","last_unstale":"2023-05-17T12:25:06.995514+0000","last_undegraded":"2023-05-17T12:25:06.995514+0000","last_fullsized":"2023-05-17T12:25:06.995514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494371+0000","last_change":"2023-05-17T12:25:01.307685+0000","last_active":"2023-05-17T12:25:06.494371+0000","last_peered":"2023-05-17T12:25:06.494371+0000","last_clean":"2023-05-17T12:25:06.494371+0000","last_became_active":"2023-05-17T12:25:01.307371+0000","last_became_peered":"2023-05-17T12:25:01.307371+0000","last_unstale":"2023-05-17T12:25:06.494371+0000","last_undegraded":"2023-05-17T12:25:06.494371+0000","last_fullsized":"2023-05-17T12:25:06.494371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:23.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325414+0000","last_change":"2023-05-17T12:25:01.809898+0000","last_active":"2023-05-17T12:25:06.325414+0000","last_peered":"2023-05-17T12:25:06.325414+0000","last_clean":"2023-05-17T12:25:06.325414+0000","last_became_active":"2023-05-17T12:25:01.809647+0000","last_became_peered":"2023-05-17T12:25:01.809647+0000","last_unstale":"2023-05-17T12:25:06.325414+0000","last_undegraded":"2023-05-17T12:25:06.325414+0000","last_fullsized":"2023-05-17T12:25:06.325414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995271+0000","last_change":"2023-05-17T12:25:05.837992+0000","last_active":"2023-05-17T12:25:06.995271+0000","last_peered":"2023-05-17T12:25:06.995271+0000","last_clean":"2023-05-17T12:25:06.995271+0000","last_became_active":"2023-05-17T12:25:05.836246+0000","last_became_peered":"2023-05-17T12:25:05.836246+0000","last_unstale":"2023-05-17T12:25:06.995271+0000","last_undegraded":"2023-05-17T12:25:06.995271+0000","last_fullsized":"2023-05-17T12:25:06.995271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:01:31.652913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994685+0000","last_change":"2023-05-17T12:25:01.303375+0000","last_active":"2023-05-17T12:25:06.994685+0000","last_peered":"2023-05-17T12:25:06.994685+0000","last_clean":"2023-05-17T12:25:06.994685+0000","last_became_active":"2023-05-17T12:25:01.303046+0000","last_became_peered":"2023-05-17T12:25:01.303046+0000","last_unstale":"2023-05-17T12:25:06.994685+0000","last_undegraded":"2023-05-17T12:25:06.994685+0000","last_fullsized":"2023-05-17T12:25:06.994685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:40:08.139475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494947+0000","last_change":"2023-05-17T12:24:55.755523+0000","last_active":"2023-05-17T12:25:06.494947+0000","last_peered":"2023-05-17T12:25:06.494947+0000","last_clean":"2023-05-17T12:25:06.494947+0000","last_became_active":"2023-05-17T12:24:55.755229+0000","last_became_peered":"2023-05-17T12:24:55.755229+0000","last_unstale":"2023-05-17T12:25:06.494947+0000","last_undegraded":"2023-05-17T12:25:06.494947+0000","last_fullsized":"2023-05-17T12:25:06.494947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.993978+0000","last_change":"2023-05-17T12:25:01.814467+0000","last_active":"2023-05-17T12:25:06.993978+0000","last_peered":"2023-05-17T12:25:06.993978+0000","last_clean":"2023-05-17T12:25:06.993978+0000","last_became_active":"2023-05-17T12:25:01.813813+0000","last_became_peered":"2023-05-17T12:25:01.813813+0000","last_unstale":"2023-05-17T12:25:06.993978+0000","last_undegraded":"2023-05-17T12:25:06.993978+0000","last_fullsized":"2023-05-17T12:25:06.993978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:22.759151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.993949+0000","last_change":"2023-05-17T12:25:05.826670+0000","last_active":"2023-05-17T12:25:06.993949+0000","last_peered":"2023-05-17T12:25:06.993949+0000","last_clean":"2023-05-17T12:25:06.993949+0000","last_became_active":"2023-05-17T12:25:05.826237+0000","last_became_peered":"2023-05-17T12:25:05.826237+0000","last_unstale":"2023-05-17T12:25:06.993949+0000","last_undegraded":"2023-05-17T12:25:06.993949+0000","last_fullsized":"2023-05-17T12:25:06.993949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:13:01.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298606+0000","last_change":"2023-05-17T12:24:55.755814+0000","last_active":"2023-05-17T12:25:06.298606+0000","last_peered":"2023-05-17T12:25:06.298606+0000","last_clean":"2023-05-17T12:25:06.298606+0000","last_became_active":"2023-05-17T12:24:55.755481+0000","last_became_peered":"2023-05-17T12:24:55.755481+0000","last_unstale":"2023-05-17T12:25:06.298606+0000","last_undegraded":"2023-05-17T12:25:06.298606+0000","last_fullsized":"2023-05-17T12:25:06.298606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:58:43.934611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325579+0000","last_change":"2023-05-17T12:25:01.310606+0000","last_active":"2023-05-17T12:25:06.325579+0000","last_peered":"2023-05-17T12:25:06.325579+0000","last_clean":"2023-05-17T12:25:06.325579+0000","last_became_active":"2023-05-17T12:25:01.309614+0000","last_became_peered":"2023-05-17T12:25:01.309614+0000","last_unstale":"2023-05-17T12:25:06.325579+0000","last_undegraded":"2023-05-17T12:25:06.325579+0000","last_fullsized":"2023-05-17T12:25:06.325579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:27.380050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994784+0000","last_change":"2023-05-17T12:25:01.801978+0000","last_active":"2023-05-17T12:25:06.994784+0000","last_peered":"2023-05-17T12:25:06.994784+0000","last_clean":"2023-05-17T12:25:06.994784+0000","last_became_active":"2023-05-17T12:25:01.801664+0000","last_became_peered":"2023-05-17T12:25:01.801664+0000","last_unstale":"2023-05-17T12:25:06.994784+0000","last_undegraded":"2023-05-17T12:25:06.994784+0000","last_fullsized":"2023-05-17T12:25:06.994784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:49:24.674805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494716+0000","last_change":"2023-05-17T12:25:05.827430+0000","last_active":"2023-05-17T12:25:06.494716+0000","last_peered":"2023-05-17T12:25:06.494716+0000","last_clean":"2023-05-17T12:25:06.494716+0000","last_became_active":"2023-05-17T12:25:05.827001+0000","last_became_peered":"2023-05-17T12:25:05.827001+0000","last_unstale":"2023-05-17T12:25:06.494716+0000","last_undegraded":"2023-05-17T12:25:06.494716+0000","last_fullsized":"2023-05-17T12:25:06.494716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:26.275442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325368+0000","last_change":"2023-05-17T12:25:01.311128+0000","last_active":"2023-05-17T12:25:06.325368+0000","last_peered":"2023-05-17T12:25:06.325368+0000","last_clean":"2023-05-17T12:25:06.325368+0000","last_became_active":"2023-05-17T12:25:01.310836+0000","last_became_peered":"2023-05-17T12:25:01.310836+0000","last_unstale":"2023-05-17T12:25:06.325368+0000","last_undegraded":"2023-05-17T12:25:06.325368+0000","last_fullsized":"2023-05-17T12:25:06.325368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:21.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296706+0000","last_change":"2023-05-17T12:25:01.802967+0000","last_active":"2023-05-17T12:25:06.296706+0000","last_peered":"2023-05-17T12:25:06.296706+0000","last_clean":"2023-05-17T12:25:06.296706+0000","last_became_active":"2023-05-17T12:25:01.802692+0000","last_became_peered":"2023-05-17T12:25:01.802692+0000","last_unstale":"2023-05-17T12:25:06.296706+0000","last_undegraded":"2023-05-17T12:25:06.296706+0000","last_fullsized":"2023-05-17T12:25:06.296706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:58:57.061496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996669+0000","last_change":"2023-05-17T12:25:05.842157+0000","last_active":"2023-05-17T12:25:06.996669+0000","last_peered":"2023-05-17T12:25:06.996669+0000","last_clean":"2023-05-17T12:25:06.996669+0000","last_became_active":"2023-05-17T12:25:05.841642+0000","last_became_peered":"2023-05-17T12:25:05.841642+0000","last_unstale":"2023-05-17T12:25:06.996669+0000","last_undegraded":"2023-05-17T12:25:06.996669+0000","last_fullsized":"2023-05-17T12:25:06.996669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:53:03.043259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299117+0000","last_change":"2023-05-17T12:25:01.309109+0000","last_active":"2023-05-17T12:25:06.299117+0000","last_peered":"2023-05-17T12:25:06.299117+0000","last_clean":"2023-05-17T12:25:06.299117+0000","last_became_active":"2023-05-17T12:25:01.308819+0000","last_became_peered":"2023-05-17T12:25:01.308819+0000","last_unstale":"2023-05-17T12:25:06.299117+0000","last_undegraded":"2023-05-17T12:25:06.299117+0000","last_fullsized":"2023-05-17T12:25:06.299117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:10.497260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995019+0000","last_change":"2023-05-17T12:25:01.807742+0000","last_active":"2023-05-17T12:25:06.995019+0000","last_peered":"2023-05-17T12:25:06.995019+0000","last_clean":"2023-05-17T12:25:06.995019+0000","last_became_active":"2023-05-17T12:25:01.807486+0000","last_became_peered":"2023-05-17T12:25:01.807486+0000","last_unstale":"2023-05-17T12:25:06.995019+0000","last_undegraded":"2023-05-17T12:25:06.995019+0000","last_fullsized":"2023-05-17T12:25:06.995019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:34:11.854588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298559+0000","last_change":"2023-05-17T12:25:05.828527+0000","last_active":"2023-05-17T12:25:06.298559+0000","last_peered":"2023-05-17T12:25:06.298559+0000","last_clean":"2023-05-17T12:25:06.298559+0000","last_became_active":"2023-05-17T12:25:05.828110+0000","last_became_peered":"2023-05-17T12:25:05.828110+0000","last_unstale":"2023-05-17T12:25:06.298559+0000","last_undegraded":"2023-05-17T12:25:06.298559+0000","last_fullsized":"2023-05-17T12:25:06.298559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:58.136837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299503+0000","last_change":"2023-05-17T12:25:01.309151+0000","last_active":"2023-05-17T12:25:06.299503+0000","last_peered":"2023-05-17T12:25:06.299503+0000","last_clean":"2023-05-17T12:25:06.299503+0000","last_became_active":"2023-05-17T12:25:01.308858+0000","last_became_peered":"2023-05-17T12:25:01.308858+0000","last_unstale":"2023-05-17T12:25:06.299503+0000","last_undegraded":"2023-05-17T12:25:06.299503+0000","last_fullsized":"2023-05-17T12:25:06.299503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:31.192844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996383+0000","last_change":"2023-05-17T12:25:01.803419+0000","last_active":"2023-05-17T12:25:06.996383+0000","last_peered":"2023-05-17T12:25:06.996383+0000","last_clean":"2023-05-17T12:25:06.996383+0000","last_became_active":"2023-05-17T12:25:01.802965+0000","last_became_peered":"2023-05-17T12:25:01.802965+0000","last_unstale":"2023-05-17T12:25:06.996383+0000","last_undegraded":"2023-05-17T12:25:06.996383+0000","last_fullsized":"2023-05-17T12:25:06.996383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:18:56.538552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994811+0000","last_change":"2023-05-17T12:25:05.825330+0000","last_active":"2023-05-17T12:25:06.994811+0000","last_peered":"2023-05-17T12:25:06.994811+0000","last_clean":"2023-05-17T12:25:06.994811+0000","last_became_active":"2023-05-17T12:25:05.824868+0000","last_became_peered":"2023-05-17T12:25:05.824868+0000","last_unstale":"2023-05-17T12:25:06.994811+0000","last_undegraded":"2023-05-17T12:25:06.994811+0000","last_fullsized":"2023-05-17T12:25:06.994811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:53:03.043259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994461+0000","last_change":"2023-05-17T12:25:01.304287+0000","last_active":"2023-05-17T12:25:06.994461+0000","last_peered":"2023-05-17T12:25:06.994461+0000","last_clean":"2023-05-17T12:25:06.994461+0000","last_became_active":"2023-05-17T12:25:01.304009+0000","last_became_peered":"2023-05-17T12:25:01.304009+0000","last_unstale":"2023-05-17T12:25:06.994461+0000","last_undegraded":"2023-05-17T12:25:06.994461+0000","last_fullsized":"2023-05-17T12:25:06.994461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994672+0000","last_change":"2023-05-17T12:25:01.795767+0000","last_active":"2023-05-17T12:25:06.994672+0000","last_peered":"2023-05-17T12:25:06.994672+0000","last_clean":"2023-05-17T12:25:06.994672+0000","last_became_active":"2023-05-17T12:25:01.795283+0000","last_became_peered":"2023-05-17T12:25:01.795283+0000","last_unstale":"2023-05-17T12:25:06.994672+0000","last_undegraded":"2023-05-17T12:25:06.994672+0000","last_fullsized":"2023-05-17T12:25:06.994672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:12.607072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494307+0000","last_change":"2023-05-17T12:25:05.835654+0000","last_active":"2023-05-17T12:25:06.494307+0000","last_peered":"2023-05-17T12:25:06.494307+0000","last_clean":"2023-05-17T12:25:06.494307+0000","last_became_active":"2023-05-17T12:25:05.835230+0000","last_became_peered":"2023-05-17T12:25:05.835230+0000","last_unstale":"2023-05-17T12:25:06.494307+0000","last_undegraded":"2023-05-17T12:25:06.494307+0000","last_fullsized":"2023-05-17T12:25:06.494307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:43:00.150100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325785+0000","last_change":"2023-05-17T12:25:01.302349+0000","last_active":"2023-05-17T12:25:06.325785+0000","last_peered":"2023-05-17T12:25:06.325785+0000","last_clean":"2023-05-17T12:25:06.325785+0000","last_became_active":"2023-05-17T12:25:01.302092+0000","last_became_peered":"2023-05-17T12:25:01.302092+0000","last_unstale":"2023-05-17T12:25:06.325785+0000","last_undegraded":"2023-05-17T12:25:06.325785+0000","last_fullsized":"2023-05-17T12:25:06.325785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994890+0000","last_change":"2023-05-17T12:25:01.815996+0000","last_active":"2023-05-17T12:25:06.994890+0000","last_peered":"2023-05-17T12:25:06.994890+0000","last_clean":"2023-05-17T12:25:06.994890+0000","last_became_active":"2023-05-17T12:25:01.812605+0000","last_became_peered":"2023-05-17T12:25:01.812605+0000","last_unstale":"2023-05-17T12:25:06.994890+0000","last_undegraded":"2023-05-17T12:25:06.994890+0000","last_fullsized":"2023-05-17T12:25:06.994890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:01:41.127461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298262+0000","last_change":"2023-05-17T12:25:01.805399+0000","last_active":"2023-05-17T12:25:06.298262+0000","last_peered":"2023-05-17T12:25:06.298262+0000","last_clean":"2023-05-17T12:25:06.298262+0000","last_became_active":"2023-05-17T12:25:01.805099+0000","last_became_peered":"2023-05-17T12:25:01.805099+0000","last_unstale":"2023-05-17T12:25:06.298262+0000","last_undegraded":"2023-05-17T12:25:06.298262+0000","last_fullsized":"2023-05-17T12:25:06.298262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:36:36.387439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994465+0000","last_change":"2023-05-17T12:25:01.802926+0000","last_active":"2023-05-17T12:25:06.994465+0000","last_peered":"2023-05-17T12:25:06.994465+0000","last_clean":"2023-05-17T12:25:06.994465+0000","last_became_active":"2023-05-17T12:25:01.802651+0000","last_became_peered":"2023-05-17T12:25:01.802651+0000","last_unstale":"2023-05-17T12:25:06.994465+0000","last_undegraded":"2023-05-17T12:25:06.994465+0000","last_fullsized":"2023-05-17T12:25:06.994465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:16.838754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995441+0000","last_change":"2023-05-17T12:25:01.812203+0000","last_active":"2023-05-17T12:25:06.995441+0000","last_peered":"2023-05-17T12:25:06.995441+0000","last_clean":"2023-05-17T12:25:06.995441+0000","last_became_active":"2023-05-17T12:25:01.811900+0000","last_became_peered":"2023-05-17T12:25:01.811900+0000","last_unstale":"2023-05-17T12:25:06.995441+0000","last_undegraded":"2023-05-17T12:25:06.995441+0000","last_fullsized":"2023-05-17T12:25:06.995441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:36:46.242202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994166+0000","last_change":"2023-05-17T12:25:01.814710+0000","last_active":"2023-05-17T12:25:06.994166+0000","last_peered":"2023-05-17T12:25:06.994166+0000","last_clean":"2023-05-17T12:25:06.994166+0000","last_became_active":"2023-05-17T12:25:01.814215+0000","last_became_peered":"2023-05-17T12:25:01.814215+0000","last_unstale":"2023-05-17T12:25:06.994166+0000","last_undegraded":"2023-05-17T12:25:06.994166+0000","last_fullsized":"2023-05-17T12:25:06.994166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494339+0000","last_change":"2023-05-17T12:25:01.802046+0000","last_active":"2023-05-17T12:25:06.494339+0000","last_peered":"2023-05-17T12:25:06.494339+0000","last_clean":"2023-05-17T12:25:06.494339+0000","last_became_active":"2023-05-17T12:25:01.801281+0000","last_became_peered":"2023-05-17T12:25:01.801281+0000","last_unstale":"2023-05-17T12:25:06.494339+0000","last_undegraded":"2023-05-17T12:25:06.494339+0000","last_fullsized":"2023-05-17T12:25:06.494339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:28:58.337893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8228,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363612,"statfs":{"total":96636764160,"available":96628338688,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T12:25:31.669 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T12:25:31.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.882+0000 7f730bfff700 1 Processor -- start 2023-05-17T12:25:31.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.882+0000 7f730bfff700 1 -- start start 2023-05-17T12:25:31.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f730bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 0x7f73040cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f730bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73041605f0 0x7f73040cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f730bfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7304160b40 con 0x7f730415ca70 2023-05-17T12:25:31.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f730bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040cb600 con 0x7f73041605f0 2023-05-17T12:25:31.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f730bfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7304160e20 con 0x7f73040b3060 2023-05-17T12:25:31.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f730a59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73041605f0 0x7f73040cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f730959a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 0x7f73040cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f7309d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f730415ca70 0x7f73040b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51896/0 (socket says 172.21.15.88:51896) 2023-05-17T12:25:31.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f730a59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73041605f0 0x7f73040cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37192/0 (socket says 172.21.15.88:37192) 2023-05-17T12:25:31.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.883+0000 7f730a59c700 1 -- 172.21.15.88:0/245777306 learned_addr learned my addr 172.21.15.88:0/245777306 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:31.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.884+0000 7f730a59c700 1 -- 172.21.15.88:0/245777306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 msgr2=0x7f73040cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:31.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.884+0000 7f730a59c700 1 --2- 172.21.15.88:0/245777306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 0x7f73040cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.884+0000 7f730a59c700 1 -- 172.21.15.88:0/245777306 >> v1:172.21.15.88:6789/0 conn(0x7f730415ca70 legacy=0x7f73040b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.884+0000 7f730a59c700 1 -- 172.21.15.88:0/245777306 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304161100 con 0x7f73041605f0 2023-05-17T12:25:31.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.884+0000 7f7308d99700 1 -- 172.21.15.88:0/245777306 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365536361 0 0) 0x7f7304160b40 con 0x7f730415ca70 2023-05-17T12:25:31.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.884+0000 7f730a59c700 1 --2- 172.21.15.88:0/245777306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73041605f0 0x7f73040cbf60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009e50 tx=0x7f72fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d8411305d13727 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:31.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.884+0000 7f7308d99700 1 -- 172.21.15.88:0/245777306 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00e070 con 0x7f73041605f0 2023-05-17T12:25:31.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.884+0000 7f7308d99700 1 -- 172.21.15.88:0/245777306 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc00b910 con 0x7f73041605f0 2023-05-17T12:25:31.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.884+0000 7f7308d99700 1 -- 172.21.15.88:0/245777306 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00bcc0 con 0x7f73041605f0 2023-05-17T12:25:31.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.885+0000 7f730bfff700 1 -- 172.21.15.88:0/245777306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73041605f0 msgr2=0x7f73040cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.885+0000 7f730bfff700 1 --2- 172.21.15.88:0/245777306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73041605f0 0x7f73040cbf60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009e50 tx=0x7f72fc00b330 comp rx=0 tx=0).stop 2023-05-17T12:25:31.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.885+0000 7f730bfff700 1 -- 172.21.15.88:0/245777306 shutdown_connections 2023-05-17T12:25:31.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.885+0000 7f730bfff700 1 --2- 172.21.15.88:0/245777306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73041605f0 0x7f73040cbf60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.885+0000 7f730bfff700 1 --2- 172.21.15.88:0/245777306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 0x7f73040cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.885+0000 7f730bfff700 1 -- 172.21.15.88:0/245777306 >> 172.21.15.88:0/245777306 conn(0x7f73040ce5a0 msgr2=0x7f73040d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:31.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.885+0000 7f730bfff700 1 -- 172.21.15.88:0/245777306 shutdown_connections 2023-05-17T12:25:31.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.885+0000 7f730bfff700 1 -- 172.21.15.88:0/245777306 wait complete. 2023-05-17T12:25:31.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.887+0000 7f730bfff700 1 Processor -- start 2023-05-17T12:25:31.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.887+0000 7f730bfff700 1 -- start start 2023-05-17T12:25:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f730bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 0x7f73041f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f730bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f730415ca70 0x7f730415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f730bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73041605f0 0x7f730415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f730bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73040c5440 con 0x7f730415ca70 2023-05-17T12:25:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f730bfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73041f67e0 con 0x7f73041605f0 2023-05-17T12:25:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f730bfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73040c4b10 con 0x7f73040b3060 2023-05-17T12:25:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f730959a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f730415ca70 0x7f730415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f730959a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f730415ca70 0x7f730415a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37194/0 (socket says 172.21.15.88:37194) 2023-05-17T12:25:31.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f730959a700 1 -- 172.21.15.88:0/2478791942 learned_addr learned my addr 172.21.15.88:0/2478791942 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:31.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.888+0000 7f7309d9b700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 0x7f73041f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f730a59c700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73041605f0 0x7f730415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f730959a700 1 -- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 msgr2=0x7f73041f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f730959a700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 0x7f73041f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f730959a700 1 -- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73041605f0 msgr2=0x7f730415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:31.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f730959a700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73041605f0 0x7f730415ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f730959a700 1 -- 172.21.15.88:0/2478791942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc009b30 con 0x7f730415ca70 2023-05-17T12:25:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f730959a700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f730415ca70 0x7f730415a810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f72f400e9e0 tx=0x7f72f400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f72fa7fc700 1 -- 172.21.15.88:0/2478791942 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4009710 con 0x7f730415ca70 2023-05-17T12:25:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f72fa7fc700 1 -- 172.21.15.88:0/2478791942 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f400c850 con 0x7f730415ca70 2023-05-17T12:25:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730415ce40 con 0x7f730415ca70 2023-05-17T12:25:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f72fa7fc700 1 -- 172.21.15.88:0/2478791942 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400cbc0 con 0x7f730415ca70 2023-05-17T12:25:31.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.889+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73041613e0 con 0x7f730415ca70 2023-05-17T12:25:31.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.890+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73040d0af0 con 0x7f730415ca70 2023-05-17T12:25:31.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.891+0000 7f72fa7fc700 1 -- 172.21.15.88:0/2478791942 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f72f400cd20 con 0x7f730415ca70 2023-05-17T12:25:31.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.893+0000 7f72fa7fc700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f72e806ace0 0x7f72e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:31.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.893+0000 7f72fa7fc700 1 -- 172.21.15.88:0/2478791942 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f72f4089950 con 0x7f730415ca70 2023-05-17T12:25:31.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.893+0000 7f7309d9b700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f72e806ace0 0x7f72e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:31.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.894+0000 7f7309d9b700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f72e806ace0 0x7f72e806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7300000f60 tx=0x7f7300007be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:31.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:31.897+0000 7f72fa7fc700 1 -- 172.21.15.88:0/2478791942 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f72f4058100 con 0x7f730415ca70 2023-05-17T12:25:32.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.086+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 --> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7304074530 con 0x7f72e806ace0 2023-05-17T12:25:32.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.097+0000 7f72fa7fc700 1 -- 172.21.15.88:0/2478791942 <== mgr.4106 v2:172.21.15.187:6832/2490620069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367295 (secure 0 0 0) 0x7f7304074530 con 0x7f72e806ace0 2023-05-17T12:25:32.104 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:32.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f72e806ace0 msgr2=0x7f72e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f72e806ace0 0x7f72e806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7300000f60 tx=0x7f7300007be0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f730415ca70 msgr2=0x7f730415a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f730415ca70 0x7f730415a810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f72f400e9e0 tx=0x7f72f400eda0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 shutdown_connections 2023-05-17T12:25:32.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f72e806ace0 0x7f72e806d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73041605f0 0x7f730415ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73040b3060 0x7f73041f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 --2- 172.21.15.88:0/2478791942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f730415ca70 0x7f730415a810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 >> 172.21.15.88:0/2478791942 conn(0x7f73040ce5a0 msgr2=0x7f73040cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:32.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 shutdown_connections 2023-05-17T12:25:32.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.102+0000 7f730bfff700 1 -- 172.21.15.88:0/2478791942 wait complete. 2023-05-17T12:25:32.108 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-05-17T12:25:32.122 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-05-17T12:25:31.455485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67560,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907160,"statfs":{"total":773094113280,"available":773024931840,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003725"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296789+0000","last_change":"2023-05-17T12:25:01.795822+0000","last_active":"2023-05-17T12:25:06.296789+0000","last_peered":"2023-05-17T12:25:06.296789+0000","last_clean":"2023-05-17T12:25:06.296789+0000","last_became_active":"2023-05-17T12:25:01.795035+0000","last_became_peered":"2023-05-17T12:25:01.795035+0000","last_unstale":"2023-05-17T12:25:06.296789+0000","last_undegraded":"2023-05-17T12:25:06.296789+0000","last_fullsized":"2023-05-17T12:25:06.296789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:29:24.037566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299680+0000","last_change":"2023-05-17T12:25:01.804268+0000","last_active":"2023-05-17T12:25:06.299680+0000","last_peered":"2023-05-17T12:25:06.299680+0000","last_clean":"2023-05-17T12:25:06.299680+0000","last_became_active":"2023-05-17T12:25:01.803974+0000","last_became_peered":"2023-05-17T12:25:01.803974+0000","last_unstale":"2023-05-17T12:25:06.299680+0000","last_undegraded":"2023-05-17T12:25:06.299680+0000","last_fullsized":"2023-05-17T12:25:06.299680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:16.838754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996137+0000","last_change":"2023-05-17T12:25:01.808847+0000","last_active":"2023-05-17T12:25:06.996137+0000","last_peered":"2023-05-17T12:25:06.996137+0000","last_clean":"2023-05-17T12:25:06.996137+0000","last_became_active":"2023-05-17T12:25:01.808039+0000","last_became_peered":"2023-05-17T12:25:01.808039+0000","last_unstale":"2023-05-17T12:25:06.996137+0000","last_undegraded":"2023-05-17T12:25:06.996137+0000","last_fullsized":"2023-05-17T12:25:06.996137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:34:11.837824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298571+0000","last_change":"2023-05-17T12:25:01.804061+0000","last_active":"2023-05-17T12:25:06.298571+0000","last_peered":"2023-05-17T12:25:06.298571+0000","last_clean":"2023-05-17T12:25:06.298571+0000","last_became_active":"2023-05-17T12:25:01.803700+0000","last_became_peered":"2023-05-17T12:25:01.803700+0000","last_unstale":"2023-05-17T12:25:06.298571+0000","last_undegraded":"2023-05-17T12:25:06.298571+0000","last_fullsized":"2023-05-17T12:25:06.298571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:13:33.437413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325509+0000","last_change":"2023-05-17T12:25:01.799019+0000","last_active":"2023-05-17T12:25:06.325509+0000","last_peered":"2023-05-17T12:25:06.325509+0000","last_clean":"2023-05-17T12:25:06.325509+0000","last_became_active":"2023-05-17T12:25:01.798806+0000","last_became_peered":"2023-05-17T12:25:01.798806+0000","last_unstale":"2023-05-17T12:25:06.325509+0000","last_undegraded":"2023-05-17T12:25:06.325509+0000","last_fullsized":"2023-05-17T12:25:06.325509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995568+0000","last_change":"2023-05-17T12:25:01.803257+0000","last_active":"2023-05-17T12:25:06.995568+0000","last_peered":"2023-05-17T12:25:06.995568+0000","last_clean":"2023-05-17T12:25:06.995568+0000","last_became_active":"2023-05-17T12:25:01.802691+0000","last_became_peered":"2023-05-17T12:25:01.802691+0000","last_unstale":"2023-05-17T12:25:06.995568+0000","last_undegraded":"2023-05-17T12:25:06.995568+0000","last_fullsized":"2023-05-17T12:25:06.995568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:19:39.033646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996181+0000","last_change":"2023-05-17T12:25:01.806572+0000","last_active":"2023-05-17T12:25:06.996181+0000","last_peered":"2023-05-17T12:25:06.996181+0000","last_clean":"2023-05-17T12:25:06.996181+0000","last_became_active":"2023-05-17T12:25:01.806281+0000","last_became_peered":"2023-05-17T12:25:01.806281+0000","last_unstale":"2023-05-17T12:25:06.996181+0000","last_undegraded":"2023-05-17T12:25:06.996181+0000","last_fullsized":"2023-05-17T12:25:06.996181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:56:53.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299059+0000","last_change":"2023-05-17T12:25:01.803927+0000","last_active":"2023-05-17T12:25:06.299059+0000","last_peered":"2023-05-17T12:25:06.299059+0000","last_clean":"2023-05-17T12:25:06.299059+0000","last_became_active":"2023-05-17T12:25:01.803617+0000","last_became_peered":"2023-05-17T12:25:01.803617+0000","last_unstale":"2023-05-17T12:25:06.299059+0000","last_undegraded":"2023-05-17T12:25:06.299059+0000","last_fullsized":"2023-05-17T12:25:06.299059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:22.759151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325614+0000","last_change":"2023-05-17T12:25:01.799177+0000","last_active":"2023-05-17T12:25:06.325614+0000","last_peered":"2023-05-17T12:25:06.325614+0000","last_clean":"2023-05-17T12:25:06.325614+0000","last_became_active":"2023-05-17T12:25:01.798532+0000","last_became_peered":"2023-05-17T12:25:01.798532+0000","last_unstale":"2023-05-17T12:25:06.325614+0000","last_undegraded":"2023-05-17T12:25:06.325614+0000","last_fullsized":"2023-05-17T12:25:06.325614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:22.299274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299922+0000","last_change":"2023-05-17T12:25:01.798406+0000","last_active":"2023-05-17T12:25:06.299922+0000","last_peered":"2023-05-17T12:25:06.299922+0000","last_clean":"2023-05-17T12:25:06.299922+0000","last_became_active":"2023-05-17T12:25:01.798107+0000","last_became_peered":"2023-05-17T12:25:01.798107+0000","last_unstale":"2023-05-17T12:25:06.299922+0000","last_undegraded":"2023-05-17T12:25:06.299922+0000","last_fullsized":"2023-05-17T12:25:06.299922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:56.325526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996483+0000","last_change":"2023-05-17T12:25:01.810494+0000","last_active":"2023-05-17T12:25:06.996483+0000","last_peered":"2023-05-17T12:25:06.996483+0000","last_clean":"2023-05-17T12:25:06.996483+0000","last_became_active":"2023-05-17T12:25:01.810141+0000","last_became_peered":"2023-05-17T12:25:01.810141+0000","last_unstale":"2023-05-17T12:25:06.996483+0000","last_undegraded":"2023-05-17T12:25:06.996483+0000","last_fullsized":"2023-05-17T12:25:06.996483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:55:47.642675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296559+0000","last_change":"2023-05-17T12:25:01.810500+0000","last_active":"2023-05-17T12:25:06.296559+0000","last_peered":"2023-05-17T12:25:06.296559+0000","last_clean":"2023-05-17T12:25:06.296559+0000","last_became_active":"2023-05-17T12:25:01.810218+0000","last_became_peered":"2023-05-17T12:25:01.810218+0000","last_unstale":"2023-05-17T12:25:06.296559+0000","last_undegraded":"2023-05-17T12:25:06.296559+0000","last_fullsized":"2023-05-17T12:25:06.296559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:25.158644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296403+0000","last_change":"2023-05-17T12:25:01.795337+0000","last_active":"2023-05-17T12:25:06.296403+0000","last_peered":"2023-05-17T12:25:06.296403+0000","last_clean":"2023-05-17T12:25:06.296403+0000","last_became_active":"2023-05-17T12:25:01.795015+0000","last_became_peered":"2023-05-17T12:25:01.795015+0000","last_unstale":"2023-05-17T12:25:06.296403+0000","last_undegraded":"2023-05-17T12:25:06.296403+0000","last_fullsized":"2023-05-17T12:25:06.296403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:08:00.351240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298545+0000","last_change":"2023-05-17T12:25:01.794491+0000","last_active":"2023-05-17T12:25:06.298545+0000","last_peered":"2023-05-17T12:25:06.298545+0000","last_clean":"2023-05-17T12:25:06.298545+0000","last_became_active":"2023-05-17T12:25:01.794195+0000","last_became_peered":"2023-05-17T12:25:01.794195+0000","last_unstale":"2023-05-17T12:25:06.298545+0000","last_undegraded":"2023-05-17T12:25:06.298545+0000","last_fullsized":"2023-05-17T12:25:06.298545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:42:56.633809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995720+0000","last_change":"2023-05-17T12:25:01.806504+0000","last_active":"2023-05-17T12:25:06.995720+0000","last_peered":"2023-05-17T12:25:06.995720+0000","last_clean":"2023-05-17T12:25:06.995720+0000","last_became_active":"2023-05-17T12:25:01.806169+0000","last_became_peered":"2023-05-17T12:25:01.806169+0000","last_unstale":"2023-05-17T12:25:06.995720+0000","last_undegraded":"2023-05-17T12:25:06.995720+0000","last_fullsized":"2023-05-17T12:25:06.995720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995025+0000","last_change":"2023-05-17T12:25:01.810537+0000","last_active":"2023-05-17T12:25:06.995025+0000","last_peered":"2023-05-17T12:25:06.995025+0000","last_clean":"2023-05-17T12:25:06.995025+0000","last_became_active":"2023-05-17T12:25:01.809999+0000","last_became_peered":"2023-05-17T12:25:01.809999+0000","last_unstale":"2023-05-17T12:25:06.995025+0000","last_undegraded":"2023-05-17T12:25:06.995025+0000","last_fullsized":"2023-05-17T12:25:06.995025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:02:23.504157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325601+0000","last_change":"2023-05-17T12:25:01.798577+0000","last_active":"2023-05-17T12:25:06.325601+0000","last_peered":"2023-05-17T12:25:06.325601+0000","last_clean":"2023-05-17T12:25:06.325601+0000","last_became_active":"2023-05-17T12:25:01.798348+0000","last_became_peered":"2023-05-17T12:25:01.798348+0000","last_unstale":"2023-05-17T12:25:06.325601+0000","last_undegraded":"2023-05-17T12:25:06.325601+0000","last_fullsized":"2023-05-17T12:25:06.325601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996347+0000","last_change":"2023-05-17T12:25:01.810349+0000","last_active":"2023-05-17T12:25:06.996347+0000","last_peered":"2023-05-17T12:25:06.996347+0000","last_clean":"2023-05-17T12:25:06.996347+0000","last_became_active":"2023-05-17T12:25:01.809853+0000","last_became_peered":"2023-05-17T12:25:01.809853+0000","last_unstale":"2023-05-17T12:25:06.996347+0000","last_undegraded":"2023-05-17T12:25:06.996347+0000","last_fullsized":"2023-05-17T12:25:06.996347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:04:42.761172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296403+0000","last_change":"2023-05-17T12:25:01.811973+0000","last_active":"2023-05-17T12:25:06.296403+0000","last_peered":"2023-05-17T12:25:06.296403+0000","last_clean":"2023-05-17T12:25:06.296403+0000","last_became_active":"2023-05-17T12:25:01.811764+0000","last_became_peered":"2023-05-17T12:25:01.811764+0000","last_unstale":"2023-05-17T12:25:06.296403+0000","last_undegraded":"2023-05-17T12:25:06.296403+0000","last_fullsized":"2023-05-17T12:25:06.296403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:59:51.442756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995789+0000","last_change":"2023-05-17T12:25:01.812104+0000","last_active":"2023-05-17T12:25:06.995789+0000","last_peered":"2023-05-17T12:25:06.995789+0000","last_clean":"2023-05-17T12:25:06.995789+0000","last_became_active":"2023-05-17T12:25:01.811782+0000","last_became_peered":"2023-05-17T12:25:01.811782+0000","last_unstale":"2023-05-17T12:25:06.995789+0000","last_undegraded":"2023-05-17T12:25:06.995789+0000","last_fullsized":"2023-05-17T12:25:06.995789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:27:46.682969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995644+0000","last_change":"2023-05-17T12:25:01.800327+0000","last_active":"2023-05-17T12:25:06.995644+0000","last_peered":"2023-05-17T12:25:06.995644+0000","last_clean":"2023-05-17T12:25:06.995644+0000","last_became_active":"2023-05-17T12:25:01.799859+0000","last_became_peered":"2023-05-17T12:25:01.799859+0000","last_unstale":"2023-05-17T12:25:06.995644+0000","last_undegraded":"2023-05-17T12:25:06.995644+0000","last_fullsized":"2023-05-17T12:25:06.995644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:22.299274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325260+0000","last_change":"2023-05-17T12:25:01.804627+0000","last_active":"2023-05-17T12:25:06.325260+0000","last_peered":"2023-05-17T12:25:06.325260+0000","last_clean":"2023-05-17T12:25:06.325260+0000","last_became_active":"2023-05-17T12:25:01.804355+0000","last_became_peered":"2023-05-17T12:25:01.804355+0000","last_unstale":"2023-05-17T12:25:06.325260+0000","last_undegraded":"2023-05-17T12:25:06.325260+0000","last_fullsized":"2023-05-17T12:25:06.325260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:58.149661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994004+0000","last_change":"2023-05-17T12:25:01.795597+0000","last_active":"2023-05-17T12:25:06.994004+0000","last_peered":"2023-05-17T12:25:06.994004+0000","last_clean":"2023-05-17T12:25:06.994004+0000","last_became_active":"2023-05-17T12:25:01.794994+0000","last_became_peered":"2023-05-17T12:25:01.794994+0000","last_unstale":"2023-05-17T12:25:06.994004+0000","last_undegraded":"2023-05-17T12:25:06.994004+0000","last_fullsized":"2023-05-17T12:25:06.994004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995908+0000","last_change":"2023-05-17T12:25:01.799968+0000","last_active":"2023-05-17T12:25:06.995908+0000","last_peered":"2023-05-17T12:25:06.995908+0000","last_clean":"2023-05-17T12:25:06.995908+0000","last_became_active":"2023-05-17T12:25:01.799673+0000","last_became_peered":"2023-05-17T12:25:01.799673+0000","last_unstale":"2023-05-17T12:25:06.995908+0000","last_undegraded":"2023-05-17T12:25:06.995908+0000","last_fullsized":"2023-05-17T12:25:06.995908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:01.358359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494793+0000","last_change":"2023-05-17T12:25:01.808781+0000","last_active":"2023-05-17T12:25:06.494793+0000","last_peered":"2023-05-17T12:25:06.494793+0000","last_clean":"2023-05-17T12:25:06.494793+0000","last_became_active":"2023-05-17T12:25:01.808497+0000","last_became_peered":"2023-05-17T12:25:01.808497+0000","last_unstale":"2023-05-17T12:25:06.494793+0000","last_undegraded":"2023-05-17T12:25:06.494793+0000","last_fullsized":"2023-05-17T12:25:06.494793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.495101+0000","last_change":"2023-05-17T12:25:01.799943+0000","last_active":"2023-05-17T12:25:06.495101+0000","last_peered":"2023-05-17T12:25:06.495101+0000","last_clean":"2023-05-17T12:25:06.495101+0000","last_became_active":"2023-05-17T12:25:01.799590+0000","last_became_peered":"2023-05-17T12:25:01.799590+0000","last_unstale":"2023-05-17T12:25:06.495101+0000","last_undegraded":"2023-05-17T12:25:06.495101+0000","last_fullsized":"2023-05-17T12:25:06.495101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299616+0000","last_change":"2023-05-17T12:25:01.809762+0000","last_active":"2023-05-17T12:25:06.299616+0000","last_peered":"2023-05-17T12:25:06.299616+0000","last_clean":"2023-05-17T12:25:06.299616+0000","last_became_active":"2023-05-17T12:25:01.809453+0000","last_became_peered":"2023-05-17T12:25:01.809453+0000","last_unstale":"2023-05-17T12:25:06.299616+0000","last_undegraded":"2023-05-17T12:25:06.299616+0000","last_fullsized":"2023-05-17T12:25:06.299616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996398+0000","last_change":"2023-05-17T12:25:05.826281+0000","last_active":"2023-05-17T12:25:06.996398+0000","last_peered":"2023-05-17T12:25:06.996398+0000","last_clean":"2023-05-17T12:25:06.996398+0000","last_became_active":"2023-05-17T12:25:05.825799+0000","last_became_peered":"2023-05-17T12:25:05.825799+0000","last_unstale":"2023-05-17T12:25:06.996398+0000","last_undegraded":"2023-05-17T12:25:06.996398+0000","last_fullsized":"2023-05-17T12:25:06.996398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:29:56.321361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995190+0000","last_change":"2023-05-17T12:25:01.309876+0000","last_active":"2023-05-17T12:25:06.995190+0000","last_peered":"2023-05-17T12:25:06.995190+0000","last_clean":"2023-05-17T12:25:06.995190+0000","last_became_active":"2023-05-17T12:25:01.307886+0000","last_became_peered":"2023-05-17T12:25:01.307886+0000","last_unstale":"2023-05-17T12:25:06.995190+0000","last_undegraded":"2023-05-17T12:25:06.995190+0000","last_fullsized":"2023-05-17T12:25:06.995190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:18:49.877888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994778+0000","last_change":"2023-05-17T12:25:01.803127+0000","last_active":"2023-05-17T12:25:06.994778+0000","last_peered":"2023-05-17T12:25:06.994778+0000","last_clean":"2023-05-17T12:25:06.994778+0000","last_became_active":"2023-05-17T12:25:01.802844+0000","last_became_peered":"2023-05-17T12:25:01.802844+0000","last_unstale":"2023-05-17T12:25:06.994778+0000","last_undegraded":"2023-05-17T12:25:06.994778+0000","last_fullsized":"2023-05-17T12:25:06.994778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:52:59.526969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298648+0000","last_change":"2023-05-17T12:25:05.828211+0000","last_active":"2023-05-17T12:25:06.298648+0000","last_peered":"2023-05-17T12:25:06.298648+0000","last_clean":"2023-05-17T12:25:06.298648+0000","last_became_active":"2023-05-17T12:25:05.827748+0000","last_became_peered":"2023-05-17T12:25:05.827748+0000","last_unstale":"2023-05-17T12:25:06.298648+0000","last_undegraded":"2023-05-17T12:25:06.298648+0000","last_fullsized":"2023-05-17T12:25:06.298648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:07:33.893870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.493925+0000","last_change":"2023-05-17T12:25:01.302947+0000","last_active":"2023-05-17T12:25:06.493925+0000","last_peered":"2023-05-17T12:25:06.493925+0000","last_clean":"2023-05-17T12:25:06.493925+0000","last_became_active":"2023-05-17T12:25:01.302640+0000","last_became_peered":"2023-05-17T12:25:01.302640+0000","last_unstale":"2023-05-17T12:25:06.493925+0000","last_undegraded":"2023-05-17T12:25:06.493925+0000","last_fullsized":"2023-05-17T12:25:06.493925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:46:32.251609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325638+0000","last_change":"2023-05-17T12:25:01.810080+0000","last_active":"2023-05-17T12:25:06.325638+0000","last_peered":"2023-05-17T12:25:06.325638+0000","last_clean":"2023-05-17T12:25:06.325638+0000","last_became_active":"2023-05-17T12:25:01.808787+0000","last_became_peered":"2023-05-17T12:25:01.808787+0000","last_unstale":"2023-05-17T12:25:06.325638+0000","last_undegraded":"2023-05-17T12:25:06.325638+0000","last_fullsized":"2023-05-17T12:25:06.325638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325836+0000","last_change":"2023-05-17T12:25:05.831211+0000","last_active":"2023-05-17T12:25:06.325836+0000","last_peered":"2023-05-17T12:25:06.325836+0000","last_clean":"2023-05-17T12:25:06.325836+0000","last_became_active":"2023-05-17T12:25:05.830823+0000","last_became_peered":"2023-05-17T12:25:05.830823+0000","last_unstale":"2023-05-17T12:25:06.325836+0000","last_undegraded":"2023-05-17T12:25:06.325836+0000","last_fullsized":"2023-05-17T12:25:06.325836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:04.874650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994157+0000","last_change":"2023-05-17T12:25:01.304687+0000","last_active":"2023-05-17T12:25:06.994157+0000","last_peered":"2023-05-17T12:25:06.994157+0000","last_clean":"2023-05-17T12:25:06.994157+0000","last_became_active":"2023-05-17T12:25:01.304242+0000","last_became_peered":"2023-05-17T12:25:01.304242+0000","last_unstale":"2023-05-17T12:25:06.994157+0000","last_undegraded":"2023-05-17T12:25:06.994157+0000","last_fullsized":"2023-05-17T12:25:06.994157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:27.380050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298774+0000","last_change":"2023-05-17T12:25:01.807436+0000","last_active":"2023-05-17T12:25:06.298774+0000","last_peered":"2023-05-17T12:25:06.298774+0000","last_clean":"2023-05-17T12:25:06.298774+0000","last_became_active":"2023-05-17T12:25:01.807174+0000","last_became_peered":"2023-05-17T12:25:01.807174+0000","last_unstale":"2023-05-17T12:25:06.298774+0000","last_undegraded":"2023-05-17T12:25:06.298774+0000","last_fullsized":"2023-05-17T12:25:06.298774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:53:31.008703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298892+0000","last_change":"2023-05-17T12:25:05.833027+0000","last_active":"2023-05-17T12:25:06.298892+0000","last_peered":"2023-05-17T12:25:06.298892+0000","last_clean":"2023-05-17T12:25:06.298892+0000","last_became_active":"2023-05-17T12:25:05.832612+0000","last_became_peered":"2023-05-17T12:25:05.832612+0000","last_unstale":"2023-05-17T12:25:06.298892+0000","last_undegraded":"2023-05-17T12:25:06.298892+0000","last_fullsized":"2023-05-17T12:25:06.298892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:55:06.307490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325684+0000","last_change":"2023-05-17T12:25:01.310559+0000","last_active":"2023-05-17T12:25:06.325684+0000","last_peered":"2023-05-17T12:25:06.325684+0000","last_clean":"2023-05-17T12:25:06.325684+0000","last_became_active":"2023-05-17T12:25:01.310250+0000","last_became_peered":"2023-05-17T12:25:01.310250+0000","last_unstale":"2023-05-17T12:25:06.325684+0000","last_undegraded":"2023-05-17T12:25:06.325684+0000","last_fullsized":"2023-05-17T12:25:06.325684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:15.832901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994111+0000","last_change":"2023-05-17T12:25:01.805412+0000","last_active":"2023-05-17T12:25:06.994111+0000","last_peered":"2023-05-17T12:25:06.994111+0000","last_clean":"2023-05-17T12:25:06.994111+0000","last_became_active":"2023-05-17T12:25:01.805151+0000","last_became_peered":"2023-05-17T12:25:01.805151+0000","last_unstale":"2023-05-17T12:25:06.994111+0000","last_undegraded":"2023-05-17T12:25:06.994111+0000","last_fullsized":"2023-05-17T12:25:06.994111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995226+0000","last_change":"2023-05-17T12:25:05.838900+0000","last_active":"2023-05-17T12:25:06.995226+0000","last_peered":"2023-05-17T12:25:06.995226+0000","last_clean":"2023-05-17T12:25:06.995226+0000","last_became_active":"2023-05-17T12:25:05.838472+0000","last_became_peered":"2023-05-17T12:25:05.838472+0000","last_unstale":"2023-05-17T12:25:06.995226+0000","last_undegraded":"2023-05-17T12:25:06.995226+0000","last_fullsized":"2023-05-17T12:25:06.995226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:33.512949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299849+0000","last_change":"2023-05-17T12:25:01.303641+0000","last_active":"2023-05-17T12:25:06.299849+0000","last_peered":"2023-05-17T12:25:06.299849+0000","last_clean":"2023-05-17T12:25:06.299849+0000","last_became_active":"2023-05-17T12:25:01.303288+0000","last_became_peered":"2023-05-17T12:25:01.303288+0000","last_unstale":"2023-05-17T12:25:06.299849+0000","last_undegraded":"2023-05-17T12:25:06.299849+0000","last_fullsized":"2023-05-17T12:25:06.299849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:41.485809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994071+0000","last_change":"2023-05-17T12:25:01.813134+0000","last_active":"2023-05-17T12:25:06.994071+0000","last_peered":"2023-05-17T12:25:06.994071+0000","last_clean":"2023-05-17T12:25:06.994071+0000","last_became_active":"2023-05-17T12:25:01.812890+0000","last_became_peered":"2023-05-17T12:25:01.812890+0000","last_unstale":"2023-05-17T12:25:06.994071+0000","last_undegraded":"2023-05-17T12:25:06.994071+0000","last_fullsized":"2023-05-17T12:25:06.994071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994712+0000","last_change":"2023-05-17T12:25:05.825529+0000","last_active":"2023-05-17T12:25:06.994712+0000","last_peered":"2023-05-17T12:25:06.994712+0000","last_clean":"2023-05-17T12:25:06.994712+0000","last_became_active":"2023-05-17T12:25:05.825141+0000","last_became_peered":"2023-05-17T12:25:05.825141+0000","last_unstale":"2023-05-17T12:25:06.994712+0000","last_undegraded":"2023-05-17T12:25:06.994712+0000","last_fullsized":"2023-05-17T12:25:06.994712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:01.828288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995416+0000","last_change":"2023-05-17T12:25:01.312424+0000","last_active":"2023-05-17T12:25:06.995416+0000","last_peered":"2023-05-17T12:25:06.995416+0000","last_clean":"2023-05-17T12:25:06.995416+0000","last_became_active":"2023-05-17T12:25:01.312124+0000","last_became_peered":"2023-05-17T12:25:01.312124+0000","last_unstale":"2023-05-17T12:25:06.995416+0000","last_undegraded":"2023-05-17T12:25:06.995416+0000","last_fullsized":"2023-05-17T12:25:06.995416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:15.832901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494444+0000","last_change":"2023-05-17T12:25:01.808707+0000","last_active":"2023-05-17T12:25:06.494444+0000","last_peered":"2023-05-17T12:25:06.494444+0000","last_clean":"2023-05-17T12:25:06.494444+0000","last_became_active":"2023-05-17T12:25:01.808370+0000","last_became_peered":"2023-05-17T12:25:01.808370+0000","last_unstale":"2023-05-17T12:25:06.494444+0000","last_undegraded":"2023-05-17T12:25:06.494444+0000","last_fullsized":"2023-05-17T12:25:06.494444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:58.149661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494050+0000","last_change":"2023-05-17T12:25:05.828428+0000","last_active":"2023-05-17T12:25:06.494050+0000","last_peered":"2023-05-17T12:25:06.494050+0000","last_clean":"2023-05-17T12:25:06.494050+0000","last_became_active":"2023-05-17T12:25:05.828056+0000","last_became_peered":"2023-05-17T12:25:05.828056+0000","last_unstale":"2023-05-17T12:25:06.494050+0000","last_undegraded":"2023-05-17T12:25:06.494050+0000","last_fullsized":"2023-05-17T12:25:06.494050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:09:51.971442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:21.144736+0000","last_change":"2023-05-17T12:25:01.303424+0000","last_active":"2023-05-17T12:25:21.144736+0000","last_peered":"2023-05-17T12:25:21.144736+0000","last_clean":"2023-05-17T12:25:21.144736+0000","last_became_active":"2023-05-17T12:25:01.303056+0000","last_became_peered":"2023-05-17T12:25:01.303056+0000","last_unstale":"2023-05-17T12:25:21.144736+0000","last_undegraded":"2023-05-17T12:25:21.144736+0000","last_fullsized":"2023-05-17T12:25:21.144736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:08:00.689474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996178+0000","last_change":"2023-05-17T12:25:01.812617+0000","last_active":"2023-05-17T12:25:06.996178+0000","last_peered":"2023-05-17T12:25:06.996178+0000","last_clean":"2023-05-17T12:25:06.996178+0000","last_became_active":"2023-05-17T12:25:01.811849+0000","last_became_peered":"2023-05-17T12:25:01.811849+0000","last_unstale":"2023-05-17T12:25:06.996178+0000","last_undegraded":"2023-05-17T12:25:06.996178+0000","last_fullsized":"2023-05-17T12:25:06.996178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:45:31.781166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299814+0000","last_change":"2023-05-17T12:25:05.830416+0000","last_active":"2023-05-17T12:25:06.299814+0000","last_peered":"2023-05-17T12:25:06.299814+0000","last_clean":"2023-05-17T12:25:06.299814+0000","last_became_active":"2023-05-17T12:25:05.829972+0000","last_became_peered":"2023-05-17T12:25:05.829972+0000","last_unstale":"2023-05-17T12:25:06.299814+0000","last_undegraded":"2023-05-17T12:25:06.299814+0000","last_fullsized":"2023-05-17T12:25:06.299814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:04.874650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995420+0000","last_change":"2023-05-17T12:25:01.307020+0000","last_active":"2023-05-17T12:25:06.995420+0000","last_peered":"2023-05-17T12:25:06.995420+0000","last_clean":"2023-05-17T12:25:06.995420+0000","last_became_active":"2023-05-17T12:25:01.306785+0000","last_became_peered":"2023-05-17T12:25:01.306785+0000","last_unstale":"2023-05-17T12:25:06.995420+0000","last_undegraded":"2023-05-17T12:25:06.995420+0000","last_fullsized":"2023-05-17T12:25:06.995420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:45.367692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994598+0000","last_change":"2023-05-17T12:25:01.803384+0000","last_active":"2023-05-17T12:25:06.994598+0000","last_peered":"2023-05-17T12:25:06.994598+0000","last_clean":"2023-05-17T12:25:06.994598+0000","last_became_active":"2023-05-17T12:25:01.803098+0000","last_became_peered":"2023-05-17T12:25:01.803098+0000","last_unstale":"2023-05-17T12:25:06.994598+0000","last_undegraded":"2023-05-17T12:25:06.994598+0000","last_fullsized":"2023-05-17T12:25:06.994598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:56.325526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994382+0000","last_change":"2023-05-17T12:25:05.832871+0000","last_active":"2023-05-17T12:25:06.994382+0000","last_peered":"2023-05-17T12:25:06.994382+0000","last_clean":"2023-05-17T12:25:06.994382+0000","last_became_active":"2023-05-17T12:25:05.832188+0000","last_became_peered":"2023-05-17T12:25:05.832188+0000","last_unstale":"2023-05-17T12:25:06.994382+0000","last_undegraded":"2023-05-17T12:25:06.994382+0000","last_fullsized":"2023-05-17T12:25:06.994382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:09.673142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325005+0000","last_change":"2023-05-17T12:25:01.299295+0000","last_active":"2023-05-17T12:25:06.325005+0000","last_peered":"2023-05-17T12:25:06.325005+0000","last_clean":"2023-05-17T12:25:06.325005+0000","last_became_active":"2023-05-17T12:25:01.298965+0000","last_became_peered":"2023-05-17T12:25:01.298965+0000","last_unstale":"2023-05-17T12:25:06.325005+0000","last_undegraded":"2023-05-17T12:25:06.325005+0000","last_fullsized":"2023-05-17T12:25:06.325005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:53.614694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299614+0000","last_change":"2023-05-17T12:25:01.809638+0000","last_active":"2023-05-17T12:25:06.299614+0000","last_peered":"2023-05-17T12:25:06.299614+0000","last_clean":"2023-05-17T12:25:06.299614+0000","last_became_active":"2023-05-17T12:25:01.809317+0000","last_became_peered":"2023-05-17T12:25:01.809317+0000","last_unstale":"2023-05-17T12:25:06.299614+0000","last_undegraded":"2023-05-17T12:25:06.299614+0000","last_fullsized":"2023-05-17T12:25:06.299614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994585+0000","last_change":"2023-05-17T12:25:05.834920+0000","last_active":"2023-05-17T12:25:06.994585+0000","last_peered":"2023-05-17T12:25:06.994585+0000","last_clean":"2023-05-17T12:25:06.994585+0000","last_became_active":"2023-05-17T12:25:05.834577+0000","last_became_peered":"2023-05-17T12:25:05.834577+0000","last_unstale":"2023-05-17T12:25:06.994585+0000","last_undegraded":"2023-05-17T12:25:06.994585+0000","last_fullsized":"2023-05-17T12:25:06.994585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:46.007953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995874+0000","last_change":"2023-05-17T12:25:01.307004+0000","last_active":"2023-05-17T12:25:06.995874+0000","last_peered":"2023-05-17T12:25:06.995874+0000","last_clean":"2023-05-17T12:25:06.995874+0000","last_became_active":"2023-05-17T12:25:01.306682+0000","last_became_peered":"2023-05-17T12:25:01.306682+0000","last_unstale":"2023-05-17T12:25:06.995874+0000","last_undegraded":"2023-05-17T12:25:06.995874+0000","last_fullsized":"2023-05-17T12:25:06.995874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325659+0000","last_change":"2023-05-17T12:25:01.798105+0000","last_active":"2023-05-17T12:25:06.325659+0000","last_peered":"2023-05-17T12:25:06.325659+0000","last_clean":"2023-05-17T12:25:06.325659+0000","last_became_active":"2023-05-17T12:25:01.797871+0000","last_became_peered":"2023-05-17T12:25:01.797871+0000","last_unstale":"2023-05-17T12:25:06.325659+0000","last_undegraded":"2023-05-17T12:25:06.325659+0000","last_fullsized":"2023-05-17T12:25:06.325659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299751+0000","last_change":"2023-05-17T12:25:05.830239+0000","last_active":"2023-05-17T12:25:06.299751+0000","last_peered":"2023-05-17T12:25:06.299751+0000","last_clean":"2023-05-17T12:25:06.299751+0000","last_became_active":"2023-05-17T12:25:05.829812+0000","last_became_peered":"2023-05-17T12:25:05.829812+0000","last_unstale":"2023-05-17T12:25:06.299751+0000","last_undegraded":"2023-05-17T12:25:06.299751+0000","last_fullsized":"2023-05-17T12:25:06.299751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:42.636103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298742+0000","last_change":"2023-05-17T12:25:01.301970+0000","last_active":"2023-05-17T12:25:06.298742+0000","last_peered":"2023-05-17T12:25:06.298742+0000","last_clean":"2023-05-17T12:25:06.298742+0000","last_became_active":"2023-05-17T12:25:01.301645+0000","last_became_peered":"2023-05-17T12:25:01.301645+0000","last_unstale":"2023-05-17T12:25:06.298742+0000","last_undegraded":"2023-05-17T12:25:06.298742+0000","last_fullsized":"2023-05-17T12:25:06.298742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:01:41.050026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994656+0000","last_change":"2023-05-17T12:25:01.814151+0000","last_active":"2023-05-17T12:25:06.994656+0000","last_peered":"2023-05-17T12:25:06.994656+0000","last_clean":"2023-05-17T12:25:06.994656+0000","last_became_active":"2023-05-17T12:25:01.813749+0000","last_became_peered":"2023-05-17T12:25:01.813749+0000","last_unstale":"2023-05-17T12:25:06.994656+0000","last_undegraded":"2023-05-17T12:25:06.994656+0000","last_fullsized":"2023-05-17T12:25:06.994656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:56:53.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996349+0000","last_change":"2023-05-17T12:25:05.841929+0000","last_active":"2023-05-17T12:25:06.996349+0000","last_peered":"2023-05-17T12:25:06.996349+0000","last_clean":"2023-05-17T12:25:06.996349+0000","last_became_active":"2023-05-17T12:25:05.841487+0000","last_became_peered":"2023-05-17T12:25:05.841487+0000","last_unstale":"2023-05-17T12:25:06.996349+0000","last_undegraded":"2023-05-17T12:25:06.996349+0000","last_fullsized":"2023-05-17T12:25:06.996349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:01.828288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996446+0000","last_change":"2023-05-17T12:25:01.304576+0000","last_active":"2023-05-17T12:25:06.996446+0000","last_peered":"2023-05-17T12:25:06.996446+0000","last_clean":"2023-05-17T12:25:06.996446+0000","last_became_active":"2023-05-17T12:25:01.304198+0000","last_became_peered":"2023-05-17T12:25:01.304198+0000","last_unstale":"2023-05-17T12:25:06.996446+0000","last_undegraded":"2023-05-17T12:25:06.996446+0000","last_fullsized":"2023-05-17T12:25:06.996446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:11.601219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298936+0000","last_change":"2023-05-17T12:25:01.802054+0000","last_active":"2023-05-17T12:25:06.298936+0000","last_peered":"2023-05-17T12:25:06.298936+0000","last_clean":"2023-05-17T12:25:06.298936+0000","last_became_active":"2023-05-17T12:25:01.801727+0000","last_became_peered":"2023-05-17T12:25:01.801727+0000","last_unstale":"2023-05-17T12:25:06.298936+0000","last_undegraded":"2023-05-17T12:25:06.298936+0000","last_fullsized":"2023-05-17T12:25:06.298936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:24.353901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296090+0000","last_change":"2023-05-17T12:25:05.831343+0000","last_active":"2023-05-17T12:25:06.296090+0000","last_peered":"2023-05-17T12:25:06.296090+0000","last_clean":"2023-05-17T12:25:06.296090+0000","last_became_active":"2023-05-17T12:25:05.830962+0000","last_became_peered":"2023-05-17T12:25:05.830962+0000","last_unstale":"2023-05-17T12:25:06.296090+0000","last_undegraded":"2023-05-17T12:25:06.296090+0000","last_fullsized":"2023-05-17T12:25:06.296090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:31:26.034991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996563+0000","last_change":"2023-05-17T12:25:01.307148+0000","last_active":"2023-05-17T12:25:06.996563+0000","last_peered":"2023-05-17T12:25:06.996563+0000","last_clean":"2023-05-17T12:25:06.996563+0000","last_became_active":"2023-05-17T12:25:01.306796+0000","last_became_peered":"2023-05-17T12:25:01.306796+0000","last_unstale":"2023-05-17T12:25:06.996563+0000","last_undegraded":"2023-05-17T12:25:06.996563+0000","last_fullsized":"2023-05-17T12:25:06.996563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:40:08.139475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995053+0000","last_change":"2023-05-17T12:25:01.810661+0000","last_active":"2023-05-17T12:25:06.995053+0000","last_peered":"2023-05-17T12:25:06.995053+0000","last_clean":"2023-05-17T12:25:06.995053+0000","last_became_active":"2023-05-17T12:25:01.810315+0000","last_became_peered":"2023-05-17T12:25:01.810315+0000","last_unstale":"2023-05-17T12:25:06.995053+0000","last_undegraded":"2023-05-17T12:25:06.995053+0000","last_fullsized":"2023-05-17T12:25:06.995053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:11:45.271597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296256+0000","last_change":"2023-05-17T12:25:05.827003+0000","last_active":"2023-05-17T12:25:06.296256+0000","last_peered":"2023-05-17T12:25:06.296256+0000","last_clean":"2023-05-17T12:25:06.296256+0000","last_became_active":"2023-05-17T12:25:05.826640+0000","last_became_peered":"2023-05-17T12:25:05.826640+0000","last_unstale":"2023-05-17T12:25:06.296256+0000","last_undegraded":"2023-05-17T12:25:06.296256+0000","last_fullsized":"2023-05-17T12:25:06.296256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:46:35.905087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995688+0000","last_change":"2023-05-17T12:25:01.309404+0000","last_active":"2023-05-17T12:25:06.995688+0000","last_peered":"2023-05-17T12:25:06.995688+0000","last_clean":"2023-05-17T12:25:06.995688+0000","last_became_active":"2023-05-17T12:25:01.309104+0000","last_became_peered":"2023-05-17T12:25:01.309104+0000","last_unstale":"2023-05-17T12:25:06.995688+0000","last_undegraded":"2023-05-17T12:25:06.995688+0000","last_fullsized":"2023-05-17T12:25:06.995688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:17.774402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298561+0000","last_change":"2023-05-17T12:25:01.806638+0000","last_active":"2023-05-17T12:25:06.298561+0000","last_peered":"2023-05-17T12:25:06.298561+0000","last_clean":"2023-05-17T12:25:06.298561+0000","last_became_active":"2023-05-17T12:25:01.806398+0000","last_became_peered":"2023-05-17T12:25:01.806398+0000","last_unstale":"2023-05-17T12:25:06.298561+0000","last_undegraded":"2023-05-17T12:25:06.298561+0000","last_fullsized":"2023-05-17T12:25:06.298561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:32:04.677765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296330+0000","last_change":"2023-05-17T12:25:05.825320+0000","last_active":"2023-05-17T12:25:06.296330+0000","last_peered":"2023-05-17T12:25:06.296330+0000","last_clean":"2023-05-17T12:25:06.296330+0000","last_became_active":"2023-05-17T12:25:05.824918+0000","last_became_peered":"2023-05-17T12:25:05.824918+0000","last_unstale":"2023-05-17T12:25:06.296330+0000","last_undegraded":"2023-05-17T12:25:06.296330+0000","last_fullsized":"2023-05-17T12:25:06.296330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:12:01.541988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298981+0000","last_change":"2023-05-17T12:25:01.311086+0000","last_active":"2023-05-17T12:25:06.298981+0000","last_peered":"2023-05-17T12:25:06.298981+0000","last_clean":"2023-05-17T12:25:06.298981+0000","last_became_active":"2023-05-17T12:25:01.310778+0000","last_became_peered":"2023-05-17T12:25:01.310778+0000","last_unstale":"2023-05-17T12:25:06.298981+0000","last_undegraded":"2023-05-17T12:25:06.298981+0000","last_fullsized":"2023-05-17T12:25:06.298981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:57.143808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325238+0000","last_change":"2023-05-17T12:25:01.803984+0000","last_active":"2023-05-17T12:25:06.325238+0000","last_peered":"2023-05-17T12:25:06.325238+0000","last_clean":"2023-05-17T12:25:06.325238+0000","last_became_active":"2023-05-17T12:25:01.803655+0000","last_became_peered":"2023-05-17T12:25:01.803655+0000","last_unstale":"2023-05-17T12:25:06.325238+0000","last_undegraded":"2023-05-17T12:25:06.325238+0000","last_fullsized":"2023-05-17T12:25:06.325238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:24.353901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296620+0000","last_change":"2023-05-17T12:25:05.827683+0000","last_active":"2023-05-17T12:25:06.296620+0000","last_peered":"2023-05-17T12:25:06.296620+0000","last_clean":"2023-05-17T12:25:06.296620+0000","last_became_active":"2023-05-17T12:25:05.827247+0000","last_became_peered":"2023-05-17T12:25:05.827247+0000","last_unstale":"2023-05-17T12:25:06.296620+0000","last_undegraded":"2023-05-17T12:25:06.296620+0000","last_fullsized":"2023-05-17T12:25:06.296620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:26:50.186275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994317+0000","last_change":"2023-05-17T12:25:01.302898+0000","last_active":"2023-05-17T12:25:06.994317+0000","last_peered":"2023-05-17T12:25:06.994317+0000","last_clean":"2023-05-17T12:25:06.994317+0000","last_became_active":"2023-05-17T12:25:01.302511+0000","last_became_peered":"2023-05-17T12:25:01.302511+0000","last_unstale":"2023-05-17T12:25:06.994317+0000","last_undegraded":"2023-05-17T12:25:06.994317+0000","last_fullsized":"2023-05-17T12:25:06.994317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:00.352507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995431+0000","last_change":"2023-05-17T12:25:01.809822+0000","last_active":"2023-05-17T12:25:06.995431+0000","last_peered":"2023-05-17T12:25:06.995431+0000","last_clean":"2023-05-17T12:25:06.995431+0000","last_became_active":"2023-05-17T12:25:01.809341+0000","last_became_peered":"2023-05-17T12:25:01.809341+0000","last_unstale":"2023-05-17T12:25:06.995431+0000","last_undegraded":"2023-05-17T12:25:06.995431+0000","last_fullsized":"2023-05-17T12:25:06.995431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:55:38.616795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494179+0000","last_change":"2023-05-17T12:25:05.823841+0000","last_active":"2023-05-17T12:25:06.494179+0000","last_peered":"2023-05-17T12:25:06.494179+0000","last_clean":"2023-05-17T12:25:06.494179+0000","last_became_active":"2023-05-17T12:25:05.823477+0000","last_became_peered":"2023-05-17T12:25:05.823477+0000","last_unstale":"2023-05-17T12:25:06.494179+0000","last_undegraded":"2023-05-17T12:25:06.494179+0000","last_fullsized":"2023-05-17T12:25:06.494179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:35:08.935796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298699+0000","last_change":"2023-05-17T12:25:01.304712+0000","last_active":"2023-05-17T12:25:06.298699+0000","last_peered":"2023-05-17T12:25:06.298699+0000","last_clean":"2023-05-17T12:25:06.298699+0000","last_became_active":"2023-05-17T12:25:01.304393+0000","last_became_peered":"2023-05-17T12:25:01.304393+0000","last_unstale":"2023-05-17T12:25:06.298699+0000","last_undegraded":"2023-05-17T12:25:06.298699+0000","last_fullsized":"2023-05-17T12:25:06.298699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:26:28.248372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995773+0000","last_change":"2023-05-17T12:25:01.798453+0000","last_active":"2023-05-17T12:25:06.995773+0000","last_peered":"2023-05-17T12:25:06.995773+0000","last_clean":"2023-05-17T12:25:06.995773+0000","last_became_active":"2023-05-17T12:25:01.798156+0000","last_became_peered":"2023-05-17T12:25:01.798156+0000","last_unstale":"2023-05-17T12:25:06.995773+0000","last_undegraded":"2023-05-17T12:25:06.995773+0000","last_fullsized":"2023-05-17T12:25:06.995773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:43.116514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299389+0000","last_change":"2023-05-17T12:25:05.830481+0000","last_active":"2023-05-17T12:25:06.299389+0000","last_peered":"2023-05-17T12:25:06.299389+0000","last_clean":"2023-05-17T12:25:06.299389+0000","last_became_active":"2023-05-17T12:25:05.829790+0000","last_became_peered":"2023-05-17T12:25:05.829790+0000","last_unstale":"2023-05-17T12:25:06.299389+0000","last_undegraded":"2023-05-17T12:25:06.299389+0000","last_fullsized":"2023-05-17T12:25:06.299389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:49.889835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995559+0000","last_change":"2023-05-17T12:25:01.303346+0000","last_active":"2023-05-17T12:25:06.995559+0000","last_peered":"2023-05-17T12:25:06.995559+0000","last_clean":"2023-05-17T12:25:06.995559+0000","last_became_active":"2023-05-17T12:25:01.303010+0000","last_became_peered":"2023-05-17T12:25:01.303010+0000","last_unstale":"2023-05-17T12:25:06.995559+0000","last_undegraded":"2023-05-17T12:25:06.995559+0000","last_fullsized":"2023-05-17T12:25:06.995559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:05:24.193334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996498+0000","last_change":"2023-05-17T12:25:01.812147+0000","last_active":"2023-05-17T12:25:06.996498+0000","last_peered":"2023-05-17T12:25:06.996498+0000","last_clean":"2023-05-17T12:25:06.996498+0000","last_became_active":"2023-05-17T12:25:01.811794+0000","last_became_peered":"2023-05-17T12:25:01.811794+0000","last_unstale":"2023-05-17T12:25:06.996498+0000","last_undegraded":"2023-05-17T12:25:06.996498+0000","last_fullsized":"2023-05-17T12:25:06.996498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:21:08.368476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996608+0000","last_change":"2023-05-17T12:25:05.825191+0000","last_active":"2023-05-17T12:25:06.996608+0000","last_peered":"2023-05-17T12:25:06.996608+0000","last_clean":"2023-05-17T12:25:06.996608+0000","last_became_active":"2023-05-17T12:25:05.824783+0000","last_became_peered":"2023-05-17T12:25:05.824783+0000","last_unstale":"2023-05-17T12:25:06.996608+0000","last_undegraded":"2023-05-17T12:25:06.996608+0000","last_fullsized":"2023-05-17T12:25:06.996608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:37.899306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994023+0000","last_change":"2023-05-17T12:25:01.308187+0000","last_active":"2023-05-17T12:25:06.994023+0000","last_peered":"2023-05-17T12:25:06.994023+0000","last_clean":"2023-05-17T12:25:06.994023+0000","last_became_active":"2023-05-17T12:25:01.307806+0000","last_became_peered":"2023-05-17T12:25:01.307806+0000","last_unstale":"2023-05-17T12:25:06.994023+0000","last_undegraded":"2023-05-17T12:25:06.994023+0000","last_fullsized":"2023-05-17T12:25:06.994023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:28.990806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494856+0000","last_change":"2023-05-17T12:25:01.801432+0000","last_active":"2023-05-17T12:25:06.494856+0000","last_peered":"2023-05-17T12:25:06.494856+0000","last_clean":"2023-05-17T12:25:06.494856+0000","last_became_active":"2023-05-17T12:25:01.801009+0000","last_became_peered":"2023-05-17T12:25:01.801009+0000","last_unstale":"2023-05-17T12:25:06.494856+0000","last_undegraded":"2023-05-17T12:25:06.494856+0000","last_fullsized":"2023-05-17T12:25:06.494856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325252+0000","last_change":"2023-05-17T12:25:05.822949+0000","last_active":"2023-05-17T12:25:06.325252+0000","last_peered":"2023-05-17T12:25:06.325252+0000","last_clean":"2023-05-17T12:25:06.325252+0000","last_became_active":"2023-05-17T12:25:05.822299+0000","last_became_peered":"2023-05-17T12:25:05.822299+0000","last_unstale":"2023-05-17T12:25:06.325252+0000","last_undegraded":"2023-05-17T12:25:06.325252+0000","last_fullsized":"2023-05-17T12:25:06.325252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:43:00.150100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494254+0000","last_change":"2023-05-17T12:24:55.792670+0000","last_active":"2023-05-17T12:25:06.494254+0000","last_peered":"2023-05-17T12:25:06.494254+0000","last_clean":"2023-05-17T12:25:06.494254+0000","last_became_active":"2023-05-17T12:24:55.792363+0000","last_became_peered":"2023-05-17T12:24:55.792363+0000","last_unstale":"2023-05-17T12:25:06.494254+0000","last_undegraded":"2023-05-17T12:25:06.494254+0000","last_fullsized":"2023-05-17T12:25:06.494254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:48.078768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299528+0000","last_change":"2023-05-17T12:25:01.311296+0000","last_active":"2023-05-17T12:25:06.299528+0000","last_peered":"2023-05-17T12:25:06.299528+0000","last_clean":"2023-05-17T12:25:06.299528+0000","last_became_active":"2023-05-17T12:25:01.310946+0000","last_became_peered":"2023-05-17T12:25:01.310946+0000","last_unstale":"2023-05-17T12:25:06.299528+0000","last_undegraded":"2023-05-17T12:25:06.299528+0000","last_fullsized":"2023-05-17T12:25:06.299528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:21.293421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494247+0000","last_change":"2023-05-17T12:25:01.798812+0000","last_active":"2023-05-17T12:25:06.494247+0000","last_peered":"2023-05-17T12:25:06.494247+0000","last_clean":"2023-05-17T12:25:06.494247+0000","last_became_active":"2023-05-17T12:25:01.798536+0000","last_became_peered":"2023-05-17T12:25:01.798536+0000","last_unstale":"2023-05-17T12:25:06.494247+0000","last_undegraded":"2023-05-17T12:25:06.494247+0000","last_fullsized":"2023-05-17T12:25:06.494247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:52:17.557383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325259+0000","last_change":"2023-05-17T12:25:05.830657+0000","last_active":"2023-05-17T12:25:06.325259+0000","last_peered":"2023-05-17T12:25:06.325259+0000","last_clean":"2023-05-17T12:25:06.325259+0000","last_became_active":"2023-05-17T12:25:05.830173+0000","last_became_peered":"2023-05-17T12:25:05.830173+0000","last_unstale":"2023-05-17T12:25:06.325259+0000","last_undegraded":"2023-05-17T12:25:06.325259+0000","last_fullsized":"2023-05-17T12:25:06.325259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:29:01.854184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298702+0000","last_change":"2023-05-17T12:24:55.754074+0000","last_active":"2023-05-17T12:25:06.298702+0000","last_peered":"2023-05-17T12:25:06.298702+0000","last_clean":"2023-05-17T12:25:06.298702+0000","last_became_active":"2023-05-17T12:24:55.753544+0000","last_became_peered":"2023-05-17T12:24:55.753544+0000","last_unstale":"2023-05-17T12:25:06.298702+0000","last_undegraded":"2023-05-17T12:25:06.298702+0000","last_fullsized":"2023-05-17T12:25:06.298702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:28:51.796115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995192+0000","last_change":"2023-05-17T12:25:01.305764+0000","last_active":"2023-05-17T12:25:06.995192+0000","last_peered":"2023-05-17T12:25:06.995192+0000","last_clean":"2023-05-17T12:25:06.995192+0000","last_became_active":"2023-05-17T12:25:01.304391+0000","last_became_peered":"2023-05-17T12:25:01.304391+0000","last_unstale":"2023-05-17T12:25:06.995192+0000","last_undegraded":"2023-05-17T12:25:06.995192+0000","last_fullsized":"2023-05-17T12:25:06.995192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:59:10.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494223+0000","last_change":"2023-05-17T12:25:01.796749+0000","last_active":"2023-05-17T12:25:06.494223+0000","last_peered":"2023-05-17T12:25:06.494223+0000","last_clean":"2023-05-17T12:25:06.494223+0000","last_became_active":"2023-05-17T12:25:01.796483+0000","last_became_peered":"2023-05-17T12:25:01.796483+0000","last_unstale":"2023-05-17T12:25:06.494223+0000","last_undegraded":"2023-05-17T12:25:06.494223+0000","last_fullsized":"2023-05-17T12:25:06.494223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:41:28.654953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296765+0000","last_change":"2023-05-17T12:25:05.831371+0000","last_active":"2023-05-17T12:25:06.296765+0000","last_peered":"2023-05-17T12:25:06.296765+0000","last_clean":"2023-05-17T12:25:06.296765+0000","last_became_active":"2023-05-17T12:25:05.830975+0000","last_became_peered":"2023-05-17T12:25:05.830975+0000","last_unstale":"2023-05-17T12:25:06.296765+0000","last_undegraded":"2023-05-17T12:25:06.296765+0000","last_fullsized":"2023-05-17T12:25:06.296765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:20.938620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296249+0000","last_change":"2023-05-17T12:24:56.008501+0000","last_active":"2023-05-17T12:25:06.296249+0000","last_peered":"2023-05-17T12:25:06.296249+0000","last_clean":"2023-05-17T12:25:06.296249+0000","last_became_active":"2023-05-17T12:24:56.008203+0000","last_became_peered":"2023-05-17T12:24:56.008203+0000","last_unstale":"2023-05-17T12:25:06.296249+0000","last_undegraded":"2023-05-17T12:25:06.296249+0000","last_fullsized":"2023-05-17T12:25:06.296249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:04:51.599706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.493981+0000","last_change":"2023-05-17T12:25:01.301806+0000","last_active":"2023-05-17T12:25:06.493981+0000","last_peered":"2023-05-17T12:25:06.493981+0000","last_clean":"2023-05-17T12:25:06.493981+0000","last_became_active":"2023-05-17T12:25:01.301537+0000","last_became_peered":"2023-05-17T12:25:01.301537+0000","last_unstale":"2023-05-17T12:25:06.493981+0000","last_undegraded":"2023-05-17T12:25:06.493981+0000","last_fullsized":"2023-05-17T12:25:06.493981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:34:24.246684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494836+0000","last_change":"2023-05-17T12:25:01.801261+0000","last_active":"2023-05-17T12:25:06.494836+0000","last_peered":"2023-05-17T12:25:06.494836+0000","last_clean":"2023-05-17T12:25:06.494836+0000","last_became_active":"2023-05-17T12:25:01.800721+0000","last_became_peered":"2023-05-17T12:25:01.800721+0000","last_unstale":"2023-05-17T12:25:06.494836+0000","last_undegraded":"2023-05-17T12:25:06.494836+0000","last_fullsized":"2023-05-17T12:25:06.494836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:29.996659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996033+0000","last_change":"2023-05-17T12:25:05.844206+0000","last_active":"2023-05-17T12:25:06.996033+0000","last_peered":"2023-05-17T12:25:06.996033+0000","last_clean":"2023-05-17T12:25:06.996033+0000","last_became_active":"2023-05-17T12:25:05.843845+0000","last_became_peered":"2023-05-17T12:25:05.843845+0000","last_unstale":"2023-05-17T12:25:06.996033+0000","last_undegraded":"2023-05-17T12:25:06.996033+0000","last_fullsized":"2023-05-17T12:25:06.996033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:46.007953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299370+0000","last_change":"2023-05-17T12:24:55.753963+0000","last_active":"2023-05-17T12:25:06.299370+0000","last_peered":"2023-05-17T12:25:06.299370+0000","last_clean":"2023-05-17T12:25:06.299370+0000","last_became_active":"2023-05-17T12:24:55.753582+0000","last_became_peered":"2023-05-17T12:24:55.753582+0000","last_unstale":"2023-05-17T12:25:06.299370+0000","last_undegraded":"2023-05-17T12:25:06.299370+0000","last_fullsized":"2023-05-17T12:25:06.299370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995510+0000","last_change":"2023-05-17T12:24:48.829166+0000","last_active":"2023-05-17T12:25:06.995510+0000","last_peered":"2023-05-17T12:25:06.995510+0000","last_clean":"2023-05-17T12:25:06.995510+0000","last_became_active":"2023-05-17T12:24:48.828767+0000","last_became_peered":"2023-05-17T12:24:48.828767+0000","last_unstale":"2023-05-17T12:25:06.995510+0000","last_undegraded":"2023-05-17T12:25:06.995510+0000","last_fullsized":"2023-05-17T12:25:06.995510+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_clean_scrub_stamp":"2023-05-17T12:24:47.688706+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:18.612053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994251+0000","last_change":"2023-05-17T12:25:01.310793+0000","last_active":"2023-05-17T12:25:06.994251+0000","last_peered":"2023-05-17T12:25:06.994251+0000","last_clean":"2023-05-17T12:25:06.994251+0000","last_became_active":"2023-05-17T12:25:01.310471+0000","last_became_peered":"2023-05-17T12:25:01.310471+0000","last_unstale":"2023-05-17T12:25:06.994251+0000","last_undegraded":"2023-05-17T12:25:06.994251+0000","last_fullsized":"2023-05-17T12:25:06.994251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:21.293421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299111+0000","last_change":"2023-05-17T12:25:01.813237+0000","last_active":"2023-05-17T12:25:06.299111+0000","last_peered":"2023-05-17T12:25:06.299111+0000","last_clean":"2023-05-17T12:25:06.299111+0000","last_became_active":"2023-05-17T12:25:01.812856+0000","last_became_peered":"2023-05-17T12:25:01.812856+0000","last_unstale":"2023-05-17T12:25:06.299111+0000","last_undegraded":"2023-05-17T12:25:06.299111+0000","last_fullsized":"2023-05-17T12:25:06.299111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:03:48.424581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299344+0000","last_change":"2023-05-17T12:25:05.831353+0000","last_active":"2023-05-17T12:25:06.299344+0000","last_peered":"2023-05-17T12:25:06.299344+0000","last_clean":"2023-05-17T12:25:06.299344+0000","last_became_active":"2023-05-17T12:25:05.830895+0000","last_became_peered":"2023-05-17T12:25:05.830895+0000","last_unstale":"2023-05-17T12:25:06.299344+0000","last_undegraded":"2023-05-17T12:25:06.299344+0000","last_fullsized":"2023-05-17T12:25:06.299344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:33.512949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996042+0000","last_change":"2023-05-17T12:24:55.756595+0000","last_active":"2023-05-17T12:25:06.996042+0000","last_peered":"2023-05-17T12:25:06.996042+0000","last_clean":"2023-05-17T12:25:06.996042+0000","last_became_active":"2023-05-17T12:24:55.756274+0000","last_became_peered":"2023-05-17T12:24:55.756274+0000","last_unstale":"2023-05-17T12:25:06.996042+0000","last_undegraded":"2023-05-17T12:25:06.996042+0000","last_fullsized":"2023-05-17T12:25:06.996042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:49.783748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.324875+0000","last_change":"2023-05-17T12:25:01.304992+0000","last_active":"2023-05-17T12:25:06.324875+0000","last_peered":"2023-05-17T12:25:06.324875+0000","last_clean":"2023-05-17T12:25:06.324875+0000","last_became_active":"2023-05-17T12:25:01.304670+0000","last_became_peered":"2023-05-17T12:25:01.304670+0000","last_unstale":"2023-05-17T12:25:06.324875+0000","last_undegraded":"2023-05-17T12:25:06.324875+0000","last_fullsized":"2023-05-17T12:25:06.324875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:52:16.551530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325454+0000","last_change":"2023-05-17T12:25:01.804023+0000","last_active":"2023-05-17T12:25:06.325454+0000","last_peered":"2023-05-17T12:25:06.325454+0000","last_clean":"2023-05-17T12:25:06.325454+0000","last_became_active":"2023-05-17T12:25:01.803777+0000","last_became_peered":"2023-05-17T12:25:01.803777+0000","last_unstale":"2023-05-17T12:25:06.325454+0000","last_undegraded":"2023-05-17T12:25:06.325454+0000","last_fullsized":"2023-05-17T12:25:06.325454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:29.996659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298944+0000","last_change":"2023-05-17T12:25:05.834950+0000","last_active":"2023-05-17T12:25:06.298944+0000","last_peered":"2023-05-17T12:25:06.298944+0000","last_clean":"2023-05-17T12:25:06.298944+0000","last_became_active":"2023-05-17T12:25:05.833927+0000","last_became_peered":"2023-05-17T12:25:05.833927+0000","last_unstale":"2023-05-17T12:25:06.298944+0000","last_undegraded":"2023-05-17T12:25:06.298944+0000","last_fullsized":"2023-05-17T12:25:06.298944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:43:29.212877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995514+0000","last_change":"2023-05-17T12:24:55.792994+0000","last_active":"2023-05-17T12:25:06.995514+0000","last_peered":"2023-05-17T12:25:06.995514+0000","last_clean":"2023-05-17T12:25:06.995514+0000","last_became_active":"2023-05-17T12:24:55.792597+0000","last_became_peered":"2023-05-17T12:24:55.792597+0000","last_unstale":"2023-05-17T12:25:06.995514+0000","last_undegraded":"2023-05-17T12:25:06.995514+0000","last_fullsized":"2023-05-17T12:25:06.995514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494371+0000","last_change":"2023-05-17T12:25:01.307685+0000","last_active":"2023-05-17T12:25:06.494371+0000","last_peered":"2023-05-17T12:25:06.494371+0000","last_clean":"2023-05-17T12:25:06.494371+0000","last_became_active":"2023-05-17T12:25:01.307371+0000","last_became_peered":"2023-05-17T12:25:01.307371+0000","last_unstale":"2023-05-17T12:25:06.494371+0000","last_undegraded":"2023-05-17T12:25:06.494371+0000","last_fullsized":"2023-05-17T12:25:06.494371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:23.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325414+0000","last_change":"2023-05-17T12:25:01.809898+0000","last_active":"2023-05-17T12:25:06.325414+0000","last_peered":"2023-05-17T12:25:06.325414+0000","last_clean":"2023-05-17T12:25:06.325414+0000","last_became_active":"2023-05-17T12:25:01.809647+0000","last_became_peered":"2023-05-17T12:25:01.809647+0000","last_unstale":"2023-05-17T12:25:06.325414+0000","last_undegraded":"2023-05-17T12:25:06.325414+0000","last_fullsized":"2023-05-17T12:25:06.325414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995271+0000","last_change":"2023-05-17T12:25:05.837992+0000","last_active":"2023-05-17T12:25:06.995271+0000","last_peered":"2023-05-17T12:25:06.995271+0000","last_clean":"2023-05-17T12:25:06.995271+0000","last_became_active":"2023-05-17T12:25:05.836246+0000","last_became_peered":"2023-05-17T12:25:05.836246+0000","last_unstale":"2023-05-17T12:25:06.995271+0000","last_undegraded":"2023-05-17T12:25:06.995271+0000","last_fullsized":"2023-05-17T12:25:06.995271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:01:31.652913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994685+0000","last_change":"2023-05-17T12:25:01.303375+0000","last_active":"2023-05-17T12:25:06.994685+0000","last_peered":"2023-05-17T12:25:06.994685+0000","last_clean":"2023-05-17T12:25:06.994685+0000","last_became_active":"2023-05-17T12:25:01.303046+0000","last_became_peered":"2023-05-17T12:25:01.303046+0000","last_unstale":"2023-05-17T12:25:06.994685+0000","last_undegraded":"2023-05-17T12:25:06.994685+0000","last_fullsized":"2023-05-17T12:25:06.994685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:40:08.139475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494947+0000","last_change":"2023-05-17T12:24:55.755523+0000","last_active":"2023-05-17T12:25:06.494947+0000","last_peered":"2023-05-17T12:25:06.494947+0000","last_clean":"2023-05-17T12:25:06.494947+0000","last_became_active":"2023-05-17T12:24:55.755229+0000","last_became_peered":"2023-05-17T12:24:55.755229+0000","last_unstale":"2023-05-17T12:25:06.494947+0000","last_undegraded":"2023-05-17T12:25:06.494947+0000","last_fullsized":"2023-05-17T12:25:06.494947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.993978+0000","last_change":"2023-05-17T12:25:01.814467+0000","last_active":"2023-05-17T12:25:06.993978+0000","last_peered":"2023-05-17T12:25:06.993978+0000","last_clean":"2023-05-17T12:25:06.993978+0000","last_became_active":"2023-05-17T12:25:01.813813+0000","last_became_peered":"2023-05-17T12:25:01.813813+0000","last_unstale":"2023-05-17T12:25:06.993978+0000","last_undegraded":"2023-05-17T12:25:06.993978+0000","last_fullsized":"2023-05-17T12:25:06.993978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:22.759151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.993949+0000","last_change":"2023-05-17T12:25:05.826670+0000","last_active":"2023-05-17T12:25:06.993949+0000","last_peered":"2023-05-17T12:25:06.993949+0000","last_clean":"2023-05-17T12:25:06.993949+0000","last_became_active":"2023-05-17T12:25:05.826237+0000","last_became_peered":"2023-05-17T12:25:05.826237+0000","last_unstale":"2023-05-17T12:25:06.993949+0000","last_undegraded":"2023-05-17T12:25:06.993949+0000","last_fullsized":"2023-05-17T12:25:06.993949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:13:01.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298606+0000","last_change":"2023-05-17T12:24:55.755814+0000","last_active":"2023-05-17T12:25:06.298606+0000","last_peered":"2023-05-17T12:25:06.298606+0000","last_clean":"2023-05-17T12:25:06.298606+0000","last_became_active":"2023-05-17T12:24:55.755481+0000","last_became_peered":"2023-05-17T12:24:55.755481+0000","last_unstale":"2023-05-17T12:25:06.298606+0000","last_undegraded":"2023-05-17T12:25:06.298606+0000","last_fullsized":"2023-05-17T12:25:06.298606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:58:43.934611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325579+0000","last_change":"2023-05-17T12:25:01.310606+0000","last_active":"2023-05-17T12:25:06.325579+0000","last_peered":"2023-05-17T12:25:06.325579+0000","last_clean":"2023-05-17T12:25:06.325579+0000","last_became_active":"2023-05-17T12:25:01.309614+0000","last_became_peered":"2023-05-17T12:25:01.309614+0000","last_unstale":"2023-05-17T12:25:06.325579+0000","last_undegraded":"2023-05-17T12:25:06.325579+0000","last_fullsized":"2023-05-17T12:25:06.325579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:27.380050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994784+0000","last_change":"2023-05-17T12:25:01.801978+0000","last_active":"2023-05-17T12:25:06.994784+0000","last_peered":"2023-05-17T12:25:06.994784+0000","last_clean":"2023-05-17T12:25:06.994784+0000","last_became_active":"2023-05-17T12:25:01.801664+0000","last_became_peered":"2023-05-17T12:25:01.801664+0000","last_unstale":"2023-05-17T12:25:06.994784+0000","last_undegraded":"2023-05-17T12:25:06.994784+0000","last_fullsized":"2023-05-17T12:25:06.994784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:49:24.674805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494716+0000","last_change":"2023-05-17T12:25:05.827430+0000","last_active":"2023-05-17T12:25:06.494716+0000","last_peered":"2023-05-17T12:25:06.494716+0000","last_clean":"2023-05-17T12:25:06.494716+0000","last_became_active":"2023-05-17T12:25:05.827001+0000","last_became_peered":"2023-05-17T12:25:05.827001+0000","last_unstale":"2023-05-17T12:25:06.494716+0000","last_undegraded":"2023-05-17T12:25:06.494716+0000","last_fullsized":"2023-05-17T12:25:06.494716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:26.275442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325368+0000","last_change":"2023-05-17T12:25:01.311128+0000","last_active":"2023-05-17T12:25:06.325368+0000","last_peered":"2023-05-17T12:25:06.325368+0000","last_clean":"2023-05-17T12:25:06.325368+0000","last_became_active":"2023-05-17T12:25:01.310836+0000","last_became_peered":"2023-05-17T12:25:01.310836+0000","last_unstale":"2023-05-17T12:25:06.325368+0000","last_undegraded":"2023-05-17T12:25:06.325368+0000","last_fullsized":"2023-05-17T12:25:06.325368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:21.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296706+0000","last_change":"2023-05-17T12:25:01.802967+0000","last_active":"2023-05-17T12:25:06.296706+0000","last_peered":"2023-05-17T12:25:06.296706+0000","last_clean":"2023-05-17T12:25:06.296706+0000","last_became_active":"2023-05-17T12:25:01.802692+0000","last_became_peered":"2023-05-17T12:25:01.802692+0000","last_unstale":"2023-05-17T12:25:06.296706+0000","last_undegraded":"2023-05-17T12:25:06.296706+0000","last_fullsized":"2023-05-17T12:25:06.296706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:58:57.061496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996669+0000","last_change":"2023-05-17T12:25:05.842157+0000","last_active":"2023-05-17T12:25:06.996669+0000","last_peered":"2023-05-17T12:25:06.996669+0000","last_clean":"2023-05-17T12:25:06.996669+0000","last_became_active":"2023-05-17T12:25:05.841642+0000","last_became_peered":"2023-05-17T12:25:05.841642+0000","last_unstale":"2023-05-17T12:25:06.996669+0000","last_undegraded":"2023-05-17T12:25:06.996669+0000","last_fullsized":"2023-05-17T12:25:06.996669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:53:03.043259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299117+0000","last_change":"2023-05-17T12:25:01.309109+0000","last_active":"2023-05-17T12:25:06.299117+0000","last_peered":"2023-05-17T12:25:06.299117+0000","last_clean":"2023-05-17T12:25:06.299117+0000","last_became_active":"2023-05-17T12:25:01.308819+0000","last_became_peered":"2023-05-17T12:25:01.308819+0000","last_unstale":"2023-05-17T12:25:06.299117+0000","last_undegraded":"2023-05-17T12:25:06.299117+0000","last_fullsized":"2023-05-17T12:25:06.299117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:10.497260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995019+0000","last_change":"2023-05-17T12:25:01.807742+0000","last_active":"2023-05-17T12:25:06.995019+0000","last_peered":"2023-05-17T12:25:06.995019+0000","last_clean":"2023-05-17T12:25:06.995019+0000","last_became_active":"2023-05-17T12:25:01.807486+0000","last_became_peered":"2023-05-17T12:25:01.807486+0000","last_unstale":"2023-05-17T12:25:06.995019+0000","last_undegraded":"2023-05-17T12:25:06.995019+0000","last_fullsized":"2023-05-17T12:25:06.995019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:34:11.854588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298559+0000","last_change":"2023-05-17T12:25:05.828527+0000","last_active":"2023-05-17T12:25:06.298559+0000","last_peered":"2023-05-17T12:25:06.298559+0000","last_clean":"2023-05-17T12:25:06.298559+0000","last_became_active":"2023-05-17T12:25:05.828110+0000","last_became_peered":"2023-05-17T12:25:05.828110+0000","last_unstale":"2023-05-17T12:25:06.298559+0000","last_undegraded":"2023-05-17T12:25:06.298559+0000","last_fullsized":"2023-05-17T12:25:06.298559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:58.136837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299503+0000","last_change":"2023-05-17T12:25:01.309151+0000","last_active":"2023-05-17T12:25:06.299503+0000","last_peered":"2023-05-17T12:25:06.299503+0000","last_clean":"2023-05-17T12:25:06.299503+0000","last_became_active":"2023-05-17T12:25:01.308858+0000","last_became_peered":"2023-05-17T12:25:01.308858+0000","last_unstale":"2023-05-17T12:25:06.299503+0000","last_undegraded":"2023-05-17T12:25:06.299503+0000","last_fullsized":"2023-05-17T12:25:06.299503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:31.192844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996383+0000","last_change":"2023-05-17T12:25:01.803419+0000","last_active":"2023-05-17T12:25:06.996383+0000","last_peered":"2023-05-17T12:25:06.996383+0000","last_clean":"2023-05-17T12:25:06.996383+0000","last_became_active":"2023-05-17T12:25:01.802965+0000","last_became_peered":"2023-05-17T12:25:01.802965+0000","last_unstale":"2023-05-17T12:25:06.996383+0000","last_undegraded":"2023-05-17T12:25:06.996383+0000","last_fullsized":"2023-05-17T12:25:06.996383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:18:56.538552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994811+0000","last_change":"2023-05-17T12:25:05.825330+0000","last_active":"2023-05-17T12:25:06.994811+0000","last_peered":"2023-05-17T12:25:06.994811+0000","last_clean":"2023-05-17T12:25:06.994811+0000","last_became_active":"2023-05-17T12:25:05.824868+0000","last_became_peered":"2023-05-17T12:25:05.824868+0000","last_unstale":"2023-05-17T12:25:06.994811+0000","last_undegraded":"2023-05-17T12:25:06.994811+0000","last_fullsized":"2023-05-17T12:25:06.994811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:53:03.043259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994461+0000","last_change":"2023-05-17T12:25:01.304287+0000","last_active":"2023-05-17T12:25:06.994461+0000","last_peered":"2023-05-17T12:25:06.994461+0000","last_clean":"2023-05-17T12:25:06.994461+0000","last_became_active":"2023-05-17T12:25:01.304009+0000","last_became_peered":"2023-05-17T12:25:01.304009+0000","last_unstale":"2023-05-17T12:25:06.994461+0000","last_undegraded":"2023-05-17T12:25:06.994461+0000","last_fullsized":"2023-05-17T12:25:06.994461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994672+0000","last_change":"2023-05-17T12:25:01.795767+0000","last_active":"2023-05-17T12:25:06.994672+0000","last_peered":"2023-05-17T12:25:06.994672+0000","last_clean":"2023-05-17T12:25:06.994672+0000","last_became_active":"2023-05-17T12:25:01.795283+0000","last_became_peered":"2023-05-17T12:25:01.795283+0000","last_unstale":"2023-05-17T12:25:06.994672+0000","last_undegraded":"2023-05-17T12:25:06.994672+0000","last_fullsized":"2023-05-17T12:25:06.994672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:12.607072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494307+0000","last_change":"2023-05-17T12:25:05.835654+0000","last_active":"2023-05-17T12:25:06.494307+0000","last_peered":"2023-05-17T12:25:06.494307+0000","last_clean":"2023-05-17T12:25:06.494307+0000","last_became_active":"2023-05-17T12:25:05.835230+0000","last_became_peered":"2023-05-17T12:25:05.835230+0000","last_unstale":"2023-05-17T12:25:06.494307+0000","last_undegraded":"2023-05-17T12:25:06.494307+0000","last_fullsized":"2023-05-17T12:25:06.494307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:43:00.150100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325785+0000","last_change":"2023-05-17T12:25:01.302349+0000","last_active":"2023-05-17T12:25:06.325785+0000","last_peered":"2023-05-17T12:25:06.325785+0000","last_clean":"2023-05-17T12:25:06.325785+0000","last_became_active":"2023-05-17T12:25:01.302092+0000","last_became_peered":"2023-05-17T12:25:01.302092+0000","last_unstale":"2023-05-17T12:25:06.325785+0000","last_undegraded":"2023-05-17T12:25:06.325785+0000","last_fullsized":"2023-05-17T12:25:06.325785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994890+0000","last_change":"2023-05-17T12:25:01.815996+0000","last_active":"2023-05-17T12:25:06.994890+0000","last_peered":"2023-05-17T12:25:06.994890+0000","last_clean":"2023-05-17T12:25:06.994890+0000","last_became_active":"2023-05-17T12:25:01.812605+0000","last_became_peered":"2023-05-17T12:25:01.812605+0000","last_unstale":"2023-05-17T12:25:06.994890+0000","last_undegraded":"2023-05-17T12:25:06.994890+0000","last_fullsized":"2023-05-17T12:25:06.994890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:01:41.127461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298262+0000","last_change":"2023-05-17T12:25:01.805399+0000","last_active":"2023-05-17T12:25:06.298262+0000","last_peered":"2023-05-17T12:25:06.298262+0000","last_clean":"2023-05-17T12:25:06.298262+0000","last_became_active":"2023-05-17T12:25:01.805099+0000","last_became_peered":"2023-05-17T12:25:01.805099+0000","last_unstale":"2023-05-17T12:25:06.298262+0000","last_undegraded":"2023-05-17T12:25:06.298262+0000","last_fullsized":"2023-05-17T12:25:06.298262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:36:36.387439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994465+0000","last_change":"2023-05-17T12:25:01.802926+0000","last_active":"2023-05-17T12:25:06.994465+0000","last_peered":"2023-05-17T12:25:06.994465+0000","last_clean":"2023-05-17T12:25:06.994465+0000","last_became_active":"2023-05-17T12:25:01.802651+0000","last_became_peered":"2023-05-17T12:25:01.802651+0000","last_unstale":"2023-05-17T12:25:06.994465+0000","last_undegraded":"2023-05-17T12:25:06.994465+0000","last_fullsized":"2023-05-17T12:25:06.994465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:16.838754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995441+0000","last_change":"2023-05-17T12:25:01.812203+0000","last_active":"2023-05-17T12:25:06.995441+0000","last_peered":"2023-05-17T12:25:06.995441+0000","last_clean":"2023-05-17T12:25:06.995441+0000","last_became_active":"2023-05-17T12:25:01.811900+0000","last_became_peered":"2023-05-17T12:25:01.811900+0000","last_unstale":"2023-05-17T12:25:06.995441+0000","last_undegraded":"2023-05-17T12:25:06.995441+0000","last_fullsized":"2023-05-17T12:25:06.995441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:36:46.242202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994166+0000","last_change":"2023-05-17T12:25:01.814710+0000","last_active":"2023-05-17T12:25:06.994166+0000","last_peered":"2023-05-17T12:25:06.994166+0000","last_clean":"2023-05-17T12:25:06.994166+0000","last_became_active":"2023-05-17T12:25:01.814215+0000","last_became_peered":"2023-05-17T12:25:01.814215+0000","last_unstale":"2023-05-17T12:25:06.994166+0000","last_undegraded":"2023-05-17T12:25:06.994166+0000","last_fullsized":"2023-05-17T12:25:06.994166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494339+0000","last_change":"2023-05-17T12:25:01.802046+0000","last_active":"2023-05-17T12:25:06.494339+0000","last_peered":"2023-05-17T12:25:06.494339+0000","last_clean":"2023-05-17T12:25:06.494339+0000","last_became_active":"2023-05-17T12:25:01.801281+0000","last_became_peered":"2023-05-17T12:25:01.801281+0000","last_unstale":"2023-05-17T12:25:06.494339+0000","last_undegraded":"2023-05-17T12:25:06.494339+0000","last_fullsized":"2023-05-17T12:25:06.494339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:28:58.337893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8228,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363612,"statfs":{"total":96636764160,"available":96628338688,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T12:25:32.130 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T12:25:32.131 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-17T12:25:32.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-17T12:25:32.131 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-17T12:25:32.132 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-17T12:25:32.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.345+0000 7fc1441ff700 1 Processor -- start 2023-05-17T12:25:32.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.346+0000 7fc1441ff700 1 -- start start 2023-05-17T12:25:32.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.347+0000 7fc1441ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c0ce2a0 0x7fc13c164480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.347+0000 7fc1441ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13c1599b0 con 0x7fc13c1595e0 2023-05-17T12:25:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.347+0000 7fc1441ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13c15e000 con 0x7fc13c071540 2023-05-17T12:25:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.347+0000 7fc1441ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c0cca80 con 0x7fc13c0ce2a0 2023-05-17T12:25:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.347+0000 7fc141f9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc13c1595e0 0x7fc13c070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51902/0 (socket says 172.21.15.88:51902) 2023-05-17T12:25:32.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.347+0000 7fc141f9b700 1 -- 172.21.15.88:0/222789553 learned_addr learned my addr 172.21.15.88:0/222789553 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:32.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.347+0000 7fc14279c700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c0ce2a0 0x7fc13c164480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.347+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153485000 0 0) 0x7fc13c1599b0 con 0x7fc13c1595e0 2023-05-17T12:25:32.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.347+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1280035b0 con 0x7fc13c1595e0 2023-05-17T12:25:32.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327997687 0 0) 0x7fc13c15e000 con 0x7fc13c071540 2023-05-17T12:25:32.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc13c1599b0 con 0x7fc13c071540 2023-05-17T12:25:32.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 593756945 0 0) 0x7fc1280035b0 con 0x7fc13c1595e0 2023-05-17T12:25:32.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c0ce2a0 msgr2=0x7fc13c164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:32.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c0ce2a0 0x7fc13c164480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 >> v1:172.21.15.187:6789/0 conn(0x7fc13c071540 legacy=0x7fc13c0cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c0ccd60 con 0x7fc13c1595e0 2023-05-17T12:25:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7fc138001670 con 0x7fc13c1595e0 2023-05-17T12:25:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 >> v1:172.21.15.88:6789/0 conn(0x7fc13c1595e0 legacy=0x7fc13c070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c0ce2a0 0x7fc128003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc128004170 0x7fc128004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004d90 0x7fc128005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c0cca80 con 0x7fc128004170 2023-05-17T12:25:32.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12800bb20 con 0x7fc128004d90 2023-05-17T12:25:32.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12800bce0 con 0x7fc13c0ce2a0 2023-05-17T12:25:32.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc14179a700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc128004170 0x7fc128004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc141f9b700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c0ce2a0 0x7fc128003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.348+0000 7fc14279c700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004d90 0x7fc128005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc14179a700 1 -- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c0ce2a0 msgr2=0x7fc128003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:32.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc14179a700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c0ce2a0 0x7fc128003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc14179a700 1 -- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004d90 msgr2=0x7fc128005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc14179a700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004d90 0x7fc128005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc14179a700 1 -- 172.21.15.88:0/222789553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280035b0 con 0x7fc128004170 2023-05-17T12:25:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc14279c700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004d90 0x7fc128005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc14179a700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc128004170 0x7fc128004850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc12c001a00 tx=0x7fc128005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fb69398f852a31 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0014f0 con 0x7fc128004170 2023-05-17T12:25:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c0052d0 con 0x7fc128004170 2023-05-17T12:25:32.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.349+0000 7fc140f99700 1 -- 172.21.15.88:0/222789553 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00e860 con 0x7fc128004170 2023-05-17T12:25:32.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.350+0000 7fc1441ff700 1 -- 172.21.15.88:0/222789553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc128004170 msgr2=0x7fc128004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.350+0000 7fc1441ff700 1 --2- 172.21.15.88:0/222789553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc128004170 0x7fc128004850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc12c001a00 tx=0x7fc128005880 comp rx=0 tx=0).stop 2023-05-17T12:25:32.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.350+0000 7fc14279c700 1 -- 172.21.15.88:0/222789553 reap_dead start 2023-05-17T12:25:32.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.350+0000 7fc1441ff700 1 -- 172.21.15.88:0/222789553 shutdown_connections 2023-05-17T12:25:32.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.350+0000 7fc1441ff700 1 -- 172.21.15.88:0/222789553 >> 172.21.15.88:0/222789553 conn(0x7fc13c0ced10 msgr2=0x7fc13c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:32.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.350+0000 7fc1441ff700 1 -- 172.21.15.88:0/222789553 shutdown_connections 2023-05-17T12:25:32.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.350+0000 7fc1441ff700 1 -- 172.21.15.88:0/222789553 wait complete. 2023-05-17T12:25:32.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.352+0000 7fc1441ff700 1 Processor -- start 2023-05-17T12:25:32.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.352+0000 7fc1441ff700 1 -- start start 2023-05-17T12:25:32.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.353+0000 7fc1441ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004170 0x7fc13c14a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.353+0000 7fc1441ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c15bea0 0x7fc13c15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.353+0000 7fc1441ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c155330 0x7fc13c1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc1441ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c15a6c0 con 0x7fc13c155330 2023-05-17T12:25:32.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc1441ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c155ce0 con 0x7fc128004170 2023-05-17T12:25:32.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc1441ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c14fd90 con 0x7fc13c15bea0 2023-05-17T12:25:32.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14279c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c155330 0x7fc13c1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14279c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c155330 0x7fc13c1557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37206/0 (socket says 172.21.15.88:37206) 2023-05-17T12:25:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14279c700 1 -- 172.21.15.88:0/3001705242 learned_addr learned my addr 172.21.15.88:0/3001705242 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc141f9b700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004170 0x7fc13c14a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14179a700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c15bea0 0x7fc13c15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14279c700 1 -- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c15bea0 msgr2=0x7fc13c15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14279c700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c15bea0 0x7fc13c15c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14279c700 1 -- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004170 msgr2=0x7fc13c14a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14279c700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004170 0x7fc13c14a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14279c700 1 -- 172.21.15.88:0/3001705242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c0cd320 con 0x7fc13c155330 2023-05-17T12:25:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc141f9b700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004170 0x7fc13c14a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.354+0000 7fc14279c700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c155330 0x7fc13c1557a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0cfc70 tx=0x7fc1340104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.355+0000 7fc1327fc700 1 -- 172.21.15.88:0/3001705242 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13401b070 con 0x7fc13c155330 2023-05-17T12:25:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.355+0000 7fc1327fc700 1 -- 172.21.15.88:0/3001705242 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13400f040 con 0x7fc13c155330 2023-05-17T12:25:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.355+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c0cd040 con 0x7fc13c155330 2023-05-17T12:25:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.355+0000 7fc1327fc700 1 -- 172.21.15.88:0/3001705242 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13400e050 con 0x7fc13c155330 2023-05-17T12:25:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.355+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13c0cd840 con 0x7fc13c155330 2023-05-17T12:25:32.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.356+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13c074530 con 0x7fc13c155330 2023-05-17T12:25:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.357+0000 7fc1327fc700 1 -- 172.21.15.88:0/3001705242 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc134003a20 con 0x7fc13c155330 2023-05-17T12:25:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.358+0000 7fc1327fc700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc12006ace0 0x7fc12006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.358+0000 7fc1327fc700 1 -- 172.21.15.88:0/3001705242 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc134089ac0 con 0x7fc13c155330 2023-05-17T12:25:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.358+0000 7fc141f9b700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc12006ace0 0x7fc12006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.359+0000 7fc141f9b700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc12006ace0 0x7fc12006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc138000ff0 tx=0x7fc138009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.362+0000 7fc1327fc700 1 -- 172.21.15.88:0/3001705242 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc134054870 con 0x7fc13c155330 2023-05-17T12:25:32.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.615+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc13c15cc10 con 0x7fc13c155330 2023-05-17T12:25:32.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.618+0000 7fc1327fc700 1 -- 172.21.15.88:0/3001705242 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170847 (secure 0 0 0) 0x7fc134057e90 con 0x7fc13c155330 2023-05-17T12:25:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc12006ace0 msgr2=0x7fc12006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc12006ace0 0x7fc12006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc138000ff0 tx=0x7fc138009040 comp rx=0 tx=0).stop 2023-05-17T12:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c155330 msgr2=0x7fc13c1557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c155330 0x7fc13c1557a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0cfc70 tx=0x7fc1340104a0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 shutdown_connections 2023-05-17T12:25:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc12006ace0 0x7fc12006d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c155330 0x7fc13c1557a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc128004170 0x7fc13c14a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 --2- 172.21.15.88:0/3001705242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc13c15bea0 0x7fc13c15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.621+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 >> 172.21.15.88:0/3001705242 conn(0x7fc13c0ced10 msgr2=0x7fc13c158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.622+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 shutdown_connections 2023-05-17T12:25:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.622+0000 7fc1441ff700 1 -- 172.21.15.88:0/3001705242 wait complete. 2023-05-17T12:25:32.641 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2490620069},{"type":"v1","addr":"172.21.15.187:6833","nonce":2490620069}]},"active_addr":"172.21.15.187:6833/2490620069","active_change":"2023-05-17T12:24:41.431677+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":137572158}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":2166765368}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":610503186}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":3620346796}]}]} 2023-05-17T12:25:32.646 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-17T12:25:32.647 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-17T12:25:32.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:32.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.828+0000 7f62d59ff700 1 Processor -- start 2023-05-17T12:25:32.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.829+0000 7f62d59ff700 1 -- start start 2023-05-17T12:25:32.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62d59ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d015c840 0x7f62d006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62d59ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62d006b0b0 0x7f62d00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62d59ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d00cd6b0 con 0x7f62d006c330 2023-05-17T12:25:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62d59ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d00cdf50 con 0x7f62d006b0b0 2023-05-17T12:25:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62d59ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d00cf860 con 0x7f62d015c840 2023-05-17T12:25:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62c7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62d006b0b0 0x7f62d00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62cf7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f62d006c330 0x7f62d0160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51906/0 (socket says 172.21.15.88:51906) 2023-05-17T12:25:32.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62cf7fe700 1 -- 172.21.15.88:0/597302598 learned_addr learned my addr 172.21.15.88:0/597302598 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62ceffd700 1 --2- 172.21.15.88:0/597302598 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d015c840 0x7f62d006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62c7fff700 1 -- 172.21.15.88:0/597302598 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d015c840 msgr2=0x7f62d006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62c7fff700 1 --2- 172.21.15.88:0/597302598 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d015c840 0x7f62d006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62c7fff700 1 -- 172.21.15.88:0/597302598 >> v1:172.21.15.88:6789/0 conn(0x7f62d006c330 legacy=0x7f62d0160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62c7fff700 1 -- 172.21.15.88:0/597302598 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d00b2460 con 0x7f62d006b0b0 2023-05-17T12:25:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.830+0000 7f62ce7fc700 1 -- 172.21.15.88:0/597302598 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263706430 0 0) 0x7f62d00cd6b0 con 0x7f62d006c330 2023-05-17T12:25:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62c7fff700 1 --2- 172.21.15.88:0/597302598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d006b0b0 0x7f62d00cf320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009840 tx=0x7f62b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7a24a5f0124a25 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62ce7fc700 1 -- 172.21.15.88:0/597302598 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8011830 con 0x7f62d006b0b0 2023-05-17T12:25:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62ce7fc700 1 -- 172.21.15.88:0/597302598 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8011990 con 0x7f62d006b0b0 2023-05-17T12:25:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62ce7fc700 1 -- 172.21.15.88:0/597302598 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8011d20 con 0x7f62d006b0b0 2023-05-17T12:25:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62d59ff700 1 -- 172.21.15.88:0/597302598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d006b0b0 msgr2=0x7f62d00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62d59ff700 1 --2- 172.21.15.88:0/597302598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d006b0b0 0x7f62d00cf320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009840 tx=0x7f62b8009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62d59ff700 1 -- 172.21.15.88:0/597302598 shutdown_connections 2023-05-17T12:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62d59ff700 1 --2- 172.21.15.88:0/597302598 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d015c840 0x7f62d006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62d59ff700 1 --2- 172.21.15.88:0/597302598 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d006b0b0 0x7f62d00cf320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62d59ff700 1 -- 172.21.15.88:0/597302598 >> 172.21.15.88:0/597302598 conn(0x7f62d00d3060 msgr2=0x7f62d00d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.831+0000 7f62d59ff700 1 -- 172.21.15.88:0/597302598 shutdown_connections 2023-05-17T12:25:32.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.832+0000 7f62d59ff700 1 -- 172.21.15.88:0/597302598 wait complete. 2023-05-17T12:25:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.833+0000 7f62d59ff700 1 Processor -- start 2023-05-17T12:25:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.833+0000 7f62d59ff700 1 -- start start 2023-05-17T12:25:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.834+0000 7f62d59ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d006b0b0 0x7f62d00c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.834+0000 7f62d59ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d006c330 0x7f62d015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.834+0000 7f62d59ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d015c840 0x7f62d0157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.834+0000 7f62d59ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d015df30 con 0x7f62d015c840 2023-05-17T12:25:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.834+0000 7f62d59ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0157b80 con 0x7f62d006c330 2023-05-17T12:25:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.834+0000 7f62d59ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d015d320 con 0x7f62d006b0b0 2023-05-17T12:25:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.834+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d015c840 0x7f62d0157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.834+0000 7f62ceffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d006b0b0 0x7f62d00c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.834+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d015c840 0x7f62d0157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37232/0 (socket says 172.21.15.88:37232) 2023-05-17T12:25:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62cf7fe700 1 -- 172.21.15.88:0/2645042300 learned_addr learned my addr 172.21.15.88:0/2645042300 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62c7fff700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d006c330 0x7f62d015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62cf7fe700 1 -- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d006b0b0 msgr2=0x7f62d00c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62cf7fe700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d006b0b0 0x7f62d00c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62cf7fe700 1 -- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d006c330 msgr2=0x7f62d015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62cf7fe700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d006c330 0x7f62d015cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62cf7fe700 1 -- 172.21.15.88:0/2645042300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80094a0 con 0x7f62d015c840 2023-05-17T12:25:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62ceffd700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d006b0b0 0x7f62d00c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62cf7fe700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d015c840 0x7f62d0157640 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62c8002230 tx=0x7f62c800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62ccff9700 1 -- 172.21.15.88:0/2645042300 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c800aac0 con 0x7f62d015c840 2023-05-17T12:25:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62ccff9700 1 -- 172.21.15.88:0/2645042300 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c800ac40 con 0x7f62d015c840 2023-05-17T12:25:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d00cd900 con 0x7f62d015c840 2023-05-17T12:25:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.835+0000 7f62ccff9700 1 -- 172.21.15.88:0/2645042300 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c80070d0 con 0x7f62d015c840 2023-05-17T12:25:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.836+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d00b2740 con 0x7f62d015c840 2023-05-17T12:25:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.837+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d00cdbe0 con 0x7f62d015c840 2023-05-17T12:25:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.838+0000 7f62ccff9700 1 -- 172.21.15.88:0/2645042300 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62c8007250 con 0x7f62d015c840 2023-05-17T12:25:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.839+0000 7f62ccff9700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f62b006ace0 0x7f62b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.839+0000 7f62ccff9700 1 -- 172.21.15.88:0/2645042300 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f62c80895c0 con 0x7f62d015c840 2023-05-17T12:25:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.839+0000 7f62ceffd700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f62b006ace0 0x7f62b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.840+0000 7f62ceffd700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f62b006ace0 0x7f62b006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62c0006b20 tx=0x7f62c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:32.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:32.843+0000 7f62ccff9700 1 -- 172.21.15.88:0/2645042300 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f62c8054370 con 0x7f62d015c840 2023-05-17T12:25:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.036+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62d0074530 con 0x7f62d015c840 2023-05-17T12:25:33.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.038+0000 7f62ccff9700 1 -- 172.21.15.88:0/2645042300 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f62c8057990 con 0x7f62d015c840 2023-05-17T12:25:33.041 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:33.041 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:33.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f62b006ace0 msgr2=0x7f62b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f62b006ace0 0x7f62b006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62c0006b20 tx=0x7f62c0008040 comp rx=0 tx=0).stop 2023-05-17T12:25:33.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d015c840 msgr2=0x7f62d0157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d015c840 0x7f62d0157640 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62c8002230 tx=0x7f62c800cf50 comp rx=0 tx=0).stop 2023-05-17T12:25:33.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 shutdown_connections 2023-05-17T12:25:33.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f62b006ace0 0x7f62b006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d015c840 0x7f62d0157640 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62d006b0b0 0x7f62d00c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 --2- 172.21.15.88:0/2645042300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62d006c330 0x7f62d015cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 >> 172.21.15.88:0/2645042300 conn(0x7f62d00d3060 msgr2=0x7f62d00b6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 shutdown_connections 2023-05-17T12:25:33.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.040+0000 7f62d59ff700 1 -- 172.21.15.88:0/2645042300 wait complete. 2023-05-17T12:25:33.060 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-17T12:25:33.061 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.243+0000 7fd3751ff700 1 Processor -- start 2023-05-17T12:25:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.243+0000 7fd3751ff700 1 -- start start 2023-05-17T12:25:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd3751ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37015c840 0x7fd37006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd3751ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd37006b0b0 0x7fd3700cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd3751ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd37006c330 0x7fd37006c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd3751ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700cdf50 con 0x7fd37006b0b0 2023-05-17T12:25:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd3751ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37006ccf0 con 0x7fd37006c330 2023-05-17T12:25:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd3751ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700cd6b0 con 0x7fd37015c840 2023-05-17T12:25:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd367fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd37006b0b0 0x7fd3700cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd367fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd37006b0b0 0x7fd3700cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37248/0 (socket says 172.21.15.88:37248) 2023-05-17T12:25:33.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd367fff700 1 -- 172.21.15.88:0/2956924532 learned_addr learned my addr 172.21.15.88:0/2956924532 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd36ed9d700 1 --2- 172.21.15.88:0/2956924532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37015c840 0x7fd37006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd36f59e700 1 --2- 172.21.15.88:0/2956924532 >> v2:172.21.15.187:3300/0 conn(0x7fd37006c330 0x7fd37006c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd367fff700 1 -- 172.21.15.88:0/2956924532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37015c840 msgr2=0x7fd37006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd367fff700 1 --2- 172.21.15.88:0/2956924532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37015c840 0x7fd37006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd367fff700 1 -- 172.21.15.88:0/2956924532 >> v2:172.21.15.187:3300/0 conn(0x7fd37006c330 msgr2=0x7fd37006c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd367fff700 1 --2- 172.21.15.88:0/2956924532 >> v2:172.21.15.187:3300/0 conn(0x7fd37006c330 0x7fd37006c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.245+0000 7fd367fff700 1 -- 172.21.15.88:0/2956924532 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700cf860 con 0x7fd37006b0b0 2023-05-17T12:25:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd367fff700 1 --2- 172.21.15.88:0/2956924532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006b0b0 0x7fd3700cf320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3701603e0 tx=0x7fd358009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9783ee514f18ff05 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd36e59c700 1 -- 172.21.15.88:0/2956924532 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800b870 con 0x7fd37006b0b0 2023-05-17T12:25:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd36e59c700 1 -- 172.21.15.88:0/2956924532 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35800b9d0 con 0x7fd37006b0b0 2023-05-17T12:25:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd36e59c700 1 -- 172.21.15.88:0/2956924532 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800bd60 con 0x7fd37006b0b0 2023-05-17T12:25:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd3751ff700 1 -- 172.21.15.88:0/2956924532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006b0b0 msgr2=0x7fd3700cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd3751ff700 1 --2- 172.21.15.88:0/2956924532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006b0b0 0x7fd3700cf320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3701603e0 tx=0x7fd358009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd3751ff700 1 -- 172.21.15.88:0/2956924532 shutdown_connections 2023-05-17T12:25:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd3751ff700 1 --2- 172.21.15.88:0/2956924532 >> v2:172.21.15.187:3300/0 conn(0x7fd37006c330 0x7fd37006c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd3751ff700 1 --2- 172.21.15.88:0/2956924532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37015c840 0x7fd37006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd3751ff700 1 --2- 172.21.15.88:0/2956924532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006b0b0 0x7fd3700cf320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.246+0000 7fd3751ff700 1 -- 172.21.15.88:0/2956924532 >> 172.21.15.88:0/2956924532 conn(0x7fd3700d3060 msgr2=0x7fd3700d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.247+0000 7fd3751ff700 1 -- 172.21.15.88:0/2956924532 shutdown_connections 2023-05-17T12:25:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.247+0000 7fd3751ff700 1 -- 172.21.15.88:0/2956924532 wait complete. 2023-05-17T12:25:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.248+0000 7fd3751ff700 1 Processor -- start 2023-05-17T12:25:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.248+0000 7fd3751ff700 1 -- start start 2023-05-17T12:25:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.249+0000 7fd3751ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37006b0b0 0x7fd3700a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.249+0000 7fd3751ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006c330 0x7fd3701f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.249+0000 7fd3751ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37015c840 0x7fd37015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.249+0000 7fd3751ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700aa090 con 0x7fd37006c330 2023-05-17T12:25:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.249+0000 7fd3751ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37015ef10 con 0x7fd37015c840 2023-05-17T12:25:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.249+0000 7fd3751ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37015aed0 con 0x7fd37006b0b0 2023-05-17T12:25:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.249+0000 7fd367fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006c330 0x7fd3701f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.249+0000 7fd367fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006c330 0x7fd3701f2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37260/0 (socket says 172.21.15.88:37260) 2023-05-17T12:25:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.249+0000 7fd367fff700 1 -- 172.21.15.88:0/1376524083 learned_addr learned my addr 172.21.15.88:0/1376524083 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd36f59e700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37015c840 0x7fd37015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd36ed9d700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37006b0b0 0x7fd3700a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd367fff700 1 -- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37006b0b0 msgr2=0x7fd3700a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd367fff700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37006b0b0 0x7fd3700a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd367fff700 1 -- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37015c840 msgr2=0x7fd37015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd367fff700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37015c840 0x7fd37015a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd367fff700 1 -- 172.21.15.88:0/1376524083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358009550 con 0x7fd37006c330 2023-05-17T12:25:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd367fff700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006c330 0x7fd3701f2820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd3700d3d00 tx=0x7fd358004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd3677fe700 1 -- 172.21.15.88:0/1376524083 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358004480 con 0x7fd37006c330 2023-05-17T12:25:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd3677fe700 1 -- 172.21.15.88:0/1376524083 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3580045e0 con 0x7fd37006c330 2023-05-17T12:25:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd3677fe700 1 -- 172.21.15.88:0/1376524083 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580038e0 con 0x7fd37006c330 2023-05-17T12:25:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.250+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3700b2740 con 0x7fd37006c330 2023-05-17T12:25:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.251+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3700b2460 con 0x7fd37006c330 2023-05-17T12:25:33.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.251+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3700cd900 con 0x7fd37006c330 2023-05-17T12:25:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.252+0000 7fd3677fe700 1 -- 172.21.15.88:0/1376524083 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd358021070 con 0x7fd37006c330 2023-05-17T12:25:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.253+0000 7fd3677fe700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd35006ace0 0x7fd35006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.253+0000 7fd3677fe700 1 -- 172.21.15.88:0/1376524083 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd35808ad30 con 0x7fd37006c330 2023-05-17T12:25:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.253+0000 7fd36ed9d700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd35006ace0 0x7fd35006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.254+0000 7fd36ed9d700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd35006ace0 0x7fd35006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd37006aec0 tx=0x7fd360008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.257+0000 7fd3677fe700 1 -- 172.21.15.88:0/1376524083 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd358055cb0 con 0x7fd37006c330 2023-05-17T12:25:33.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.456+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd370074530 con 0x7fd37006c330 2023-05-17T12:25:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.458+0000 7fd3677fe700 1 -- 172.21.15.88:0/1376524083 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fd358061e60 con 0x7fd37006c330 2023-05-17T12:25:33.461 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:33.461 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:33.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd35006ace0 msgr2=0x7fd35006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd35006ace0 0x7fd35006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd37006aec0 tx=0x7fd360008040 comp rx=0 tx=0).stop 2023-05-17T12:25:33.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006c330 msgr2=0x7fd3701f2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006c330 0x7fd3701f2820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd3700d3d00 tx=0x7fd358004750 comp rx=0 tx=0).stop 2023-05-17T12:25:33.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 shutdown_connections 2023-05-17T12:25:33.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd35006ace0 0x7fd35006d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37015c840 0x7fd37015a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37006b0b0 0x7fd3700a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 --2- 172.21.15.88:0/1376524083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd37006c330 0x7fd3701f2820 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 >> 172.21.15.88:0/1376524083 conn(0x7fd3700d3060 msgr2=0x7fd3700b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 shutdown_connections 2023-05-17T12:25:33.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.460+0000 7fd3751ff700 1 -- 172.21.15.88:0/1376524083 wait complete. 2023-05-17T12:25:33.480 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-17T12:25:33.481 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-17T12:25:33.481 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-17T12:25:33.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-17T12:25:33.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-17T12:25:33.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-17T12:25:33.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-17T12:25:33.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-17T12:25:33.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.815+0000 7f50635ff700 1 Processor -- start 2023-05-17T12:25:33.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.816+0000 7f50635ff700 1 -- start start 2023-05-17T12:25:33.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.817+0000 7f50635ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f505c0d1bb0 0x7f505c0d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.817+0000 7f50635ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505c1574f0 con 0x7f505c15d990 2023-05-17T12:25:33.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.818+0000 7f50635ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505c0cd9e0 con 0x7f505c0cf650 2023-05-17T12:25:33.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.818+0000 7f50635ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c0cd800 con 0x7f505c0d1bb0 2023-05-17T12:25:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.818+0000 7f5061b9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f505c15d990 0x7f505c06c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51908/0 (socket says 172.21.15.88:51908) 2023-05-17T12:25:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.818+0000 7f5061b9c700 1 -- 172.21.15.88:0/820839885 learned_addr learned my addr 172.21.15.88:0/820839885 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.818+0000 7f506139b700 1 --2- 172.21.15.88:0/820839885 >> v2:172.21.15.88:3300/0 conn(0x7f505c0d1bb0 0x7f505c0d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.819+0000 7f506139b700 1 -- 172.21.15.88:0/820839885 >> v1:172.21.15.187:6789/0 conn(0x7f505c0cf650 legacy=0x7f505c160ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:33.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.819+0000 7f506139b700 1 -- 172.21.15.88:0/820839885 >> v1:172.21.15.88:6789/0 conn(0x7f505c15d990 legacy=0x7f505c06c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.819+0000 7f506139b700 1 -- 172.21.15.88:0/820839885 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c0cdcc0 con 0x7f505c0d1bb0 2023-05-17T12:25:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.819+0000 7f5053fff700 1 -- 172.21.15.88:0/820839885 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920010562 0 0) 0x7f505c1574f0 con 0x7f505c15d990 2023-05-17T12:25:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.820+0000 7f506139b700 1 --2- 172.21.15.88:0/820839885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f505c0d1bb0 0x7f505c0d1f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f504c009840 tx=0x7f504c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c34626e15a5067 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.820+0000 7f5053fff700 1 -- 172.21.15.88:0/820839885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c004230 con 0x7f505c0d1bb0 2023-05-17T12:25:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.820+0000 7f5053fff700 1 -- 172.21.15.88:0/820839885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c004390 con 0x7f505c0d1bb0 2023-05-17T12:25:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.820+0000 7f5053fff700 1 -- 172.21.15.88:0/820839885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0036a0 con 0x7f505c0d1bb0 2023-05-17T12:25:33.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.821+0000 7ff6c7bff700 1 Processor -- start 2023-05-17T12:25:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.821+0000 7f50635ff700 1 -- 172.21.15.88:0/820839885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f505c0d1bb0 msgr2=0x7f505c0d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.821+0000 7f50635ff700 1 --2- 172.21.15.88:0/820839885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f505c0d1bb0 0x7f505c0d1f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f504c009840 tx=0x7f504c009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.822+0000 7f50635ff700 1 -- 172.21.15.88:0/820839885 shutdown_connections 2023-05-17T12:25:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.822+0000 7f50635ff700 1 --2- 172.21.15.88:0/820839885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f505c0d1bb0 0x7f505c0d1f80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.822+0000 7f50635ff700 1 -- 172.21.15.88:0/820839885 >> 172.21.15.88:0/820839885 conn(0x7f505c0d3ed0 msgr2=0x7f505c0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.822+0000 7f50635ff700 1 -- 172.21.15.88:0/820839885 shutdown_connections 2023-05-17T12:25:33.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.823+0000 7f5edb7ff700 1 Processor -- start 2023-05-17T12:25:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.823+0000 7f50635ff700 1 -- 172.21.15.88:0/820839885 wait complete. 2023-05-17T12:25:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.823+0000 7f5edb7ff700 1 -- start start 2023-05-17T12:25:33.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.821+0000 7ff6c7bff700 1 -- start start 2023-05-17T12:25:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.823+0000 7ff6c7bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff6c0070f70 0x7ff6c00cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.823+0000 7ff6c7bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c00c1c70 0x7ff6c0071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.823+0000 7ff6c7bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c006d080 con 0x7ff6c006dad0 2023-05-17T12:25:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.823+0000 7ff6c7bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c00cb3a0 con 0x7ff6c0070f70 2023-05-17T12:25:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.823+0000 7ff6c7bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c006d640 con 0x7ff6c00c1c70 2023-05-17T12:25:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.824+0000 7ff6c599b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff6c0070f70 0x7ff6c00cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.824+0000 7ff6c599b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff6c0070f70 0x7ff6c00cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:48714/0 (socket says 172.21.15.88:48714) 2023-05-17T12:25:33.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.824+0000 7ff6c599b700 1 -- 172.21.15.88:0/4245870206 learned_addr learned my addr 172.21.15.88:0/4245870206 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.824+0000 7ff6c519a700 1 --2- 172.21.15.88:0/4245870206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c00c1c70 0x7ff6c0071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.821+0000 7f7e49dff700 1 Processor -- start 2023-05-17T12:25:33.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.822+0000 7f7e49dff700 1 -- start start 2023-05-17T12:25:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7ff6c4999700 1 -- 172.21.15.88:0/4245870206 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664419741 0 0) 0x7ff6c006d080 con 0x7ff6c006dad0 2023-05-17T12:25:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7ff6c4999700 1 -- 172.21.15.88:0/4245870206 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ac0035b0 con 0x7ff6c006dad0 2023-05-17T12:25:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7ff6c519a700 1 -- 172.21.15.88:0/4245870206 >> v2:172.21.15.187:3300/0 conn(0x7ff6c0070f70 msgr2=0x7ff6c00cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7ff6c519a700 1 --2- 172.21.15.88:0/4245870206 >> v2:172.21.15.187:3300/0 conn(0x7ff6c0070f70 0x7ff6c00cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7ff6c519a700 1 -- 172.21.15.88:0/4245870206 >> v1:172.21.15.88:6789/0 conn(0x7ff6c006dad0 legacy=0x7ff6c00c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7ff6c519a700 1 -- 172.21.15.88:0/4245870206 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0071880 con 0x7ff6c00c1c70 2023-05-17T12:25:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7ff6c519a700 1 --2- 172.21.15.88:0/4245870206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c00c1c70 0x7ff6c0071340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009d90 tx=0x7ff6b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58028edb3fd8fed3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7f5edb7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ed40716f0 0x7f5ed406a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7f5edb7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed40ccc50 con 0x7f5ed406d080 2023-05-17T12:25:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7f5edb7ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed4071d10 con 0x7f5ed40cd980 2023-05-17T12:25:33.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7f5edb7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40cd560 con 0x7f5ed40716f0 2023-05-17T12:25:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f5ed8d9a700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f5ed40cd980 0x7f5ed4070fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40824/0 (socket says 172.21.15.88:40824) 2023-05-17T12:25:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f5ed8d9a700 1 -- 172.21.15.88:0/2495242358 learned_addr learned my addr 172.21.15.88:0/2495242358 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7f50635ff700 1 Processor -- start 2023-05-17T12:25:33.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f7e49dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e4416ab00 0x7f7e4406d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f7e49dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4406d9c0 con 0x7f7e4406d5c0 2023-05-17T12:25:33.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f7e49dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e440cf800 con 0x7f7e440cce90 2023-05-17T12:25:33.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f7e49dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e440cd260 con 0x7f7e4416ab00 2023-05-17T12:25:33.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7ff587dff700 1 Processor -- start 2023-05-17T12:25:33.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f7e437fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f7e440cce90 0x7f7e44070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40834/0 (socket says 172.21.15.88:40834) 2023-05-17T12:25:33.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f7e437fe700 1 -- 172.21.15.88:0/3806638729 learned_addr learned my addr 172.21.15.88:0/3806638729 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:33.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f7e42ffd700 1 --2- 172.21.15.88:0/3806638729 >> v2:172.21.15.187:3300/0 conn(0x7f7e4416ab00 0x7f7e4406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.825+0000 7f50635ff700 1 -- start start 2023-05-17T12:25:33.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.827+0000 7f5ed9d9c700 1 --2- 172.21.15.88:0/2495242358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ed40716f0 0x7f5ed406a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.827+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624366983 0 0) 0x7f7e440cf800 con 0x7f7e440cce90 2023-05-17T12:25:33.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.827+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e2c0035b0 con 0x7f7e440cce90 2023-05-17T12:25:33.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.827+0000 7ff6c4999700 1 -- 172.21.15.88:0/4245870206 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800e070 con 0x7ff6c00c1c70 2023-05-17T12:25:33.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.827+0000 7ff6c4999700 1 -- 172.21.15.88:0/4245870206 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b800bae0 con 0x7ff6c00c1c70 2023-05-17T12:25:33.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.827+0000 7ff6c4999700 1 -- 172.21.15.88:0/4245870206 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800be90 con 0x7ff6c00c1c70 2023-05-17T12:25:33.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f93bafff700 1 Processor -- start 2023-05-17T12:25:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7f93bafff700 1 -- start start 2023-05-17T12:25:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279428981 0 0) 0x7f7e2c0035b0 con 0x7f7e440cce90 2023-05-17T12:25:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 >> v2:172.21.15.187:3300/0 conn(0x7f7e4416ab00 msgr2=0x7f7e4406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 --2- 172.21.15.88:0/3806638729 >> v2:172.21.15.187:3300/0 conn(0x7f7e4416ab00 0x7f7e4406d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 >> v1:172.21.15.88:6789/0 conn(0x7f7e4406d5c0 legacy=0x7f7e4406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440cd480 con 0x7f7e440cce90 2023-05-17T12:25:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f7e3c0019f0 con 0x7f7e440cce90 2023-05-17T12:25:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 >> v1:172.21.15.187:6789/0 conn(0x7f7e440cce90 legacy=0x7f7e44070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c003a50 0x7f7e2c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c004850 0x7f7e2c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c005200 0x7f7e2c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440cd260 con 0x7f7e2c005200 2023-05-17T12:25:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0148f0 con 0x7f7e2c003a50 2023-05-17T12:25:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c014ab0 con 0x7f7e2c004850 2023-05-17T12:25:33.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.826+0000 7ff587dff700 1 -- start start 2023-05-17T12:25:33.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7ff587dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff580070f70 0x7ff5800cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f5ed9d9c700 1 -- 172.21.15.88:0/2495242358 >> v1:172.21.15.187:6789/0 conn(0x7f5ed40cd980 legacy=0x7f5ed4070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f5ed9d9c700 1 -- 172.21.15.88:0/2495242358 >> v1:172.21.15.88:6789/0 conn(0x7f5ed406d080 legacy=0x7f5ed406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f50635ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f505c0cf650 0x7f505c0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f50635ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f505c0d1bb0 0x7f505c0ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f50635ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f505c15d990 0x7f505c14da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f50635ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0c7db0 con 0x7f505c0d1bb0 2023-05-17T12:25:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f50635ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0ca7c0 con 0x7f505c0cf650 2023-05-17T12:25:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f50635ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0c96b0 con 0x7f505c15d990 2023-05-17T12:25:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7f5ed9d9c700 1 -- 172.21.15.88:0/2495242358 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40ccea0 con 0x7f5ed40716f0 2023-05-17T12:25:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f93bafff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f93b4161050 0x7f93b4161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f93bafff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b4162680 con 0x7f93b406d080 2023-05-17T12:25:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f93bafff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b40cb620 con 0x7f93b406a510 2023-05-17T12:25:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.828+0000 7f93bafff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b4161b00 con 0x7f93b4161050 2023-05-17T12:25:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7f93b3fff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f93b406a510 0x7f93b40caf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40860/0 (socket says 172.21.15.88:40860) 2023-05-17T12:25:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7f93b3fff700 1 -- 172.21.15.88:0/446338262 learned_addr learned my addr 172.21.15.88:0/446338262 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7ff6c7bff700 1 -- 172.21.15.88:0/4245870206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c00c1c70 msgr2=0x7ff6c0071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7ff6c7bff700 1 --2- 172.21.15.88:0/4245870206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c00c1c70 0x7ff6c0071340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009d90 tx=0x7ff6b800b330 comp rx=0 tx=0).stop 2023-05-17T12:25:33.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7f93b8d9b700 1 --2- 172.21.15.88:0/446338262 >> v2:172.21.15.187:3300/0 conn(0x7f93b4161050 0x7f93b4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7ff587dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff58006dad0 0x7ff58006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7f5ed9d9c700 1 --2- 172.21.15.88:0/2495242358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ed40716f0 0x7f5ed406a730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00aed0 tx=0x7f5ecc00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8316c9368db96da server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7f5061b9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f505c15d990 0x7f505c14da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f5061b9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f505c15d990 0x7f505c14da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:35884/0 (socket says 172.21.15.88:35884) 2023-05-17T12:25:33.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f5061b9c700 1 -- 172.21.15.88:0/2619727771 learned_addr learned my addr 172.21.15.88:0/2619727771 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f5060b9a700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f505c0d1bb0 0x7f505c0ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7f7e42ffd700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c004850 0x7f7e2c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f7e43fff700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c005200 0x7f7e2c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7ff58539a700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ff5800c1c70 0x7ff580071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40850/0 (socket says 172.21.15.88:40850) 2023-05-17T12:25:33.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff58539a700 1 -- 172.21.15.88:0/721304006 learned_addr learned my addr 172.21.15.88:0/721304006 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:33.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f93b8d9b700 1 -- 172.21.15.88:0/446338262 >> v1:172.21.15.187:6789/0 conn(0x7f93b406a510 legacy=0x7f93b40caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f93b8d9b700 1 -- 172.21.15.88:0/446338262 >> v1:172.21.15.88:6789/0 conn(0x7f93b406d080 legacy=0x7f93b406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.829+0000 7f93b37fe700 1 -- 172.21.15.88:0/446338262 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993619323 0 0) 0x7f93b40cb620 con 0x7f93b406a510 2023-05-17T12:25:33.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f93b8d9b700 1 -- 172.21.15.88:0/446338262 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4161de0 con 0x7f93b4161050 2023-05-17T12:25:33.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f5ecbfff700 1 -- 172.21.15.88:0/2495242358 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00f070 con 0x7f5ed40716f0 2023-05-17T12:25:33.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f5ecbfff700 1 -- 172.21.15.88:0/2495242358 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc00a2e0 con 0x7f5ed40716f0 2023-05-17T12:25:33.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f5ecbfff700 1 -- 172.21.15.88:0/2495242358 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc003c40 con 0x7f5ed40716f0 2023-05-17T12:25:33.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff6c7bff700 1 -- 172.21.15.88:0/4245870206 shutdown_connections 2023-05-17T12:25:33.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff6c7bff700 1 --2- 172.21.15.88:0/4245870206 >> v2:172.21.15.187:3300/0 conn(0x7ff6c0070f70 0x7ff6c00cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff6c7bff700 1 --2- 172.21.15.88:0/4245870206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c00c1c70 0x7ff6c0071340 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff6c7bff700 1 -- 172.21.15.88:0/4245870206 >> 172.21.15.88:0/4245870206 conn(0x7ff6c00b1530 msgr2=0x7ff6c00ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f93b8d9b700 1 --2- 172.21.15.88:0/446338262 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b4161050 0x7f93b4161420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009840 tx=0x7f93a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b06e046d4c141251 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7f93b37fe700 1 -- 172.21.15.88:0/446338262 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8011830 con 0x7f93b4161050 2023-05-17T12:25:33.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f93b37fe700 1 -- 172.21.15.88:0/446338262 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8011990 con 0x7f93b4161050 2023-05-17T12:25:33.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f93b37fe700 1 -- 172.21.15.88:0/446338262 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8011d20 con 0x7f93b4161050 2023-05-17T12:25:33.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff587dff700 1 -- 172.21.15.88:0/721304006 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58006d080 con 0x7ff5800c1c70 2023-05-17T12:25:33.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff587dff700 1 -- 172.21.15.88:0/721304006 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5800cb3a0 con 0x7ff58006dad0 2023-05-17T12:25:33.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff587dff700 1 -- 172.21.15.88:0/721304006 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58006d640 con 0x7ff580070f70 2023-05-17T12:25:33.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff58639c700 1 --2- 172.21.15.88:0/721304006 >> v2:172.21.15.88:3300/0 conn(0x7ff58006dad0 0x7ff58006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.830+0000 7ff585b9b700 1 --2- 172.21.15.88:0/721304006 >> v2:172.21.15.187:3300/0 conn(0x7ff580070f70 0x7ff5800cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f7e437fe700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c003a50 0x7f7e2c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7ff584b99700 1 -- 172.21.15.88:0/721304006 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781046850 0 0) 0x7ff58006d080 con 0x7ff5800c1c70 2023-05-17T12:25:33.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7ff584b99700 1 -- 172.21.15.88:0/721304006 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff56c0035b0 con 0x7ff5800c1c70 2023-05-17T12:25:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f7e43fff700 1 -- 172.21.15.88:0/3806638729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c004850 msgr2=0x7f7e2c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f7e43fff700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c004850 0x7f7e2c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f7e43fff700 1 -- 172.21.15.88:0/3806638729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c003a50 msgr2=0x7f7e2c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f7e43fff700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e2c003a50 0x7f7e2c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f7e43fff700 1 -- 172.21.15.88:0/3806638729 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0035b0 con 0x7f7e2c005200 2023-05-17T12:25:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f7e42ffd700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c004850 0x7f7e2c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f7e43fff700 1 -- 172.21.15.88:0/3806638729 reap_dead start 2023-05-17T12:25:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f93bafff700 1 -- 172.21.15.88:0/446338262 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b4161050 msgr2=0x7f93b4161420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f93bafff700 1 --2- 172.21.15.88:0/446338262 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b4161050 0x7f93b4161420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009840 tx=0x7f93a8009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:33.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f5edb7ff700 1 -- 172.21.15.88:0/2495242358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ed40716f0 msgr2=0x7f5ed406a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f5edb7ff700 1 --2- 172.21.15.88:0/2495242358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ed40716f0 0x7f5ed406a730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00aed0 tx=0x7f5ecc00c330 comp rx=0 tx=0).stop 2023-05-17T12:25:33.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f506139b700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f505c0cf650 0x7f505c0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f5061b9c700 1 -- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f505c0cf650 msgr2=0x7f505c0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f5061b9c700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f505c0cf650 0x7f505c0c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f5061b9c700 1 -- 172.21.15.88:0/2619727771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f505c0d1bb0 msgr2=0x7f505c0ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f5061b9c700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f505c0d1bb0 0x7f505c0ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f5061b9c700 1 -- 172.21.15.88:0/2619727771 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0094a0 con 0x7f505c15d990 2023-05-17T12:25:33.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f5061b9c700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f505c15d990 0x7f505c14da30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f505800c410 tx=0x7f505800c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7f7e43fff700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c005200 0x7f7e2c00ba10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e380017d0 tx=0x7f7e2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0710da4dacc72a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7ff584b99700 1 -- 172.21.15.88:0/721304006 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 979165492 0 0) 0x7ff56c0035b0 con 0x7ff5800c1c70 2023-05-17T12:25:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7ff585b9b700 1 -- 172.21.15.88:0/721304006 >> v2:172.21.15.88:3300/0 conn(0x7ff58006dad0 msgr2=0x7ff58006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7ff585b9b700 1 --2- 172.21.15.88:0/721304006 >> v2:172.21.15.88:3300/0 conn(0x7ff58006dad0 0x7ff58006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.831+0000 7ff585b9b700 1 -- 172.21.15.88:0/721304006 >> v1:172.21.15.187:6789/0 conn(0x7ff5800c1c70 legacy=0x7ff580071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7ff585b9b700 1 -- 172.21.15.88:0/721304006 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58006ba00 con 0x7ff580070f70 2023-05-17T12:25:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f93bafff700 1 -- 172.21.15.88:0/446338262 shutdown_connections 2023-05-17T12:25:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f93bafff700 1 --2- 172.21.15.88:0/446338262 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b4161050 0x7f93b4161420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f93bafff700 1 -- 172.21.15.88:0/446338262 >> 172.21.15.88:0/446338262 conn(0x7f93b40b1530 msgr2=0x7f93b40ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7ff585b9b700 1 --2- 172.21.15.88:0/721304006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff580070f70 0x7ff5800cae60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff58006f1a0 tx=0x7ff57c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46304cc60140d1d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f5edb7ff700 1 -- 172.21.15.88:0/2495242358 shutdown_connections 2023-05-17T12:25:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f5edb7ff700 1 --2- 172.21.15.88:0/2495242358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ed40716f0 0x7f5ed406a730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f5edb7ff700 1 -- 172.21.15.88:0/2495242358 >> 172.21.15.88:0/2495242358 conn(0x7f5ed40b1530 msgr2=0x7f5ed40ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38001290 con 0x7f7e2c005200 2023-05-17T12:25:33.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e380052f0 con 0x7f7e2c005200 2023-05-17T12:25:33.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f7e427fc700 1 -- 172.21.15.88:0/3806638729 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38003680 con 0x7f7e2c005200 2023-05-17T12:25:33.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f5051ffb700 1 -- 172.21.15.88:0/2619727771 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058004c80 con 0x7f505c15d990 2023-05-17T12:25:33.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f5051ffb700 1 -- 172.21.15.88:0/2619727771 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5058004de0 con 0x7f505c15d990 2023-05-17T12:25:33.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f5051ffb700 1 -- 172.21.15.88:0/2619727771 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50580072f0 con 0x7f505c15d990 2023-05-17T12:25:33.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7f93bafff700 1 -- 172.21.15.88:0/446338262 shutdown_connections 2023-05-17T12:25:33.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7f7e49dff700 1 -- 172.21.15.88:0/3806638729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c005200 msgr2=0x7f7e2c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7f7e49dff700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c005200 0x7f7e2c00ba10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e380017d0 tx=0x7f7e2c005880 comp rx=0 tx=0).stop 2023-05-17T12:25:33.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7f7e49dff700 1 -- 172.21.15.88:0/3806638729 shutdown_connections 2023-05-17T12:25:33.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7f7e49dff700 1 --2- 172.21.15.88:0/3806638729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c005200 0x7f7e2c00ba10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7f7e49dff700 1 -- 172.21.15.88:0/3806638729 >> 172.21.15.88:0/3806638729 conn(0x7f7e440b1530 msgr2=0x7f7e440ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7ff584b99700 1 -- 172.21.15.88:0/721304006 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570001670 con 0x7ff580070f70 2023-05-17T12:25:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7ff584b99700 1 -- 172.21.15.88:0/721304006 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c004030 con 0x7ff580070f70 2023-05-17T12:25:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7ff584b99700 1 -- 172.21.15.88:0/721304006 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0043a0 con 0x7ff580070f70 2023-05-17T12:25:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7ff587dff700 1 -- 172.21.15.88:0/721304006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff580070f70 msgr2=0x7ff5800cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7ff587dff700 1 --2- 172.21.15.88:0/721304006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff580070f70 0x7ff5800cae60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff58006f1a0 tx=0x7ff57c009b20 comp rx=0 tx=0).stop 2023-05-17T12:25:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.834+0000 7f7e49dff700 1 -- 172.21.15.88:0/3806638729 shutdown_connections 2023-05-17T12:25:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7f93bafff700 1 -- 172.21.15.88:0/446338262 wait complete. 2023-05-17T12:25:33.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.834+0000 7ff587dff700 1 -- 172.21.15.88:0/721304006 shutdown_connections 2023-05-17T12:25:33.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.834+0000 7ff587dff700 1 --2- 172.21.15.88:0/721304006 >> v2:172.21.15.88:3300/0 conn(0x7ff58006dad0 0x7ff58006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.834+0000 7ff587dff700 1 --2- 172.21.15.88:0/721304006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff580070f70 0x7ff5800cae60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.834+0000 7ff587dff700 1 -- 172.21.15.88:0/721304006 >> 172.21.15.88:0/721304006 conn(0x7ff5800b1530 msgr2=0x7ff5800ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.832+0000 7f5edb7ff700 1 -- 172.21.15.88:0/2495242358 shutdown_connections 2023-05-17T12:25:33.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.833+0000 7f5edb7ff700 1 -- 172.21.15.88:0/2495242358 wait complete. 2023-05-17T12:25:33.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.834+0000 7ff587dff700 1 -- 172.21.15.88:0/721304006 shutdown_connections 2023-05-17T12:25:33.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.834+0000 7ff587dff700 1 -- 172.21.15.88:0/721304006 wait complete. 2023-05-17T12:25:33.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.835+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c15d470 con 0x7f505c15d990 2023-05-17T12:25:33.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.835+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c15d190 con 0x7f505c15d990 2023-05-17T12:25:33.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.835+0000 7f93bafff700 1 Processor -- start 2023-05-17T12:25:33.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.835+0000 7f5edb7ff700 1 Processor -- start 2023-05-17T12:25:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.836+0000 7ff6c7bff700 1 -- 172.21.15.88:0/4245870206 shutdown_connections 2023-05-17T12:25:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.836+0000 7f93bafff700 1 -- start start 2023-05-17T12:25:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f93bafff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b406a510 0x7f93b41f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f93bafff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b406d080 0x7f93b40bd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f93bafff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b4161050 0x7f93b40bde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f93bafff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40c03d0 con 0x7f93b406a510 2023-05-17T12:25:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f93bafff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40b4640 con 0x7f93b4161050 2023-05-17T12:25:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f93bafff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40bfaa0 con 0x7f93b406d080 2023-05-17T12:25:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f93b3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b406d080 0x7f93b40bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f93b3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b406d080 0x7f93b40bd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:35912/0 (socket says 172.21.15.88:35912) 2023-05-17T12:25:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f93b3fff700 1 -- 172.21.15.88:0/3673116025 learned_addr learned my addr 172.21.15.88:0/3673116025 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f93b959c700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b4161050 0x7f93b40bde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f93b8d9b700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b406a510 0x7f93b41f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f93b3fff700 1 -- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b4161050 msgr2=0x7f93b40bde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f93b3fff700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b4161050 0x7f93b40bde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f93b3fff700 1 -- 172.21.15.88:0/3673116025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b406a510 msgr2=0x7f93b41f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f93b3fff700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93b406a510 0x7f93b41f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f93b3fff700 1 -- 172.21.15.88:0/3673116025 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80094a0 con 0x7f93b406d080 2023-05-17T12:25:33.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.836+0000 7f5edb7ff700 1 -- start start 2023-05-17T12:25:33.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f5edb7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ed406d080 0x7f5ed4202880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f5edb7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed40716f0 0x7f5ed4202dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f5edb7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed40cd980 0x7f5ed4203720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f5edb7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4151d40 con 0x7f5ed40716f0 2023-05-17T12:25:33.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f5edb7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4203300 con 0x7f5ed40cd980 2023-05-17T12:25:33.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f5edb7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40c53e0 con 0x7f5ed406d080 2023-05-17T12:25:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f5ed8d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed40716f0 0x7f5ed4202dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f5ed8d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed40716f0 0x7f5ed4202dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37316/0 (socket says 172.21.15.88:37316) 2023-05-17T12:25:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f5ed8d9a700 1 -- 172.21.15.88:0/773252602 learned_addr learned my addr 172.21.15.88:0/773252602 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.836+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f505c0cdfa0 con 0x7f505c15d990 2023-05-17T12:25:33.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.834+0000 7f7e49dff700 1 -- 172.21.15.88:0/3806638729 wait complete. 2023-05-17T12:25:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.836+0000 7f7e49dff700 1 Processor -- start 2023-05-17T12:25:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7f7e49dff700 1 -- start start 2023-05-17T12:25:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f7e49dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c005200 0x7f7e440c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f7e49dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e440c4fb0 0x7f7e442025e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f7e49dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44088b10 0x7f7e440b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f7e49dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c7490 con 0x7f7e44088b10 2023-05-17T12:25:33.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f7e49dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c7770 con 0x7f7e440c4fb0 2023-05-17T12:25:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7f7e49dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c7a50 con 0x7f7e2c005200 2023-05-17T12:25:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f7e437fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c005200 0x7f7e440c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f7e437fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c005200 0x7f7e440c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:35914/0 (socket says 172.21.15.88:35914) 2023-05-17T12:25:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f7e437fe700 1 -- 172.21.15.88:0/36291453 learned_addr learned my addr 172.21.15.88:0/36291453 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f7e42ffd700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e440c4fb0 0x7f7e442025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7f7e43fff700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44088b10 0x7f7e440b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7f7e437fe700 1 -- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e440c4fb0 msgr2=0x7f7e442025e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7f7e437fe700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e440c4fb0 0x7f7e442025e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7f7e437fe700 1 -- 172.21.15.88:0/36291453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44088b10 msgr2=0x7f7e440b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7f7e437fe700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44088b10 0x7f7e440b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7f7e437fe700 1 -- 172.21.15.88:0/36291453 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440cda40 con 0x7f7e2c005200 2023-05-17T12:25:33.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7ff587dff700 1 Processor -- start 2023-05-17T12:25:33.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.837+0000 7ff587dff700 1 -- start start 2023-05-17T12:25:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7ff587dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff58006dad0 0x7ff5800a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7ff587dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff580070f70 0x7ff5800c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7ff587dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5800c1c70 0x7ff5800c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7ff587dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800a8d70 con 0x7ff58006dad0 2023-05-17T12:25:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7ff587dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800a8a90 con 0x7ff580070f70 2023-05-17T12:25:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.839+0000 7ff587dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800c74a0 con 0x7ff5800c1c70 2023-05-17T12:25:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7ff58639c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5800c1c70 0x7ff5800c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7ff58639c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5800c1c70 0x7ff5800c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:35926/0 (socket says 172.21.15.88:35926) 2023-05-17T12:25:33.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7ff58639c700 1 -- 172.21.15.88:0/736560138 learned_addr learned my addr 172.21.15.88:0/736560138 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7ff58539a700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff580070f70 0x7ff5800c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7f7e437fe700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c005200 0x7f7e440c8250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0013d0 tx=0x7f7e3c00e570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7ff58639c700 1 -- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff580070f70 msgr2=0x7ff5800c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7ff58639c700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff580070f70 0x7ff5800c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7ff58639c700 1 -- 172.21.15.88:0/736560138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff58006dad0 msgr2=0x7ff5800a80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7ff58639c700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff58006dad0 0x7ff5800a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.840+0000 7ff58639c700 1 -- 172.21.15.88:0/736560138 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c0094a0 con 0x7ff5800c1c70 2023-05-17T12:25:33.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.838+0000 7ff6c7bff700 1 -- 172.21.15.88:0/4245870206 wait complete. 2023-05-17T12:25:33.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7ff6c7bff700 1 Processor -- start 2023-05-17T12:25:33.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f5ed8d9a700 1 -- 172.21.15.88:0/773252602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ed406d080 msgr2=0x7f5ed4202880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f5ed8d9a700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ed406d080 0x7f5ed4202880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f5ed8d9a700 1 -- 172.21.15.88:0/773252602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed40cd980 msgr2=0x7f5ed4203720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-17T12:25:33.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f5ed8d9a700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed40cd980 0x7f5ed4203720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f7e2bfff700 1 -- 172.21.15.88:0/36291453 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00edf0 con 0x7f7e2c005200 2023-05-17T12:25:33.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f7e2bfff700 1 -- 172.21.15.88:0/36291453 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c013420 con 0x7f7e2c005200 2023-05-17T12:25:33.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f7e2bfff700 1 -- 172.21.15.88:0/36291453 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0137d0 con 0x7f7e2c005200 2023-05-17T12:25:33.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7ff58639c700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5800c1c70 0x7ff5800c47f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff57800efc0 tx=0x7ff57800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f5ed8d9a700 1 -- 172.21.15.88:0/773252602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc00ab80 con 0x7f5ed40716f0 2023-05-17T12:25:33.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f5ed8d9a700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed40716f0 0x7f5ed4202dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c750 tx=0x7f5ed000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e440cd760 con 0x7f7e2c005200 2023-05-17T12:25:33.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4416af80 con 0x7f7e2c005200 2023-05-17T12:25:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7ff6c7bff700 1 -- start start 2023-05-17T12:25:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7ff6c7bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c006dad0 0x7ff6c0153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7ff6c7bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c0070f70 0x7ff6c0153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7ff6c7bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c00c1c70 0x7ff6c00b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7ff6c7bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01445c0 con 0x7ff6c0070f70 2023-05-17T12:25:33.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7ff6c7bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0143730 con 0x7ff6c00c1c70 2023-05-17T12:25:33.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7ff6c7bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0143940 con 0x7ff6c006dad0 2023-05-17T12:25:33.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7f5ec9ffb700 1 -- 172.21.15.88:0/773252602 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0004e60 con 0x7f5ed40716f0 2023-05-17T12:25:33.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7f5ec9ffb700 1 -- 172.21.15.88:0/773252602 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed00070d0 con 0x7f5ed40716f0 2023-05-17T12:25:33.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7f5ec9ffb700 1 -- 172.21.15.88:0/773252602 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0007480 con 0x7f5ed40716f0 2023-05-17T12:25:33.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.843+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed4158ea0 con 0x7f5ed40716f0 2023-05-17T12:25:33.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.843+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed40cd180 con 0x7f5ed40716f0 2023-05-17T12:25:33.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7f5051ffb700 1 -- 172.21.15.88:0/2619727771 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5058007450 con 0x7f505c15d990 2023-05-17T12:25:33.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.842+0000 7f5051ffb700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f504006ade0 0x7f504006d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.843+0000 7f5051ffb700 1 -- 172.21.15.88:0/2619727771 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5058089830 con 0x7f505c15d990 2023-05-17T12:25:33.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.843+0000 7f5051ffb700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.88:6824/2184192424,v1:172.21.15.88:6825/2184192424] conn(0x7f5040074ab0 0x7f5040076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.843+0000 7f5051ffb700 1 -- 172.21.15.88:0/2619727771 --> [v2:172.21.15.88:6824/2184192424,v1:172.21.15.88:6825/2184192424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50400775b0 con 0x7f5040074ab0 2023-05-17T12:25:33.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.843+0000 7f5051ffb700 1 -- 172.21.15.88:0/2619727771 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5058089be0 con 0x7f505c15d990 2023-05-17T12:25:33.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7ff5767fc700 1 -- 172.21.15.88:0/736560138 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578009ba0 con 0x7ff5800c1c70 2023-05-17T12:25:33.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7ff5767fc700 1 -- 172.21.15.88:0/736560138 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57800f040 con 0x7ff5800c1c70 2023-05-17T12:25:33.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7ff5767fc700 1 -- 172.21.15.88:0/736560138 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578014480 con 0x7ff5800c1c70 2023-05-17T12:25:33.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58006d2d0 con 0x7ff5800c1c70 2023-05-17T12:25:33.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.841+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58006bce0 con 0x7ff5800c1c70 2023-05-17T12:25:33.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.843+0000 7f5060b9a700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.88:6824/2184192424,v1:172.21.15.88:6825/2184192424] conn(0x7f5040074ab0 0x7f5040076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.843+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff568000fc0 con 0x7ff5800c1c70 2023-05-17T12:25:33.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.844+0000 7ff6c519a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c0070f70 0x7ff6c0153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.844+0000 7ff6c519a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c0070f70 0x7ff6c0153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37344/0 (socket says 172.21.15.88:37344) 2023-05-17T12:25:33.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.844+0000 7ff6c519a700 1 -- 172.21.15.88:0/3680110196 learned_addr learned my addr 172.21.15.88:0/3680110196 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.844+0000 7ff6c599b700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c006dad0 0x7ff6c0153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.844+0000 7ff6c619c700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c00c1c70 0x7ff6c00b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.844+0000 7f5060b9a700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.88:6824/2184192424,v1:172.21.15.88:6825/2184192424] conn(0x7f5040074ab0 0x7f5040076ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.844+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ed40c4c00 con 0x7f5ed40716f0 2023-05-17T12:25:33.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7f93b3fff700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b406d080 0x7f93b40bd910 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f93a400c550 tx=0x7f93a400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7ff6c519a700 1 -- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c006dad0 msgr2=0x7ff6c0153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7ff6c519a700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c006dad0 0x7ff6c0153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7ff6c519a700 1 -- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c00c1c70 msgr2=0x7ff6c00b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7ff6c519a700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c00c1c70 0x7ff6c00b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7ff6c519a700 1 -- 172.21.15.88:0/3680110196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b8009a70 con 0x7ff6c0070f70 2023-05-17T12:25:33.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7f93b17fa700 1 -- 172.21.15.88:0/3673116025 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4004c80 con 0x7f93b406d080 2023-05-17T12:25:33.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7f93b17fa700 1 -- 172.21.15.88:0/3673116025 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4004e00 con 0x7f93b406d080 2023-05-17T12:25:33.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7f93b17fa700 1 -- 172.21.15.88:0/3673116025 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4007310 con 0x7f93b406d080 2023-05-17T12:25:33.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b41623a0 con 0x7f93b406d080 2023-05-17T12:25:33.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.846+0000 7f5051ffb700 1 -- 172.21.15.88:0/2619727771 <== osd.3 v2:172.21.15.88:6824/2184192424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f50400775b0 con 0x7f5040074ab0 2023-05-17T12:25:33.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.845+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e24000fc0 con 0x7f7e2c005200 2023-05-17T12:25:33.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.846+0000 7ff6c519a700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c0070f70 0x7ff6c0153640 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800b370 tx=0x7ff6b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.847+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b41620c0 con 0x7f93b406d080 2023-05-17T12:25:33.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.847+0000 7f506139b700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f504006ade0 0x7f504006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.846+0000 7ff6b67fc700 1 -- 172.21.15.88:0/3680110196 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8004670 con 0x7ff6c0070f70 2023-05-17T12:25:33.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.847+0000 7ff6b67fc700 1 -- 172.21.15.88:0/3680110196 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b80047d0 con 0x7ff6c0070f70 2023-05-17T12:25:33.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.847+0000 7ff6b67fc700 1 -- 172.21.15.88:0/3680110196 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8012670 con 0x7ff6c0070f70 2023-05-17T12:25:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.847+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c006bce0 con 0x7ff6c0070f70 2023-05-17T12:25:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.847+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c006ba00 con 0x7ff6c0070f70 2023-05-17T12:25:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.847+0000 7ff5767fc700 1 -- 172.21.15.88:0/736560138 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff5780145e0 con 0x7ff5800c1c70 2023-05-17T12:25:33.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.849+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93b406a9b0 con 0x7f93b406d080 2023-05-17T12:25:33.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.849+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6a8000fc0 con 0x7ff6c0070f70 2023-05-17T12:25:33.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.848+0000 7f5ec9ffb700 1 -- 172.21.15.88:0/773252602 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ed00075e0 con 0x7f5ed40716f0 2023-05-17T12:25:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.849+0000 7ff5767fc700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff56406adb0 0x7ff56406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.849+0000 7ff5767fc700 1 -- 172.21.15.88:0/736560138 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff57808a730 con 0x7ff5800c1c70 2023-05-17T12:25:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.848+0000 7f7e2bfff700 1 -- 172.21.15.88:0/36291453 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e3c013930 con 0x7f7e2c005200 2023-05-17T12:25:33.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.849+0000 7f7e2bfff700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7e3006ad60 0x7f7e3006d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.849+0000 7f7e2bfff700 1 -- 172.21.15.88:0/36291453 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7e3c08a340 con 0x7f7e2c005200 2023-05-17T12:25:33.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.850+0000 7f7e2bfff700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6800/2496559669,v1:172.21.15.187:6801/2496559669] conn(0x7f7e30074a30 0x7f7e30076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.850+0000 7f7e2bfff700 1 -- 172.21.15.88:0/36291453 --> [v2:172.21.15.187:6800/2496559669,v1:172.21.15.187:6801/2496559669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e30077530 con 0x7f7e30074a30 2023-05-17T12:25:33.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.850+0000 7f7e2bfff700 1 -- 172.21.15.88:0/36291453 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e3c08a6b0 con 0x7f7e2c005200 2023-05-17T12:25:33.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.850+0000 7ff5767fc700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6816/133779704,v1:172.21.15.187:6818/133779704] conn(0x7ff564074a80 0x7ff564076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.850+0000 7ff5767fc700 1 -- 172.21.15.88:0/736560138 --> [v2:172.21.15.187:6816/133779704,v1:172.21.15.187:6818/133779704] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff564077580 con 0x7ff564074a80 2023-05-17T12:25:33.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.850+0000 7ff5767fc700 1 -- 172.21.15.88:0/736560138 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff57808aae0 con 0x7ff5800c1c70 2023-05-17T12:25:33.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.850+0000 7ff585b9b700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff56406adb0 0x7ff56406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.851+0000 7ff58539a700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6816/133779704,v1:172.21.15.187:6818/133779704] conn(0x7ff564074a80 0x7ff564076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.852+0000 7ff58539a700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6816/133779704,v1:172.21.15.187:6818/133779704] conn(0x7ff564074a80 0x7ff564076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.852+0000 7f93b17fa700 1 -- 172.21.15.88:0/3673116025 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f93a4007470 con 0x7f93b406d080 2023-05-17T12:25:33.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.852+0000 7f7e42ffd700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7e3006ad60 0x7f7e3006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.852+0000 7f7e43fff700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6800/2496559669,v1:172.21.15.187:6801/2496559669] conn(0x7f7e30074a30 0x7f7e30076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.852+0000 7f5ec9ffb700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5eb806adb0 0x7f5eb806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.852+0000 7f5ec9ffb700 1 -- 172.21.15.88:0/773252602 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ed0089610 con 0x7f5ed40716f0 2023-05-17T12:25:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.852+0000 7f5ec9ffb700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.88:6808/3210201149,v1:172.21.15.88:6809/3210201149] conn(0x7f5eb8074a80 0x7f5eb8076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.852+0000 7f5ec9ffb700 1 -- 172.21.15.88:0/773252602 --> [v2:172.21.15.88:6808/3210201149,v1:172.21.15.88:6809/3210201149] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5eb8077580 con 0x7f5eb8074a80 2023-05-17T12:25:33.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.852+0000 7f5ec9ffb700 1 -- 172.21.15.88:0/773252602 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ed00899c0 con 0x7f5ed40716f0 2023-05-17T12:25:33.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.853+0000 7ff585b9b700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff56406adb0 0x7ff56406d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009b60 tx=0x7ff57c00f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.853+0000 7ff6b67fc700 1 -- 172.21.15.88:0/3680110196 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6b802e420 con 0x7ff6c0070f70 2023-05-17T12:25:33.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.853+0000 7f5ed959b700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5eb806adb0 0x7f5eb806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.854+0000 7ff5767fc700 1 -- 172.21.15.88:0/736560138 <== osd.5 v2:172.21.15.187:6816/133779704 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff564077580 con 0x7ff564074a80 2023-05-17T12:25:33.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.854+0000 7f93b17fa700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f93a006adb0 0x7f93a006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.854+0000 7f93b17fa700 1 -- 172.21.15.88:0/3673116025 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f93a4089460 con 0x7f93b406d080 2023-05-17T12:25:33.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.854+0000 7f93b17fa700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.88:6816/2066173711,v1:172.21.15.88:6817/2066173711] conn(0x7f93a0074a80 0x7f93a0076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.854+0000 7f93b17fa700 1 -- 172.21.15.88:0/3673116025 --> [v2:172.21.15.88:6816/2066173711,v1:172.21.15.88:6817/2066173711] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93a0077580 con 0x7f93a0074a80 2023-05-17T12:25:33.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.854+0000 7f93b17fa700 1 -- 172.21.15.88:0/3673116025 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93a408ba20 con 0x7f93b406d080 2023-05-17T12:25:33.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.854+0000 7f5ed9d9c700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.88:6808/3210201149,v1:172.21.15.88:6809/3210201149] conn(0x7f5eb8074a80 0x7f5eb8076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.855+0000 7f93b8d9b700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f93a006adb0 0x7f93a006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.855+0000 7f5ed959b700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5eb806adb0 0x7f5eb806d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4003df0 tx=0x7f5ec4007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.855+0000 7ff6b67fc700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff6a406adb0 0x7ff6a406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.855+0000 7f5ed9d9c700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.88:6808/3210201149,v1:172.21.15.88:6809/3210201149] conn(0x7f5eb8074a80 0x7f5eb8076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.855+0000 7ff6b67fc700 1 -- 172.21.15.88:0/3680110196 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff6b808bba0 con 0x7ff6c0070f70 2023-05-17T12:25:33.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.855+0000 7ff6b67fc700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.88:6800/441996497,v1:172.21.15.88:6801/441996497] conn(0x7ff6a4074a80 0x7ff6a4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.855+0000 7ff6b67fc700 1 -- 172.21.15.88:0/3680110196 --> [v2:172.21.15.88:6800/441996497,v1:172.21.15.88:6801/441996497] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6a4077580 con 0x7ff6a4074a80 2023-05-17T12:25:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.855+0000 7ff6b67fc700 1 -- 172.21.15.88:0/3680110196 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6b808bf50 con 0x7ff6c0070f70 2023-05-17T12:25:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.855+0000 7ff6c599b700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff6a406adb0 0x7ff6a406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.856+0000 7f93b8d9b700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f93a006adb0 0x7f93a006d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f93a80090b0 tx=0x7f93a8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.856+0000 7ff6c619c700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.88:6800/441996497,v1:172.21.15.88:6801/441996497] conn(0x7ff6a4074a80 0x7ff6a4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.856+0000 7f93b959c700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.88:6816/2066173711,v1:172.21.15.88:6817/2066173711] conn(0x7f93a0074a80 0x7f93a0076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.857+0000 7f5ec9ffb700 1 -- 172.21.15.88:0/773252602 <== osd.2 v2:172.21.15.88:6808/3210201149 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5eb8077580 con 0x7f5eb8074a80 2023-05-17T12:25:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.857+0000 7f7e43fff700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6800/2496559669,v1:172.21.15.187:6801/2496559669] conn(0x7f7e30074a30 0x7f7e30076e60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.857+0000 7f7e42ffd700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7e3006ad60 0x7f7e3006d210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7e440cb5c0 tx=0x7f7e34009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.857+0000 7f93b959c700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.88:6816/2066173711,v1:172.21.15.88:6817/2066173711] conn(0x7f93a0074a80 0x7f93a0076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.858+0000 7f506139b700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f504006ade0 0x7f504006d290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f504c009b90 tx=0x7f504c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.857+0000 7ff6c599b700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff6a406adb0 0x7ff6a406d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6c014f9c0 tx=0x7ff6b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.858+0000 7ff6c619c700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.88:6800/441996497,v1:172.21.15.88:6801/441996497] conn(0x7ff6a4074a80 0x7ff6a4076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.858+0000 7f7e2bfff700 1 -- 172.21.15.88:0/36291453 <== osd.4 v2:172.21.15.187:6800/2496559669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7e30077530 con 0x7f7e30074a30 2023-05-17T12:25:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.860+0000 7f93b17fa700 1 -- 172.21.15.88:0/3673116025 <== osd.1 v2:172.21.15.88:6816/2066173711 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f93a0077580 con 0x7f93a0074a80 2023-05-17T12:25:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.860+0000 7f1d789ff700 1 Processor -- start 2023-05-17T12:25:33.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.861+0000 7ff6b67fc700 1 -- 172.21.15.88:0/3680110196 <== osd.0 v2:172.21.15.88:6800/441996497 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff6a4077580 con 0x7ff6a4074a80 2023-05-17T12:25:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.861+0000 7f91e21ff700 1 Processor -- start 2023-05-17T12:25:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.861+0000 7f91e21ff700 1 -- start start 2023-05-17T12:25:33.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.860+0000 7f1d789ff700 1 -- start start 2023-05-17T12:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.862+0000 7f1d789ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d740b88b0 0x7f1d7406af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.862+0000 7f1d789ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7406b500 con 0x7f1d7406cb50 2023-05-17T12:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.862+0000 7f1d789ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d740cdb30 con 0x7f1d740d2750 2023-05-17T12:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.862+0000 7f1d789ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d740cdfc0 con 0x7f1d740b88b0 2023-05-17T12:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f1d71d9b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f1d740d2750 0x7f1d7406c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40862/0 (socket says 172.21.15.88:40862) 2023-05-17T12:25:33.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f1d71d9b700 1 -- 172.21.15.88:0/85608859 learned_addr learned my addr 172.21.15.88:0/85608859 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f1d7259c700 1 --2- 172.21.15.88:0/85608859 >> v2:172.21.15.88:3300/0 conn(0x7f1d740b88b0 0x7f1d7406af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518629639 0 0) 0x7f1d740cdb30 con 0x7f1d740d2750 2023-05-17T12:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d5c0035b0 con 0x7f1d740d2750 2023-05-17T12:25:33.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f91e21ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f91dc0cd4e0 0x7f91dc0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f91e21ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91dc0cd960 0x7f91dc0b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f91e21ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91dc06ada0 con 0x7f91dc1591f0 2023-05-17T12:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f91e21ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc06bc00 con 0x7f91dc0cd4e0 2023-05-17T12:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.863+0000 7f91e21ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc06aff0 con 0x7f91dc0cd960 2023-05-17T12:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f91db7fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f91dc1591f0 0x7f91dc0ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40876/0 (socket says 172.21.15.88:40876) 2023-05-17T12:25:33.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f91db7fe700 1 -- 172.21.15.88:0/3186724822 learned_addr learned my addr 172.21.15.88:0/3186724822 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f91dbfff700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91dc0cd960 0x7f91dc0b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f91d2ffd700 1 --2- 172.21.15.88:0/3186724822 >> v2:172.21.15.187:3300/0 conn(0x7f91dc0cd4e0 0x7f91dc0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231694680 0 0) 0x7f91dc06ada0 con 0x7f91dc1591f0 2023-05-17T12:25:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c80034d0 con 0x7f91dc1591f0 2023-05-17T12:25:33.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2081911391 0 0) 0x7f1d5c0035b0 con 0x7f1d740d2750 2023-05-17T12:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 >> v2:172.21.15.88:3300/0 conn(0x7f1d740b88b0 msgr2=0x7f1d7406af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 --2- 172.21.15.88:0/85608859 >> v2:172.21.15.88:3300/0 conn(0x7f1d740b88b0 0x7f1d7406af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 >> v1:172.21.15.88:6789/0 conn(0x7f1d7406cb50 legacy=0x7f1d740d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740cf3c0 con 0x7f1d740d2750 2023-05-17T12:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f1d64001670 con 0x7f1d740d2750 2023-05-17T12:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 >> v1:172.21.15.187:6789/0 conn(0x7f1d740d2750 legacy=0x7f1d7406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d5c003a00 0x7f1d5c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d5c004850 0x7f1d5c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d5c005200 0x7f1d5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740cdfc0 con 0x7f1d5c005200 2023-05-17T12:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c00c0e0 con 0x7f1d5c004850 2023-05-17T12:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.864+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c00c270 con 0x7f1d5c003a00 2023-05-17T12:25:33.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f1d71d9b700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d5c004850 0x7f1d5c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3568182322 0 0) 0x7f91c80034d0 con 0x7f91dc1591f0 2023-05-17T12:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91dc0cd960 msgr2=0x7f91dc0b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91dc0cd960 0x7f91dc0b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 >> v2:172.21.15.187:3300/0 conn(0x7f91dc0cd4e0 msgr2=0x7f91dc0b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 --2- 172.21.15.88:0/3186724822 >> v2:172.21.15.187:3300/0 conn(0x7f91dc0cd4e0 0x7f91dc0b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc06b2d0 con 0x7f91dc1591f0 2023-05-17T12:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f91cc0019f0 con 0x7f91dc1591f0 2023-05-17T12:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 >> v1:172.21.15.187:6789/0 conn(0x7f91dc1591f0 legacy=0x7f91dc0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c8003af0 0x7f91c8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c80088e0 0x7f91c800acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c800b310 0x7f91c800d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc06bc00 con 0x7f91c8003af0 2023-05-17T12:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc06aff0 con 0x7f91c80088e0 2023-05-17T12:25:33.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.865+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c800e0a0 con 0x7f91c800b310 2023-05-17T12:25:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f91db7fe700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c8003af0 0x7f91c8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f91dbfff700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c800b310 0x7f91c800d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f1d72d9d700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d5c005200 0x7f1d5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f1d71d9b700 1 -- 172.21.15.88:0/85608859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d5c003a00 msgr2=0x7f1d5c003e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f1d71d9b700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d5c003a00 0x7f1d5c003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f1d71d9b700 1 -- 172.21.15.88:0/85608859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d5c005200 msgr2=0x7f1d5c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f1d71d9b700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d5c005200 0x7f1d5c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f1d71d9b700 1 -- 172.21.15.88:0/85608859 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740cf3c0 con 0x7f1d5c004850 2023-05-17T12:25:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f1d72d9d700 1 -- 172.21.15.88:0/85608859 reap_dead start 2023-05-17T12:25:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f91dbfff700 1 -- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c80088e0 msgr2=0x7f91c800acc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:33.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f91dbfff700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c80088e0 0x7f91c800acc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f91dbfff700 1 -- 172.21.15.88:0/3186724822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c8003af0 msgr2=0x7f91c8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f91dbfff700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91c8003af0 0x7f91c8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f91dbfff700 1 -- 172.21.15.88:0/3186724822 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc06b2d0 con 0x7f91c800b310 2023-05-17T12:25:33.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.867+0000 7f91dbfff700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c800b310 0x7f91c800d790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009a20 tx=0x7f91c8003780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9c2249e6ade6ca3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.866+0000 7f1d71d9b700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d5c004850 0x7f1d5c004cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d64001eb0 tx=0x7f1d5c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2908b26fcfd3501e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.867+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64007c10 con 0x7f1d5c004850 2023-05-17T12:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.867+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6400cdd0 con 0x7f1d5c004850 2023-05-17T12:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.867+0000 7f1d7159a700 1 -- 172.21.15.88:0/85608859 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64005ba0 con 0x7f1d5c004850 2023-05-17T12:25:33.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.867+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4009e50 con 0x7f91c800b310 2023-05-17T12:25:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.867+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d400e6c0 con 0x7f91c800b310 2023-05-17T12:25:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.867+0000 7f91daffd700 1 -- 172.21.15.88:0/3186724822 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d400ea30 con 0x7f91c800b310 2023-05-17T12:25:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f1d789ff700 1 -- 172.21.15.88:0/85608859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d5c004850 msgr2=0x7f1d5c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f1d789ff700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d5c004850 0x7f1d5c004cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d64001eb0 tx=0x7f1d5c005880 comp rx=0 tx=0).stop 2023-05-17T12:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f91e21ff700 1 -- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c800b310 msgr2=0x7f91c800d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f91e21ff700 1 --2- 172.21.15.88:0/3186724822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91c800b310 0x7f91c800d790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009a20 tx=0x7f91c8003780 comp rx=0 tx=0).stop 2023-05-17T12:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f91dbfff700 1 -- 172.21.15.88:0/3186724822 reap_dead start 2023-05-17T12:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f91e21ff700 1 -- 172.21.15.88:0/3186724822 shutdown_connections 2023-05-17T12:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f91e21ff700 1 -- 172.21.15.88:0/3186724822 >> 172.21.15.88:0/3186724822 conn(0x7f91dc06e5a0 msgr2=0x7f91dc0cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f1d789ff700 1 -- 172.21.15.88:0/85608859 shutdown_connections 2023-05-17T12:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f1d789ff700 1 --2- 172.21.15.88:0/85608859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d5c004850 0x7f1d5c004cc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.868+0000 7f1d789ff700 1 -- 172.21.15.88:0/85608859 >> 172.21.15.88:0/85608859 conn(0x7f1d740d3e60 msgr2=0x7f1d740cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.869+0000 7f91e21ff700 1 -- 172.21.15.88:0/3186724822 shutdown_connections 2023-05-17T12:25:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.869+0000 7f91e21ff700 1 -- 172.21.15.88:0/3186724822 wait complete. 2023-05-17T12:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.870+0000 7f1d789ff700 1 -- 172.21.15.88:0/85608859 shutdown_connections 2023-05-17T12:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.870+0000 7f1d789ff700 1 -- 172.21.15.88:0/85608859 wait complete. 2023-05-17T12:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.873+0000 7f1d789ff700 1 Processor -- start 2023-05-17T12:25:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.873+0000 7f1d789ff700 1 -- start start 2023-05-17T12:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.872+0000 7f91e21ff700 1 Processor -- start 2023-05-17T12:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.872+0000 7f91e21ff700 1 -- start start 2023-05-17T12:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.874+0000 7f91e21ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c800b310 0x7f91dc0c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.874+0000 7f91e21ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91dc0b3450 0x7f91dc0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.874+0000 7f91e21ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91dc1430d0 0x7f91dc143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.874+0000 7f91e21ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0c8a90 con 0x7f91dc0b3450 2023-05-17T12:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.874+0000 7f91e21ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc158890 con 0x7f91c800b310 2023-05-17T12:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.874+0000 7f91e21ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc0b38c0 con 0x7f91dc1430d0 2023-05-17T12:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.874+0000 7f91d2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91dc0b3450 0x7f91dc0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.874+0000 7f91d2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91dc0b3450 0x7f91dc0c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37370/0 (socket says 172.21.15.88:37370) 2023-05-17T12:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.874+0000 7f91d2ffd700 1 -- 172.21.15.88:0/1304390050 learned_addr learned my addr 172.21.15.88:0/1304390050 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.875+0000 7f91db7fe700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c800b310 0x7f91dc0c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.875+0000 7f91d2ffd700 1 -- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91dc1430d0 msgr2=0x7f91dc143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.875+0000 7f91d2ffd700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91dc1430d0 0x7f91dc143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.875+0000 7f91d2ffd700 1 -- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c800b310 msgr2=0x7f91dc0c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.875+0000 7f91d2ffd700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91c800b310 0x7f91dc0c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.875+0000 7f91d2ffd700 1 -- 172.21.15.88:0/1304390050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc06b890 con 0x7f91dc0b3450 2023-05-17T12:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.876+0000 7f91d2ffd700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91dc0b3450 0x7f91dc0c72a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91c400e9b0 tx=0x7f91c400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.876+0000 7f91d8ff9700 1 -- 172.21.15.88:0/1304390050 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c400c850 con 0x7f91dc0b3450 2023-05-17T12:25:33.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.876+0000 7f91d8ff9700 1 -- 172.21.15.88:0/1304390050 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c400c9b0 con 0x7f91dc0b3450 2023-05-17T12:25:33.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.877+0000 7f91d8ff9700 1 -- 172.21.15.88:0/1304390050 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c400cd60 con 0x7f91dc0b3450 2023-05-17T12:25:33.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.875+0000 7f1d789ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d5c004850 0x7f1d740cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.875+0000 7f1d7259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d5c004850 0x7f1d740cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.875+0000 7f1d7259c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d5c004850 0x7f1d740cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:35984/0 (socket says 172.21.15.88:35984) 2023-05-17T12:25:33.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.877+0000 7f1d789ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d740ca240 0x7f1d7415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.878+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 --> [v2:172.21.15.88:6824/2184192424,v1:172.21.15.88:6825/2184192424] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f505c074530 con 0x7f5040074ab0 2023-05-17T12:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.878+0000 7f1d789ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d740c90e0 0x7f1d7415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.878+0000 7f1d789ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7415b1b0 con 0x7f1d740c90e0 2023-05-17T12:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.878+0000 7f1d789ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7415a7e0 con 0x7f1d740ca240 2023-05-17T12:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.878+0000 7f1d789ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740b6940 con 0x7f1d5c004850 2023-05-17T12:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.878+0000 7f1d71d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d740ca240 0x7f1d7415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.878+0000 7f1d71d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d740ca240 0x7f1d7415ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:48844/0 (socket says 172.21.15.88:48844) 2023-05-17T12:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.878+0000 7f1d71d9b700 1 -- 172.21.15.88:0/2048296183 learned_addr learned my addr 172.21.15.88:0/2048296183 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.879+0000 7f1d71d9b700 1 -- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d5c004850 msgr2=0x7f1d740cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.879+0000 7f1d71d9b700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d5c004850 0x7f1d740cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.879+0000 7f1d71d9b700 1 -- 172.21.15.88:0/2048296183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d740c90e0 msgr2=0x7f1d7415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.879+0000 7f1d71d9b700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d740c90e0 0x7f1d7415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.879+0000 7f1d71d9b700 1 -- 172.21.15.88:0/2048296183 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740cf940 con 0x7f1d740ca240 2023-05-17T12:25:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.879+0000 7f1d71d9b700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d740ca240 0x7f1d7415ac70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0047d0 tx=0x7f1d64001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.881+0000 7f5051ffb700 1 -- 172.21.15.88:0/2619727771 <== osd.3 v2:172.21.15.88:6824/2184192424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f505c074530 con 0x7f5040074ab0 2023-05-17T12:25:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.880+0000 7f1d62ffd700 1 -- 172.21.15.88:0/2048296183 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400cbd0 con 0x7f1d740ca240 2023-05-17T12:25:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.880+0000 7f1d62ffd700 1 -- 172.21.15.88:0/2048296183 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d64006110 con 0x7f1d740ca240 2023-05-17T12:25:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.880+0000 7f1d62ffd700 1 -- 172.21.15.88:0/2048296183 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64006480 con 0x7f1d740ca240 2023-05-17T12:25:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.880+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d740cf660 con 0x7f1d740ca240 2023-05-17T12:25:33.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.880+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d740cd7c0 con 0x7f1d740ca240 2023-05-17T12:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.877+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc06b5b0 con 0x7f91dc0b3450 2023-05-17T12:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.880+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc1595c0 con 0x7f91dc0b3450 2023-05-17T12:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.882+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91dc074530 con 0x7f91dc0b3450 2023-05-17T12:25:33.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.885+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 >> [v2:172.21.15.88:6824/2184192424,v1:172.21.15.88:6825/2184192424] conn(0x7f5040074ab0 msgr2=0x7f5040076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.885+0000 7f50635ff700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.88:6824/2184192424,v1:172.21.15.88:6825/2184192424] conn(0x7f5040074ab0 0x7f5040076ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.885+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f504006ade0 msgr2=0x7f504006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.885+0000 7f50635ff700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f504006ade0 0x7f504006d290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f504c009b90 tx=0x7f504c008030 comp rx=0 tx=0).stop 2023-05-17T12:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.885+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f505c15d990 msgr2=0x7f505c14da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.885+0000 7f50635ff700 1 --2- 172.21.15.88:0/2619727771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f505c15d990 0x7f505c14da30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f505800c410 tx=0x7f505800c7d0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.884+0000 7f1d62ffd700 1 -- 172.21.15.88:0/2048296183 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d64019070 con 0x7f1d740ca240 2023-05-17T12:25:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.885+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 --> [v2:172.21.15.187:6816/133779704,v1:172.21.15.187:6818/133779704] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff568002d40 con 0x7ff564074a80 2023-05-17T12:25:33.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.886+0000 7f5061b9c700 1 -- 172.21.15.88:0/2619727771 reap_dead start 2023-05-17T12:25:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.886+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d58000fc0 con 0x7f1d740ca240 2023-05-17T12:25:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.886+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 shutdown_connections 2023-05-17T12:25:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.886+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 >> 172.21.15.88:0/2619727771 conn(0x7f505c0d3ed0 msgr2=0x7f505c0b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.886+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 shutdown_connections 2023-05-17T12:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.886+0000 7f1d62ffd700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1d5406ade0 0x7f1d5406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.886+0000 7ff5767fc700 1 -- 172.21.15.88:0/736560138 <== osd.5 v2:172.21.15.187:6816/133779704 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff568002d40 con 0x7ff564074a80 2023-05-17T12:25:33.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7f50635ff700 1 -- 172.21.15.88:0/2619727771 wait complete. 2023-05-17T12:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6816/133779704,v1:172.21.15.187:6818/133779704] conn(0x7ff564074a80 msgr2=0x7ff564076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7ff587dff700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6816/133779704,v1:172.21.15.187:6818/133779704] conn(0x7ff564074a80 0x7ff564076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7f1d62ffd700 1 -- 172.21.15.88:0/2048296183 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1d6408ab00 con 0x7f1d740ca240 2023-05-17T12:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7f1d62ffd700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6817/3144907026,v1:172.21.15.187:6819/3144907026] conn(0x7f1d54074a30 0x7f1d54076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7f1d62ffd700 1 -- 172.21.15.88:0/2048296183 --> [v2:172.21.15.187:6817/3144907026,v1:172.21.15.187:6819/3144907026] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d54077530 con 0x7f1d54074a30 2023-05-17T12:25:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7f91d8ff9700 1 -- 172.21.15.88:0/1304390050 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91c4026480 con 0x7f91dc0b3450 2023-05-17T12:25:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff56406adb0 msgr2=0x7ff56406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7ff587dff700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff56406adb0 0x7ff56406d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009b60 tx=0x7ff57c00f000 comp rx=0 tx=0).stop 2023-05-17T12:25:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5800c1c70 msgr2=0x7ff5800c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7ff587dff700 1 --2- 172.21.15.88:0/736560138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5800c1c70 0x7ff5800c47f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff57800efc0 tx=0x7ff57800c3a0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7f1d7259c700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1d5406ade0 0x7f1d5406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7ff58639c700 1 -- 172.21.15.88:0/736560138 reap_dead start 2023-05-17T12:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.887+0000 7f1d72d9d700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6817/3144907026,v1:172.21.15.187:6819/3144907026] conn(0x7f1d54074a30 0x7f1d54076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.888+0000 7f1d62ffd700 1 -- 172.21.15.88:0/2048296183 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d64055d00 con 0x7f1d740ca240 2023-05-17T12:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.888+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 shutdown_connections 2023-05-17T12:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.888+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 >> 172.21.15.88:0/736560138 conn(0x7ff5800b1530 msgr2=0x7ff5800ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.888+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 shutdown_connections 2023-05-17T12:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.888+0000 7ff587dff700 1 -- 172.21.15.88:0/736560138 wait complete. 2023-05-17T12:25:33.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.888+0000 7f1d7259c700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1d5406ade0 0x7f1d5406d290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009be0 tx=0x7f1d68009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.889+0000 7f91d8ff9700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f91bc06adb0 0x7f91bc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.889+0000 7f91d8ff9700 1 -- 172.21.15.88:0/1304390050 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f91c4089fb0 con 0x7f91dc0b3450 2023-05-17T12:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.889+0000 7f91d8ff9700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6808/3991459512,v1:172.21.15.187:6809/3991459512] conn(0x7f91bc074a80 0x7f91bc076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.889+0000 7f91d8ff9700 1 -- 172.21.15.88:0/1304390050 --> [v2:172.21.15.187:6808/3991459512,v1:172.21.15.187:6809/3991459512] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91bc077580 con 0x7f91bc074a80 2023-05-17T12:25:33.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.889+0000 7f91d8ff9700 1 -- 172.21.15.88:0/1304390050 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91c408a360 con 0x7f91dc0b3450 2023-05-17T12:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.889+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 --> [v2:172.21.15.88:6808/3210201149,v1:172.21.15.88:6809/3210201149] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ed4159030 con 0x7f5eb8074a80 2023-05-17T12:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.890+0000 7f91db7fe700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f91bc06adb0 0x7f91bc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.890+0000 7f1d72d9d700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6817/3144907026,v1:172.21.15.187:6819/3144907026] conn(0x7f1d54074a30 0x7f1d54076e60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.890+0000 7f5ec9ffb700 1 -- 172.21.15.88:0/773252602 <== osd.2 v2:172.21.15.88:6808/3210201149 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ed4159030 con 0x7f5eb8074a80 2023-05-17T12:25:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.890+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 --> [v2:172.21.15.187:6800/2496559669,v1:172.21.15.187:6801/2496559669] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e24002d40 con 0x7f7e30074a30 2023-05-17T12:25:33.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f91dbfff700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6808/3991459512,v1:172.21.15.187:6809/3991459512] conn(0x7f91bc074a80 0x7f91bc076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f91db7fe700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f91bc06adb0 0x7f91bc06d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f91cc001330 tx=0x7f91cc006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 >> [v2:172.21.15.88:6808/3210201149,v1:172.21.15.88:6809/3210201149] conn(0x7f5eb8074a80 msgr2=0x7f5eb8076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f5edb7ff700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.88:6808/3210201149,v1:172.21.15.88:6809/3210201149] conn(0x7f5eb8074a80 0x7f5eb8076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f7e2bfff700 1 -- 172.21.15.88:0/36291453 <== osd.4 v2:172.21.15.187:6800/2496559669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e24002d40 con 0x7f7e30074a30 2023-05-17T12:25:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5eb806adb0 msgr2=0x7f5eb806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f5edb7ff700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5eb806adb0 0x7f5eb806d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4003df0 tx=0x7f5ec4007a40 comp rx=0 tx=0).stop 2023-05-17T12:25:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed40716f0 msgr2=0x7f5ed4202dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f5edb7ff700 1 --2- 172.21.15.88:0/773252602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ed40716f0 0x7f5ed4202dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c750 tx=0x7f5ed000cb10 comp rx=0 tx=0).stop 2023-05-17T12:25:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f5ed9d9c700 1 -- 172.21.15.88:0/773252602 reap_dead start 2023-05-17T12:25:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 shutdown_connections 2023-05-17T12:25:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.891+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 >> 172.21.15.88:0/773252602 conn(0x7f5ed40b1530 msgr2=0x7f5ed40ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.892+0000 7f91dbfff700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6808/3991459512,v1:172.21.15.187:6809/3991459512] conn(0x7f91bc074a80 0x7f91bc076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.892+0000 7f1d62ffd700 1 -- 172.21.15.88:0/2048296183 <== osd.6 v2:172.21.15.187:6817/3144907026 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1d54077530 con 0x7f1d54074a30 2023-05-17T12:25:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.892+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 shutdown_connections 2023-05-17T12:25:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.892+0000 7f5edb7ff700 1 -- 172.21.15.88:0/773252602 wait complete. 2023-05-17T12:25:33.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.893+0000 7f91d8ff9700 1 -- 172.21.15.88:0/1304390050 <== osd.7 v2:172.21.15.187:6808/3991459512 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f91bc077580 con 0x7f91bc074a80 2023-05-17T12:25:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.892+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6800/2496559669,v1:172.21.15.187:6801/2496559669] conn(0x7f7e30074a30 msgr2=0x7f7e30076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.892+0000 7f7e49dff700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6800/2496559669,v1:172.21.15.187:6801/2496559669] conn(0x7f7e30074a30 0x7f7e30076e60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.893+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7e3006ad60 msgr2=0x7f7e3006d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.893+0000 7f7e49dff700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7e3006ad60 0x7f7e3006d210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7e440cb5c0 tx=0x7f7e34009210 comp rx=0 tx=0).stop 2023-05-17T12:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.893+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c005200 msgr2=0x7f7e440c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.893+0000 7f7e49dff700 1 --2- 172.21.15.88:0/36291453 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e2c005200 0x7f7e440c8250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0013d0 tx=0x7f7e3c00e570 comp rx=0 tx=0).stop 2023-05-17T12:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.893+0000 7f7e43fff700 1 -- 172.21.15.88:0/36291453 reap_dead start 2023-05-17T12:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.893+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 shutdown_connections 2023-05-17T12:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.893+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 >> 172.21.15.88:0/36291453 conn(0x7f7e440b1530 msgr2=0x7f7e4406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.902+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 shutdown_connections 2023-05-17T12:25:33.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.902+0000 7f7e49dff700 1 -- 172.21.15.88:0/36291453 wait complete. 2023-05-17T12:25:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.903+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 --> [v2:172.21.15.88:6800/441996497,v1:172.21.15.88:6801/441996497] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff6a8002d40 con 0x7ff6a4074a80 2023-05-17T12:25:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.903+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 --> [v2:172.21.15.88:6816/2066173711,v1:172.21.15.88:6817/2066173711] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93b40ce810 con 0x7f93a0074a80 2023-05-17T12:25:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.904+0000 7ff6b67fc700 1 -- 172.21.15.88:0/3680110196 <== osd.0 v2:172.21.15.88:6800/441996497 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff6a8002d40 con 0x7ff6a4074a80 2023-05-17T12:25:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.906+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 >> [v2:172.21.15.88:6800/441996497,v1:172.21.15.88:6801/441996497] conn(0x7ff6a4074a80 msgr2=0x7ff6a4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.906+0000 7ff6c7bff700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.88:6800/441996497,v1:172.21.15.88:6801/441996497] conn(0x7ff6a4074a80 0x7ff6a4076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.906+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff6a406adb0 msgr2=0x7ff6a406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.906+0000 7ff6c7bff700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff6a406adb0 0x7ff6a406d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6c014f9c0 tx=0x7ff6b0008040 comp rx=0 tx=0).stop 2023-05-17T12:25:33.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.906+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c0070f70 msgr2=0x7ff6c0153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.906+0000 7ff6c7bff700 1 --2- 172.21.15.88:0/3680110196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c0070f70 0x7ff6c0153640 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800b370 tx=0x7ff6b8004ad0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.906+0000 7ff6c619c700 1 -- 172.21.15.88:0/3680110196 reap_dead start 2023-05-17T12:25:33.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.906+0000 7f93b17fa700 1 -- 172.21.15.88:0/3673116025 <== osd.1 v2:172.21.15.88:6816/2066173711 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93b40ce810 con 0x7f93a0074a80 2023-05-17T12:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.907+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 >> [v2:172.21.15.88:6816/2066173711,v1:172.21.15.88:6817/2066173711] conn(0x7f93a0074a80 msgr2=0x7f93a0076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.907+0000 7f93bafff700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.88:6816/2066173711,v1:172.21.15.88:6817/2066173711] conn(0x7f93a0074a80 0x7f93a0076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.907+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f93a006adb0 msgr2=0x7f93a006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.907+0000 7f93bafff700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f93a006adb0 0x7f93a006d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f93a80090b0 tx=0x7f93a8008030 comp rx=0 tx=0).stop 2023-05-17T12:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.907+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b406d080 msgr2=0x7f93b40bd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.907+0000 7f93bafff700 1 --2- 172.21.15.88:0/3673116025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b406d080 0x7f93b40bd910 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f93a400c550 tx=0x7f93a400c860 comp rx=0 tx=0).stop 2023-05-17T12:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.908+0000 7f93b959c700 1 -- 172.21.15.88:0/3673116025 reap_dead start 2023-05-17T12:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.908+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 shutdown_connections 2023-05-17T12:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.908+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 >> 172.21.15.88:0/3673116025 conn(0x7f93b40b1530 msgr2=0x7f93b40c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.908+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 shutdown_connections 2023-05-17T12:25:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.908+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 >> 172.21.15.88:0/3680110196 conn(0x7ff6c00b1530 msgr2=0x7ff6c00af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.909+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 shutdown_connections 2023-05-17T12:25:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.909+0000 7ff6c7bff700 1 -- 172.21.15.88:0/3680110196 wait complete. 2023-05-17T12:25:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.912+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 shutdown_connections 2023-05-17T12:25:33.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.915+0000 7f93bafff700 1 -- 172.21.15.88:0/3673116025 wait complete. 2023-05-17T12:25:33.971 INFO:teuthology.orchestra.run.smithi088.stdout:55834574861 2023-05-17T12:25:33.972 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-17T12:25:33.972 INFO:teuthology.orchestra.run.smithi088.stdout:55834574861 2023-05-17T12:25:33.973 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-17T12:25:33.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.921+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 --> [v2:172.21.15.187:6817/3144907026,v1:172.21.15.187:6819/3144907026] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d58002d40 con 0x7f1d54074a30 2023-05-17T12:25:33.974 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-05-17T12:25:33.974 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-17T12:25:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.922+0000 7f1d62ffd700 1 -- 172.21.15.88:0/2048296183 <== osd.6 v2:172.21.15.187:6817/3144907026 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d58002d40 con 0x7f1d54074a30 2023-05-17T12:25:33.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6817/3144907026,v1:172.21.15.187:6819/3144907026] conn(0x7f1d54074a30 msgr2=0x7f1d54076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6817/3144907026,v1:172.21.15.187:6819/3144907026] conn(0x7f1d54074a30 0x7f1d54076e60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1d5406ade0 msgr2=0x7f1d5406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1d5406ade0 0x7f1d5406d290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009be0 tx=0x7f1d68009210 comp rx=0 tx=0).stop 2023-05-17T12:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d740ca240 msgr2=0x7f1d7415ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 --2- 172.21.15.88:0/2048296183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d740ca240 0x7f1d7415ac70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0047d0 tx=0x7f1d64001930 comp rx=0 tx=0).stop 2023-05-17T12:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d72d9d700 1 -- 172.21.15.88:0/2048296183 reap_dead start 2023-05-17T12:25:33.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 shutdown_connections 2023-05-17T12:25:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 >> 172.21.15.88:0/2048296183 conn(0x7f1d740d3e60 msgr2=0x7f1d740b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 --> [v2:172.21.15.187:6808/3991459512,v1:172.21.15.187:6809/3991459512] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91dc0b5560 con 0x7f91bc074a80 2023-05-17T12:25:33.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 shutdown_connections 2023-05-17T12:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.923+0000 7f1d789ff700 1 -- 172.21.15.88:0/2048296183 wait complete. 2023-05-17T12:25:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.924+0000 7f91d8ff9700 1 -- 172.21.15.88:0/1304390050 <== osd.7 v2:172.21.15.187:6808/3991459512 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f91dc0b5560 con 0x7f91bc074a80 2023-05-17T12:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.924+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6808/3991459512,v1:172.21.15.187:6809/3991459512] conn(0x7f91bc074a80 msgr2=0x7f91bc076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.924+0000 7f91e21ff700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6808/3991459512,v1:172.21.15.187:6809/3991459512] conn(0x7f91bc074a80 0x7f91bc076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.924+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f91bc06adb0 msgr2=0x7f91bc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.924+0000 7f91e21ff700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f91bc06adb0 0x7f91bc06d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f91cc001330 tx=0x7f91cc006040 comp rx=0 tx=0).stop 2023-05-17T12:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.924+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91dc0b3450 msgr2=0x7f91dc0c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.924+0000 7f91e21ff700 1 --2- 172.21.15.88:0/1304390050 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91dc0b3450 0x7f91dc0c72a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91c400e9b0 tx=0x7f91c400ed70 comp rx=0 tx=0).stop 2023-05-17T12:25:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.924+0000 7f91dbfff700 1 -- 172.21.15.88:0/1304390050 reap_dead start 2023-05-17T12:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.925+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 shutdown_connections 2023-05-17T12:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.925+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 >> 172.21.15.88:0/1304390050 conn(0x7f91dc06e5a0 msgr2=0x7f91dc0afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.926+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 shutdown_connections 2023-05-17T12:25:33.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:33.926+0000 7f91e21ff700 1 -- 172.21.15.88:0/1304390050 wait complete. 2023-05-17T12:25:33.981 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-05-17T12:25:33.981 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-17T12:25:33.982 INFO:teuthology.orchestra.run.smithi088.stdout:55834574862 2023-05-17T12:25:33.982 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-17T12:25:33.983 INFO:teuthology.orchestra.run.smithi088.stdout:55834574861 2023-05-17T12:25:33.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-17T12:25:33.984 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-05-17T12:25:33.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-17T12:25:33.985 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-05-17T12:25:33.986 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-17T12:25:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.344+0000 7f2504bff700 1 Processor -- start 2023-05-17T12:25:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.344+0000 7f2504bff700 1 -- start start 2023-05-17T12:25:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.343+0000 7f92a17ff700 1 Processor -- start 2023-05-17T12:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.343+0000 7f92a17ff700 1 -- start start 2023-05-17T12:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.345+0000 7f92a17ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c0cd980 0x7f929c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.345+0000 7f92a17ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f929c071520 0x7f929c06a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.345+0000 7f92a17ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0ccc50 con 0x7f929c06d080 2023-05-17T12:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.345+0000 7f92a17ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c0cd560 con 0x7f929c071520 2023-05-17T12:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.345+0000 7f92a17ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c15a1c0 con 0x7f929c0cd980 2023-05-17T12:25:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.346+0000 7f929affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f929c06d080 0x7f929c06d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51964/0 (socket says 172.21.15.88:51964) 2023-05-17T12:25:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.346+0000 7f929affd700 1 -- 172.21.15.88:0/3698161728 learned_addr learned my addr 172.21.15.88:0/3698161728 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.348+0000 7f929b7fe700 1 --2- 172.21.15.88:0/3698161728 >> v2:172.21.15.187:3300/0 conn(0x7f929c071520 0x7f929c06a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.348+0000 7f929a7fc700 1 --2- 172.21.15.88:0/3698161728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c0cd980 0x7f929c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.349+0000 7f9299ffb700 1 -- 172.21.15.88:0/3698161728 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489130798 0 0) 0x7f929c0ccc50 con 0x7f929c06d080 2023-05-17T12:25:34.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.349+0000 7f9299ffb700 1 -- 172.21.15.88:0/3698161728 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92840057c0 con 0x7f929c06d080 2023-05-17T12:25:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.346+0000 7f2504bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f250006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.346+0000 7f2504bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f25000ced50 0x7f25000cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.346+0000 7f2504bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250006b370 con 0x7f25000d0d80 2023-05-17T12:25:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.346+0000 7f2504bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250006aee0 con 0x7f25000ced50 2023-05-17T12:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.346+0000 7f2504bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000cfaa0 con 0x7f250006c510 2023-05-17T12:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.347+0000 7f24fdd9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f25000ced50 0x7f25000cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.347+0000 7f24fdd9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f25000ced50 0x7f25000cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:48862/0 (socket says 172.21.15.88:48862) 2023-05-17T12:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.347+0000 7f24fdd9b700 1 -- 172.21.15.88:0/366011880 learned_addr learned my addr 172.21.15.88:0/366011880 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.347+0000 7f24fe59c700 1 --2- 172.21.15.88:0/366011880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f250006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.348+0000 7f24fe59c700 1 -- 172.21.15.88:0/366011880 >> v2:172.21.15.187:3300/0 conn(0x7f25000ced50 msgr2=0x7f25000cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.348+0000 7f24fe59c700 1 --2- 172.21.15.88:0/366011880 >> v2:172.21.15.187:3300/0 conn(0x7f25000ced50 0x7f25000cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.348+0000 7f24fe59c700 1 -- 172.21.15.88:0/366011880 >> v1:172.21.15.187:6789/0 conn(0x7f25000d0d80 legacy=0x7f25000d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.348+0000 7f24fe59c700 1 -- 172.21.15.88:0/366011880 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250006ce20 con 0x7f250006c510 2023-05-17T12:25:34.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.348+0000 7f24fe59c700 1 --2- 172.21.15.88:0/366011880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f250006c8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009840 tx=0x7f24f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1cb99da94980c39 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.349+0000 7f24fd59a700 1 -- 172.21.15.88:0/366011880 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0004230 con 0x7f250006c510 2023-05-17T12:25:34.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.349+0000 7f24fd59a700 1 -- 172.21.15.88:0/366011880 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f0004390 con 0x7f250006c510 2023-05-17T12:25:34.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.349+0000 7f24fd59a700 1 -- 172.21.15.88:0/366011880 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f00036a0 con 0x7f250006c510 2023-05-17T12:25:34.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.350+0000 7f2504bff700 1 -- 172.21.15.88:0/366011880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 msgr2=0x7f250006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.350+0000 7f2504bff700 1 --2- 172.21.15.88:0/366011880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f250006c8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009840 tx=0x7f24f0009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:34.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.351+0000 7f5f6b3ff700 1 Processor -- start 2023-05-17T12:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.351+0000 7f929b7fe700 1 -- 172.21.15.88:0/3698161728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c0cd980 msgr2=0x7f929c070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.351+0000 7f929b7fe700 1 --2- 172.21.15.88:0/3698161728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c0cd980 0x7f929c070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.351+0000 7f929b7fe700 1 -- 172.21.15.88:0/3698161728 >> v1:172.21.15.88:6789/0 conn(0x7f929c06d080 legacy=0x7f929c06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.351+0000 7f929b7fe700 1 -- 172.21.15.88:0/3698161728 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c071d10 con 0x7f929c071520 2023-05-17T12:25:34.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.352+0000 7f929b7fe700 1 --2- 172.21.15.88:0/3698161728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f929c071520 0x7f929c06a730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9294009cb0 tx=0x7f929400b050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27489c74830d82c5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.352+0000 7f5f6b3ff700 1 -- start start 2023-05-17T12:25:34.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.353+0000 7f2504bff700 1 -- 172.21.15.88:0/366011880 shutdown_connections 2023-05-17T12:25:34.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.353+0000 7f2504bff700 1 --2- 172.21.15.88:0/366011880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f250006c8e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.353+0000 7f2504bff700 1 --2- 172.21.15.88:0/366011880 >> v2:172.21.15.187:3300/0 conn(0x7f25000ced50 0x7f25000cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.353+0000 7f2504bff700 1 -- 172.21.15.88:0/366011880 >> 172.21.15.88:0/366011880 conn(0x7f25000d3ed0 msgr2=0x7f25000cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.353+0000 7f5f6b3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f64158db0 0x7f5f6406d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.353+0000 7f5f6b3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6406d5c0 0x7f5f64070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.354+0000 7f5f6b3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640ccc50 con 0x7f5f640cf460 2023-05-17T12:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.354+0000 7f5f6b3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f640cd560 con 0x7f5f64158db0 2023-05-17T12:25:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.354+0000 7f5f6b3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6415a1c0 con 0x7f5f6406d5c0 2023-05-17T12:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.354+0000 7f2504bff700 1 -- 172.21.15.88:0/366011880 shutdown_connections 2023-05-17T12:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.350+0000 7ff7377ff700 1 Processor -- start 2023-05-17T12:25:34.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.353+0000 7ff7377ff700 1 -- start start 2023-05-17T12:25:34.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.354+0000 7f2504bff700 1 -- 172.21.15.88:0/366011880 wait complete. 2023-05-17T12:25:34.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.354+0000 7f5f6899a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f64158db0 0x7f5f6406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.355+0000 7f5f6919b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5f640cf460 0x7f5f640cd980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51980/0 (socket says 172.21.15.88:51980) 2023-05-17T12:25:34.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.355+0000 7f5f6919b700 1 -- 172.21.15.88:0/1525831304 learned_addr learned my addr 172.21.15.88:0/1525831304 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:34.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.355+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242089511 0 0) 0x7f5f640ccc50 con 0x7f5f640cf460 2023-05-17T12:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.355+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f500035b0 con 0x7f5f640cf460 2023-05-17T12:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.355+0000 7ff7377ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff73016ab00 0x7ff73006d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.355+0000 7ff7377ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff73006a880 0x7ff73006ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.355+0000 7ff7377ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73006d990 con 0x7ff73006d080 2023-05-17T12:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.355+0000 7ff7377ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7300cf800 con 0x7ff73016ab00 2023-05-17T12:25:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.355+0000 7ff7377ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7300cd480 con 0x7ff73006a880 2023-05-17T12:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.356+0000 7f5f6999c700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6406d5c0 0x7f5f64070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.356+0000 7f9299ffb700 1 -- 172.21.15.88:0/3698161728 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929400b8e0 con 0x7f929c071520 2023-05-17T12:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.356+0000 7f9299ffb700 1 -- 172.21.15.88:0/3698161728 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929400ba40 con 0x7f929c071520 2023-05-17T12:25:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.356+0000 7f9299ffb700 1 -- 172.21.15.88:0/3698161728 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929400bdd0 con 0x7f929c071520 2023-05-17T12:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.356+0000 7ff73559b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ff73006d080 0x7ff730070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40894/0 (socket says 172.21.15.88:40894) 2023-05-17T12:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.356+0000 7ff73559b700 1 -- 172.21.15.88:0/76993561 learned_addr learned my addr 172.21.15.88:0/76993561 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.356+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2121192809 0 0) 0x7f5f500035b0 con 0x7f5f640cf460 2023-05-17T12:25:34.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6406d5c0 msgr2=0x7f5f64070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f6406d5c0 0x7f5f64070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 >> v2:172.21.15.88:3300/0 conn(0x7f5f64158db0 msgr2=0x7f5f6406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 --2- 172.21.15.88:0/1525831304 >> v2:172.21.15.88:3300/0 conn(0x7f5f64158db0 0x7f5f6406d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6406da00 con 0x7f5f640cf460 2023-05-17T12:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f5f60001670 con 0x7f5f640cf460 2023-05-17T12:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 >> v1:172.21.15.88:6789/0 conn(0x7f5f640cf460 legacy=0x7f5f640cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50003a30 0x7f5f50003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f50004850 0x7f5f50004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f50005200 0x7f5f5000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640cd560 con 0x7f5f50003a30 2023-05-17T12:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6415a1c0 con 0x7f5f50004850 2023-05-17T12:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5000bf80 con 0x7f5f50005200 2023-05-17T12:25:34.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f5f6899a700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f50004850 0x7f5f50004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f2504bff700 1 Processor -- start 2023-05-17T12:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.356+0000 7ff735d9c700 1 --2- 172.21.15.88:0/76993561 >> v2:172.21.15.187:3300/0 conn(0x7ff73006a880 0x7ff73006ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7ff734d9a700 1 --2- 172.21.15.88:0/76993561 >> v2:172.21.15.88:3300/0 conn(0x7ff73016ab00 0x7ff73006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.357+0000 7f2504bff700 1 -- start start 2023-05-17T12:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7f5f6919b700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50003a30 0x7f5f50003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7f5f6999c700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f50005200 0x7f5f5000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7f5f6899a700 1 -- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f50005200 msgr2=0x7f5f5000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7f5f6899a700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f50005200 0x7f5f5000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7f5f6899a700 1 -- 172.21.15.88:0/1525831304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50003a30 msgr2=0x7f5f50003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7f5f6899a700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50003a30 0x7f5f50003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7f5f6899a700 1 -- 172.21.15.88:0/1525831304 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6406da00 con 0x7f5f50004850 2023-05-17T12:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7f5f6899a700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f50004850 0x7f5f50004cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f540096f0 tx=0x7f5f50005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab93352fecfbfd6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7f2504bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f2500162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7f2504bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25000ced50 0x7f25001ff240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7f2504bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25000d0d80 0x7f25000b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7f2504bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000b5030 con 0x7f25000d0d80 2023-05-17T12:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7f2504bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2500162190 con 0x7f25000ced50 2023-05-17T12:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7f2504bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2500162a30 con 0x7f250006c510 2023-05-17T12:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7f92a17ff700 1 -- 172.21.15.88:0/3698161728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f929c071520 msgr2=0x7f929c06a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7f92a17ff700 1 --2- 172.21.15.88:0/3698161728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f929c071520 0x7f929c06a730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9294009cb0 tx=0x7f929400b050 comp rx=0 tx=0).stop 2023-05-17T12:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f92a17ff700 1 -- 172.21.15.88:0/3698161728 shutdown_connections 2023-05-17T12:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f92a17ff700 1 --2- 172.21.15.88:0/3698161728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f929c071520 0x7f929c06a730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f92a17ff700 1 --2- 172.21.15.88:0/3698161728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c0cd980 0x7f929c070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f92a17ff700 1 -- 172.21.15.88:0/3698161728 >> 172.21.15.88:0/3698161728 conn(0x7f929c0b1530 msgr2=0x7f929c0ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f24fdd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25000ced50 0x7f25001ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f24fe59c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f2500162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f24fdd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25000ced50 0x7f25001ff240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:48890/0 (socket says 172.21.15.88:48890) 2023-05-17T12:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f24fdd9b700 1 -- 172.21.15.88:0/3510850485 learned_addr learned my addr 172.21.15.88:0/3510850485 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f24fed9d700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25000d0d80 0x7f25000b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.361+0000 7f24fe59c700 1 -- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25000ced50 msgr2=0x7f25001ff240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.361+0000 7f24fe59c700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25000ced50 0x7f25001ff240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.361+0000 7f24fe59c700 1 -- 172.21.15.88:0/3510850485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25000d0d80 msgr2=0x7f25000b7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.361+0000 7f24fe59c700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25000d0d80 0x7f25000b7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.361+0000 7f24fe59c700 1 -- 172.21.15.88:0/3510850485 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f00094a0 con 0x7f250006c510 2023-05-17T12:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.361+0000 7f24fe59c700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f2500162ec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f24f0013000 tx=0x7f24f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f92a17ff700 1 -- 172.21.15.88:0/3698161728 shutdown_connections 2023-05-17T12:25:34.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7f92a17ff700 1 -- 172.21.15.88:0/3698161728 wait complete. 2023-05-17T12:25:34.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7ff735d9c700 1 -- 172.21.15.88:0/76993561 >> v2:172.21.15.88:3300/0 conn(0x7ff73016ab00 msgr2=0x7ff73006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7ff735d9c700 1 --2- 172.21.15.88:0/76993561 >> v2:172.21.15.88:3300/0 conn(0x7ff73016ab00 0x7ff73006d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7ff735d9c700 1 -- 172.21.15.88:0/76993561 >> v1:172.21.15.187:6789/0 conn(0x7ff73006d080 legacy=0x7ff730070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7ff735d9c700 1 -- 172.21.15.88:0/76993561 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7300cd760 con 0x7ff73006a880 2023-05-17T12:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7ff735d9c700 1 --2- 172.21.15.88:0/76993561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff73006a880 0x7ff73006ac80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7300723d0 tx=0x7ff72800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7173f18ea0217b4f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.358+0000 7ff727fff700 1 -- 172.21.15.88:0/76993561 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800e070 con 0x7ff73006a880 2023-05-17T12:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7ff727fff700 1 -- 172.21.15.88:0/76993561 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72800b9c0 con 0x7ff73006a880 2023-05-17T12:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.359+0000 7ff727fff700 1 -- 172.21.15.88:0/76993561 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800bd50 con 0x7ff73006a880 2023-05-17T12:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7ff7377ff700 1 -- 172.21.15.88:0/76993561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff73006a880 msgr2=0x7ff73006ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7ff7377ff700 1 --2- 172.21.15.88:0/76993561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff73006a880 0x7ff73006ac80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7300723d0 tx=0x7ff72800b330 comp rx=0 tx=0).stop 2023-05-17T12:25:34.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7ff7377ff700 1 -- 172.21.15.88:0/76993561 shutdown_connections 2023-05-17T12:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7ff7377ff700 1 --2- 172.21.15.88:0/76993561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff73006a880 0x7ff73006ac80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7ff7377ff700 1 --2- 172.21.15.88:0/76993561 >> v2:172.21.15.88:3300/0 conn(0x7ff73016ab00 0x7ff73006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.360+0000 7ff7377ff700 1 -- 172.21.15.88:0/76993561 >> 172.21.15.88:0/76993561 conn(0x7ff7300b1530 msgr2=0x7ff7300ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.362+0000 7ff7377ff700 1 -- 172.21.15.88:0/76993561 shutdown_connections 2023-05-17T12:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.362+0000 7ff7377ff700 1 -- 172.21.15.88:0/76993561 wait complete. 2023-05-17T12:25:34.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.364+0000 7f92a17ff700 1 Processor -- start 2023-05-17T12:25:34.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.365+0000 7ff6417ff700 1 Processor -- start 2023-05-17T12:25:34.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.364+0000 7f92a17ff700 1 -- start start 2023-05-17T12:25:34.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7f92a17ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f929c06d080 0x7f929c0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7f92a17ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c071520 0x7f929c156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7f92a17ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f929c0cd980 0x7f929c1f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7f92a17ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0c7430 con 0x7f929c0cd980 2023-05-17T12:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7f92a17ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0c7710 con 0x7f929c06d080 2023-05-17T12:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7f92a17ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0c79f0 con 0x7f929c071520 2023-05-17T12:25:34.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.365+0000 7ff6417ff700 1 -- start start 2023-05-17T12:25:34.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7ff6417ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff63c0cd800 0x7ff63c160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7ff6417ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c0cdc00 con 0x7ff63c06cc20 2023-05-17T12:25:34.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7ff6417ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c0cde90 con 0x7ff63c15ca90 2023-05-17T12:25:34.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.366+0000 7ff6417ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63c1614d0 con 0x7ff63c0cd800 2023-05-17T12:25:34.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7f24eeffd700 1 -- 172.21.15.88:0/3510850485 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f00045c0 con 0x7f250006c510 2023-05-17T12:25:34.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7f24eeffd700 1 -- 172.21.15.88:0/3510850485 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f0011630 con 0x7f250006c510 2023-05-17T12:25:34.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7f24eeffd700 1 -- 172.21.15.88:0/3510850485 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0011a00 con 0x7f250006c510 2023-05-17T12:25:34.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.365+0000 7ff7377ff700 1 Processor -- start 2023-05-17T12:25:34.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.365+0000 7ff7377ff700 1 -- start start 2023-05-17T12:25:34.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff7377ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff73006a880 0x7ff7300bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff7377ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff73006d080 0x7ff7300c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff7377ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff73016ab00 0x7ff730162980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff7377ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300c8e80 con 0x7ff73016ab00 2023-05-17T12:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff7377ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff730161c00 con 0x7ff73006a880 2023-05-17T12:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff7377ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300bdc10 con 0x7ff73006d080 2023-05-17T12:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff734d9a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff73006d080 0x7ff7300c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff734d9a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff73006d080 0x7ff7300c0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:36066/0 (socket says 172.21.15.88:36066) 2023-05-17T12:25:34.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff734d9a700 1 -- 172.21.15.88:0/2002992396 learned_addr learned my addr 172.21.15.88:0/2002992396 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff73559b700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff73006a880 0x7ff7300bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff63b7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff63c0cd800 0x7ff63c160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff63b7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff63c0cd800 0x7ff63c160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:48918/0 (socket says 172.21.15.88:48918) 2023-05-17T12:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7ff63b7fe700 1 -- 172.21.15.88:0/4036414334 learned_addr learned my addr 172.21.15.88:0/4036414334 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5400e6c0 con 0x7f5f50004850 2023-05-17T12:25:34.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5400e820 con 0x7f5f50004850 2023-05-17T12:25:34.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.367+0000 7f5f5bfff700 1 -- 172.21.15.88:0/1525831304 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5400ebb0 con 0x7f5f50004850 2023-05-17T12:25:34.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f50004850 msgr2=0x7f5f50004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f5f6b3ff700 1 --2- 172.21.15.88:0/1525831304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f50004850 0x7f5f50004cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f540096f0 tx=0x7f5f50005880 comp rx=0 tx=0).stop 2023-05-17T12:25:34.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f5f6999c700 1 -- 172.21.15.88:0/1525831304 reap_dead start 2023-05-17T12:25:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250006a890 con 0x7f250006c510 2023-05-17T12:25:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250006a5b0 con 0x7f250006c510 2023-05-17T12:25:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7ff734d9a700 1 -- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff73006a880 msgr2=0x7ff7300bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7ff734d9a700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff73006a880 0x7ff7300bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7ff734d9a700 1 -- 172.21.15.88:0/2002992396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff73016ab00 msgr2=0x7ff730162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7ff734d9a700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff73016ab00 0x7ff730162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7ff734d9a700 1 -- 172.21.15.88:0/2002992396 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff728009a70 con 0x7ff73006d080 2023-05-17T12:25:34.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7ff734d9a700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff73006d080 0x7ff7300c0da0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff72000dd10 tx=0x7ff720009400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/1525831304 shutdown_connections 2023-05-17T12:25:34.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/1525831304 >> 172.21.15.88:0/1525831304 conn(0x7f5f640b1530 msgr2=0x7f5f640ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f929c0cd980 0x7f929c1f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929a7fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c071520 0x7f929c156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f929c0cd980 0x7f929c1f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37418/0 (socket says 172.21.15.88:37418) 2023-05-17T12:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929b7fe700 1 -- 172.21.15.88:0/2715363151 learned_addr learned my addr 172.21.15.88:0/2715363151 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929a7fc700 1 -- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f929c06d080 msgr2=0x7f929c0c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929a7fc700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f929c06d080 0x7f929c0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929a7fc700 1 -- 172.21.15.88:0/2715363151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f929c0cd980 msgr2=0x7f929c1f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929a7fc700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f929c0cd980 0x7f929c1f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929a7fc700 1 -- 172.21.15.88:0/2715363151 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929400d040 con 0x7f929c071520 2023-05-17T12:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.368+0000 7f929b7fe700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f929c0cd980 0x7f929c1f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7f929a7fc700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c071520 0x7f929c156f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f928c00d5c0 tx=0x7f928c00d8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847113184 0 0) 0x7ff63c0cdc00 con 0x7ff63c06cc20 2023-05-17T12:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6240035b0 con 0x7ff63c06cc20 2023-05-17T12:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1127087828 0 0) 0x7ff6240035b0 con 0x7ff63c06cc20 2023-05-17T12:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 >> v2:172.21.15.187:3300/0 conn(0x7ff63c0cd800 msgr2=0x7ff63c160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 --2- 172.21.15.88:0/4036414334 >> v2:172.21.15.187:3300/0 conn(0x7ff63c0cd800 0x7ff63c160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 >> v1:172.21.15.187:6789/0 conn(0x7ff63c15ca90 legacy=0x7ff63c06c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c15d270 con 0x7ff63c06cc20 2023-05-17T12:25:34.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7ff630001670 con 0x7ff63c06cc20 2023-05-17T12:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 >> v1:172.21.15.88:6789/0 conn(0x7ff63c06cc20 legacy=0x7ff63c0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff624003a00 0x7ff624003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff624004850 0x7ff624004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624005200 0x7ff62400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c1614d0 con 0x7ff624004850 2023-05-17T12:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400c080 con 0x7ff624003a00 2023-05-17T12:25:34.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62400c240 con 0x7ff624005200 2023-05-17T12:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7f92837fe700 1 -- 172.21.15.88:0/2715363151 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c0125f0 con 0x7f929c071520 2023-05-17T12:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7f92837fe700 1 -- 172.21.15.88:0/2715363151 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c012750 con 0x7f929c071520 2023-05-17T12:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7f92837fe700 1 -- 172.21.15.88:0/2715363151 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c012ac0 con 0x7f929c071520 2023-05-17T12:25:34.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.370+0000 7ff63affd700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff624003a00 0x7ff624003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.370+0000 7ff63a7fc700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff624004850 0x7ff624004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.372+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e40052f0 con 0x7f250006c510 2023-05-17T12:25:34.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.371+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c0cd180 con 0x7f929c071520 2023-05-17T12:25:34.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.371+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c0ccea0 con 0x7f929c071520 2023-05-17T12:25:34.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff725ffb700 1 -- 172.21.15.88:0/2002992396 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000b1c0 con 0x7ff73006d080 2023-05-17T12:25:34.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff725ffb700 1 -- 172.21.15.88:0/2002992396 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff720009a10 con 0x7ff73006d080 2023-05-17T12:25:34.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff725ffb700 1 -- 172.21.15.88:0/2002992396 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720009dc0 con 0x7ff73006d080 2023-05-17T12:25:34.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73016af80 con 0x7ff73006d080 2023-05-17T12:25:34.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.369+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7300cda40 con 0x7ff73006d080 2023-05-17T12:25:34.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.371+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff730089c40 con 0x7ff73006d080 2023-05-17T12:25:34.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.371+0000 7ff63a7fc700 1 -- 172.21.15.88:0/4036414334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624005200 msgr2=0x7ff62400ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:34.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.371+0000 7ff63a7fc700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624005200 0x7ff62400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.371+0000 7ff63a7fc700 1 -- 172.21.15.88:0/4036414334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff624003a00 msgr2=0x7ff624003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.371+0000 7ff63a7fc700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff624003a00 0x7ff624003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.371+0000 7ff63a7fc700 1 -- 172.21.15.88:0/4036414334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c15d270 con 0x7ff624004850 2023-05-17T12:25:34.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.372+0000 7ff63b7fe700 1 -- 172.21.15.88:0/4036414334 reap_dead start 2023-05-17T12:25:34.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.372+0000 7ff63a7fc700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff624004850 0x7ff624004cc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c190 tx=0x7ff624005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc784ea4ab38c2e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.373+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/1525831304 shutdown_connections 2023-05-17T12:25:34.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.372+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c071960 con 0x7f929c071520 2023-05-17T12:25:34.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.373+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000cd30 con 0x7ff624004850 2023-05-17T12:25:34.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.373+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63000ce90 con 0x7ff624004850 2023-05-17T12:25:34.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.373+0000 7ff639ffb700 1 -- 172.21.15.88:0/4036414334 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630012660 con 0x7ff624004850 2023-05-17T12:25:34.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.374+0000 7ff6417ff700 1 -- 172.21.15.88:0/4036414334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff624004850 msgr2=0x7ff624004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.374+0000 7ff6417ff700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff624004850 0x7ff624004cc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff63000c190 tx=0x7ff624005880 comp rx=0 tx=0).stop 2023-05-17T12:25:34.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.374+0000 7ff6417ff700 1 -- 172.21.15.88:0/4036414334 shutdown_connections 2023-05-17T12:25:34.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.374+0000 7ff6417ff700 1 --2- 172.21.15.88:0/4036414334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff624004850 0x7ff624004cc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.374+0000 7ff6417ff700 1 -- 172.21.15.88:0/4036414334 >> 172.21.15.88:0/4036414334 conn(0x7ff63c0d3ed0 msgr2=0x7ff63c0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.374+0000 7ff6417ff700 1 -- 172.21.15.88:0/4036414334 shutdown_connections 2023-05-17T12:25:34.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.372+0000 7faa18bff700 1 Processor -- start 2023-05-17T12:25:34.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.374+0000 7f24eeffd700 1 -- 172.21.15.88:0/3510850485 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24f0018040 con 0x7f250006c510 2023-05-17T12:25:34.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.375+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/1525831304 wait complete. 2023-05-17T12:25:34.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.373+0000 7faa18bff700 1 -- start start 2023-05-17T12:25:34.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.375+0000 7faa18bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faa1406d080 0x7faa1406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.375+0000 7faa18bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa140716f0 0x7faa1406a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.375+0000 7faa18bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa140ccc50 con 0x7faa140cd980 2023-05-17T12:25:34.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.375+0000 7faa18bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa140cd560 con 0x7faa1406d080 2023-05-17T12:25:34.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.375+0000 7faa18bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa14071b10 con 0x7faa140716f0 2023-05-17T12:25:34.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7faa12d9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa140716f0 0x7faa1406a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7faa12d9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa140716f0 0x7faa1406a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:36088/0 (socket says 172.21.15.88:36088) 2023-05-17T12:25:34.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7faa12d9d700 1 -- 172.21.15.88:0/2476153961 learned_addr learned my addr 172.21.15.88:0/2476153961 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7f24eeffd700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f24e006adb0 0x7f24e006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7f24eeffd700 1 -- 172.21.15.88:0/3510850485 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f24f008ab30 con 0x7f250006c510 2023-05-17T12:25:34.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.373+0000 7fc0915ff700 1 Processor -- start 2023-05-17T12:25:34.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.373+0000 7fc0915ff700 1 -- start start 2023-05-17T12:25:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7faa12d9d700 1 -- 172.21.15.88:0/2476153961 >> v2:172.21.15.187:3300/0 conn(0x7faa1406d080 msgr2=0x7faa1406d450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T12:25:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7faa12d9d700 1 --2- 172.21.15.88:0/2476153961 >> v2:172.21.15.187:3300/0 conn(0x7faa1406d080 0x7faa1406d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7faa12d9d700 1 -- 172.21.15.88:0/2476153961 >> v1:172.21.15.88:6789/0 conn(0x7faa140cd980 legacy=0x7faa14070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7faa12d9d700 1 -- 172.21.15.88:0/2476153961 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1406d990 con 0x7faa140716f0 2023-05-17T12:25:34.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.374+0000 7ff725ffb700 1 -- 172.21.15.88:0/2002992396 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff720005a20 con 0x7ff73006d080 2023-05-17T12:25:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7ff725ffb700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff71406adb0 0x7ff71406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7ff725ffb700 1 -- 172.21.15.88:0/2002992396 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff720089e20 con 0x7ff73006d080 2023-05-17T12:25:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.375+0000 7fc0915ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc08c161050 0x7fc08c161420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.375+0000 7fc0915ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c06a510 0x7fc08c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7fc0915ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc08c06d080 0x7fc08c06d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7fc0915ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c06da40 con 0x7fc08c06d080 2023-05-17T12:25:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7fc0915ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c162680 con 0x7fc08c161050 2023-05-17T12:25:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7fc0915ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c161b00 con 0x7fc08c06a510 2023-05-17T12:25:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7fc08a7fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c06a510 0x7fc08c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7fc08a7fc700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c06a510 0x7fc08c0caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:36104/0 (socket says 172.21.15.88:36104) 2023-05-17T12:25:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7fc08a7fc700 1 -- 172.21.15.88:0/4220125153 learned_addr learned my addr 172.21.15.88:0/4220125153 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7fc08b7fe700 1 --2- 172.21.15.88:0/4220125153 >> v2:172.21.15.88:3300/0 conn(0x7fc08c06d080 0x7fc08c06d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7f24fdd9b700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f24e006adb0 0x7f24e006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.374+0000 7ff6417ff700 1 -- 172.21.15.88:0/4036414334 wait complete. 2023-05-17T12:25:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7f5f6b3ff700 1 Processor -- start 2023-05-17T12:25:34.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.378+0000 7f5f6b3ff700 1 -- start start 2023-05-17T12:25:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.375+0000 7f92837fe700 1 -- 172.21.15.88:0/2715363151 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f928c012c20 con 0x7f929c071520 2023-05-17T12:25:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.376+0000 7f92837fe700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f928806ad30 0x7f928806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7f929affd700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f928806ad30 0x7f928806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.378+0000 7f929affd700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f928806ad30 0x7f928806d1e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92900061a0 tx=0x7f9290005ae0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7ff73559b700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff71406adb0 0x7ff71406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7ff6417ff700 1 Processor -- start 2023-05-17T12:25:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7fc08affd700 1 --2- 172.21.15.88:0/4220125153 >> v2:172.21.15.187:3300/0 conn(0x7fc08c161050 0x7fc08c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7fc08a7fc700 1 -- 172.21.15.88:0/4220125153 >> v2:172.21.15.187:3300/0 conn(0x7fc08c161050 msgr2=0x7fc08c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7fc08a7fc700 1 --2- 172.21.15.88:0/4220125153 >> v2:172.21.15.187:3300/0 conn(0x7fc08c161050 0x7fc08c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7fc08a7fc700 1 -- 172.21.15.88:0/4220125153 >> v2:172.21.15.88:3300/0 conn(0x7fc08c06d080 msgr2=0x7fc08c06d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7fc08a7fc700 1 --2- 172.21.15.88:0/4220125153 >> v2:172.21.15.88:3300/0 conn(0x7fc08c06d080 0x7fc08c06d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7fc08a7fc700 1 -- 172.21.15.88:0/4220125153 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c161de0 con 0x7fc08c06a510 2023-05-17T12:25:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7fc08affd700 1 --2- 172.21.15.88:0/4220125153 >> v2:172.21.15.187:3300/0 conn(0x7fc08c161050 0x7fc08c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:34.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.378+0000 7faa12d9d700 1 --2- 172.21.15.88:0/2476153961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa140716f0 0x7faa1406a730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0088f0 tx=0x7faa0c00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea29e4912016073e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7fa8fafff700 1 Processor -- start 2023-05-17T12:25:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7fa8fafff700 1 -- start start 2023-05-17T12:25:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.378+0000 7ff73559b700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff71406adb0 0x7ff71406d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00a510 tx=0x7ff72c00a4a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.378+0000 7f24fdd9b700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f24e006adb0 0x7f24e006d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2500202cf0 tx=0x7f24f40092c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.378+0000 7f92837fe700 1 -- 172.21.15.88:0/2715363151 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f928c05c600 con 0x7f929c071520 2023-05-17T12:25:34.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.378+0000 7ff725ffb700 1 -- 172.21.15.88:0/2002992396 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff720054c50 con 0x7ff73006d080 2023-05-17T12:25:34.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.378+0000 7fc08a7fc700 1 --2- 172.21.15.88:0/4220125153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c06a510 0x7fc08c0caf10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0676e0 tx=0x7fc08400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e165579f8325abf1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.377+0000 7ff6417ff700 1 -- start start 2023-05-17T12:25:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff6417ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624004850 0x7ff63c0a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff6417ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63c1f2450 0x7ff63c156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff6417ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c1f60c0 0x7ff63c1f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff6417ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c1f3460 con 0x7ff63c1f60c0 2023-05-17T12:25:34.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff6417ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c1f5c30 con 0x7ff63c1f2450 2023-05-17T12:25:34.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff6417ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c1f2bc0 con 0x7ff624004850 2023-05-17T12:25:34.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7f5f6b3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50004850 0x7f5f64151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff63affd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624004850 0x7ff63c0a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff63affd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624004850 0x7ff63c0a9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:36108/0 (socket says 172.21.15.88:36108) 2023-05-17T12:25:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff63affd700 1 -- 172.21.15.88:0/44325415 learned_addr learned my addr 172.21.15.88:0/44325415 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7f5f6b3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f64152260 0x7f5f640c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7f5f6b3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f640bd910 0x7f5f640bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7f5f6b3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640be2d0 con 0x7f5f50004850 2023-05-17T12:25:34.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7f5f6b3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640c4560 con 0x7f5f640bd910 2023-05-17T12:25:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7f5f6b3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640c3950 con 0x7f5f64152260 2023-05-17T12:25:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.379+0000 7ff63a7fc700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63c1f2450 0x7ff63c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7ff63b7fe700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c1f60c0 0x7ff63c1f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7fa8fafff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8f406c440 0x7fa8f406c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7fa8fafff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 0x7fa8f40d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7fa8fafff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f40d2e70 con 0x7fa8f40d2580 2023-05-17T12:25:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7fa8fafff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f4162260 con 0x7fa8f406c440 2023-05-17T12:25:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7fa8fafff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f40cfa60 con 0x7fa8f40d29f0 2023-05-17T12:25:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7f5f6899a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f64152260 0x7f5f640c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7f5f6919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50004850 0x7f5f64151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7f5f6919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50004850 0x7f5f64151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37474/0 (socket says 172.21.15.88:37474) 2023-05-17T12:25:34.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7f5f6919b700 1 -- 172.21.15.88:0/842853667 learned_addr learned my addr 172.21.15.88:0/842853667 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7ff63affd700 1 -- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63c1f2450 msgr2=0x7ff63c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7ff63affd700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63c1f2450 0x7ff63c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7ff63affd700 1 -- 172.21.15.88:0/44325415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c1f60c0 msgr2=0x7ff63c1f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7ff63affd700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c1f60c0 0x7ff63c1f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7ff63affd700 1 -- 172.21.15.88:0/44325415 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c15d830 con 0x7ff624004850 2023-05-17T12:25:34.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7fa8f8d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8f406c440 0x7fa8f406c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7fa8ebfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa8f40d2580 0x7fa8f40d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52008/0 (socket says 172.21.15.88:52008) 2023-05-17T12:25:34.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.380+0000 7fa8ebfff700 1 -- 172.21.15.88:0/2249841264 learned_addr learned my addr 172.21.15.88:0/2249841264 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:34.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7fa8f959c700 1 --2- 172.21.15.88:0/2249841264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 0x7fa8f40d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7f5f6999c700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f640bd910 0x7f5f640bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7ff63affd700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624004850 0x7ff63c0a9e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00f7f0 tx=0x7ff62c00fb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7f5f6919b700 1 -- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f64152260 msgr2=0x7f5f640c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7f5f6919b700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f64152260 0x7f5f640c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7f5f6919b700 1 -- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f640bd910 msgr2=0x7f5f640bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7f5f6919b700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f640bd910 0x7f5f640bdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7f5f6919b700 1 -- 172.21.15.88:0/842853667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640ccea0 con 0x7f5f50004850 2023-05-17T12:25:34.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7fa8f8d9b700 1 -- 172.21.15.88:0/2249841264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 msgr2=0x7fa8f40d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:34.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7fa8f8d9b700 1 --2- 172.21.15.88:0/2249841264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 0x7fa8f40d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7fa8f8d9b700 1 -- 172.21.15.88:0/2249841264 >> v1:172.21.15.88:6789/0 conn(0x7fa8f40d2580 legacy=0x7fa8f40d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7fa8f8d9b700 1 -- 172.21.15.88:0/2249841264 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f406cd50 con 0x7fa8f406c440 2023-05-17T12:25:34.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7f5f6919b700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50004850 0x7f5f64151930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000eb40 tx=0x7f5f6000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.381+0000 7fa8f8d9b700 1 --2- 172.21.15.88:0/2249841264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 0x7fa8f406c810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009840 tx=0x7fa8e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944ba8c0953baccd server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.382+0000 7f5f59ffb700 1 -- 172.21.15.88:0/842853667 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60005e00 con 0x7f5f50004850 2023-05-17T12:25:34.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.382+0000 7f5f59ffb700 1 -- 172.21.15.88:0/842853667 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6000c7e0 con 0x7f5f50004850 2023-05-17T12:25:34.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.382+0000 7f5f59ffb700 1 -- 172.21.15.88:0/842853667 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000cb50 con 0x7f5f50004850 2023-05-17T12:25:34.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.382+0000 7fa8eb7fe700 1 -- 172.21.15.88:0/2249841264 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4011830 con 0x7fa8f406c440 2023-05-17T12:25:34.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.382+0000 7fa8eb7fe700 1 -- 172.21.15.88:0/2249841264 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4011990 con 0x7fa8f406c440 2023-05-17T12:25:34.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.382+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f64071d10 con 0x7f5f50004850 2023-05-17T12:25:34.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.382+0000 7fa8eb7fe700 1 -- 172.21.15.88:0/2249841264 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4011d20 con 0x7fa8f406c440 2023-05-17T12:25:34.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.382+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f640cd180 con 0x7f5f50004850 2023-05-17T12:25:34.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.383+0000 7fa8fafff700 1 -- 172.21.15.88:0/2249841264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 msgr2=0x7fa8f406c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.383+0000 7fa8fafff700 1 --2- 172.21.15.88:0/2249841264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 0x7fa8f406c810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009840 tx=0x7fa8e4009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:34.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.383+0000 7fa8fafff700 1 -- 172.21.15.88:0/2249841264 shutdown_connections 2023-05-17T12:25:34.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.383+0000 7fa8fafff700 1 --2- 172.21.15.88:0/2249841264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 0x7fa8f40d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.383+0000 7fa8fafff700 1 --2- 172.21.15.88:0/2249841264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 0x7fa8f406c810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.383+0000 7fa8fafff700 1 -- 172.21.15.88:0/2249841264 >> 172.21.15.88:0/2249841264 conn(0x7fa8f40d3e60 msgr2=0x7fa8f40cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.383+0000 7fa8fafff700 1 -- 172.21.15.88:0/2249841264 shutdown_connections 2023-05-17T12:25:34.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.383+0000 7fa8fafff700 1 -- 172.21.15.88:0/2249841264 wait complete. 2023-05-17T12:25:34.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.384+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f640c8ec0 con 0x7f5f50004850 2023-05-17T12:25:34.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.384+0000 7f24eeffd700 1 -- 172.21.15.88:0/3510850485 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f24f0055a80 con 0x7f250006c510 2023-05-17T12:25:34.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.385+0000 7f5f59ffb700 1 -- 172.21.15.88:0/842853667 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f6000ccb0 con 0x7f5f50004850 2023-05-17T12:25:34.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.385+0000 7fa8fafff700 1 Processor -- start 2023-05-17T12:25:34.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.386+0000 7fa8fafff700 1 -- start start 2023-05-17T12:25:34.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.386+0000 7f5f59ffb700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4806ad30 0x7f5f4806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.386+0000 7f5f59ffb700 1 -- 172.21.15.88:0/842853667 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f60089eb0 con 0x7f5f50004850 2023-05-17T12:25:34.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.386+0000 7f5f6899a700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4806ad30 0x7f5f4806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8fafff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 0x7fa8f4153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8fafff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8f40d2580 0x7fa8f41ea470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8fafff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 0x7fa8f40ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8fafff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f41ea9b0 con 0x7fa8f406c440 2023-05-17T12:25:34.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8fafff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f41f6bb0 con 0x7fa8f40d2580 2023-05-17T12:25:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8fafff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f415b380 con 0x7fa8f40d29f0 2023-05-17T12:25:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8f8d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 0x7fa8f4153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8f8d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 0x7fa8f4153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37494/0 (socket says 172.21.15.88:37494) 2023-05-17T12:25:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8f8d9b700 1 -- 172.21.15.88:0/3947764241 learned_addr learned my addr 172.21.15.88:0/3947764241 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8ebfff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8f40d2580 0x7fa8f41ea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.387+0000 7fa8f959c700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 0x7fa8f40ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7f5f6899a700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4806ad30 0x7f5f4806d1e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f64152630 tx=0x7f5f54017000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8ebfff700 1 -- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 msgr2=0x7fa8f40ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8ebfff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 0x7fa8f40ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8ebfff700 1 -- 172.21.15.88:0/3947764241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 msgr2=0x7fa8f4153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8ebfff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 0x7fa8f4153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8ebfff700 1 -- 172.21.15.88:0/3947764241 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40094a0 con 0x7fa8f40d2580 2023-05-17T12:25:34.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8ebfff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8f40d2580 0x7fa8f41ea470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000cae0 tx=0x7fa8f000cdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8e97fa700 1 -- 172.21.15.88:0/3947764241 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000a9e0 con 0x7fa8f40d2580 2023-05-17T12:25:34.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8e97fa700 1 -- 172.21.15.88:0/3947764241 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f000ab40 con 0x7fa8f40d2580 2023-05-17T12:25:34.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8e97fa700 1 -- 172.21.15.88:0/3947764241 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0012400 con 0x7fa8f40d2580 2023-05-17T12:25:34.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.388+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f406a970 con 0x7fa8f40d2580 2023-05-17T12:25:34.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.389+0000 7ff6237fe700 1 -- 172.21.15.88:0/44325415 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0052e0 con 0x7ff624004850 2023-05-17T12:25:34.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7ff6237fe700 1 -- 172.21.15.88:0/44325415 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c005440 con 0x7ff624004850 2023-05-17T12:25:34.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7ff6237fe700 1 -- 172.21.15.88:0/44325415 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0038c0 con 0x7ff624004850 2023-05-17T12:25:34.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c15d550 con 0x7ff624004850 2023-05-17T12:25:34.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c15dd50 con 0x7ff624004850 2023-05-17T12:25:34.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7faa1159a700 1 -- 172.21.15.88:0/2476153961 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c010070 con 0x7faa140716f0 2023-05-17T12:25:34.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7faa1159a700 1 -- 172.21.15.88:0/2476153961 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c00da40 con 0x7faa140716f0 2023-05-17T12:25:34.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7faa1159a700 1 -- 172.21.15.88:0/2476153961 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00ddd0 con 0x7faa140716f0 2023-05-17T12:25:34.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.389+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f406a690 con 0x7fa8f40d2580 2023-05-17T12:25:34.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f406ac50 con 0x7fa8f40d2580 2023-05-17T12:25:34.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.389+0000 7fc089ffb700 1 -- 172.21.15.88:0/4220125153 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400e070 con 0x7fc08c06a510 2023-05-17T12:25:34.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.389+0000 7fc089ffb700 1 -- 172.21.15.88:0/4220125153 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400b910 con 0x7fc08c06a510 2023-05-17T12:25:34.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.389+0000 7fc089ffb700 1 -- 172.21.15.88:0/4220125153 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400bcc0 con 0x7fc08c06a510 2023-05-17T12:25:34.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7fc0915ff700 1 -- 172.21.15.88:0/4220125153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c06a510 msgr2=0x7fc08c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4220125153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c06a510 0x7fc08c0caf10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0676e0 tx=0x7fc08400b330 comp rx=0 tx=0).stop 2023-05-17T12:25:34.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7fc0915ff700 1 -- 172.21.15.88:0/4220125153 shutdown_connections 2023-05-17T12:25:34.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4220125153 >> v2:172.21.15.187:3300/0 conn(0x7fc08c161050 0x7fc08c161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4220125153 >> v2:172.21.15.88:3300/0 conn(0x7fc08c06d080 0x7fc08c06d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4220125153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c06a510 0x7fc08c0caf10 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0676e0 tx=0x7fc08400b330 comp rx=0 tx=0).stop 2023-05-17T12:25:34.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7fc0915ff700 1 -- 172.21.15.88:0/4220125153 >> 172.21.15.88:0/4220125153 conn(0x7fc08c0b1530 msgr2=0x7fc08c0ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.391+0000 7fc0915ff700 1 -- 172.21.15.88:0/4220125153 shutdown_connections 2023-05-17T12:25:34.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.391+0000 7fc0915ff700 1 -- 172.21.15.88:0/4220125153 wait complete. 2023-05-17T12:25:34.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.391+0000 7faa18bff700 1 -- 172.21.15.88:0/2476153961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa140716f0 msgr2=0x7faa1406a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.391+0000 7faa18bff700 1 --2- 172.21.15.88:0/2476153961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa140716f0 0x7faa1406a730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0088f0 tx=0x7faa0c00d330 comp rx=0 tx=0).stop 2023-05-17T12:25:34.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.392+0000 7faa18bff700 1 -- 172.21.15.88:0/2476153961 shutdown_connections 2023-05-17T12:25:34.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.392+0000 7faa18bff700 1 --2- 172.21.15.88:0/2476153961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa140716f0 0x7faa1406a730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.392+0000 7faa18bff700 1 --2- 172.21.15.88:0/2476153961 >> v2:172.21.15.187:3300/0 conn(0x7faa1406d080 0x7faa1406d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.392+0000 7faa18bff700 1 -- 172.21.15.88:0/2476153961 >> 172.21.15.88:0/2476153961 conn(0x7faa140b1530 msgr2=0x7faa140ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.393+0000 7faa18bff700 1 -- 172.21.15.88:0/2476153961 shutdown_connections 2023-05-17T12:25:34.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.390+0000 7f92837fe700 1 -- 172.21.15.88:0/2715363151 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f928c054980 con 0x7f929c071520 2023-05-17T12:25:34.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.394+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c0052f0 con 0x7ff624004850 2023-05-17T12:25:34.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.393+0000 7fc0915ff700 1 Processor -- start 2023-05-17T12:25:34.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.394+0000 7fc0915ff700 1 -- start start 2023-05-17T12:25:34.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.395+0000 7fc0915ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc08c06d080 0x7fc08c1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.395+0000 7fc0915ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c161050 0x7fc08c0c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.395+0000 7fc0915ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c151600 0x7fc08c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.395+0000 7fc0915ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0cbde0 con 0x7fc08c06d080 2023-05-17T12:25:34.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.395+0000 7fc0915ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0cb1d0 con 0x7fc08c161050 2023-05-17T12:25:34.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.395+0000 7fc0915ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0cb4b0 con 0x7fc08c151600 2023-05-17T12:25:34.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08a7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c161050 0x7fc08c0c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08a7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c161050 0x7fc08c0c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:48976/0 (socket says 172.21.15.88:48976) 2023-05-17T12:25:34.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08a7fc700 1 -- 172.21.15.88:0/4012927600 learned_addr learned my addr 172.21.15.88:0/4012927600 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08b7fe700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c151600 0x7fc08c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.393+0000 7faa18bff700 1 -- 172.21.15.88:0/2476153961 wait complete. 2023-05-17T12:25:34.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7faa18bff700 1 Processor -- start 2023-05-17T12:25:34.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.392+0000 7fa8e97fa700 1 -- 172.21.15.88:0/3947764241 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8f001b3b0 con 0x7fa8f40d2580 2023-05-17T12:25:34.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.394+0000 7fa8e97fa700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa8e006ace0 0x7fa8e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.394+0000 7fa8e97fa700 1 -- 172.21.15.88:0/3947764241 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa8f0089260 con 0x7fa8f40d2580 2023-05-17T12:25:34.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.395+0000 7fa8f8d9b700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa8e006ace0 0x7fa8e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08affd700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc08c06d080 0x7fc08c1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08a7fc700 1 -- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c151600 msgr2=0x7fc08c0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08a7fc700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c151600 0x7fc08c0c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08a7fc700 1 -- 172.21.15.88:0/4012927600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc08c06d080 msgr2=0x7fc08c1506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08a7fc700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc08c06d080 0x7fc08c1506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7fc08a7fc700 1 -- 172.21.15.88:0/4012927600 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009b30 con 0x7fc08c161050 2023-05-17T12:25:34.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.397+0000 7fc08affd700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc08c06d080 0x7fc08c1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:34.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.397+0000 7fa8f8d9b700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa8e006ace0 0x7fa8e006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4014040 tx=0x7fa8e401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.397+0000 7fc08a7fc700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c161050 0x7fc08c0c4a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc084012000 tx=0x7fc084004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.397+0000 7f5f59ffb700 1 -- 172.21.15.88:0/842853667 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5f600587e0 con 0x7f5f50004850 2023-05-17T12:25:34.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.396+0000 7faa18bff700 1 -- start start 2023-05-17T12:25:34.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.397+0000 7faa18bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa1406d080 0x7faa140c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.397+0000 7faa18bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa140716f0 0x7faa1406a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.397+0000 7faa18bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa140cd980 0x7faa141f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.398+0000 7faa18bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140c6630 con 0x7faa140cd980 2023-05-17T12:25:34.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.398+0000 7faa18bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140c5e20 con 0x7faa140716f0 2023-05-17T12:25:34.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.398+0000 7faa18bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa141ff7d0 con 0x7faa1406d080 2023-05-17T12:25:34.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.398+0000 7faa11d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa140716f0 0x7faa1406a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.398+0000 7faa11d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa140716f0 0x7faa1406a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:48988/0 (socket says 172.21.15.88:48988) 2023-05-17T12:25:34.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.398+0000 7faa11d9b700 1 -- 172.21.15.88:0/465307069 learned_addr learned my addr 172.21.15.88:0/465307069 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:34.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.398+0000 7faa12d9d700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa140cd980 0x7faa141f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.397+0000 7ff6237fe700 1 -- 172.21.15.88:0/44325415 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff62c003a20 con 0x7ff624004850 2023-05-17T12:25:34.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.398+0000 7ff6237fe700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff62806adb0 0x7ff62806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.399+0000 7ff6237fe700 1 -- 172.21.15.88:0/44325415 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff62c089900 con 0x7ff624004850 2023-05-17T12:25:34.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.399+0000 7faa11d9b700 1 -- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa1406d080 msgr2=0x7faa140c8b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-17T12:25:34.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.399+0000 7faa11d9b700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa1406d080 0x7faa140c8b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.399+0000 7faa11d9b700 1 -- 172.21.15.88:0/465307069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa140cd980 msgr2=0x7faa141f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.399+0000 7faa11d9b700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa140cd980 0x7faa141f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.399+0000 7faa11d9b700 1 -- 172.21.15.88:0/465307069 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0085d0 con 0x7faa140716f0 2023-05-17T12:25:34.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.399+0000 7faa11d9b700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa140716f0 0x7faa1406a9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa0400b4a0 tx=0x7faa0400b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.400+0000 7fc0737fe700 1 -- 172.21.15.88:0/4012927600 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084004450 con 0x7fc08c161050 2023-05-17T12:25:34.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.400+0000 7fc0737fe700 1 -- 172.21.15.88:0/4012927600 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0840045b0 con 0x7fc08c161050 2023-05-17T12:25:34.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.400+0000 7fc0737fe700 1 -- 172.21.15.88:0/4012927600 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084004960 con 0x7fc08c161050 2023-05-17T12:25:34.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.399+0000 7faa0affd700 1 -- 172.21.15.88:0/465307069 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa04011830 con 0x7faa140716f0 2023-05-17T12:25:34.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.400+0000 7faa0affd700 1 -- 172.21.15.88:0/465307069 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa04011990 con 0x7faa140716f0 2023-05-17T12:25:34.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.400+0000 7faa0affd700 1 -- 172.21.15.88:0/465307069 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa04011d40 con 0x7faa140716f0 2023-05-17T12:25:34.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.399+0000 7fa8e97fa700 1 -- 172.21.15.88:0/3947764241 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa8f0054030 con 0x7fa8f40d2580 2023-05-17T12:25:34.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.400+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa140ccea0 con 0x7faa140716f0 2023-05-17T12:25:34.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.400+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa14071d10 con 0x7faa140716f0 2023-05-17T12:25:34.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.400+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c1623a0 con 0x7fc08c161050 2023-05-17T12:25:34.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.400+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c1620c0 con 0x7fc08c161050 2023-05-17T12:25:34.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.401+0000 7ff6237fe700 1 -- 172.21.15.88:0/44325415 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff62c0546a0 con 0x7ff624004850 2023-05-17T12:25:34.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.402+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c0052f0 con 0x7fc08c161050 2023-05-17T12:25:34.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.403+0000 7ff63a7fc700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff62806adb0 0x7ff62806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.404+0000 7ff63a7fc700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff62806adb0 0x7ff62806d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff630000c00 tx=0x7ff630005040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.414+0000 7fc0737fe700 1 -- 172.21.15.88:0/4012927600 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc08401c440 con 0x7fc08c161050 2023-05-17T12:25:34.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.415+0000 7fc0737fe700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc07806adb0 0x7fc07806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.416+0000 7fc0737fe700 1 -- 172.21.15.88:0/4012927600 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc08408a6e0 con 0x7fc08c161050 2023-05-17T12:25:34.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.416+0000 7fc0737fe700 1 -- 172.21.15.88:0/4012927600 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc08408ab60 con 0x7fc08c161050 2023-05-17T12:25:34.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.417+0000 7fc08affd700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc07806adb0 0x7fc07806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.418+0000 7fc08affd700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc07806adb0 0x7fc07806d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0c8e20 tx=0x7fc080008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.418+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa140cd180 con 0x7faa140716f0 2023-05-17T12:25:34.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.420+0000 7faa0affd700 1 -- 172.21.15.88:0/465307069 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa0401a400 con 0x7faa140716f0 2023-05-17T12:25:34.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.421+0000 7faa0affd700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa9f406adb0 0x7fa9f406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:34.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.421+0000 7faa0affd700 1 -- 172.21.15.88:0/465307069 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faa04089610 con 0x7faa140716f0 2023-05-17T12:25:34.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.422+0000 7faa1259c700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa9f406adb0 0x7fa9f406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:34.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.423+0000 7faa1259c700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa9f406adb0 0x7fa9f406d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00ab90 tx=0x7fa9fc009230 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:34.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.425+0000 7faa0affd700 1 -- 172.21.15.88:0/465307069 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faa04054440 con 0x7faa140716f0 2023-05-17T12:25:34.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.809+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff730074530 con 0x7ff73006d080 2023-05-17T12:25:34.815 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-05-17T12:25:34.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.809+0000 7ff725ffb700 1 -- 172.21.15.88:0/2002992396 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff720058270 con 0x7ff73006d080 2023-05-17T12:25:34.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.813+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff71406adb0 msgr2=0x7ff71406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.813+0000 7ff7377ff700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff71406adb0 0x7ff71406d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00a510 tx=0x7ff72c00a4a0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.813+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff73006d080 msgr2=0x7ff7300c0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.813+0000 7ff7377ff700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff73006d080 0x7ff7300c0da0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff72000dd10 tx=0x7ff720009400 comp rx=0 tx=0).stop 2023-05-17T12:25:34.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.814+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 shutdown_connections 2023-05-17T12:25:34.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.814+0000 7ff7377ff700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff71406adb0 0x7ff71406d260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.814+0000 7ff7377ff700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff73016ab00 0x7ff730162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.814+0000 7ff7377ff700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff73006a880 0x7ff7300bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.814+0000 7ff7377ff700 1 --2- 172.21.15.88:0/2002992396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff73006d080 0x7ff7300c0da0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.814+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 >> 172.21.15.88:0/2002992396 conn(0x7ff7300b1530 msgr2=0x7ff7300ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.815+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 shutdown_connections 2023-05-17T12:25:34.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.815+0000 7ff7377ff700 1 -- 172.21.15.88:0/2002992396 wait complete. 2023-05-17T12:25:34.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.826+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f24e4005870 con 0x7f250006c510 2023-05-17T12:25:34.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.827+0000 7f24eeffd700 1 -- 172.21.15.88:0/3510850485 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24f0016090 con 0x7f250006c510 2023-05-17T12:25:34.833 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-05-17T12:25:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.831+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f24e006adb0 msgr2=0x7f24e006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.831+0000 7f2504bff700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f24e006adb0 0x7f24e006d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2500202cf0 tx=0x7f24f40092c0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.831+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 msgr2=0x7f2500162ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.831+0000 7f2504bff700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f2500162ec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f24f0013000 tx=0x7f24f0004750 comp rx=0 tx=0).stop 2023-05-17T12:25:34.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.832+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 shutdown_connections 2023-05-17T12:25:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.832+0000 7f2504bff700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f24e006adb0 0x7f24e006d260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.832+0000 7f2504bff700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25000d0d80 0x7f25000b7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.832+0000 7f2504bff700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f250006c510 0x7f2500162ec0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.832+0000 7f2504bff700 1 --2- 172.21.15.88:0/3510850485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25000ced50 0x7f25001ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.832+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 >> 172.21.15.88:0/3510850485 conn(0x7f25000d3ed0 msgr2=0x7f250015edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.832+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 shutdown_connections 2023-05-17T12:25:34.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.832+0000 7f2504bff700 1 -- 172.21.15.88:0/3510850485 wait complete. 2023-05-17T12:25:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.838+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f929c0c7b30 con 0x7f929c071520 2023-05-17T12:25:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.839+0000 7f92837fe700 1 -- 172.21.15.88:0/2715363151 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f929c0c7b30 con 0x7f929c071520 2023-05-17T12:25:34.845 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-05-17T12:25:34.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2023-05-17T12:25:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.844+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f928806ad30 msgr2=0x7f928806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.844+0000 7f92a17ff700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f928806ad30 0x7f928806d1e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92900061a0 tx=0x7f9290005ae0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.844+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c071520 msgr2=0x7f929c156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.844+0000 7f92a17ff700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c071520 0x7f929c156f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f928c00d5c0 tx=0x7f928c00d8d0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.845+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 shutdown_connections 2023-05-17T12:25:34.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.845+0000 7f92a17ff700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f928806ad30 0x7f928806d1e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.845+0000 7f92a17ff700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f929c0cd980 0x7f929c1f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.845+0000 7f92a17ff700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f929c06d080 0x7f929c0c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.845+0000 7f92a17ff700 1 --2- 172.21.15.88:0/2715363151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f929c071520 0x7f929c156f50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.845+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 >> 172.21.15.88:0/2715363151 conn(0x7f929c0b1530 msgr2=0x7f929c158380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.845+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 shutdown_connections 2023-05-17T12:25:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.845+0000 7f92a17ff700 1 -- 172.21.15.88:0/2715363151 wait complete. 2023-05-17T12:25:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.847+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f64074530 con 0x7f5f50004850 2023-05-17T12:25:34.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.848+0000 7f5f59ffb700 1 -- 172.21.15.88:0/842853667 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f60058370 con 0x7f5f50004850 2023-05-17T12:25:34.851 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-05-17T12:25:34.851 INFO:teuthology.orchestra.run.smithi088.stdout:55834574861 2023-05-17T12:25:34.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.847+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff61c005870 con 0x7ff624004850 2023-05-17T12:25:34.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.848+0000 7ff6237fe700 1 -- 172.21.15.88:0/44325415 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff62c057cc0 con 0x7ff624004850 2023-05-17T12:25:34.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.849+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa8f4067860 con 0x7fa8f40d2580 2023-05-17T12:25:34.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.850+0000 7fa8e97fa700 1 -- 172.21.15.88:0/3947764241 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8f005be60 con 0x7fa8f40d2580 2023-05-17T12:25:34.853 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-05-17T12:25:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff62806adb0 msgr2=0x7ff62806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff62806adb0 0x7ff62806d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff630000c00 tx=0x7ff630005040 comp rx=0 tx=0).stop 2023-05-17T12:25:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624004850 msgr2=0x7ff63c0a9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624004850 0x7ff63c0a9e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00f7f0 tx=0x7ff62c00fb00 comp rx=0 tx=0).stop 2023-05-17T12:25:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 shutdown_connections 2023-05-17T12:25:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff62806adb0 0x7ff62806d260 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff630000c00 tx=0x7ff630005040 comp rx=0 tx=0).stop 2023-05-17T12:25:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff63c1f60c0 0x7ff63c1f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff624004850 0x7ff63c0a9e40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 --2- 172.21.15.88:0/44325415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63c1f2450 0x7ff63c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.851+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 >> 172.21.15.88:0/44325415 conn(0x7ff63c0d3ed0 msgr2=0x7ff63c160710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4806ad30 msgr2=0x7f5f4806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4806ad30 0x7f5f4806d1e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f64152630 tx=0x7f5f54017000 comp rx=0 tx=0).stop 2023-05-17T12:25:34.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50004850 msgr2=0x7f5f64151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50004850 0x7f5f64151930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000eb40 tx=0x7f5f6000ee50 comp rx=0 tx=0).stop 2023-05-17T12:25:34.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 shutdown_connections 2023-05-17T12:25:34.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f5f4806ad30 0x7f5f4806d1e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f640bd910 0x7f5f640bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f50004850 0x7f5f64151930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 --2- 172.21.15.88:0/842853667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f64152260 0x7f5f640c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 >> 172.21.15.88:0/842853667 conn(0x7f5f640b1530 msgr2=0x7f5f640b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 shutdown_connections 2023-05-17T12:25:34.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 shutdown_connections 2023-05-17T12:25:34.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7ff6417ff700 1 -- 172.21.15.88:0/44325415 wait complete. 2023-05-17T12:25:34.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.852+0000 7f5f6b3ff700 1 -- 172.21.15.88:0/842853667 wait complete. 2023-05-17T12:25:34.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa8e006ace0 msgr2=0x7fa8e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa8e006ace0 0x7fa8e006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4014040 tx=0x7fa8e401c040 comp rx=0 tx=0).stop 2023-05-17T12:25:34.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8f40d2580 msgr2=0x7fa8f41ea470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8f40d2580 0x7fa8f41ea470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000cae0 tx=0x7fa8f000cdf0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 shutdown_connections 2023-05-17T12:25:34.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa8e006ace0 0x7fa8e006d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8f40d29f0 0x7fa8f40ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8f406c440 0x7fa8f4153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 --2- 172.21.15.88:0/3947764241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8f40d2580 0x7fa8f41ea470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 >> 172.21.15.88:0/3947764241 conn(0x7fa8f40d3e60 msgr2=0x7fa8f4161020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 shutdown_connections 2023-05-17T12:25:34.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.854+0000 7fa8fafff700 1 -- 172.21.15.88:0/3947764241 wait complete. 2023-05-17T12:25:34.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.859+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc06c005870 con 0x7fc08c161050 2023-05-17T12:25:34.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.860+0000 7fc0737fe700 1 -- 172.21.15.88:0/4012927600 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc084055510 con 0x7fc08c161050 2023-05-17T12:25:34.863 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-05-17T12:25:34.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.5 2023-05-17T12:25:34.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.864+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc07806adb0 msgr2=0x7fc07806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.864+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc07806adb0 0x7fc07806d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0c8e20 tx=0x7fc080008040 comp rx=0 tx=0).stop 2023-05-17T12:25:34.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.864+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c161050 msgr2=0x7fc08c0c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.864+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c161050 0x7fc08c0c4a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc084012000 tx=0x7fc084004ad0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.871+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 shutdown_connections 2023-05-17T12:25:34.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.871+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc07806adb0 0x7fc07806d260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.871+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc08c151600 0x7fc08c0c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.871+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc08c06d080 0x7fc08c1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.871+0000 7fc0915ff700 1 --2- 172.21.15.88:0/4012927600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c161050 0x7fc08c0c4a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.871+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 >> 172.21.15.88:0/4012927600 conn(0x7fc08c0b1530 msgr2=0x7fc08c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.873+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 shutdown_connections 2023-05-17T12:25:34.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.873+0000 7fc0915ff700 1 -- 172.21.15.88:0/4012927600 wait complete. 2023-05-17T12:25:34.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.874+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7faa14074530 con 0x7faa140716f0 2023-05-17T12:25:34.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.874+0000 7faa0affd700 1 -- 172.21.15.88:0/465307069 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa04057a60 con 0x7faa140716f0 2023-05-17T12:25:34.877 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-05-17T12:25:34.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.0 2023-05-17T12:25:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa9f406adb0 msgr2=0x7fa9f406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa9f406adb0 0x7fa9f406d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00ab90 tx=0x7fa9fc009230 comp rx=0 tx=0).stop 2023-05-17T12:25:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa140716f0 msgr2=0x7faa1406a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa140716f0 0x7faa1406a9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa0400b4a0 tx=0x7faa0400b7b0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 shutdown_connections 2023-05-17T12:25:34.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa9f406adb0 0x7fa9f406d260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa140cd980 0x7faa141f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa1406d080 0x7faa140c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 --2- 172.21.15.88:0/465307069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa140716f0 0x7faa1406a9a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 >> 172.21.15.88:0/465307069 conn(0x7faa140b1530 msgr2=0x7faa140af150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 shutdown_connections 2023-05-17T12:25:34.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:34.878+0000 7faa18bff700 1 -- 172.21.15.88:0/465307069 wait complete. 2023-05-17T12:25:34.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.2 2023-05-17T12:25:34.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.6 2023-05-17T12:25:34.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.3 2023-05-17T12:25:34.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.1 2023-05-17T12:25:34.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.7 2023-05-17T12:25:35.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-17T12:25:35.867 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-17T12:25:35.879 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-17T12:25:35.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-17T12:25:35.888 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-17T12:25:35.888 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-17T12:25:35.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-17T12:25:35.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-17T12:25:36.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.144+0000 7f36995ff700 1 Processor -- start 2023-05-17T12:25:36.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.144+0000 7f36995ff700 1 -- start start 2023-05-17T12:25:36.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.146+0000 7f36995ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3694160ec0 0x7f369406dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.146+0000 7f36995ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f369406e100 0x7f3694070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.146+0000 7f36995ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369406d120 con 0x7f36940714b0 2023-05-17T12:25:36.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.146+0000 7f36995ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3694071950 con 0x7f369406e100 2023-05-17T12:25:36.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.146+0000 7f36995ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36940cd9b0 con 0x7f3694160ec0 2023-05-17T12:25:36.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.147+0000 7f36937fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f36940714b0 0x7f36940c9580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40902/0 (socket says 172.21.15.88:40902) 2023-05-17T12:25:36.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.147+0000 7f36937fe700 1 -- 172.21.15.88:0/2450532035 learned_addr learned my addr 172.21.15.88:0/2450532035 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:36.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.147+0000 7f3692ffd700 1 --2- 172.21.15.88:0/2450532035 >> v2:172.21.15.187:3300/0 conn(0x7f3694160ec0 0x7f369406dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.148+0000 7f3691ffb700 1 -- 172.21.15.88:0/2450532035 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743415195 0 0) 0x7f369406d120 con 0x7f36940714b0 2023-05-17T12:25:36.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.148+0000 7f3691ffb700 1 -- 172.21.15.88:0/2450532035 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f367c0035b0 con 0x7f36940714b0 2023-05-17T12:25:36.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.148+0000 7f3692ffd700 1 -- 172.21.15.88:0/2450532035 >> v2:172.21.15.88:3300/0 conn(0x7f369406e100 msgr2=0x7f3694070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:36.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.148+0000 7f3692ffd700 1 --2- 172.21.15.88:0/2450532035 >> v2:172.21.15.88:3300/0 conn(0x7f369406e100 0x7f3694070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.148+0000 7f3692ffd700 1 -- 172.21.15.88:0/2450532035 >> v1:172.21.15.187:6789/0 conn(0x7f36940714b0 legacy=0x7f36940c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.148+0000 7f3692ffd700 1 -- 172.21.15.88:0/2450532035 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694162250 con 0x7f3694160ec0 2023-05-17T12:25:36.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.149+0000 7f3692ffd700 1 --2- 172.21.15.88:0/2450532035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3694160ec0 0x7f369406dbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3694071ac0 tx=0x7f3684009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a298b74125edefc3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.149+0000 7f3691ffb700 1 -- 172.21.15.88:0/2450532035 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684004230 con 0x7f3694160ec0 2023-05-17T12:25:36.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.149+0000 7f3691ffb700 1 -- 172.21.15.88:0/2450532035 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684004390 con 0x7f3694160ec0 2023-05-17T12:25:36.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.149+0000 7f3691ffb700 1 -- 172.21.15.88:0/2450532035 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840036a0 con 0x7f3694160ec0 2023-05-17T12:25:36.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.150+0000 7f36995ff700 1 -- 172.21.15.88:0/2450532035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3694160ec0 msgr2=0x7f369406dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.150+0000 7f36995ff700 1 --2- 172.21.15.88:0/2450532035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3694160ec0 0x7f369406dbc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3694071ac0 tx=0x7f3684009b20 comp rx=0 tx=0).stop 2023-05-17T12:25:36.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.151+0000 7f36995ff700 1 -- 172.21.15.88:0/2450532035 shutdown_connections 2023-05-17T12:25:36.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.151+0000 7f36995ff700 1 --2- 172.21.15.88:0/2450532035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3694160ec0 0x7f369406dbc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.151+0000 7f36995ff700 1 --2- 172.21.15.88:0/2450532035 >> v2:172.21.15.88:3300/0 conn(0x7f369406e100 0x7f3694070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.151+0000 7f36995ff700 1 -- 172.21.15.88:0/2450532035 >> 172.21.15.88:0/2450532035 conn(0x7f36940b1530 msgr2=0x7f36940ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.151+0000 7f36995ff700 1 -- 172.21.15.88:0/2450532035 shutdown_connections 2023-05-17T12:25:36.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.151+0000 7f36995ff700 1 -- 172.21.15.88:0/2450532035 wait complete. 2023-05-17T12:25:36.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.154+0000 7f36995ff700 1 Processor -- start 2023-05-17T12:25:36.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.154+0000 7f36995ff700 1 -- start start 2023-05-17T12:25:36.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.155+0000 7f36995ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f369406e100 0x7f36940cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.155+0000 7f36995ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940714b0 0x7f369414ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.155+0000 7f36995ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694160ec0 0x7f369414ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.155+0000 7f36995ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940c7040 con 0x7f369406e100 2023-05-17T12:25:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.155+0000 7f36995ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369414b1b0 con 0x7f36940714b0 2023-05-17T12:25:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.155+0000 7f36995ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369414b470 con 0x7f3694160ec0 2023-05-17T12:25:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f36927fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940714b0 0x7f369414ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f36927fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940714b0 0x7f369414ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:49016/0 (socket says 172.21.15.88:49016) 2023-05-17T12:25:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f36927fc700 1 -- 172.21.15.88:0/602085166 learned_addr learned my addr 172.21.15.88:0/602085166 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f36937fe700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694160ec0 0x7f369414ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f3692ffd700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f369406e100 0x7f36940cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f36927fc700 1 -- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694160ec0 msgr2=0x7f369414ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f36927fc700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694160ec0 0x7f369414ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f36927fc700 1 -- 172.21.15.88:0/602085166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f369406e100 msgr2=0x7f36940cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f36927fc700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f369406e100 0x7f36940cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.158+0000 7f36927fc700 1 -- 172.21.15.88:0/602085166 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36840094a0 con 0x7f36940714b0 2023-05-17T12:25:36.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.159+0000 7f36927fc700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940714b0 0x7f369414ea30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f368800b500 tx=0x7f368800b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.167+0000 7f367b7fe700 1 -- 172.21.15.88:0/602085166 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688011830 con 0x7f36940714b0 2023-05-17T12:25:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.167+0000 7f367b7fe700 1 -- 172.21.15.88:0/602085166 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688011990 con 0x7f36940714b0 2023-05-17T12:25:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.167+0000 7f367b7fe700 1 -- 172.21.15.88:0/602085166 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688011d40 con 0x7f36940714b0 2023-05-17T12:25:36.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.167+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369406d6a0 con 0x7f36940714b0 2023-05-17T12:25:36.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.167+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369406d3c0 con 0x7f36940714b0 2023-05-17T12:25:36.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.169+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36740052f0 con 0x7f36940714b0 2023-05-17T12:25:36.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.171+0000 7f367b7fe700 1 -- 172.21.15.88:0/602085166 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f368801a400 con 0x7f36940714b0 2023-05-17T12:25:36.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.173+0000 7f367b7fe700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f368006adb0 0x7f368006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.173+0000 7f367b7fe700 1 -- 172.21.15.88:0/602085166 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3688089900 con 0x7f36940714b0 2023-05-17T12:25:36.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.174+0000 7f3692ffd700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f368006adb0 0x7f368006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.175+0000 7f367b7fe700 1 -- 172.21.15.88:0/602085166 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3688054730 con 0x7f36940714b0 2023-05-17T12:25:36.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.199+0000 7f3692ffd700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f368006adb0 0x7f368006d260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36840090b0 tx=0x7f3684013040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.217+0000 7fe9af3ff700 1 Processor -- start 2023-05-17T12:25:36.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.218+0000 7fe9af3ff700 1 -- start start 2023-05-17T12:25:36.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7fe9af3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a8161420 0x7fe9a80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7fe9af3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a8162680 con 0x7fe9a806d080 2023-05-17T12:25:36.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7fe9af3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a8161890 con 0x7fe9a8161050 2023-05-17T12:25:36.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7fe9af3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8161b00 con 0x7fe9a8161420 2023-05-17T12:25:36.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7f57079ff700 1 Processor -- start 2023-05-17T12:25:36.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7fe9ac99a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a8161420 0x7fe9a80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7fe9ac99a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a8161420 0x7fe9a80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:36166/0 (socket says 172.21.15.88:36166) 2023-05-17T12:25:36.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7fe9ad99c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe9a806d080 0x7fe9a80c1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52016/0 (socket says 172.21.15.88:52016) 2023-05-17T12:25:36.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7fe9ac99a700 1 -- 172.21.15.88:0/4171231501 learned_addr learned my addr 172.21.15.88:0/4171231501 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.220+0000 7f57079ff700 1 -- start start 2023-05-17T12:25:36.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.221+0000 7fe9ac99a700 1 -- 172.21.15.88:0/4171231501 >> v1:172.21.15.187:6789/0 conn(0x7fe9a8161050 legacy=0x7fe9a806a510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:36.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.221+0000 7fe9ac99a700 1 -- 172.21.15.88:0/4171231501 >> v1:172.21.15.88:6789/0 conn(0x7fe9a806d080 legacy=0x7fe9a80c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.221+0000 7fe9ac99a700 1 -- 172.21.15.88:0/4171231501 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a8161de0 con 0x7fe9a8161420 2023-05-17T12:25:36.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.222+0000 7fe9ac99a700 1 --2- 172.21.15.88:0/4171231501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a8161420 0x7fe9a80caf10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe998009920 tx=0x7fe998009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57fb2fdcf81b4dba server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7fe99ffff700 1 -- 172.21.15.88:0/4171231501 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998004230 con 0x7fe9a8161420 2023-05-17T12:25:36.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7fe99ffff700 1 -- 172.21.15.88:0/4171231501 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe998004390 con 0x7fe9a8161420 2023-05-17T12:25:36.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7fe99ffff700 1 -- 172.21.15.88:0/4171231501 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998009e70 con 0x7fe9a8161420 2023-05-17T12:25:36.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7f57079ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f57000cf460 0x7f57000cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7f57079ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57000ccc50 con 0x7f57000716f0 2023-05-17T12:25:36.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7f57079ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5700071d10 con 0x7f570006d080 2023-05-17T12:25:36.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7f57079ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57000cd560 con 0x7f57000cf460 2023-05-17T12:25:36.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7f5704f9a700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f570006d080 0x7f5700070fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40928/0 (socket says 172.21.15.88:40928) 2023-05-17T12:25:36.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7f5704f9a700 1 -- 172.21.15.88:0/2695774183 learned_addr learned my addr 172.21.15.88:0/2695774183 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:36.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.221+0000 7f16e79ff700 1 Processor -- start 2023-05-17T12:25:36.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.221+0000 7f16e79ff700 1 -- start start 2023-05-17T12:25:36.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7f16e79ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16e006d080 0x7f16e006d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.223+0000 7f16e79ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f16e00cd980 0x7f16e0070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f16e79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e006a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f16e79ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e00cd560 con 0x7f16e006d080 2023-05-17T12:25:36.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f16e79ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e015a1c0 con 0x7f16e00cd980 2023-05-17T12:25:36.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f16e79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00ccc50 con 0x7f16e0071520 2023-05-17T12:25:36.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7fe9af3ff700 1 -- 172.21.15.88:0/4171231501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a8161420 msgr2=0x7fe9a80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7fe9af3ff700 1 --2- 172.21.15.88:0/4171231501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a8161420 0x7fe9a80caf10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe998009920 tx=0x7fe998009c30 comp rx=0 tx=0).stop 2023-05-17T12:25:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781382381 0 0) 0x7f5700071d10 con 0x7f570006d080 2023-05-17T12:25:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56ec0057c0 con 0x7f570006d080 2023-05-17T12:25:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549134523 0 0) 0x7f57000ccc50 con 0x7f57000716f0 2023-05-17T12:25:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5700071d10 con 0x7f57000716f0 2023-05-17T12:25:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f16e5f9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e006a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f16e5f9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e006a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:36174/0 (socket says 172.21.15.88:36174) 2023-05-17T12:25:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.224+0000 7f16e5f9c700 1 -- 172.21.15.88:0/3763043168 learned_addr learned my addr 172.21.15.88:0/3763043168 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f16e579b700 1 --2- 172.21.15.88:0/3763043168 >> v2:172.21.15.88:3300/0 conn(0x7f16e006d080 0x7f16e006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f16e5f9c700 1 -- 172.21.15.88:0/3763043168 >> v2:172.21.15.187:3300/0 conn(0x7f16e00cd980 msgr2=0x7f16e0070fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-17T12:25:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f16e5f9c700 1 --2- 172.21.15.88:0/3763043168 >> v2:172.21.15.187:3300/0 conn(0x7f16e00cd980 0x7f16e0070fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f16e5f9c700 1 -- 172.21.15.88:0/3763043168 >> v2:172.21.15.88:3300/0 conn(0x7f16e006d080 msgr2=0x7f16e006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f16e5f9c700 1 --2- 172.21.15.88:0/3763043168 >> v2:172.21.15.88:3300/0 conn(0x7f16e006d080 0x7f16e006d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f16e5f9c700 1 -- 172.21.15.88:0/3763043168 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e006d990 con 0x7f16e0071520 2023-05-17T12:25:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944743860 0 0) 0x7f56ec0057c0 con 0x7f570006d080 2023-05-17T12:25:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 >> v2:172.21.15.187:3300/0 conn(0x7f57000cf460 msgr2=0x7f57000cd980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 --2- 172.21.15.88:0/2695774183 >> v2:172.21.15.187:3300/0 conn(0x7f57000cf460 0x7f57000cd980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 >> v1:172.21.15.88:6789/0 conn(0x7f57000716f0 legacy=0x7f570006a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57000ccea0 con 0x7f570006d080 2023-05-17T12:25:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f56fc001670 con 0x7f570006d080 2023-05-17T12:25:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 >> v1:172.21.15.187:6789/0 conn(0x7f570006d080 legacy=0x7f5700070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56ec006e50 0x7f56ec007240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f56ec005e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56ec006400 0x7f56ec0100a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57000cd560 con 0x7f56ec005a00 2023-05-17T12:25:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec010820 con 0x7f56ec006400 2023-05-17T12:25:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0109e0 con 0x7f56ec006e50 2023-05-17T12:25:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.225+0000 7f5704f9a700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f56ec005e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f5705f9c700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56ec006400 0x7f56ec0100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f16e5f9c700 1 --2- 172.21.15.88:0/3763043168 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e006a730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16e00cb780 tx=0x7f16d000d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fc46a4cf12ce5f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f16d7fff700 1 -- 172.21.15.88:0/3763043168 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0010070 con 0x7f16e0071520 2023-05-17T12:25:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f16d7fff700 1 -- 172.21.15.88:0/3763043168 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d000da40 con 0x7f16e0071520 2023-05-17T12:25:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f16d7fff700 1 -- 172.21.15.88:0/3763043168 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d000ddd0 con 0x7f16e0071520 2023-05-17T12:25:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f5704f9a700 1 -- 172.21.15.88:0/2695774183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56ec006e50 msgr2=0x7f56ec007240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f5704f9a700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56ec006e50 0x7f56ec007240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f5704f9a700 1 -- 172.21.15.88:0/2695774183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56ec006400 msgr2=0x7f56ec0100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f5704f9a700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56ec006400 0x7f56ec0100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f5704f9a700 1 -- 172.21.15.88:0/2695774183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57000ccea0 con 0x7f56ec005a00 2023-05-17T12:25:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.226+0000 7f5705f9c700 1 -- 172.21.15.88:0/2695774183 reap_dead start 2023-05-17T12:25:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.227+0000 7f5704f9a700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f56ec005e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f56ec005790 tx=0x7f56ec007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bee0ee1046f26fe server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.227+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc00cd50 con 0x7f56ec005a00 2023-05-17T12:25:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.227+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56fc005960 con 0x7f56ec005a00 2023-05-17T12:25:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.227+0000 7f56f7fff700 1 -- 172.21.15.88:0/2695774183 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc005d10 con 0x7f56ec005a00 2023-05-17T12:25:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.227+0000 7f16e79ff700 1 -- 172.21.15.88:0/3763043168 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 msgr2=0x7f16e006a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.227+0000 7f16e79ff700 1 --2- 172.21.15.88:0/3763043168 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e006a730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16e00cb780 tx=0x7f16d000d330 comp rx=0 tx=0).stop 2023-05-17T12:25:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.228+0000 7fe9af3ff700 1 -- 172.21.15.88:0/4171231501 shutdown_connections 2023-05-17T12:25:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.228+0000 7fe9af3ff700 1 --2- 172.21.15.88:0/4171231501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a8161420 0x7fe9a80caf10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.228+0000 7fe9af3ff700 1 -- 172.21.15.88:0/4171231501 >> 172.21.15.88:0/4171231501 conn(0x7fe9a80b1530 msgr2=0x7fe9a80ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.228+0000 7fe9af3ff700 1 -- 172.21.15.88:0/4171231501 shutdown_connections 2023-05-17T12:25:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.228+0000 7fe9af3ff700 1 -- 172.21.15.88:0/4171231501 wait complete. 2023-05-17T12:25:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.228+0000 7f57079ff700 1 -- 172.21.15.88:0/2695774183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 msgr2=0x7f56ec005e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.228+0000 7f57079ff700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f56ec005e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f56ec005790 tx=0x7f56ec007a90 comp rx=0 tx=0).stop 2023-05-17T12:25:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.229+0000 7f57079ff700 1 -- 172.21.15.88:0/2695774183 shutdown_connections 2023-05-17T12:25:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.229+0000 7f57079ff700 1 --2- 172.21.15.88:0/2695774183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f56ec005e70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.229+0000 7f57079ff700 1 -- 172.21.15.88:0/2695774183 >> 172.21.15.88:0/2695774183 conn(0x7f57000b1530 msgr2=0x7f57000ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.229+0000 7f57079ff700 1 -- 172.21.15.88:0/2695774183 shutdown_connections 2023-05-17T12:25:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.229+0000 7f57079ff700 1 -- 172.21.15.88:0/2695774183 wait complete. 2023-05-17T12:25:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.230+0000 7fe9af3ff700 1 Processor -- start 2023-05-17T12:25:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.231+0000 7fe9af3ff700 1 -- start start 2023-05-17T12:25:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.232+0000 7f57079ff700 1 Processor -- start 2023-05-17T12:25:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.233+0000 7fe9af3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a806d080 0x7fe9a815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.233+0000 7fe9af3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9a8161050 0x7fe9a80b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7fe9af3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a8161420 0x7fe9a80c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7fe9af3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a815aa90 con 0x7fe9a8161050 2023-05-17T12:25:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7fe9af3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a81e92c0 con 0x7fe9a8161420 2023-05-17T12:25:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7fe9af3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a81e9510 con 0x7fe9a806d080 2023-05-17T12:25:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.232+0000 7f57079ff700 1 -- start start 2023-05-17T12:25:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7f57079ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f57001514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7f57079ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5700152110 0x7f5700153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7f57079ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57001537b0 0x7f57000c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7f57079ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5700151f40 con 0x7f56ec005a00 2023-05-17T12:25:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7f57079ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57001519e0 con 0x7f5700152110 2023-05-17T12:25:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7f57079ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57000c8730 con 0x7f57001537b0 2023-05-17T12:25:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7f144fdff700 1 Processor -- start 2023-05-17T12:25:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7fe9ac99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9a8161050 0x7fe9a80b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7fe9ac99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9a8161050 0x7fe9a80b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37552/0 (socket says 172.21.15.88:37552) 2023-05-17T12:25:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.234+0000 7fe9ac99a700 1 -- 172.21.15.88:0/3857061587 learned_addr learned my addr 172.21.15.88:0/3857061587 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7f570579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f57001514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7f570579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f57001514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37562/0 (socket says 172.21.15.88:37562) 2023-05-17T12:25:36.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7f570579b700 1 -- 172.21.15.88:0/1716073345 learned_addr learned my addr 172.21.15.88:0/1716073345 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7f5705f9c700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57001537b0 0x7f57000c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7f5704f9a700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5700152110 0x7f5700153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7fe9ac99a700 1 -- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a806d080 msgr2=0x7fe9a815a550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-17T12:25:36.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7fe9ac99a700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a806d080 0x7fe9a815a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7fe9ac99a700 1 -- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a8161420 msgr2=0x7fe9a80c9fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-17T12:25:36.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7fe9ac99a700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a8161420 0x7fe9a80c9fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7fe9ac99a700 1 -- 172.21.15.88:0/3857061587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998009550 con 0x7fe9a8161050 2023-05-17T12:25:36.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7f18ff1ff700 1 Processor -- start 2023-05-17T12:25:36.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7fe9ac99a700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9a8161050 0x7fe9a80b25b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe998009870 tx=0x7fe998004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.235+0000 7f144fdff700 1 -- start start 2023-05-17T12:25:36.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7f144fdff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f144815aa70 0x7f14480cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7f144fdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14480ced80 0x7f144806f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7f144fdff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f144806f940 0x7f14480b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7f144fdff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144806fdc0 con 0x7f144806f940 2023-05-17T12:25:36.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7f144fdff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14480d01c0 con 0x7f144815aa70 2023-05-17T12:25:36.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7f144fdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480cf5b0 con 0x7f14480ced80 2023-05-17T12:25:36.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7fe99dffb700 1 -- 172.21.15.88:0/3857061587 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980036a0 con 0x7fe9a8161050 2023-05-17T12:25:36.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7fe99dffb700 1 -- 172.21.15.88:0/3857061587 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe998003820 con 0x7fe9a8161050 2023-05-17T12:25:36.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7fe99dffb700 1 -- 172.21.15.88:0/3857061587 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998003bd0 con 0x7fe9a8161050 2023-05-17T12:25:36.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7f18ff1ff700 1 -- start start 2023-05-17T12:25:36.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.238+0000 7f18ff1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 0x7f18f8160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.238+0000 7f18ff1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18f80cf6a0 0x7f18f80b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.238+0000 7f18ff1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f80cd7e0 con 0x7f18f806c4f0 2023-05-17T12:25:36.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.238+0000 7f18ff1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f80d1200 con 0x7f18f80cf6a0 2023-05-17T12:25:36.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.238+0000 7f18ff1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f81614d0 con 0x7f18f815c8e0 2023-05-17T12:25:36.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a81623a0 con 0x7fe9a8161050 2023-05-17T12:25:36.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a81620c0 con 0x7fe9a8161050 2023-05-17T12:25:36.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7f5705f9c700 1 -- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5700152110 msgr2=0x7f5700153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7f5705f9c700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5700152110 0x7f5700153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7f5705f9c700 1 -- 172.21.15.88:0/1716073345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 msgr2=0x7f57001514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7f5705f9c700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f57001514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7f5705f9c700 1 -- 172.21.15.88:0/1716073345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5700158ea0 con 0x7f57001537b0 2023-05-17T12:25:36.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.236+0000 7f5705f9c700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57001537b0 0x7f57000c6df0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5700070c60 tx=0x7f56f800ff00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7f56f5ffb700 1 -- 172.21.15.88:0/1716073345 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8003cd0 con 0x7f57001537b0 2023-05-17T12:25:36.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7f56f5ffb700 1 -- 172.21.15.88:0/1716073345 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f8003e30 con 0x7f57001537b0 2023-05-17T12:25:36.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.237+0000 7f56f5ffb700 1 -- 172.21.15.88:0/1716073345 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f800d940 con 0x7f57001537b0 2023-05-17T12:25:36.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.238+0000 7f144e39c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f144806f940 0x7f14480b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f144e39c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f144806f940 0x7f14480b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37570/0 (socket says 172.21.15.88:37570) 2023-05-17T12:25:36.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f144e39c700 1 -- 172.21.15.88:0/2446483426 learned_addr learned my addr 172.21.15.88:0/2446483426 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9880052f0 con 0x7fe9a8161050 2023-05-17T12:25:36.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57000cd180 con 0x7f57001537b0 2023-05-17T12:25:36.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5700159030 con 0x7f57001537b0 2023-05-17T12:25:36.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f144d39a700 1 --2- 172.21.15.88:0/2446483426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14480ced80 0x7f144806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f144e39c700 1 -- 172.21.15.88:0/2446483426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14480ced80 msgr2=0x7f144806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:36.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f144e39c700 1 --2- 172.21.15.88:0/2446483426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14480ced80 0x7f144806f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f144e39c700 1 -- 172.21.15.88:0/2446483426 >> v2:172.21.15.187:3300/0 conn(0x7f144815aa70 msgr2=0x7f14480cd320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f144e39c700 1 --2- 172.21.15.88:0/2446483426 >> v2:172.21.15.187:3300/0 conn(0x7f144815aa70 0x7f14480cd320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f144e39c700 1 -- 172.21.15.88:0/2446483426 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480cf890 con 0x7f144806f940 2023-05-17T12:25:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.240+0000 7f16e79ff700 1 -- 172.21.15.88:0/3763043168 shutdown_connections 2023-05-17T12:25:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.240+0000 7f16e79ff700 1 --2- 172.21.15.88:0/3763043168 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e006a730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.240+0000 7f16e79ff700 1 --2- 172.21.15.88:0/3763043168 >> v2:172.21.15.88:3300/0 conn(0x7f16e006d080 0x7f16e006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.240+0000 7f16e79ff700 1 --2- 172.21.15.88:0/3763043168 >> v2:172.21.15.187:3300/0 conn(0x7f16e00cd980 0x7f16e0070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f18fd79c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f18f806c4f0 0x7f18f806c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52030/0 (socket says 172.21.15.88:52030) 2023-05-17T12:25:36.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.239+0000 7f18fd79c700 1 -- 172.21.15.88:0/1611529930 learned_addr learned my addr 172.21.15.88:0/1611529930 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:36.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.240+0000 7f18f7fff700 1 --2- 172.21.15.88:0/1611529930 >> v2:172.21.15.88:3300/0 conn(0x7f18f80cf6a0 0x7f18f80b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.240+0000 7f16e79ff700 1 -- 172.21.15.88:0/3763043168 >> 172.21.15.88:0/3763043168 conn(0x7f16e00b1530 msgr2=0x7f16e00ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.240+0000 7f16e79ff700 1 -- 172.21.15.88:0/3763043168 shutdown_connections 2023-05-17T12:25:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.240+0000 7f144e39c700 1 --2- 172.21.15.88:0/2446483426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 0x7f14480b2a70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f144808a190 tx=0x7f1444009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb53a9cc9641724 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.242+0000 7f18f7fff700 1 -- 172.21.15.88:0/1611529930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 msgr2=0x7f18f8160f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.242+0000 7f18f7fff700 1 --2- 172.21.15.88:0/1611529930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 0x7f18f8160f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.242+0000 7f18f7fff700 1 -- 172.21.15.88:0/1611529930 >> v1:172.21.15.88:6789/0 conn(0x7f18f806c4f0 legacy=0x7f18f806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.242+0000 7f18f7fff700 1 -- 172.21.15.88:0/1611529930 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f80cda30 con 0x7f18f80cf6a0 2023-05-17T12:25:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.243+0000 7f18f7fff700 1 --2- 172.21.15.88:0/1611529930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f80cf6a0 0x7f18f80b6070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009d90 tx=0x7f18f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e95bf58786f789 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.243+0000 7fe99dffb700 1 -- 172.21.15.88:0/3857061587 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe998021070 con 0x7fe9a8161050 2023-05-17T12:25:36.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.243+0000 7f56f5ffb700 1 -- 172.21.15.88:0/1716073345 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56f800daa0 con 0x7f57001537b0 2023-05-17T12:25:36.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.245+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5700074530 con 0x7f57001537b0 2023-05-17T12:25:36.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.240+0000 7f16e79ff700 1 -- 172.21.15.88:0/3763043168 wait complete. 2023-05-17T12:25:36.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.243+0000 7f16e79ff700 1 Processor -- start 2023-05-17T12:25:36.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.245+0000 7fe99dffb700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe98c06adb0 0x7fe98c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.245+0000 7fe99dffb700 1 -- 172.21.15.88:0/3857061587 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe99808b3b0 con 0x7fe9a8161050 2023-05-17T12:25:36.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.243+0000 7f16e79ff700 1 -- start start 2023-05-17T12:25:36.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.245+0000 7f16e79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16e006d080 0x7f16e00bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.245+0000 7f16e79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e00c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.245+0000 7f16e79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16e00cd980 0x7f16e01e4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.245+0000 7f16e79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00c22c0 con 0x7f16e006d080 2023-05-17T12:25:36.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.245+0000 7f16e79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00bfb10 con 0x7f16e00cd980 2023-05-17T12:25:36.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.245+0000 7f16e79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e01e5ac0 con 0x7f16e0071520 2023-05-17T12:25:36.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7f16e5f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16e00cd980 0x7f16e01e4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7f16e5f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16e00cd980 0x7f16e01e4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:49050/0 (socket says 172.21.15.88:49050) 2023-05-17T12:25:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7f16e5f9c700 1 -- 172.21.15.88:0/2364854734 learned_addr learned my addr 172.21.15.88:0/2364854734 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7f16e4f9a700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e00c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7fe9ad19b700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe98c06adb0 0x7fe98c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7f56f5ffb700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56e406adb0 0x7f56e406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7f56f5ffb700 1 -- 172.21.15.88:0/1716073345 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f56f8089940 con 0x7f57001537b0 2023-05-17T12:25:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7f16e579b700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16e006d080 0x7f16e00bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.247+0000 7f570579b700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56e406adb0 0x7f56e406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7f16e5f9c700 1 -- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 msgr2=0x7f16e00c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.246+0000 7f16e5f9c700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e00c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.247+0000 7f16e5f9c700 1 -- 172.21.15.88:0/2364854734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16e006d080 msgr2=0x7f16e00bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.247+0000 7f16e5f9c700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16e006d080 0x7f16e00bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.247+0000 7f16e5f9c700 1 -- 172.21.15.88:0/2364854734 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00085d0 con 0x7f16e00cd980 2023-05-17T12:25:36.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.247+0000 7f16e5f9c700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16e00cd980 0x7f16e01e4920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16d000d370 tx=0x7f16d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.247+0000 7fe9ad19b700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe98c06adb0 0x7fe98c06d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009710 tx=0x7fe9a4006c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.248+0000 7f570579b700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56e406adb0 0x7f56e406d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f56f00098a0 tx=0x7f56f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.247+0000 7f16d5ffb700 1 -- 172.21.15.88:0/2364854734 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d00044d0 con 0x7f16e00cd980 2023-05-17T12:25:36.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.248+0000 7f16d5ffb700 1 -- 172.21.15.88:0/2364854734 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d00036a0 con 0x7f16e00cd980 2023-05-17T12:25:36.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.248+0000 7f16d5ffb700 1 -- 172.21.15.88:0/2364854734 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0003a50 con 0x7f16e00cd980 2023-05-17T12:25:36.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.248+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e00ccea0 con 0x7f16e00cd980 2023-05-17T12:25:36.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.248+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e0071d10 con 0x7f16e00cd980 2023-05-17T12:25:36.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.249+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e00cd180 con 0x7f16e00cd980 2023-05-17T12:25:36.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.250+0000 7f144cb99700 1 -- 172.21.15.88:0/2446483426 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144400b870 con 0x7f144806f940 2023-05-17T12:25:36.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.250+0000 7f144cb99700 1 -- 172.21.15.88:0/2446483426 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144400b9d0 con 0x7f144806f940 2023-05-17T12:25:36.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.250+0000 7f144cb99700 1 -- 172.21.15.88:0/2446483426 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144400bd60 con 0x7f144806f940 2023-05-17T12:25:36.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.250+0000 7fe99dffb700 1 -- 172.21.15.88:0/3857061587 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe998056300 con 0x7fe9a8161050 2023-05-17T12:25:36.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.250+0000 7f18f77fe700 1 -- 172.21.15.88:0/1611529930 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000e070 con 0x7f18f80cf6a0 2023-05-17T12:25:36.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.250+0000 7f18f77fe700 1 -- 172.21.15.88:0/1611529930 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f000bbd0 con 0x7f18f80cf6a0 2023-05-17T12:25:36.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.250+0000 7f18f77fe700 1 -- 172.21.15.88:0/1611529930 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0012430 con 0x7f18f80cf6a0 2023-05-17T12:25:36.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.251+0000 7f144fdff700 1 -- 172.21.15.88:0/2446483426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 msgr2=0x7f14480b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.251+0000 7f144fdff700 1 --2- 172.21.15.88:0/2446483426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 0x7f14480b2a70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f144808a190 tx=0x7f1444009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.251+0000 7f144fdff700 1 -- 172.21.15.88:0/2446483426 shutdown_connections 2023-05-17T12:25:36.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.251+0000 7f144fdff700 1 --2- 172.21.15.88:0/2446483426 >> v2:172.21.15.187:3300/0 conn(0x7f144815aa70 0x7f14480cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.251+0000 7f144fdff700 1 --2- 172.21.15.88:0/2446483426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 0x7f14480b2a70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.251+0000 7f144fdff700 1 --2- 172.21.15.88:0/2446483426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14480ced80 0x7f144806f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.251+0000 7f144fdff700 1 -- 172.21.15.88:0/2446483426 >> 172.21.15.88:0/2446483426 conn(0x7f144806ed00 msgr2=0x7f14480d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.251+0000 7f18ff1ff700 1 -- 172.21.15.88:0/1611529930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f80cf6a0 msgr2=0x7f18f80b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.251+0000 7f18ff1ff700 1 --2- 172.21.15.88:0/1611529930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f80cf6a0 0x7f18f80b6070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009d90 tx=0x7f18f000b330 comp rx=0 tx=0).stop 2023-05-17T12:25:36.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.252+0000 7f18ff1ff700 1 -- 172.21.15.88:0/1611529930 shutdown_connections 2023-05-17T12:25:36.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.252+0000 7f18ff1ff700 1 --2- 172.21.15.88:0/1611529930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 0x7f18f8160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.252+0000 7f18ff1ff700 1 --2- 172.21.15.88:0/1611529930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f80cf6a0 0x7f18f80b6070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.252+0000 7f18ff1ff700 1 -- 172.21.15.88:0/1611529930 >> 172.21.15.88:0/1611529930 conn(0x7f18f80d3eb0 msgr2=0x7f18f80cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.252+0000 7f144fdff700 1 -- 172.21.15.88:0/2446483426 shutdown_connections 2023-05-17T12:25:36.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.252+0000 7f56f5ffb700 1 -- 172.21.15.88:0/1716073345 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f56f80546e0 con 0x7f57001537b0 2023-05-17T12:25:36.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.252+0000 7f144fdff700 1 -- 172.21.15.88:0/2446483426 wait complete. 2023-05-17T12:25:36.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.252+0000 7f18ff1ff700 1 -- 172.21.15.88:0/1611529930 shutdown_connections 2023-05-17T12:25:36.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.252+0000 7f18ff1ff700 1 -- 172.21.15.88:0/1611529930 wait complete. 2023-05-17T12:25:36.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.255+0000 7f144fdff700 1 Processor -- start 2023-05-17T12:25:36.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.255+0000 7f144fdff700 1 -- start start 2023-05-17T12:25:36.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f144fdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 0x7f14481f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f144fdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14480ced80 0x7f144806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f144fdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f144815aa70 0x7f144806d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f144fdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14480c5ee0 con 0x7f144806f940 2023-05-17T12:25:36.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f144fdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14481f9b20 con 0x7f144815aa70 2023-05-17T12:25:36.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f144fdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480c60f0 con 0x7f14480ced80 2023-05-17T12:25:36.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.255+0000 7f18ff1ff700 1 Processor -- start 2023-05-17T12:25:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.256+0000 7f18ff1ff700 1 -- start start 2023-05-17T12:25:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f18ff1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18f806c4f0 0x7f18f80c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f18ff1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f80cf6a0 0x7f18f80c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f18ff1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 0x7f18f80b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f18ff1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f80c88e0 con 0x7f18f80cf6a0 2023-05-17T12:25:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f18ff1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f80c7cd0 con 0x7f18f806c4f0 2023-05-17T12:25:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.257+0000 7f18ff1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f80c7fb0 con 0x7f18f815c8e0 2023-05-17T12:25:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.258+0000 7f18fcf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18f806c4f0 0x7f18f80c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.258+0000 7f18fcf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18f806c4f0 0x7f18f80c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:49070/0 (socket says 172.21.15.88:49070) 2023-05-17T12:25:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.258+0000 7f18fcf9b700 1 -- 172.21.15.88:0/3640740888 learned_addr learned my addr 172.21.15.88:0/3640740888 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.258+0000 7f18fd79c700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 0x7f18f80b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.258+0000 7f18f7fff700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f80cf6a0 0x7f18f80c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.258+0000 7f144db9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 0x7f14481f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.258+0000 7f144db9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 0x7f14481f95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37602/0 (socket says 172.21.15.88:37602) 2023-05-17T12:25:36.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.258+0000 7f144db9b700 1 -- 172.21.15.88:0/1699702199 learned_addr learned my addr 172.21.15.88:0/1699702199 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.259+0000 7f18fd79c700 1 -- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18f806c4f0 msgr2=0x7f18f80c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.259+0000 7f18fd79c700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18f806c4f0 0x7f18f80c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.259+0000 7f18fd79c700 1 -- 172.21.15.88:0/3640740888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f80cf6a0 msgr2=0x7f18f80c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.259+0000 7f18fd79c700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f80cf6a0 0x7f18f80c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.259+0000 7f18fd79c700 1 -- 172.21.15.88:0/3640740888 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0009a70 con 0x7f18f815c8e0 2023-05-17T12:25:36.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.259+0000 7f18fd79c700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 0x7f18f80b6e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00c390 tx=0x7f18ec00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.260+0000 7f144db9b700 1 -- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14480ced80 msgr2=0x7f144806d3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-17T12:25:36.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.260+0000 7f144db9b700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14480ced80 0x7f144806d3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.260+0000 7f144db9b700 1 -- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f144815aa70 msgr2=0x7f144806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.260+0000 7f144db9b700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f144815aa70 0x7f144806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.260+0000 7f144db9b700 1 -- 172.21.15.88:0/1699702199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1444009550 con 0x7f144806f940 2023-05-17T12:25:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.260+0000 7f144db9b700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 0x7f14481f95e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f143800b550 tx=0x7f143800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.259+0000 7f18f57fa700 1 -- 172.21.15.88:0/3640740888 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec005b40 con 0x7f18f815c8e0 2023-05-17T12:25:36.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.260+0000 7f18f57fa700 1 -- 172.21.15.88:0/3640740888 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec005ca0 con 0x7f18f815c8e0 2023-05-17T12:25:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.260+0000 7f18f57fa700 1 -- 172.21.15.88:0/3640740888 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0072d0 con 0x7f18f815c8e0 2023-05-17T12:25:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.261+0000 7f143e7fc700 1 -- 172.21.15.88:0/1699702199 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438011830 con 0x7f144806f940 2023-05-17T12:25:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.261+0000 7f143e7fc700 1 -- 172.21.15.88:0/1699702199 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14380119b0 con 0x7f144806f940 2023-05-17T12:25:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.261+0000 7f143e7fc700 1 -- 172.21.15.88:0/1699702199 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438011d60 con 0x7f144806f940 2023-05-17T12:25:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.261+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14480cfe50 con 0x7f144806f940 2023-05-17T12:25:36.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.261+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14480cfb70 con 0x7f144806f940 2023-05-17T12:25:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.259+0000 7f16d5ffb700 1 -- 172.21.15.88:0/2364854734 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16d0003bb0 con 0x7f16e00cd980 2023-05-17T12:25:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.260+0000 7f16d5ffb700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16c406ad80 0x7f16c406d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.261+0000 7f16d5ffb700 1 -- 172.21.15.88:0/2364854734 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f16d008b0d0 con 0x7f16e00cd980 2023-05-17T12:25:36.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.261+0000 7f16d5ffb700 1 -- 172.21.15.88:0/2364854734 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f16d008d660 con 0x7f16e00cd980 2023-05-17T12:25:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.261+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f80d0e90 con 0x7f18f815c8e0 2023-05-17T12:25:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.261+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f80cdd10 con 0x7f18f815c8e0 2023-05-17T12:25:36.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.265+0000 7f18f57fa700 1 -- 172.21.15.88:0/3640740888 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18ec007430 con 0x7f18f815c8e0 2023-05-17T12:25:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.265+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f80cdff0 con 0x7f18f815c8e0 2023-05-17T12:25:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.266+0000 7f18f57fa700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f18e406ad30 0x7f18e406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.266+0000 7f18f57fa700 1 -- 172.21.15.88:0/3640740888 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f18ec088820 con 0x7f18f815c8e0 2023-05-17T12:25:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.267+0000 7f18fcf9b700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f18e406ad30 0x7f18e406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.267+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14300052f0 con 0x7f144806f940 2023-05-17T12:25:36.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.268+0000 7f143e7fc700 1 -- 172.21.15.88:0/1699702199 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f143801a410 con 0x7f144806f940 2023-05-17T12:25:36.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.269+0000 7f18fcf9b700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f18e406ad30 0x7f18e406d1e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006fd0 tx=0x7f18e8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.269+0000 7f16e579b700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16c406ad80 0x7f16c406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.269+0000 7f143e7fc700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f142c06ade0 0x7f142c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.270+0000 7f143e7fc700 1 -- 172.21.15.88:0/1699702199 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f14380891d0 con 0x7f144806f940 2023-05-17T12:25:36.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.271+0000 7f18f57fa700 1 -- 172.21.15.88:0/3640740888 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f18ec053700 con 0x7f18f815c8e0 2023-05-17T12:25:36.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.271+0000 7f144d39a700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f142c06ade0 0x7f142c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.278+0000 7f143e7fc700 1 -- 172.21.15.88:0/1699702199 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1438053f70 con 0x7f144806f940 2023-05-17T12:25:36.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.280+0000 7f16e579b700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16c406ad80 0x7f16c406d230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009930 tx=0x7f16dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.293+0000 7f144d39a700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f142c06ade0 0x7f142c06d290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f144815dde0 tx=0x7f1440007270 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.296+0000 7f8cd57ff700 1 Processor -- start 2023-05-17T12:25:36.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.296+0000 7f2d979ff700 1 Processor -- start 2023-05-17T12:25:36.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.296+0000 7f2d979ff700 1 -- start start 2023-05-17T12:25:36.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.296+0000 7f8cd57ff700 1 -- start start 2023-05-17T12:25:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.298+0000 7f2d979ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2d90070f70 0x7f2d900cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.298+0000 7f2d979ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9006dad0 0x7f2d9006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.298+0000 7f2d979ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9006d080 con 0x7f2d900c1c70 2023-05-17T12:25:36.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.298+0000 7f2d979ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d900cb3a0 con 0x7f2d90070f70 2023-05-17T12:25:36.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.298+0000 7f2d979ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9006d640 con 0x7f2d9006dad0 2023-05-17T12:25:36.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.300+0000 7f8cd57ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd00b88b0 0x7f8cd006af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.300+0000 7f8cd57ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cd006cb50 0x7f8cd00d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.300+0000 7f8cd57ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd006b500 con 0x7f8cd00d2750 2023-05-17T12:25:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.300+0000 7f8cd57ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd00cdfc0 con 0x7f8cd006cb50 2023-05-17T12:25:36.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.300+0000 7f8cd57ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00cdb30 con 0x7f8cd00b88b0 2023-05-17T12:25:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.301+0000 7f8cce7fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8cd00d2750 0x7f8cd006c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52044/0 (socket says 172.21.15.88:52044) 2023-05-17T12:25:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.301+0000 7f8cce7fc700 1 -- 172.21.15.88:0/426526822 learned_addr learned my addr 172.21.15.88:0/426526822 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.301+0000 7f8ccf7fe700 1 --2- 172.21.15.88:0/426526822 >> v2:172.21.15.88:3300/0 conn(0x7f8cd006cb50 0x7f8cd00d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.302+0000 7f8ccf7fe700 1 -- 172.21.15.88:0/426526822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd00b88b0 msgr2=0x7f8cd006af20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-17T12:25:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.302+0000 7f8ccf7fe700 1 --2- 172.21.15.88:0/426526822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd00b88b0 0x7f8cd006af20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.302+0000 7f8ccf7fe700 1 -- 172.21.15.88:0/426526822 >> v1:172.21.15.88:6789/0 conn(0x7f8cd00d2750 legacy=0x7f8cd006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.302+0000 7f8ccf7fe700 1 -- 172.21.15.88:0/426526822 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd00cf3c0 con 0x7f8cd006cb50 2023-05-17T12:25:36.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.303+0000 7f8ccf7fe700 1 --2- 172.21.15.88:0/426526822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd006cb50 0x7f8cd00d0d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009840 tx=0x7f8cc0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d38436a1cf75a3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.303+0000 7f2d94f9a700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f2d900c1c70 0x7f2d90071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40932/0 (socket says 172.21.15.88:40932) 2023-05-17T12:25:36.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.303+0000 7f2d94f9a700 1 -- 172.21.15.88:0/2527603155 learned_addr learned my addr 172.21.15.88:0/2527603155 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:36.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.304+0000 7f8ccdffb700 1 -- 172.21.15.88:0/426526822 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0011830 con 0x7f8cd006cb50 2023-05-17T12:25:36.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.304+0000 7f8ccdffb700 1 -- 172.21.15.88:0/426526822 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc0011990 con 0x7f8cd006cb50 2023-05-17T12:25:36.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.304+0000 7f8ccdffb700 1 -- 172.21.15.88:0/426526822 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0011d20 con 0x7f8cd006cb50 2023-05-17T12:25:36.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.304+0000 7f2d87fff700 1 -- 172.21.15.88:0/2527603155 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351822904 0 0) 0x7f2d9006d080 con 0x7f2d900c1c70 2023-05-17T12:25:36.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.304+0000 7f2d87fff700 1 -- 172.21.15.88:0/2527603155 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d7c0035b0 con 0x7f2d900c1c70 2023-05-17T12:25:36.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.304+0000 7f2d95f9c700 1 --2- 172.21.15.88:0/2527603155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9006dad0 0x7f2d9006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f8cd57ff700 1 -- 172.21.15.88:0/426526822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd006cb50 msgr2=0x7f8cd00d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f8cd57ff700 1 --2- 172.21.15.88:0/426526822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd006cb50 0x7f8cd00d0d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009840 tx=0x7f8cc0009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:36.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f8cd57ff700 1 -- 172.21.15.88:0/426526822 shutdown_connections 2023-05-17T12:25:36.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f8cd57ff700 1 --2- 172.21.15.88:0/426526822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd006cb50 0x7f8cd00d0d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f8cd57ff700 1 --2- 172.21.15.88:0/426526822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd00b88b0 0x7f8cd006af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f8cd57ff700 1 -- 172.21.15.88:0/426526822 >> 172.21.15.88:0/426526822 conn(0x7f8cd00d3e60 msgr2=0x7f8cd00cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f2d95f9c700 1 -- 172.21.15.88:0/2527603155 >> v2:172.21.15.187:3300/0 conn(0x7f2d90070f70 msgr2=0x7f2d900cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:36.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f2d95f9c700 1 --2- 172.21.15.88:0/2527603155 >> v2:172.21.15.187:3300/0 conn(0x7f2d90070f70 0x7f2d900cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f2d95f9c700 1 -- 172.21.15.88:0/2527603155 >> v1:172.21.15.187:6789/0 conn(0x7f2d900c1c70 legacy=0x7f2d90071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.305+0000 7f2d95f9c700 1 -- 172.21.15.88:0/2527603155 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9006ba00 con 0x7f2d9006dad0 2023-05-17T12:25:36.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.306+0000 7f2d95f9c700 1 --2- 172.21.15.88:0/2527603155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9006dad0 0x7f2d9006df50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009d90 tx=0x7f2d8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=177815bc3bd617b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.306+0000 7f2d87fff700 1 -- 172.21.15.88:0/2527603155 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800e070 con 0x7f2d9006dad0 2023-05-17T12:25:36.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.306+0000 7f2d87fff700 1 -- 172.21.15.88:0/2527603155 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8800bb20 con 0x7f2d9006dad0 2023-05-17T12:25:36.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.306+0000 7f2d87fff700 1 -- 172.21.15.88:0/2527603155 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88012430 con 0x7f2d9006dad0 2023-05-17T12:25:36.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.306+0000 7f8cd57ff700 1 -- 172.21.15.88:0/426526822 shutdown_connections 2023-05-17T12:25:36.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.307+0000 7f2d979ff700 1 -- 172.21.15.88:0/2527603155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9006dad0 msgr2=0x7f2d9006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.307+0000 7f2d979ff700 1 --2- 172.21.15.88:0/2527603155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9006dad0 0x7f2d9006df50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009d90 tx=0x7f2d8800b330 comp rx=0 tx=0).stop 2023-05-17T12:25:36.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.307+0000 7f2d979ff700 1 -- 172.21.15.88:0/2527603155 shutdown_connections 2023-05-17T12:25:36.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.307+0000 7f2d979ff700 1 --2- 172.21.15.88:0/2527603155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d9006dad0 0x7f2d9006df50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.307+0000 7f2d979ff700 1 --2- 172.21.15.88:0/2527603155 >> v2:172.21.15.187:3300/0 conn(0x7f2d90070f70 0x7f2d900cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.307+0000 7f2d979ff700 1 -- 172.21.15.88:0/2527603155 >> 172.21.15.88:0/2527603155 conn(0x7f2d900b1530 msgr2=0x7f2d900ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.308+0000 7f2d979ff700 1 -- 172.21.15.88:0/2527603155 shutdown_connections 2023-05-17T12:25:36.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.308+0000 7f2d979ff700 1 -- 172.21.15.88:0/2527603155 wait complete. 2023-05-17T12:25:36.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.310+0000 7f2d979ff700 1 Processor -- start 2023-05-17T12:25:36.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.307+0000 7f8cd57ff700 1 -- 172.21.15.88:0/426526822 wait complete. 2023-05-17T12:25:36.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.309+0000 7f8cd57ff700 1 Processor -- start 2023-05-17T12:25:36.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.311+0000 7f2d979ff700 1 -- start start 2023-05-17T12:25:36.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.311+0000 7f8cd57ff700 1 -- start start 2023-05-17T12:25:36.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.312+0000 7f8cd57ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd006cb50 0x7f8cd0149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.313+0000 7f8cd57ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00d2750 0x7f8cd0149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.313+0000 7f8cd57ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd014a310 0x7f8cd01495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.313+0000 7f8cd57ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00b4e30 con 0x7f8cd006cb50 2023-05-17T12:25:36.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.313+0000 7f8cd57ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00b5110 con 0x7f8cd00d2750 2023-05-17T12:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.313+0000 7f8cd57ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00b53f0 con 0x7f8cd014a310 2023-05-17T12:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.313+0000 7f8cce7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00d2750 0x7f8cd0149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.313+0000 7f8cce7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00d2750 0x7f8cd0149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:49094/0 (socket says 172.21.15.88:49094) 2023-05-17T12:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.313+0000 7f8cce7fc700 1 -- 172.21.15.88:0/228416679 learned_addr learned my addr 172.21.15.88:0/228416679 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.314+0000 7f8cce7fc700 1 -- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd014a310 msgr2=0x7f8cd01495a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T12:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.314+0000 7f8cce7fc700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd014a310 0x7f8cd01495a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.314+0000 7f8cce7fc700 1 -- 172.21.15.88:0/228416679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd006cb50 msgr2=0x7f8cd0149dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-17T12:25:36.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.314+0000 7f8cce7fc700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd006cb50 0x7f8cd0149dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.314+0000 7f8cce7fc700 1 -- 172.21.15.88:0/228416679 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00094a0 con 0x7f8cd00d2750 2023-05-17T12:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.314+0000 7f8cce7fc700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00d2750 0x7f8cd0149060 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c480 tx=0x7f8cc400c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.314+0000 7f8cb77fe700 1 -- 172.21.15.88:0/228416679 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4005e30 con 0x7f8cd00d2750 2023-05-17T12:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.314+0000 7f8cb77fe700 1 -- 172.21.15.88:0/228416679 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40070d0 con 0x7f8cd00d2750 2023-05-17T12:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.314+0000 7f8cb77fe700 1 -- 172.21.15.88:0/228416679 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4007440 con 0x7f8cd00d2750 2023-05-17T12:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.315+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd00cf940 con 0x7f8cd00d2750 2023-05-17T12:25:36.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.315+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd00cf660 con 0x7f8cd00d2750 2023-05-17T12:25:36.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.318+0000 7f2d979ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9006dad0 0x7f2d9015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.318+0000 7f2d979ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90070f70 0x7f2d900c3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.318+0000 7f2d979ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d900c1c70 0x7f2d901ec270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.318+0000 7f2d979ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d901ed2f0 con 0x7f2d90070f70 2023-05-17T12:25:36.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.318+0000 7f2d979ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900be4b0 con 0x7f2d9006dad0 2023-05-17T12:25:36.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.318+0000 7f2d979ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d901ec7b0 con 0x7f2d900c1c70 2023-05-17T12:25:36.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.319+0000 7f2d94f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90070f70 0x7f2d900c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.319+0000 7f2d94f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90070f70 0x7f2d900c3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37630/0 (socket says 172.21.15.88:37630) 2023-05-17T12:25:36.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.319+0000 7f2d94f9a700 1 -- 172.21.15.88:0/628216757 learned_addr learned my addr 172.21.15.88:0/628216757 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:36.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.320+0000 7f2d94f9a700 1 -- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d900c1c70 msgr2=0x7f2d901ec270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-17T12:25:36.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.320+0000 7f2d94f9a700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d900c1c70 0x7f2d901ec270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.320+0000 7f2d94f9a700 1 -- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9006dad0 msgr2=0x7f2d9015feb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-17T12:25:36.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.320+0000 7f2d94f9a700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9006dad0 0x7f2d9015feb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.320+0000 7f2d94f9a700 1 -- 172.21.15.88:0/628216757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88009a70 con 0x7f2d90070f70 2023-05-17T12:25:36.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.321+0000 7f2d94f9a700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90070f70 0x7f2d900c3240 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c001eb0 tx=0x7f2d8c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.317+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd00cd7c0 con 0x7f8cd00d2750 2023-05-17T12:25:36.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.319+0000 7f8cb77fe700 1 -- 172.21.15.88:0/228416679 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cc40075a0 con 0x7f8cd00d2750 2023-05-17T12:25:36.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.321+0000 7f8cb77fe700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8cbc08cd40 0x7f8cbc08f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.322+0000 7f2d85ffb700 1 -- 172.21.15.88:0/628216757 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c005d70 con 0x7f2d90070f70 2023-05-17T12:25:36.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.322+0000 7f2d85ffb700 1 -- 172.21.15.88:0/628216757 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0070d0 con 0x7f2d90070f70 2023-05-17T12:25:36.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.322+0000 7f2d85ffb700 1 -- 172.21.15.88:0/628216757 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c007440 con 0x7f2d90070f70 2023-05-17T12:25:36.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.322+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9006d2d0 con 0x7f2d90070f70 2023-05-17T12:25:36.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.322+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9006bce0 con 0x7f2d90070f70 2023-05-17T12:25:36.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.321+0000 7f8cceffd700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8cbc08cd40 0x7f8cbc08f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.322+0000 7f8cb77fe700 1 -- 172.21.15.88:0/228416679 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8cc405b490 con 0x7f8cd00d2750 2023-05-17T12:25:36.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.324+0000 7f8cceffd700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8cbc08cd40 0x7f8cbc08f1f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8cd008c450 tx=0x7f8cc8009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.326+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d90161410 con 0x7f2d90070f70 2023-05-17T12:25:36.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.327+0000 7f2d85ffb700 1 -- 172.21.15.88:0/628216757 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d8c0075a0 con 0x7f2d90070f70 2023-05-17T12:25:36.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.329+0000 7f2d85ffb700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2d7406ad30 0x7f2d7406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:36.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.330+0000 7f2d85ffb700 1 -- 172.21.15.88:0/628216757 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d8c088b90 con 0x7f2d90070f70 2023-05-17T12:25:36.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.330+0000 7f2d9579b700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2d7406ad30 0x7f2d7406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:36.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.333+0000 7f8cb77fe700 1 -- 172.21.15.88:0/228416679 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8cc4053810 con 0x7f8cd00d2750 2023-05-17T12:25:36.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.334+0000 7f2d9579b700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2d7406ad30 0x7f2d7406d1e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009690 tx=0x7f2d80006c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:36.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.340+0000 7f2d85ffb700 1 -- 172.21.15.88:0/628216757 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2d8c0539e0 con 0x7f2d90070f70 2023-05-17T12:25:36.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.615+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3674005870 con 0x7f36940714b0 2023-05-17T12:25:36.621 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-05-17T12:25:36.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.615+0000 7f367b7fe700 1 -- 172.21.15.88:0/602085166 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3688057d50 con 0x7f36940714b0 2023-05-17T12:25:36.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.619+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f368006adb0 msgr2=0x7f368006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.619+0000 7f36995ff700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f368006adb0 0x7f368006d260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36840090b0 tx=0x7f3684013040 comp rx=0 tx=0).stop 2023-05-17T12:25:36.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.619+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940714b0 msgr2=0x7f369414ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.619+0000 7f36995ff700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940714b0 0x7f369414ea30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f368800b500 tx=0x7f368800b810 comp rx=0 tx=0).stop 2023-05-17T12:25:36.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.620+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 shutdown_connections 2023-05-17T12:25:36.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.620+0000 7f36995ff700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f368006adb0 0x7f368006d260 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36840090b0 tx=0x7f3684013040 comp rx=0 tx=0).stop 2023-05-17T12:25:36.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.620+0000 7f36995ff700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694160ec0 0x7f369414ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.620+0000 7f36995ff700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f369406e100 0x7f36940cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.620+0000 7f36995ff700 1 --2- 172.21.15.88:0/602085166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940714b0 0x7f369414ea30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.620+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 >> 172.21.15.88:0/602085166 conn(0x7f36940b1530 msgr2=0x7f3694162750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.620+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 shutdown_connections 2023-05-17T12:25:36.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.620+0000 7f36995ff700 1 -- 172.21.15.88:0/602085166 wait complete. 2023-05-17T12:25:36.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-05-17T12:25:36.653 DEBUG:teuthology.parallel:result is None 2023-05-17T12:25:36.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.677+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f16e0074530 con 0x7f16e00cd980 2023-05-17T12:25:36.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.678+0000 7f16d5ffb700 1 -- 172.21.15.88:0/2364854734 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16d0056020 con 0x7f16e00cd980 2023-05-17T12:25:36.681 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-05-17T12:25:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16c406ad80 msgr2=0x7f16c406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16c406ad80 0x7f16c406d230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009930 tx=0x7f16dc008040 comp rx=0 tx=0).stop 2023-05-17T12:25:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16e00cd980 msgr2=0x7f16e01e4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16e00cd980 0x7f16e01e4920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16d000d370 tx=0x7f16d0004750 comp rx=0 tx=0).stop 2023-05-17T12:25:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 shutdown_connections 2023-05-17T12:25:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16c406ad80 0x7f16c406d230 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16e00cd980 0x7f16e01e4920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16e006d080 0x7f16e00bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 --2- 172.21.15.88:0/2364854734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16e0071520 0x7f16e00c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.680+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 >> 172.21.15.88:0/2364854734 conn(0x7f16e00b1530 msgr2=0x7f16e00b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.681+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 shutdown_connections 2023-05-17T12:25:36.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.681+0000 7f16e79ff700 1 -- 172.21.15.88:0/2364854734 wait complete. 2023-05-17T12:25:36.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.691+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57000c88c0 con 0x7f57001537b0 2023-05-17T12:25:36.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.692+0000 7f56f5ffb700 1 -- 172.21.15.88:0/1716073345 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56f8057d00 con 0x7f57001537b0 2023-05-17T12:25:36.695 INFO:teuthology.orchestra.run.smithi088.stdout:55834574862 2023-05-17T12:25:36.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56e406adb0 msgr2=0x7f56e406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56e406adb0 0x7f56e406d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f56f00098a0 tx=0x7f56f0008040 comp rx=0 tx=0).stop 2023-05-17T12:25:36.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57001537b0 msgr2=0x7f57000c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57001537b0 0x7f57000c6df0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5700070c60 tx=0x7f56f800ff00 comp rx=0 tx=0).stop 2023-05-17T12:25:36.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 shutdown_connections 2023-05-17T12:25:36.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56e406adb0 0x7f56e406d260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57001537b0 0x7f57000c6df0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56ec005a00 0x7f57001514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 --2- 172.21.15.88:0/1716073345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5700152110 0x7f5700153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 >> 172.21.15.88:0/1716073345 conn(0x7f57000b1530 msgr2=0x7f570006a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.696+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 shutdown_connections 2023-05-17T12:25:36.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.697+0000 7f57079ff700 1 -- 172.21.15.88:0/1716073345 wait complete. 2023-05-17T12:25:36.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2023-05-17T12:25:36.704 DEBUG:teuthology.parallel:result is None 2023-05-17T12:25:36.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.709+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe988005870 con 0x7fe9a8161050 2023-05-17T12:25:36.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.709+0000 7fe99dffb700 1 -- 172.21.15.88:0/3857061587 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe998059920 con 0x7fe9a8161050 2023-05-17T12:25:36.712 INFO:teuthology.orchestra.run.smithi088.stdout:55834574861 2023-05-17T12:25:36.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe98c06adb0 msgr2=0x7fe98c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe98c06adb0 0x7fe98c06d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009710 tx=0x7fe9a4006c60 comp rx=0 tx=0).stop 2023-05-17T12:25:36.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9a8161050 msgr2=0x7fe9a80b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9a8161050 0x7fe9a80b25b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe998009870 tx=0x7fe998004750 comp rx=0 tx=0).stop 2023-05-17T12:25:36.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 shutdown_connections 2023-05-17T12:25:36.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe98c06adb0 0x7fe98c06d260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9a8161420 0x7fe9a80c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9a806d080 0x7fe9a815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 --2- 172.21.15.88:0/3857061587 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9a8161050 0x7fe9a80b25b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.712+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 >> 172.21.15.88:0/3857061587 conn(0x7fe9a80b1530 msgr2=0x7fe9a80aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.713+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 shutdown_connections 2023-05-17T12:25:36.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.713+0000 7fe9af3ff700 1 -- 172.21.15.88:0/3857061587 wait complete. 2023-05-17T12:25:36.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.717+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f18f8074530 con 0x7f18f815c8e0 2023-05-17T12:25:36.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.718+0000 7f18f57fa700 1 -- 172.21.15.88:0/3640740888 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18ec056d20 con 0x7f18f815c8e0 2023-05-17T12:25:36.720 INFO:teuthology.orchestra.run.smithi088.stdout:55834574861 2023-05-17T12:25:36.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14300055a0 con 0x7f144806f940 2023-05-17T12:25:36.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f18e406ad30 msgr2=0x7f18e406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f18e406ad30 0x7f18e406d1e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006fd0 tx=0x7f18e8009190 comp rx=0 tx=0).stop 2023-05-17T12:25:36.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 msgr2=0x7f18f80b6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 0x7f18f80b6e20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00c390 tx=0x7f18ec00c6a0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 shutdown_connections 2023-05-17T12:25:36.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f18e406ad30 0x7f18e406d1e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18f815c8e0 0x7f18f80b6e20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18f806c4f0 0x7f18f80c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 --2- 172.21.15.88:0/3640740888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18f80cf6a0 0x7f18f80c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.720+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 >> 172.21.15.88:0/3640740888 conn(0x7f18f80d3eb0 msgr2=0x7f18f8158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.721+0000 7f143e7fc700 1 -- 172.21.15.88:0/1699702199 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1438057590 con 0x7f144806f940 2023-05-17T12:25:36.725 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-05-17T12:25:36.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.721+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 shutdown_connections 2023-05-17T12:25:36.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.721+0000 7f18ff1ff700 1 -- 172.21.15.88:0/3640740888 wait complete. 2023-05-17T12:25:36.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.0 2023-05-17T12:25:36.727 DEBUG:teuthology.parallel:result is None 2023-05-17T12:25:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f142c06ade0 msgr2=0x7f142c06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f142c06ade0 0x7f142c06d290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f144815dde0 tx=0x7f1440007270 comp rx=0 tx=0).stop 2023-05-17T12:25:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 msgr2=0x7f14481f95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 0x7f14481f95e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f143800b550 tx=0x7f143800b910 comp rx=0 tx=0).stop 2023-05-17T12:25:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 shutdown_connections 2023-05-17T12:25:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f142c06ade0 0x7f142c06d290 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f144815dde0 tx=0x7f1440007270 comp rx=0 tx=0).stop 2023-05-17T12:25:36.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f144815aa70 0x7f144806d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144806f940 0x7f14481f95e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 --2- 172.21.15.88:0/1699702199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14480ced80 0x7f144806d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 >> 172.21.15.88:0/1699702199 conn(0x7f144806ed00 msgr2=0x7f14480b6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 shutdown_connections 2023-05-17T12:25:36.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.725+0000 7f144fdff700 1 -- 172.21.15.88:0/1699702199 wait complete. 2023-05-17T12:25:36.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.5 2023-05-17T12:25:36.737 DEBUG:teuthology.parallel:result is None 2023-05-17T12:25:36.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.3 2023-05-17T12:25:36.746 DEBUG:teuthology.parallel:result is None 2023-05-17T12:25:36.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.751+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2d90074530 con 0x7f2d90070f70 2023-05-17T12:25:36.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.751+0000 7f2d85ffb700 1 -- 172.21.15.88:0/628216757 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d8c057000 con 0x7f2d90070f70 2023-05-17T12:25:36.754 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-05-17T12:25:36.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2023-05-17T12:25:36.756 DEBUG:teuthology.parallel:result is None 2023-05-17T12:25:36.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2d7406ad30 msgr2=0x7f2d7406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2d7406ad30 0x7f2d7406d1e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009690 tx=0x7f2d80006c10 comp rx=0 tx=0).stop 2023-05-17T12:25:36.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90070f70 msgr2=0x7f2d900c3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90070f70 0x7f2d900c3240 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c001eb0 tx=0x7f2d8c00c860 comp rx=0 tx=0).stop 2023-05-17T12:25:36.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 shutdown_connections 2023-05-17T12:25:36.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2d7406ad30 0x7f2d7406d1e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d900c1c70 0x7f2d901ec270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d9006dad0 0x7f2d9015feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 --2- 172.21.15.88:0/628216757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d90070f70 0x7f2d900c3240 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 >> 172.21.15.88:0/628216757 conn(0x7f2d900b1530 msgr2=0x7f2d900c9580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 shutdown_connections 2023-05-17T12:25:36.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.754+0000 7f2d979ff700 1 -- 172.21.15.88:0/628216757 wait complete. 2023-05-17T12:25:36.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.765+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8cd0067860 con 0x7f8cd00d2750 2023-05-17T12:25:36.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.765+0000 7f8cb77fe700 1 -- 172.21.15.88:0/228416679 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8cc4017090 con 0x7f8cd00d2750 2023-05-17T12:25:36.768 INFO:teuthology.orchestra.run.smithi088.stdout:55834574861 2023-05-17T12:25:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8cbc08cd40 msgr2=0x7f8cbc08f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8cbc08cd40 0x7f8cbc08f1f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8cd008c450 tx=0x7f8cc8009250 comp rx=0 tx=0).stop 2023-05-17T12:25:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00d2750 msgr2=0x7f8cd0149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00d2750 0x7f8cd0149060 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c480 tx=0x7f8cc400c840 comp rx=0 tx=0).stop 2023-05-17T12:25:36.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 shutdown_connections 2023-05-17T12:25:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8cbc08cd40 0x7f8cbc08f1f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd014a310 0x7f8cd01495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cd006cb50 0x7f8cd0149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 --2- 172.21.15.88:0/228416679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00d2750 0x7f8cd0149060 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 >> 172.21.15.88:0/228416679 conn(0x7f8cd00d3e60 msgr2=0x7f8cd00d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 shutdown_connections 2023-05-17T12:25:36.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:36.768+0000 7f8cd57ff700 1 -- 172.21.15.88:0/228416679 wait complete. 2023-05-17T12:25:36.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2023-05-17T12:25:36.774 DEBUG:teuthology.parallel:result is None 2023-05-17T12:25:36.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.1 2023-05-17T12:25:36.788 DEBUG:teuthology.parallel:result is None 2023-05-17T12:25:36.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-17T12:25:36.789 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T12:25:37.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.009+0000 7f052a7ff700 1 Processor -- start 2023-05-17T12:25:37.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.009+0000 7f052a7ff700 1 -- start start 2023-05-17T12:25:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.011+0000 7f052a7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f052415c840 0x7f052406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.011+0000 7f052a7ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f052406b0b0 0x7f05240cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.011+0000 7f052a7ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240cd6b0 con 0x7f052406c330 2023-05-17T12:25:37.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.011+0000 7f052a7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05240cdf50 con 0x7f052415c840 2023-05-17T12:25:37.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.011+0000 7f052a7ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05240cf860 con 0x7f052406b0b0 2023-05-17T12:25:37.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.011+0000 7f0523fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f052415c840 0x7f052406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.011+0000 7f0523fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f052415c840 0x7f052406b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37632/0 (socket says 172.21.15.88:37632) 2023-05-17T12:25:37.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.011+0000 7f0523fff700 1 -- 172.21.15.88:0/1174761370 learned_addr learned my addr 172.21.15.88:0/1174761370 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:37.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f05237fe700 1 --2- 172.21.15.88:0/1174761370 >> v2:172.21.15.187:3300/0 conn(0x7f052406b0b0 0x7f05240cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f0523fff700 1 -- 172.21.15.88:0/1174761370 >> v2:172.21.15.187:3300/0 conn(0x7f052406b0b0 msgr2=0x7f05240cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:37.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f0523fff700 1 --2- 172.21.15.88:0/1174761370 >> v2:172.21.15.187:3300/0 conn(0x7f052406b0b0 0x7f05240cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f0523fff700 1 -- 172.21.15.88:0/1174761370 >> v1:172.21.15.187:6789/0 conn(0x7f052406c330 legacy=0x7f0524160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f0523fff700 1 -- 172.21.15.88:0/1174761370 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240b2460 con 0x7f052415c840 2023-05-17T12:25:37.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f05237fe700 1 --2- 172.21.15.88:0/1174761370 >> v2:172.21.15.187:3300/0 conn(0x7f052406b0b0 0x7f05240cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:37.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f0523fff700 1 --2- 172.21.15.88:0/1174761370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052415c840 0x7f052406b940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05240cead0 tx=0x7f0514009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fab957c5535fc7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:37.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f0522ffd700 1 -- 172.21.15.88:0/1174761370 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400b870 con 0x7f052415c840 2023-05-17T12:25:37.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f0522ffd700 1 -- 172.21.15.88:0/1174761370 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051400b9d0 con 0x7f052415c840 2023-05-17T12:25:37.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.012+0000 7f0522ffd700 1 -- 172.21.15.88:0/1174761370 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051400bd60 con 0x7f052415c840 2023-05-17T12:25:37.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.013+0000 7f052a7ff700 1 -- 172.21.15.88:0/1174761370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052415c840 msgr2=0x7f052406b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.013+0000 7f052a7ff700 1 --2- 172.21.15.88:0/1174761370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052415c840 0x7f052406b940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05240cead0 tx=0x7f0514009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.013+0000 7f052a7ff700 1 -- 172.21.15.88:0/1174761370 shutdown_connections 2023-05-17T12:25:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.013+0000 7f052a7ff700 1 --2- 172.21.15.88:0/1174761370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052415c840 0x7f052406b940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.013+0000 7f052a7ff700 1 --2- 172.21.15.88:0/1174761370 >> v2:172.21.15.187:3300/0 conn(0x7f052406b0b0 0x7f05240cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.013+0000 7f052a7ff700 1 -- 172.21.15.88:0/1174761370 >> 172.21.15.88:0/1174761370 conn(0x7f05240d3060 msgr2=0x7f05240d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:37.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.013+0000 7f052a7ff700 1 -- 172.21.15.88:0/1174761370 shutdown_connections 2023-05-17T12:25:37.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.013+0000 7f052a7ff700 1 -- 172.21.15.88:0/1174761370 wait complete. 2023-05-17T12:25:37.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.015+0000 7f052a7ff700 1 Processor -- start 2023-05-17T12:25:37.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.015+0000 7f052a7ff700 1 -- start start 2023-05-17T12:25:37.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f052a7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f052406b0b0 0x7f05241e1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f052a7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052406c330 0x7f05241e3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f052a7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f052415c840 0x7f052415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f052a7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0524157ae0 con 0x7f052406c330 2023-05-17T12:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f052a7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05241e2070 con 0x7f052415c840 2023-05-17T12:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f052a7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05241e2280 con 0x7f052406b0b0 2023-05-17T12:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f05237fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052406c330 0x7f05241e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f05237fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052406c330 0x7f05241e3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37644/0 (socket says 172.21.15.88:37644) 2023-05-17T12:25:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f05237fe700 1 -- 172.21.15.88:0/412083622 learned_addr learned my addr 172.21.15.88:0/412083622 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f0523fff700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f052406b0b0 0x7f05241e1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.016+0000 7f0528d9c700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f052415c840 0x7f052415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f05237fe700 1 -- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f052406b0b0 msgr2=0x7f05241e1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f05237fe700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f052406b0b0 0x7f05241e1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f05237fe700 1 -- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f052415c840 msgr2=0x7f052415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f05237fe700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f052415c840 0x7f052415adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f05237fe700 1 -- 172.21.15.88:0/412083622 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514009550 con 0x7f052406c330 2023-05-17T12:25:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f05237fe700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052406c330 0x7f05241e3320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f051800e810 tx=0x7f051800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f0520ff9700 1 -- 172.21.15.88:0/412083622 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518004230 con 0x7f052406c330 2023-05-17T12:25:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f0520ff9700 1 -- 172.21.15.88:0/412083622 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518004390 con 0x7f052406c330 2023-05-17T12:25:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05240cd900 con 0x7f052406c330 2023-05-17T12:25:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f0520ff9700 1 -- 172.21.15.88:0/412083622 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05180036a0 con 0x7f052406c330 2023-05-17T12:25:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.017+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05240b2740 con 0x7f052406c330 2023-05-17T12:25:37.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.018+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05240cdbe0 con 0x7f052406c330 2023-05-17T12:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.019+0000 7f0520ff9700 1 -- 172.21.15.88:0/412083622 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0518003800 con 0x7f052406c330 2023-05-17T12:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.020+0000 7f0520ff9700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f051006ace0 0x7f051006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.020+0000 7f0520ff9700 1 -- 172.21.15.88:0/412083622 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0518089230 con 0x7f052406c330 2023-05-17T12:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.020+0000 7f0523fff700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f051006ace0 0x7f051006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.021+0000 7f0523fff700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f051006ace0 0x7f051006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0514014040 tx=0x7f0514008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:37.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.025+0000 7f0520ff9700 1 -- 172.21.15.88:0/412083622 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0518054060 con 0x7f052406c330 2023-05-17T12:25:37.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.215+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 --> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0524074530 con 0x7f051006ace0 2023-05-17T12:25:37.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.226+0000 7f0520ff9700 1 -- 172.21.15.88:0/412083622 <== mgr.4106 v2:172.21.15.187:6832/2490620069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367378 (secure 0 0 0) 0x7f0524074530 con 0x7f051006ace0 2023-05-17T12:25:37.235 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:37.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f051006ace0 msgr2=0x7f051006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f051006ace0 0x7f051006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0514014040 tx=0x7f0514008030 comp rx=0 tx=0).stop 2023-05-17T12:25:37.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052406c330 msgr2=0x7f05241e3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052406c330 0x7f05241e3320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f051800e810 tx=0x7f051800ebd0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 shutdown_connections 2023-05-17T12:25:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f051006ace0 0x7f051006d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f052415c840 0x7f052415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f052406b0b0 0x7f05241e1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 --2- 172.21.15.88:0/412083622 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f052406c330 0x7f05241e3320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 >> 172.21.15.88:0/412083622 conn(0x7f05240d3060 msgr2=0x7f05240b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:37.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 shutdown_connections 2023-05-17T12:25:37.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.231+0000 7f052a7ff700 1 -- 172.21.15.88:0/412083622 wait complete. 2023-05-17T12:25:37.239 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-05-17T12:25:37.251 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-05-17T12:25:35.456872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67560,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907160,"statfs":{"total":773094113280,"available":773024931840,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003927"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296789+0000","last_change":"2023-05-17T12:25:01.795822+0000","last_active":"2023-05-17T12:25:06.296789+0000","last_peered":"2023-05-17T12:25:06.296789+0000","last_clean":"2023-05-17T12:25:06.296789+0000","last_became_active":"2023-05-17T12:25:01.795035+0000","last_became_peered":"2023-05-17T12:25:01.795035+0000","last_unstale":"2023-05-17T12:25:06.296789+0000","last_undegraded":"2023-05-17T12:25:06.296789+0000","last_fullsized":"2023-05-17T12:25:06.296789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:29:24.037566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299680+0000","last_change":"2023-05-17T12:25:01.804268+0000","last_active":"2023-05-17T12:25:06.299680+0000","last_peered":"2023-05-17T12:25:06.299680+0000","last_clean":"2023-05-17T12:25:06.299680+0000","last_became_active":"2023-05-17T12:25:01.803974+0000","last_became_peered":"2023-05-17T12:25:01.803974+0000","last_unstale":"2023-05-17T12:25:06.299680+0000","last_undegraded":"2023-05-17T12:25:06.299680+0000","last_fullsized":"2023-05-17T12:25:06.299680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:16.838754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996137+0000","last_change":"2023-05-17T12:25:01.808847+0000","last_active":"2023-05-17T12:25:06.996137+0000","last_peered":"2023-05-17T12:25:06.996137+0000","last_clean":"2023-05-17T12:25:06.996137+0000","last_became_active":"2023-05-17T12:25:01.808039+0000","last_became_peered":"2023-05-17T12:25:01.808039+0000","last_unstale":"2023-05-17T12:25:06.996137+0000","last_undegraded":"2023-05-17T12:25:06.996137+0000","last_fullsized":"2023-05-17T12:25:06.996137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:34:11.837824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298571+0000","last_change":"2023-05-17T12:25:01.804061+0000","last_active":"2023-05-17T12:25:06.298571+0000","last_peered":"2023-05-17T12:25:06.298571+0000","last_clean":"2023-05-17T12:25:06.298571+0000","last_became_active":"2023-05-17T12:25:01.803700+0000","last_became_peered":"2023-05-17T12:25:01.803700+0000","last_unstale":"2023-05-17T12:25:06.298571+0000","last_undegraded":"2023-05-17T12:25:06.298571+0000","last_fullsized":"2023-05-17T12:25:06.298571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:13:33.437413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325509+0000","last_change":"2023-05-17T12:25:01.799019+0000","last_active":"2023-05-17T12:25:06.325509+0000","last_peered":"2023-05-17T12:25:06.325509+0000","last_clean":"2023-05-17T12:25:06.325509+0000","last_became_active":"2023-05-17T12:25:01.798806+0000","last_became_peered":"2023-05-17T12:25:01.798806+0000","last_unstale":"2023-05-17T12:25:06.325509+0000","last_undegraded":"2023-05-17T12:25:06.325509+0000","last_fullsized":"2023-05-17T12:25:06.325509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995568+0000","last_change":"2023-05-17T12:25:01.803257+0000","last_active":"2023-05-17T12:25:06.995568+0000","last_peered":"2023-05-17T12:25:06.995568+0000","last_clean":"2023-05-17T12:25:06.995568+0000","last_became_active":"2023-05-17T12:25:01.802691+0000","last_became_peered":"2023-05-17T12:25:01.802691+0000","last_unstale":"2023-05-17T12:25:06.995568+0000","last_undegraded":"2023-05-17T12:25:06.995568+0000","last_fullsized":"2023-05-17T12:25:06.995568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:19:39.033646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996181+0000","last_change":"2023-05-17T12:25:01.806572+0000","last_active":"2023-05-17T12:25:06.996181+0000","last_peered":"2023-05-17T12:25:06.996181+0000","last_clean":"2023-05-17T12:25:06.996181+0000","last_became_active":"2023-05-17T12:25:01.806281+0000","last_became_peered":"2023-05-17T12:25:01.806281+0000","last_unstale":"2023-05-17T12:25:06.996181+0000","last_undegraded":"2023-05-17T12:25:06.996181+0000","last_fullsized":"2023-05-17T12:25:06.996181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:56:53.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299059+0000","last_change":"2023-05-17T12:25:01.803927+0000","last_active":"2023-05-17T12:25:06.299059+0000","last_peered":"2023-05-17T12:25:06.299059+0000","last_clean":"2023-05-17T12:25:06.299059+0000","last_became_active":"2023-05-17T12:25:01.803617+0000","last_became_peered":"2023-05-17T12:25:01.803617+0000","last_unstale":"2023-05-17T12:25:06.299059+0000","last_undegraded":"2023-05-17T12:25:06.299059+0000","last_fullsized":"2023-05-17T12:25:06.299059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:22.759151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325614+0000","last_change":"2023-05-17T12:25:01.799177+0000","last_active":"2023-05-17T12:25:06.325614+0000","last_peered":"2023-05-17T12:25:06.325614+0000","last_clean":"2023-05-17T12:25:06.325614+0000","last_became_active":"2023-05-17T12:25:01.798532+0000","last_became_peered":"2023-05-17T12:25:01.798532+0000","last_unstale":"2023-05-17T12:25:06.325614+0000","last_undegraded":"2023-05-17T12:25:06.325614+0000","last_fullsized":"2023-05-17T12:25:06.325614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:22.299274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299922+0000","last_change":"2023-05-17T12:25:01.798406+0000","last_active":"2023-05-17T12:25:06.299922+0000","last_peered":"2023-05-17T12:25:06.299922+0000","last_clean":"2023-05-17T12:25:06.299922+0000","last_became_active":"2023-05-17T12:25:01.798107+0000","last_became_peered":"2023-05-17T12:25:01.798107+0000","last_unstale":"2023-05-17T12:25:06.299922+0000","last_undegraded":"2023-05-17T12:25:06.299922+0000","last_fullsized":"2023-05-17T12:25:06.299922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:56.325526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996483+0000","last_change":"2023-05-17T12:25:01.810494+0000","last_active":"2023-05-17T12:25:06.996483+0000","last_peered":"2023-05-17T12:25:06.996483+0000","last_clean":"2023-05-17T12:25:06.996483+0000","last_became_active":"2023-05-17T12:25:01.810141+0000","last_became_peered":"2023-05-17T12:25:01.810141+0000","last_unstale":"2023-05-17T12:25:06.996483+0000","last_undegraded":"2023-05-17T12:25:06.996483+0000","last_fullsized":"2023-05-17T12:25:06.996483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:55:47.642675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296559+0000","last_change":"2023-05-17T12:25:01.810500+0000","last_active":"2023-05-17T12:25:06.296559+0000","last_peered":"2023-05-17T12:25:06.296559+0000","last_clean":"2023-05-17T12:25:06.296559+0000","last_became_active":"2023-05-17T12:25:01.810218+0000","last_became_peered":"2023-05-17T12:25:01.810218+0000","last_unstale":"2023-05-17T12:25:06.296559+0000","last_undegraded":"2023-05-17T12:25:06.296559+0000","last_fullsized":"2023-05-17T12:25:06.296559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:25.158644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296403+0000","last_change":"2023-05-17T12:25:01.795337+0000","last_active":"2023-05-17T12:25:06.296403+0000","last_peered":"2023-05-17T12:25:06.296403+0000","last_clean":"2023-05-17T12:25:06.296403+0000","last_became_active":"2023-05-17T12:25:01.795015+0000","last_became_peered":"2023-05-17T12:25:01.795015+0000","last_unstale":"2023-05-17T12:25:06.296403+0000","last_undegraded":"2023-05-17T12:25:06.296403+0000","last_fullsized":"2023-05-17T12:25:06.296403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:08:00.351240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298545+0000","last_change":"2023-05-17T12:25:01.794491+0000","last_active":"2023-05-17T12:25:06.298545+0000","last_peered":"2023-05-17T12:25:06.298545+0000","last_clean":"2023-05-17T12:25:06.298545+0000","last_became_active":"2023-05-17T12:25:01.794195+0000","last_became_peered":"2023-05-17T12:25:01.794195+0000","last_unstale":"2023-05-17T12:25:06.298545+0000","last_undegraded":"2023-05-17T12:25:06.298545+0000","last_fullsized":"2023-05-17T12:25:06.298545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:42:56.633809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995720+0000","last_change":"2023-05-17T12:25:01.806504+0000","last_active":"2023-05-17T12:25:06.995720+0000","last_peered":"2023-05-17T12:25:06.995720+0000","last_clean":"2023-05-17T12:25:06.995720+0000","last_became_active":"2023-05-17T12:25:01.806169+0000","last_became_peered":"2023-05-17T12:25:01.806169+0000","last_unstale":"2023-05-17T12:25:06.995720+0000","last_undegraded":"2023-05-17T12:25:06.995720+0000","last_fullsized":"2023-05-17T12:25:06.995720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995025+0000","last_change":"2023-05-17T12:25:01.810537+0000","last_active":"2023-05-17T12:25:06.995025+0000","last_peered":"2023-05-17T12:25:06.995025+0000","last_clean":"2023-05-17T12:25:06.995025+0000","last_became_active":"2023-05-17T12:25:01.809999+0000","last_became_peered":"2023-05-17T12:25:01.809999+0000","last_unstale":"2023-05-17T12:25:06.995025+0000","last_undegraded":"2023-05-17T12:25:06.995025+0000","last_fullsized":"2023-05-17T12:25:06.995025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:02:23.504157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325601+0000","last_change":"2023-05-17T12:25:01.798577+0000","last_active":"2023-05-17T12:25:06.325601+0000","last_peered":"2023-05-17T12:25:06.325601+0000","last_clean":"2023-05-17T12:25:06.325601+0000","last_became_active":"2023-05-17T12:25:01.798348+0000","last_became_peered":"2023-05-17T12:25:01.798348+0000","last_unstale":"2023-05-17T12:25:06.325601+0000","last_undegraded":"2023-05-17T12:25:06.325601+0000","last_fullsized":"2023-05-17T12:25:06.325601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996347+0000","last_change":"2023-05-17T12:25:01.810349+0000","last_active":"2023-05-17T12:25:06.996347+0000","last_peered":"2023-05-17T12:25:06.996347+0000","last_clean":"2023-05-17T12:25:06.996347+0000","last_became_active":"2023-05-17T12:25:01.809853+0000","last_became_peered":"2023-05-17T12:25:01.809853+0000","last_unstale":"2023-05-17T12:25:06.996347+0000","last_undegraded":"2023-05-17T12:25:06.996347+0000","last_fullsized":"2023-05-17T12:25:06.996347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:04:42.761172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296403+0000","last_change":"2023-05-17T12:25:01.811973+0000","last_active":"2023-05-17T12:25:06.296403+0000","last_peered":"2023-05-17T12:25:06.296403+0000","last_clean":"2023-05-17T12:25:06.296403+0000","last_became_active":"2023-05-17T12:25:01.811764+0000","last_became_peered":"2023-05-17T12:25:01.811764+0000","last_unstale":"2023-05-17T12:25:06.296403+0000","last_undegraded":"2023-05-17T12:25:06.296403+0000","last_fullsized":"2023-05-17T12:25:06.296403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:59:51.442756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995789+0000","last_change":"2023-05-17T12:25:01.812104+0000","last_active":"2023-05-17T12:25:06.995789+0000","last_peered":"2023-05-17T12:25:06.995789+0000","last_clean":"2023-05-17T12:25:06.995789+0000","last_became_active":"2023-05-17T12:25:01.811782+0000","last_became_peered":"2023-05-17T12:25:01.811782+0000","last_unstale":"2023-05-17T12:25:06.995789+0000","last_undegraded":"2023-05-17T12:25:06.995789+0000","last_fullsized":"2023-05-17T12:25:06.995789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:27:46.682969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995644+0000","last_change":"2023-05-17T12:25:01.800327+0000","last_active":"2023-05-17T12:25:06.995644+0000","last_peered":"2023-05-17T12:25:06.995644+0000","last_clean":"2023-05-17T12:25:06.995644+0000","last_became_active":"2023-05-17T12:25:01.799859+0000","last_became_peered":"2023-05-17T12:25:01.799859+0000","last_unstale":"2023-05-17T12:25:06.995644+0000","last_undegraded":"2023-05-17T12:25:06.995644+0000","last_fullsized":"2023-05-17T12:25:06.995644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:22.299274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325260+0000","last_change":"2023-05-17T12:25:01.804627+0000","last_active":"2023-05-17T12:25:06.325260+0000","last_peered":"2023-05-17T12:25:06.325260+0000","last_clean":"2023-05-17T12:25:06.325260+0000","last_became_active":"2023-05-17T12:25:01.804355+0000","last_became_peered":"2023-05-17T12:25:01.804355+0000","last_unstale":"2023-05-17T12:25:06.325260+0000","last_undegraded":"2023-05-17T12:25:06.325260+0000","last_fullsized":"2023-05-17T12:25:06.325260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:58.149661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994004+0000","last_change":"2023-05-17T12:25:01.795597+0000","last_active":"2023-05-17T12:25:06.994004+0000","last_peered":"2023-05-17T12:25:06.994004+0000","last_clean":"2023-05-17T12:25:06.994004+0000","last_became_active":"2023-05-17T12:25:01.794994+0000","last_became_peered":"2023-05-17T12:25:01.794994+0000","last_unstale":"2023-05-17T12:25:06.994004+0000","last_undegraded":"2023-05-17T12:25:06.994004+0000","last_fullsized":"2023-05-17T12:25:06.994004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995908+0000","last_change":"2023-05-17T12:25:01.799968+0000","last_active":"2023-05-17T12:25:06.995908+0000","last_peered":"2023-05-17T12:25:06.995908+0000","last_clean":"2023-05-17T12:25:06.995908+0000","last_became_active":"2023-05-17T12:25:01.799673+0000","last_became_peered":"2023-05-17T12:25:01.799673+0000","last_unstale":"2023-05-17T12:25:06.995908+0000","last_undegraded":"2023-05-17T12:25:06.995908+0000","last_fullsized":"2023-05-17T12:25:06.995908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:01.358359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494793+0000","last_change":"2023-05-17T12:25:01.808781+0000","last_active":"2023-05-17T12:25:06.494793+0000","last_peered":"2023-05-17T12:25:06.494793+0000","last_clean":"2023-05-17T12:25:06.494793+0000","last_became_active":"2023-05-17T12:25:01.808497+0000","last_became_peered":"2023-05-17T12:25:01.808497+0000","last_unstale":"2023-05-17T12:25:06.494793+0000","last_undegraded":"2023-05-17T12:25:06.494793+0000","last_fullsized":"2023-05-17T12:25:06.494793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.495101+0000","last_change":"2023-05-17T12:25:01.799943+0000","last_active":"2023-05-17T12:25:06.495101+0000","last_peered":"2023-05-17T12:25:06.495101+0000","last_clean":"2023-05-17T12:25:06.495101+0000","last_became_active":"2023-05-17T12:25:01.799590+0000","last_became_peered":"2023-05-17T12:25:01.799590+0000","last_unstale":"2023-05-17T12:25:06.495101+0000","last_undegraded":"2023-05-17T12:25:06.495101+0000","last_fullsized":"2023-05-17T12:25:06.495101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299616+0000","last_change":"2023-05-17T12:25:01.809762+0000","last_active":"2023-05-17T12:25:06.299616+0000","last_peered":"2023-05-17T12:25:06.299616+0000","last_clean":"2023-05-17T12:25:06.299616+0000","last_became_active":"2023-05-17T12:25:01.809453+0000","last_became_peered":"2023-05-17T12:25:01.809453+0000","last_unstale":"2023-05-17T12:25:06.299616+0000","last_undegraded":"2023-05-17T12:25:06.299616+0000","last_fullsized":"2023-05-17T12:25:06.299616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996398+0000","last_change":"2023-05-17T12:25:05.826281+0000","last_active":"2023-05-17T12:25:06.996398+0000","last_peered":"2023-05-17T12:25:06.996398+0000","last_clean":"2023-05-17T12:25:06.996398+0000","last_became_active":"2023-05-17T12:25:05.825799+0000","last_became_peered":"2023-05-17T12:25:05.825799+0000","last_unstale":"2023-05-17T12:25:06.996398+0000","last_undegraded":"2023-05-17T12:25:06.996398+0000","last_fullsized":"2023-05-17T12:25:06.996398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:29:56.321361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995190+0000","last_change":"2023-05-17T12:25:01.309876+0000","last_active":"2023-05-17T12:25:06.995190+0000","last_peered":"2023-05-17T12:25:06.995190+0000","last_clean":"2023-05-17T12:25:06.995190+0000","last_became_active":"2023-05-17T12:25:01.307886+0000","last_became_peered":"2023-05-17T12:25:01.307886+0000","last_unstale":"2023-05-17T12:25:06.995190+0000","last_undegraded":"2023-05-17T12:25:06.995190+0000","last_fullsized":"2023-05-17T12:25:06.995190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:18:49.877888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994778+0000","last_change":"2023-05-17T12:25:01.803127+0000","last_active":"2023-05-17T12:25:06.994778+0000","last_peered":"2023-05-17T12:25:06.994778+0000","last_clean":"2023-05-17T12:25:06.994778+0000","last_became_active":"2023-05-17T12:25:01.802844+0000","last_became_peered":"2023-05-17T12:25:01.802844+0000","last_unstale":"2023-05-17T12:25:06.994778+0000","last_undegraded":"2023-05-17T12:25:06.994778+0000","last_fullsized":"2023-05-17T12:25:06.994778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:52:59.526969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298648+0000","last_change":"2023-05-17T12:25:05.828211+0000","last_active":"2023-05-17T12:25:06.298648+0000","last_peered":"2023-05-17T12:25:06.298648+0000","last_clean":"2023-05-17T12:25:06.298648+0000","last_became_active":"2023-05-17T12:25:05.827748+0000","last_became_peered":"2023-05-17T12:25:05.827748+0000","last_unstale":"2023-05-17T12:25:06.298648+0000","last_undegraded":"2023-05-17T12:25:06.298648+0000","last_fullsized":"2023-05-17T12:25:06.298648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:07:33.893870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.493925+0000","last_change":"2023-05-17T12:25:01.302947+0000","last_active":"2023-05-17T12:25:06.493925+0000","last_peered":"2023-05-17T12:25:06.493925+0000","last_clean":"2023-05-17T12:25:06.493925+0000","last_became_active":"2023-05-17T12:25:01.302640+0000","last_became_peered":"2023-05-17T12:25:01.302640+0000","last_unstale":"2023-05-17T12:25:06.493925+0000","last_undegraded":"2023-05-17T12:25:06.493925+0000","last_fullsized":"2023-05-17T12:25:06.493925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:46:32.251609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325638+0000","last_change":"2023-05-17T12:25:01.810080+0000","last_active":"2023-05-17T12:25:06.325638+0000","last_peered":"2023-05-17T12:25:06.325638+0000","last_clean":"2023-05-17T12:25:06.325638+0000","last_became_active":"2023-05-17T12:25:01.808787+0000","last_became_peered":"2023-05-17T12:25:01.808787+0000","last_unstale":"2023-05-17T12:25:06.325638+0000","last_undegraded":"2023-05-17T12:25:06.325638+0000","last_fullsized":"2023-05-17T12:25:06.325638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325836+0000","last_change":"2023-05-17T12:25:05.831211+0000","last_active":"2023-05-17T12:25:06.325836+0000","last_peered":"2023-05-17T12:25:06.325836+0000","last_clean":"2023-05-17T12:25:06.325836+0000","last_became_active":"2023-05-17T12:25:05.830823+0000","last_became_peered":"2023-05-17T12:25:05.830823+0000","last_unstale":"2023-05-17T12:25:06.325836+0000","last_undegraded":"2023-05-17T12:25:06.325836+0000","last_fullsized":"2023-05-17T12:25:06.325836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:04.874650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994157+0000","last_change":"2023-05-17T12:25:01.304687+0000","last_active":"2023-05-17T12:25:06.994157+0000","last_peered":"2023-05-17T12:25:06.994157+0000","last_clean":"2023-05-17T12:25:06.994157+0000","last_became_active":"2023-05-17T12:25:01.304242+0000","last_became_peered":"2023-05-17T12:25:01.304242+0000","last_unstale":"2023-05-17T12:25:06.994157+0000","last_undegraded":"2023-05-17T12:25:06.994157+0000","last_fullsized":"2023-05-17T12:25:06.994157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:27.380050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298774+0000","last_change":"2023-05-17T12:25:01.807436+0000","last_active":"2023-05-17T12:25:06.298774+0000","last_peered":"2023-05-17T12:25:06.298774+0000","last_clean":"2023-05-17T12:25:06.298774+0000","last_became_active":"2023-05-17T12:25:01.807174+0000","last_became_peered":"2023-05-17T12:25:01.807174+0000","last_unstale":"2023-05-17T12:25:06.298774+0000","last_undegraded":"2023-05-17T12:25:06.298774+0000","last_fullsized":"2023-05-17T12:25:06.298774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:53:31.008703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298892+0000","last_change":"2023-05-17T12:25:05.833027+0000","last_active":"2023-05-17T12:25:06.298892+0000","last_peered":"2023-05-17T12:25:06.298892+0000","last_clean":"2023-05-17T12:25:06.298892+0000","last_became_active":"2023-05-17T12:25:05.832612+0000","last_became_peered":"2023-05-17T12:25:05.832612+0000","last_unstale":"2023-05-17T12:25:06.298892+0000","last_undegraded":"2023-05-17T12:25:06.298892+0000","last_fullsized":"2023-05-17T12:25:06.298892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:55:06.307490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325684+0000","last_change":"2023-05-17T12:25:01.310559+0000","last_active":"2023-05-17T12:25:06.325684+0000","last_peered":"2023-05-17T12:25:06.325684+0000","last_clean":"2023-05-17T12:25:06.325684+0000","last_became_active":"2023-05-17T12:25:01.310250+0000","last_became_peered":"2023-05-17T12:25:01.310250+0000","last_unstale":"2023-05-17T12:25:06.325684+0000","last_undegraded":"2023-05-17T12:25:06.325684+0000","last_fullsized":"2023-05-17T12:25:06.325684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:15.832901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994111+0000","last_change":"2023-05-17T12:25:01.805412+0000","last_active":"2023-05-17T12:25:06.994111+0000","last_peered":"2023-05-17T12:25:06.994111+0000","last_clean":"2023-05-17T12:25:06.994111+0000","last_became_active":"2023-05-17T12:25:01.805151+0000","last_became_peered":"2023-05-17T12:25:01.805151+0000","last_unstale":"2023-05-17T12:25:06.994111+0000","last_undegraded":"2023-05-17T12:25:06.994111+0000","last_fullsized":"2023-05-17T12:25:06.994111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995226+0000","last_change":"2023-05-17T12:25:05.838900+0000","last_active":"2023-05-17T12:25:06.995226+0000","last_peered":"2023-05-17T12:25:06.995226+0000","last_clean":"2023-05-17T12:25:06.995226+0000","last_became_active":"2023-05-17T12:25:05.838472+0000","last_became_peered":"2023-05-17T12:25:05.838472+0000","last_unstale":"2023-05-17T12:25:06.995226+0000","last_undegraded":"2023-05-17T12:25:06.995226+0000","last_fullsized":"2023-05-17T12:25:06.995226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:33.512949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299849+0000","last_change":"2023-05-17T12:25:01.303641+0000","last_active":"2023-05-17T12:25:06.299849+0000","last_peered":"2023-05-17T12:25:06.299849+0000","last_clean":"2023-05-17T12:25:06.299849+0000","last_became_active":"2023-05-17T12:25:01.303288+0000","last_became_peered":"2023-05-17T12:25:01.303288+0000","last_unstale":"2023-05-17T12:25:06.299849+0000","last_undegraded":"2023-05-17T12:25:06.299849+0000","last_fullsized":"2023-05-17T12:25:06.299849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:41.485809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994071+0000","last_change":"2023-05-17T12:25:01.813134+0000","last_active":"2023-05-17T12:25:06.994071+0000","last_peered":"2023-05-17T12:25:06.994071+0000","last_clean":"2023-05-17T12:25:06.994071+0000","last_became_active":"2023-05-17T12:25:01.812890+0000","last_became_peered":"2023-05-17T12:25:01.812890+0000","last_unstale":"2023-05-17T12:25:06.994071+0000","last_undegraded":"2023-05-17T12:25:06.994071+0000","last_fullsized":"2023-05-17T12:25:06.994071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994712+0000","last_change":"2023-05-17T12:25:05.825529+0000","last_active":"2023-05-17T12:25:06.994712+0000","last_peered":"2023-05-17T12:25:06.994712+0000","last_clean":"2023-05-17T12:25:06.994712+0000","last_became_active":"2023-05-17T12:25:05.825141+0000","last_became_peered":"2023-05-17T12:25:05.825141+0000","last_unstale":"2023-05-17T12:25:06.994712+0000","last_undegraded":"2023-05-17T12:25:06.994712+0000","last_fullsized":"2023-05-17T12:25:06.994712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:01.828288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995416+0000","last_change":"2023-05-17T12:25:01.312424+0000","last_active":"2023-05-17T12:25:06.995416+0000","last_peered":"2023-05-17T12:25:06.995416+0000","last_clean":"2023-05-17T12:25:06.995416+0000","last_became_active":"2023-05-17T12:25:01.312124+0000","last_became_peered":"2023-05-17T12:25:01.312124+0000","last_unstale":"2023-05-17T12:25:06.995416+0000","last_undegraded":"2023-05-17T12:25:06.995416+0000","last_fullsized":"2023-05-17T12:25:06.995416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:15.832901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494444+0000","last_change":"2023-05-17T12:25:01.808707+0000","last_active":"2023-05-17T12:25:06.494444+0000","last_peered":"2023-05-17T12:25:06.494444+0000","last_clean":"2023-05-17T12:25:06.494444+0000","last_became_active":"2023-05-17T12:25:01.808370+0000","last_became_peered":"2023-05-17T12:25:01.808370+0000","last_unstale":"2023-05-17T12:25:06.494444+0000","last_undegraded":"2023-05-17T12:25:06.494444+0000","last_fullsized":"2023-05-17T12:25:06.494444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:58.149661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494050+0000","last_change":"2023-05-17T12:25:05.828428+0000","last_active":"2023-05-17T12:25:06.494050+0000","last_peered":"2023-05-17T12:25:06.494050+0000","last_clean":"2023-05-17T12:25:06.494050+0000","last_became_active":"2023-05-17T12:25:05.828056+0000","last_became_peered":"2023-05-17T12:25:05.828056+0000","last_unstale":"2023-05-17T12:25:06.494050+0000","last_undegraded":"2023-05-17T12:25:06.494050+0000","last_fullsized":"2023-05-17T12:25:06.494050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:09:51.971442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:21.144736+0000","last_change":"2023-05-17T12:25:01.303424+0000","last_active":"2023-05-17T12:25:21.144736+0000","last_peered":"2023-05-17T12:25:21.144736+0000","last_clean":"2023-05-17T12:25:21.144736+0000","last_became_active":"2023-05-17T12:25:01.303056+0000","last_became_peered":"2023-05-17T12:25:01.303056+0000","last_unstale":"2023-05-17T12:25:21.144736+0000","last_undegraded":"2023-05-17T12:25:21.144736+0000","last_fullsized":"2023-05-17T12:25:21.144736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:08:00.689474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996178+0000","last_change":"2023-05-17T12:25:01.812617+0000","last_active":"2023-05-17T12:25:06.996178+0000","last_peered":"2023-05-17T12:25:06.996178+0000","last_clean":"2023-05-17T12:25:06.996178+0000","last_became_active":"2023-05-17T12:25:01.811849+0000","last_became_peered":"2023-05-17T12:25:01.811849+0000","last_unstale":"2023-05-17T12:25:06.996178+0000","last_undegraded":"2023-05-17T12:25:06.996178+0000","last_fullsized":"2023-05-17T12:25:06.996178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:45:31.781166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299814+0000","last_change":"2023-05-17T12:25:05.830416+0000","last_active":"2023-05-17T12:25:06.299814+0000","last_peered":"2023-05-17T12:25:06.299814+0000","last_clean":"2023-05-17T12:25:06.299814+0000","last_became_active":"2023-05-17T12:25:05.829972+0000","last_became_peered":"2023-05-17T12:25:05.829972+0000","last_unstale":"2023-05-17T12:25:06.299814+0000","last_undegraded":"2023-05-17T12:25:06.299814+0000","last_fullsized":"2023-05-17T12:25:06.299814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:04.874650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995420+0000","last_change":"2023-05-17T12:25:01.307020+0000","last_active":"2023-05-17T12:25:06.995420+0000","last_peered":"2023-05-17T12:25:06.995420+0000","last_clean":"2023-05-17T12:25:06.995420+0000","last_became_active":"2023-05-17T12:25:01.306785+0000","last_became_peered":"2023-05-17T12:25:01.306785+0000","last_unstale":"2023-05-17T12:25:06.995420+0000","last_undegraded":"2023-05-17T12:25:06.995420+0000","last_fullsized":"2023-05-17T12:25:06.995420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:45.367692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994598+0000","last_change":"2023-05-17T12:25:01.803384+0000","last_active":"2023-05-17T12:25:06.994598+0000","last_peered":"2023-05-17T12:25:06.994598+0000","last_clean":"2023-05-17T12:25:06.994598+0000","last_became_active":"2023-05-17T12:25:01.803098+0000","last_became_peered":"2023-05-17T12:25:01.803098+0000","last_unstale":"2023-05-17T12:25:06.994598+0000","last_undegraded":"2023-05-17T12:25:06.994598+0000","last_fullsized":"2023-05-17T12:25:06.994598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:56.325526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994382+0000","last_change":"2023-05-17T12:25:05.832871+0000","last_active":"2023-05-17T12:25:06.994382+0000","last_peered":"2023-05-17T12:25:06.994382+0000","last_clean":"2023-05-17T12:25:06.994382+0000","last_became_active":"2023-05-17T12:25:05.832188+0000","last_became_peered":"2023-05-17T12:25:05.832188+0000","last_unstale":"2023-05-17T12:25:06.994382+0000","last_undegraded":"2023-05-17T12:25:06.994382+0000","last_fullsized":"2023-05-17T12:25:06.994382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:09.673142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325005+0000","last_change":"2023-05-17T12:25:01.299295+0000","last_active":"2023-05-17T12:25:06.325005+0000","last_peered":"2023-05-17T12:25:06.325005+0000","last_clean":"2023-05-17T12:25:06.325005+0000","last_became_active":"2023-05-17T12:25:01.298965+0000","last_became_peered":"2023-05-17T12:25:01.298965+0000","last_unstale":"2023-05-17T12:25:06.325005+0000","last_undegraded":"2023-05-17T12:25:06.325005+0000","last_fullsized":"2023-05-17T12:25:06.325005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:53.614694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299614+0000","last_change":"2023-05-17T12:25:01.809638+0000","last_active":"2023-05-17T12:25:06.299614+0000","last_peered":"2023-05-17T12:25:06.299614+0000","last_clean":"2023-05-17T12:25:06.299614+0000","last_became_active":"2023-05-17T12:25:01.809317+0000","last_became_peered":"2023-05-17T12:25:01.809317+0000","last_unstale":"2023-05-17T12:25:06.299614+0000","last_undegraded":"2023-05-17T12:25:06.299614+0000","last_fullsized":"2023-05-17T12:25:06.299614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994585+0000","last_change":"2023-05-17T12:25:05.834920+0000","last_active":"2023-05-17T12:25:06.994585+0000","last_peered":"2023-05-17T12:25:06.994585+0000","last_clean":"2023-05-17T12:25:06.994585+0000","last_became_active":"2023-05-17T12:25:05.834577+0000","last_became_peered":"2023-05-17T12:25:05.834577+0000","last_unstale":"2023-05-17T12:25:06.994585+0000","last_undegraded":"2023-05-17T12:25:06.994585+0000","last_fullsized":"2023-05-17T12:25:06.994585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:46.007953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995874+0000","last_change":"2023-05-17T12:25:01.307004+0000","last_active":"2023-05-17T12:25:06.995874+0000","last_peered":"2023-05-17T12:25:06.995874+0000","last_clean":"2023-05-17T12:25:06.995874+0000","last_became_active":"2023-05-17T12:25:01.306682+0000","last_became_peered":"2023-05-17T12:25:01.306682+0000","last_unstale":"2023-05-17T12:25:06.995874+0000","last_undegraded":"2023-05-17T12:25:06.995874+0000","last_fullsized":"2023-05-17T12:25:06.995874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325659+0000","last_change":"2023-05-17T12:25:01.798105+0000","last_active":"2023-05-17T12:25:06.325659+0000","last_peered":"2023-05-17T12:25:06.325659+0000","last_clean":"2023-05-17T12:25:06.325659+0000","last_became_active":"2023-05-17T12:25:01.797871+0000","last_became_peered":"2023-05-17T12:25:01.797871+0000","last_unstale":"2023-05-17T12:25:06.325659+0000","last_undegraded":"2023-05-17T12:25:06.325659+0000","last_fullsized":"2023-05-17T12:25:06.325659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299751+0000","last_change":"2023-05-17T12:25:05.830239+0000","last_active":"2023-05-17T12:25:06.299751+0000","last_peered":"2023-05-17T12:25:06.299751+0000","last_clean":"2023-05-17T12:25:06.299751+0000","last_became_active":"2023-05-17T12:25:05.829812+0000","last_became_peered":"2023-05-17T12:25:05.829812+0000","last_unstale":"2023-05-17T12:25:06.299751+0000","last_undegraded":"2023-05-17T12:25:06.299751+0000","last_fullsized":"2023-05-17T12:25:06.299751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:42.636103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298742+0000","last_change":"2023-05-17T12:25:01.301970+0000","last_active":"2023-05-17T12:25:06.298742+0000","last_peered":"2023-05-17T12:25:06.298742+0000","last_clean":"2023-05-17T12:25:06.298742+0000","last_became_active":"2023-05-17T12:25:01.301645+0000","last_became_peered":"2023-05-17T12:25:01.301645+0000","last_unstale":"2023-05-17T12:25:06.298742+0000","last_undegraded":"2023-05-17T12:25:06.298742+0000","last_fullsized":"2023-05-17T12:25:06.298742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:01:41.050026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994656+0000","last_change":"2023-05-17T12:25:01.814151+0000","last_active":"2023-05-17T12:25:06.994656+0000","last_peered":"2023-05-17T12:25:06.994656+0000","last_clean":"2023-05-17T12:25:06.994656+0000","last_became_active":"2023-05-17T12:25:01.813749+0000","last_became_peered":"2023-05-17T12:25:01.813749+0000","last_unstale":"2023-05-17T12:25:06.994656+0000","last_undegraded":"2023-05-17T12:25:06.994656+0000","last_fullsized":"2023-05-17T12:25:06.994656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:56:53.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996349+0000","last_change":"2023-05-17T12:25:05.841929+0000","last_active":"2023-05-17T12:25:06.996349+0000","last_peered":"2023-05-17T12:25:06.996349+0000","last_clean":"2023-05-17T12:25:06.996349+0000","last_became_active":"2023-05-17T12:25:05.841487+0000","last_became_peered":"2023-05-17T12:25:05.841487+0000","last_unstale":"2023-05-17T12:25:06.996349+0000","last_undegraded":"2023-05-17T12:25:06.996349+0000","last_fullsized":"2023-05-17T12:25:06.996349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:01.828288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996446+0000","last_change":"2023-05-17T12:25:01.304576+0000","last_active":"2023-05-17T12:25:06.996446+0000","last_peered":"2023-05-17T12:25:06.996446+0000","last_clean":"2023-05-17T12:25:06.996446+0000","last_became_active":"2023-05-17T12:25:01.304198+0000","last_became_peered":"2023-05-17T12:25:01.304198+0000","last_unstale":"2023-05-17T12:25:06.996446+0000","last_undegraded":"2023-05-17T12:25:06.996446+0000","last_fullsized":"2023-05-17T12:25:06.996446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:11.601219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298936+0000","last_change":"2023-05-17T12:25:01.802054+0000","last_active":"2023-05-17T12:25:06.298936+0000","last_peered":"2023-05-17T12:25:06.298936+0000","last_clean":"2023-05-17T12:25:06.298936+0000","last_became_active":"2023-05-17T12:25:01.801727+0000","last_became_peered":"2023-05-17T12:25:01.801727+0000","last_unstale":"2023-05-17T12:25:06.298936+0000","last_undegraded":"2023-05-17T12:25:06.298936+0000","last_fullsized":"2023-05-17T12:25:06.298936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:24.353901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296090+0000","last_change":"2023-05-17T12:25:05.831343+0000","last_active":"2023-05-17T12:25:06.296090+0000","last_peered":"2023-05-17T12:25:06.296090+0000","last_clean":"2023-05-17T12:25:06.296090+0000","last_became_active":"2023-05-17T12:25:05.830962+0000","last_became_peered":"2023-05-17T12:25:05.830962+0000","last_unstale":"2023-05-17T12:25:06.296090+0000","last_undegraded":"2023-05-17T12:25:06.296090+0000","last_fullsized":"2023-05-17T12:25:06.296090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:31:26.034991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996563+0000","last_change":"2023-05-17T12:25:01.307148+0000","last_active":"2023-05-17T12:25:06.996563+0000","last_peered":"2023-05-17T12:25:06.996563+0000","last_clean":"2023-05-17T12:25:06.996563+0000","last_became_active":"2023-05-17T12:25:01.306796+0000","last_became_peered":"2023-05-17T12:25:01.306796+0000","last_unstale":"2023-05-17T12:25:06.996563+0000","last_undegraded":"2023-05-17T12:25:06.996563+0000","last_fullsized":"2023-05-17T12:25:06.996563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:40:08.139475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995053+0000","last_change":"2023-05-17T12:25:01.810661+0000","last_active":"2023-05-17T12:25:06.995053+0000","last_peered":"2023-05-17T12:25:06.995053+0000","last_clean":"2023-05-17T12:25:06.995053+0000","last_became_active":"2023-05-17T12:25:01.810315+0000","last_became_peered":"2023-05-17T12:25:01.810315+0000","last_unstale":"2023-05-17T12:25:06.995053+0000","last_undegraded":"2023-05-17T12:25:06.995053+0000","last_fullsized":"2023-05-17T12:25:06.995053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:11:45.271597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296256+0000","last_change":"2023-05-17T12:25:05.827003+0000","last_active":"2023-05-17T12:25:06.296256+0000","last_peered":"2023-05-17T12:25:06.296256+0000","last_clean":"2023-05-17T12:25:06.296256+0000","last_became_active":"2023-05-17T12:25:05.826640+0000","last_became_peered":"2023-05-17T12:25:05.826640+0000","last_unstale":"2023-05-17T12:25:06.296256+0000","last_undegraded":"2023-05-17T12:25:06.296256+0000","last_fullsized":"2023-05-17T12:25:06.296256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:46:35.905087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995688+0000","last_change":"2023-05-17T12:25:01.309404+0000","last_active":"2023-05-17T12:25:06.995688+0000","last_peered":"2023-05-17T12:25:06.995688+0000","last_clean":"2023-05-17T12:25:06.995688+0000","last_became_active":"2023-05-17T12:25:01.309104+0000","last_became_peered":"2023-05-17T12:25:01.309104+0000","last_unstale":"2023-05-17T12:25:06.995688+0000","last_undegraded":"2023-05-17T12:25:06.995688+0000","last_fullsized":"2023-05-17T12:25:06.995688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:17.774402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298561+0000","last_change":"2023-05-17T12:25:01.806638+0000","last_active":"2023-05-17T12:25:06.298561+0000","last_peered":"2023-05-17T12:25:06.298561+0000","last_clean":"2023-05-17T12:25:06.298561+0000","last_became_active":"2023-05-17T12:25:01.806398+0000","last_became_peered":"2023-05-17T12:25:01.806398+0000","last_unstale":"2023-05-17T12:25:06.298561+0000","last_undegraded":"2023-05-17T12:25:06.298561+0000","last_fullsized":"2023-05-17T12:25:06.298561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:32:04.677765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296330+0000","last_change":"2023-05-17T12:25:05.825320+0000","last_active":"2023-05-17T12:25:06.296330+0000","last_peered":"2023-05-17T12:25:06.296330+0000","last_clean":"2023-05-17T12:25:06.296330+0000","last_became_active":"2023-05-17T12:25:05.824918+0000","last_became_peered":"2023-05-17T12:25:05.824918+0000","last_unstale":"2023-05-17T12:25:06.296330+0000","last_undegraded":"2023-05-17T12:25:06.296330+0000","last_fullsized":"2023-05-17T12:25:06.296330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:12:01.541988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298981+0000","last_change":"2023-05-17T12:25:01.311086+0000","last_active":"2023-05-17T12:25:06.298981+0000","last_peered":"2023-05-17T12:25:06.298981+0000","last_clean":"2023-05-17T12:25:06.298981+0000","last_became_active":"2023-05-17T12:25:01.310778+0000","last_became_peered":"2023-05-17T12:25:01.310778+0000","last_unstale":"2023-05-17T12:25:06.298981+0000","last_undegraded":"2023-05-17T12:25:06.298981+0000","last_fullsized":"2023-05-17T12:25:06.298981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:57.143808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325238+0000","last_change":"2023-05-17T12:25:01.803984+0000","last_active":"2023-05-17T12:25:06.325238+0000","last_peered":"2023-05-17T12:25:06.325238+0000","last_clean":"2023-05-17T12:25:06.325238+0000","last_became_active":"2023-05-17T12:25:01.803655+0000","last_became_peered":"2023-05-17T12:25:01.803655+0000","last_unstale":"2023-05-17T12:25:06.325238+0000","last_undegraded":"2023-05-17T12:25:06.325238+0000","last_fullsized":"2023-05-17T12:25:06.325238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:24.353901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296620+0000","last_change":"2023-05-17T12:25:05.827683+0000","last_active":"2023-05-17T12:25:06.296620+0000","last_peered":"2023-05-17T12:25:06.296620+0000","last_clean":"2023-05-17T12:25:06.296620+0000","last_became_active":"2023-05-17T12:25:05.827247+0000","last_became_peered":"2023-05-17T12:25:05.827247+0000","last_unstale":"2023-05-17T12:25:06.296620+0000","last_undegraded":"2023-05-17T12:25:06.296620+0000","last_fullsized":"2023-05-17T12:25:06.296620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:26:50.186275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994317+0000","last_change":"2023-05-17T12:25:01.302898+0000","last_active":"2023-05-17T12:25:06.994317+0000","last_peered":"2023-05-17T12:25:06.994317+0000","last_clean":"2023-05-17T12:25:06.994317+0000","last_became_active":"2023-05-17T12:25:01.302511+0000","last_became_peered":"2023-05-17T12:25:01.302511+0000","last_unstale":"2023-05-17T12:25:06.994317+0000","last_undegraded":"2023-05-17T12:25:06.994317+0000","last_fullsized":"2023-05-17T12:25:06.994317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:00.352507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995431+0000","last_change":"2023-05-17T12:25:01.809822+0000","last_active":"2023-05-17T12:25:06.995431+0000","last_peered":"2023-05-17T12:25:06.995431+0000","last_clean":"2023-05-17T12:25:06.995431+0000","last_became_active":"2023-05-17T12:25:01.809341+0000","last_became_peered":"2023-05-17T12:25:01.809341+0000","last_unstale":"2023-05-17T12:25:06.995431+0000","last_undegraded":"2023-05-17T12:25:06.995431+0000","last_fullsized":"2023-05-17T12:25:06.995431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:55:38.616795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494179+0000","last_change":"2023-05-17T12:25:05.823841+0000","last_active":"2023-05-17T12:25:06.494179+0000","last_peered":"2023-05-17T12:25:06.494179+0000","last_clean":"2023-05-17T12:25:06.494179+0000","last_became_active":"2023-05-17T12:25:05.823477+0000","last_became_peered":"2023-05-17T12:25:05.823477+0000","last_unstale":"2023-05-17T12:25:06.494179+0000","last_undegraded":"2023-05-17T12:25:06.494179+0000","last_fullsized":"2023-05-17T12:25:06.494179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:35:08.935796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298699+0000","last_change":"2023-05-17T12:25:01.304712+0000","last_active":"2023-05-17T12:25:06.298699+0000","last_peered":"2023-05-17T12:25:06.298699+0000","last_clean":"2023-05-17T12:25:06.298699+0000","last_became_active":"2023-05-17T12:25:01.304393+0000","last_became_peered":"2023-05-17T12:25:01.304393+0000","last_unstale":"2023-05-17T12:25:06.298699+0000","last_undegraded":"2023-05-17T12:25:06.298699+0000","last_fullsized":"2023-05-17T12:25:06.298699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:26:28.248372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995773+0000","last_change":"2023-05-17T12:25:01.798453+0000","last_active":"2023-05-17T12:25:06.995773+0000","last_peered":"2023-05-17T12:25:06.995773+0000","last_clean":"2023-05-17T12:25:06.995773+0000","last_became_active":"2023-05-17T12:25:01.798156+0000","last_became_peered":"2023-05-17T12:25:01.798156+0000","last_unstale":"2023-05-17T12:25:06.995773+0000","last_undegraded":"2023-05-17T12:25:06.995773+0000","last_fullsized":"2023-05-17T12:25:06.995773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:43.116514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299389+0000","last_change":"2023-05-17T12:25:05.830481+0000","last_active":"2023-05-17T12:25:06.299389+0000","last_peered":"2023-05-17T12:25:06.299389+0000","last_clean":"2023-05-17T12:25:06.299389+0000","last_became_active":"2023-05-17T12:25:05.829790+0000","last_became_peered":"2023-05-17T12:25:05.829790+0000","last_unstale":"2023-05-17T12:25:06.299389+0000","last_undegraded":"2023-05-17T12:25:06.299389+0000","last_fullsized":"2023-05-17T12:25:06.299389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:49.889835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995559+0000","last_change":"2023-05-17T12:25:01.303346+0000","last_active":"2023-05-17T12:25:06.995559+0000","last_peered":"2023-05-17T12:25:06.995559+0000","last_clean":"2023-05-17T12:25:06.995559+0000","last_became_active":"2023-05-17T12:25:01.303010+0000","last_became_peered":"2023-05-17T12:25:01.303010+0000","last_unstale":"2023-05-17T12:25:06.995559+0000","last_undegraded":"2023-05-17T12:25:06.995559+0000","last_fullsized":"2023-05-17T12:25:06.995559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:05:24.193334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996498+0000","last_change":"2023-05-17T12:25:01.812147+0000","last_active":"2023-05-17T12:25:06.996498+0000","last_peered":"2023-05-17T12:25:06.996498+0000","last_clean":"2023-05-17T12:25:06.996498+0000","last_became_active":"2023-05-17T12:25:01.811794+0000","last_became_peered":"2023-05-17T12:25:01.811794+0000","last_unstale":"2023-05-17T12:25:06.996498+0000","last_undegraded":"2023-05-17T12:25:06.996498+0000","last_fullsized":"2023-05-17T12:25:06.996498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:21:08.368476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996608+0000","last_change":"2023-05-17T12:25:05.825191+0000","last_active":"2023-05-17T12:25:06.996608+0000","last_peered":"2023-05-17T12:25:06.996608+0000","last_clean":"2023-05-17T12:25:06.996608+0000","last_became_active":"2023-05-17T12:25:05.824783+0000","last_became_peered":"2023-05-17T12:25:05.824783+0000","last_unstale":"2023-05-17T12:25:06.996608+0000","last_undegraded":"2023-05-17T12:25:06.996608+0000","last_fullsized":"2023-05-17T12:25:06.996608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:37.899306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994023+0000","last_change":"2023-05-17T12:25:01.308187+0000","last_active":"2023-05-17T12:25:06.994023+0000","last_peered":"2023-05-17T12:25:06.994023+0000","last_clean":"2023-05-17T12:25:06.994023+0000","last_became_active":"2023-05-17T12:25:01.307806+0000","last_became_peered":"2023-05-17T12:25:01.307806+0000","last_unstale":"2023-05-17T12:25:06.994023+0000","last_undegraded":"2023-05-17T12:25:06.994023+0000","last_fullsized":"2023-05-17T12:25:06.994023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:28.990806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494856+0000","last_change":"2023-05-17T12:25:01.801432+0000","last_active":"2023-05-17T12:25:06.494856+0000","last_peered":"2023-05-17T12:25:06.494856+0000","last_clean":"2023-05-17T12:25:06.494856+0000","last_became_active":"2023-05-17T12:25:01.801009+0000","last_became_peered":"2023-05-17T12:25:01.801009+0000","last_unstale":"2023-05-17T12:25:06.494856+0000","last_undegraded":"2023-05-17T12:25:06.494856+0000","last_fullsized":"2023-05-17T12:25:06.494856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325252+0000","last_change":"2023-05-17T12:25:05.822949+0000","last_active":"2023-05-17T12:25:06.325252+0000","last_peered":"2023-05-17T12:25:06.325252+0000","last_clean":"2023-05-17T12:25:06.325252+0000","last_became_active":"2023-05-17T12:25:05.822299+0000","last_became_peered":"2023-05-17T12:25:05.822299+0000","last_unstale":"2023-05-17T12:25:06.325252+0000","last_undegraded":"2023-05-17T12:25:06.325252+0000","last_fullsized":"2023-05-17T12:25:06.325252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:43:00.150100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494254+0000","last_change":"2023-05-17T12:24:55.792670+0000","last_active":"2023-05-17T12:25:06.494254+0000","last_peered":"2023-05-17T12:25:06.494254+0000","last_clean":"2023-05-17T12:25:06.494254+0000","last_became_active":"2023-05-17T12:24:55.792363+0000","last_became_peered":"2023-05-17T12:24:55.792363+0000","last_unstale":"2023-05-17T12:25:06.494254+0000","last_undegraded":"2023-05-17T12:25:06.494254+0000","last_fullsized":"2023-05-17T12:25:06.494254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:48.078768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299528+0000","last_change":"2023-05-17T12:25:01.311296+0000","last_active":"2023-05-17T12:25:06.299528+0000","last_peered":"2023-05-17T12:25:06.299528+0000","last_clean":"2023-05-17T12:25:06.299528+0000","last_became_active":"2023-05-17T12:25:01.310946+0000","last_became_peered":"2023-05-17T12:25:01.310946+0000","last_unstale":"2023-05-17T12:25:06.299528+0000","last_undegraded":"2023-05-17T12:25:06.299528+0000","last_fullsized":"2023-05-17T12:25:06.299528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:21.293421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494247+0000","last_change":"2023-05-17T12:25:01.798812+0000","last_active":"2023-05-17T12:25:06.494247+0000","last_peered":"2023-05-17T12:25:06.494247+0000","last_clean":"2023-05-17T12:25:06.494247+0000","last_became_active":"2023-05-17T12:25:01.798536+0000","last_became_peered":"2023-05-17T12:25:01.798536+0000","last_unstale":"2023-05-17T12:25:06.494247+0000","last_undegraded":"2023-05-17T12:25:06.494247+0000","last_fullsized":"2023-05-17T12:25:06.494247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:52:17.557383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325259+0000","last_change":"2023-05-17T12:25:05.830657+0000","last_active":"2023-05-17T12:25:06.325259+0000","last_peered":"2023-05-17T12:25:06.325259+0000","last_clean":"2023-05-17T12:25:06.325259+0000","last_became_active":"2023-05-17T12:25:05.830173+0000","last_became_peered":"2023-05-17T12:25:05.830173+0000","last_unstale":"2023-05-17T12:25:06.325259+0000","last_undegraded":"2023-05-17T12:25:06.325259+0000","last_fullsized":"2023-05-17T12:25:06.325259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:29:01.854184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298702+0000","last_change":"2023-05-17T12:24:55.754074+0000","last_active":"2023-05-17T12:25:06.298702+0000","last_peered":"2023-05-17T12:25:06.298702+0000","last_clean":"2023-05-17T12:25:06.298702+0000","last_became_active":"2023-05-17T12:24:55.753544+0000","last_became_peered":"2023-05-17T12:24:55.753544+0000","last_unstale":"2023-05-17T12:25:06.298702+0000","last_undegraded":"2023-05-17T12:25:06.298702+0000","last_fullsized":"2023-05-17T12:25:06.298702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:28:51.796115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995192+0000","last_change":"2023-05-17T12:25:01.305764+0000","last_active":"2023-05-17T12:25:06.995192+0000","last_peered":"2023-05-17T12:25:06.995192+0000","last_clean":"2023-05-17T12:25:06.995192+0000","last_became_active":"2023-05-17T12:25:01.304391+0000","last_became_peered":"2023-05-17T12:25:01.304391+0000","last_unstale":"2023-05-17T12:25:06.995192+0000","last_undegraded":"2023-05-17T12:25:06.995192+0000","last_fullsized":"2023-05-17T12:25:06.995192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:59:10.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494223+0000","last_change":"2023-05-17T12:25:01.796749+0000","last_active":"2023-05-17T12:25:06.494223+0000","last_peered":"2023-05-17T12:25:06.494223+0000","last_clean":"2023-05-17T12:25:06.494223+0000","last_became_active":"2023-05-17T12:25:01.796483+0000","last_became_peered":"2023-05-17T12:25:01.796483+0000","last_unstale":"2023-05-17T12:25:06.494223+0000","last_undegraded":"2023-05-17T12:25:06.494223+0000","last_fullsized":"2023-05-17T12:25:06.494223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:41:28.654953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296765+0000","last_change":"2023-05-17T12:25:05.831371+0000","last_active":"2023-05-17T12:25:06.296765+0000","last_peered":"2023-05-17T12:25:06.296765+0000","last_clean":"2023-05-17T12:25:06.296765+0000","last_became_active":"2023-05-17T12:25:05.830975+0000","last_became_peered":"2023-05-17T12:25:05.830975+0000","last_unstale":"2023-05-17T12:25:06.296765+0000","last_undegraded":"2023-05-17T12:25:06.296765+0000","last_fullsized":"2023-05-17T12:25:06.296765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:20.938620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296249+0000","last_change":"2023-05-17T12:24:56.008501+0000","last_active":"2023-05-17T12:25:06.296249+0000","last_peered":"2023-05-17T12:25:06.296249+0000","last_clean":"2023-05-17T12:25:06.296249+0000","last_became_active":"2023-05-17T12:24:56.008203+0000","last_became_peered":"2023-05-17T12:24:56.008203+0000","last_unstale":"2023-05-17T12:25:06.296249+0000","last_undegraded":"2023-05-17T12:25:06.296249+0000","last_fullsized":"2023-05-17T12:25:06.296249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:04:51.599706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.493981+0000","last_change":"2023-05-17T12:25:01.301806+0000","last_active":"2023-05-17T12:25:06.493981+0000","last_peered":"2023-05-17T12:25:06.493981+0000","last_clean":"2023-05-17T12:25:06.493981+0000","last_became_active":"2023-05-17T12:25:01.301537+0000","last_became_peered":"2023-05-17T12:25:01.301537+0000","last_unstale":"2023-05-17T12:25:06.493981+0000","last_undegraded":"2023-05-17T12:25:06.493981+0000","last_fullsized":"2023-05-17T12:25:06.493981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:34:24.246684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494836+0000","last_change":"2023-05-17T12:25:01.801261+0000","last_active":"2023-05-17T12:25:06.494836+0000","last_peered":"2023-05-17T12:25:06.494836+0000","last_clean":"2023-05-17T12:25:06.494836+0000","last_became_active":"2023-05-17T12:25:01.800721+0000","last_became_peered":"2023-05-17T12:25:01.800721+0000","last_unstale":"2023-05-17T12:25:06.494836+0000","last_undegraded":"2023-05-17T12:25:06.494836+0000","last_fullsized":"2023-05-17T12:25:06.494836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:29.996659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996033+0000","last_change":"2023-05-17T12:25:05.844206+0000","last_active":"2023-05-17T12:25:06.996033+0000","last_peered":"2023-05-17T12:25:06.996033+0000","last_clean":"2023-05-17T12:25:06.996033+0000","last_became_active":"2023-05-17T12:25:05.843845+0000","last_became_peered":"2023-05-17T12:25:05.843845+0000","last_unstale":"2023-05-17T12:25:06.996033+0000","last_undegraded":"2023-05-17T12:25:06.996033+0000","last_fullsized":"2023-05-17T12:25:06.996033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:46.007953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299370+0000","last_change":"2023-05-17T12:24:55.753963+0000","last_active":"2023-05-17T12:25:06.299370+0000","last_peered":"2023-05-17T12:25:06.299370+0000","last_clean":"2023-05-17T12:25:06.299370+0000","last_became_active":"2023-05-17T12:24:55.753582+0000","last_became_peered":"2023-05-17T12:24:55.753582+0000","last_unstale":"2023-05-17T12:25:06.299370+0000","last_undegraded":"2023-05-17T12:25:06.299370+0000","last_fullsized":"2023-05-17T12:25:06.299370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995510+0000","last_change":"2023-05-17T12:24:48.829166+0000","last_active":"2023-05-17T12:25:06.995510+0000","last_peered":"2023-05-17T12:25:06.995510+0000","last_clean":"2023-05-17T12:25:06.995510+0000","last_became_active":"2023-05-17T12:24:48.828767+0000","last_became_peered":"2023-05-17T12:24:48.828767+0000","last_unstale":"2023-05-17T12:25:06.995510+0000","last_undegraded":"2023-05-17T12:25:06.995510+0000","last_fullsized":"2023-05-17T12:25:06.995510+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_clean_scrub_stamp":"2023-05-17T12:24:47.688706+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:18.612053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994251+0000","last_change":"2023-05-17T12:25:01.310793+0000","last_active":"2023-05-17T12:25:06.994251+0000","last_peered":"2023-05-17T12:25:06.994251+0000","last_clean":"2023-05-17T12:25:06.994251+0000","last_became_active":"2023-05-17T12:25:01.310471+0000","last_became_peered":"2023-05-17T12:25:01.310471+0000","last_unstale":"2023-05-17T12:25:06.994251+0000","last_undegraded":"2023-05-17T12:25:06.994251+0000","last_fullsized":"2023-05-17T12:25:06.994251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:21.293421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299111+0000","last_change":"2023-05-17T12:25:01.813237+0000","last_active":"2023-05-17T12:25:06.299111+0000","last_peered":"2023-05-17T12:25:06.299111+0000","last_clean":"2023-05-17T12:25:06.299111+0000","last_became_active":"2023-05-17T12:25:01.812856+0000","last_became_peered":"2023-05-17T12:25:01.812856+0000","last_unstale":"2023-05-17T12:25:06.299111+0000","last_undegraded":"2023-05-17T12:25:06.299111+0000","last_fullsized":"2023-05-17T12:25:06.299111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:03:48.424581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299344+0000","last_change":"2023-05-17T12:25:05.831353+0000","last_active":"2023-05-17T12:25:06.299344+0000","last_peered":"2023-05-17T12:25:06.299344+0000","last_clean":"2023-05-17T12:25:06.299344+0000","last_became_active":"2023-05-17T12:25:05.830895+0000","last_became_peered":"2023-05-17T12:25:05.830895+0000","last_unstale":"2023-05-17T12:25:06.299344+0000","last_undegraded":"2023-05-17T12:25:06.299344+0000","last_fullsized":"2023-05-17T12:25:06.299344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:33.512949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996042+0000","last_change":"2023-05-17T12:24:55.756595+0000","last_active":"2023-05-17T12:25:06.996042+0000","last_peered":"2023-05-17T12:25:06.996042+0000","last_clean":"2023-05-17T12:25:06.996042+0000","last_became_active":"2023-05-17T12:24:55.756274+0000","last_became_peered":"2023-05-17T12:24:55.756274+0000","last_unstale":"2023-05-17T12:25:06.996042+0000","last_undegraded":"2023-05-17T12:25:06.996042+0000","last_fullsized":"2023-05-17T12:25:06.996042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:49.783748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.324875+0000","last_change":"2023-05-17T12:25:01.304992+0000","last_active":"2023-05-17T12:25:06.324875+0000","last_peered":"2023-05-17T12:25:06.324875+0000","last_clean":"2023-05-17T12:25:06.324875+0000","last_became_active":"2023-05-17T12:25:01.304670+0000","last_became_peered":"2023-05-17T12:25:01.304670+0000","last_unstale":"2023-05-17T12:25:06.324875+0000","last_undegraded":"2023-05-17T12:25:06.324875+0000","last_fullsized":"2023-05-17T12:25:06.324875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:52:16.551530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325454+0000","last_change":"2023-05-17T12:25:01.804023+0000","last_active":"2023-05-17T12:25:06.325454+0000","last_peered":"2023-05-17T12:25:06.325454+0000","last_clean":"2023-05-17T12:25:06.325454+0000","last_became_active":"2023-05-17T12:25:01.803777+0000","last_became_peered":"2023-05-17T12:25:01.803777+0000","last_unstale":"2023-05-17T12:25:06.325454+0000","last_undegraded":"2023-05-17T12:25:06.325454+0000","last_fullsized":"2023-05-17T12:25:06.325454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:29.996659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298944+0000","last_change":"2023-05-17T12:25:05.834950+0000","last_active":"2023-05-17T12:25:06.298944+0000","last_peered":"2023-05-17T12:25:06.298944+0000","last_clean":"2023-05-17T12:25:06.298944+0000","last_became_active":"2023-05-17T12:25:05.833927+0000","last_became_peered":"2023-05-17T12:25:05.833927+0000","last_unstale":"2023-05-17T12:25:06.298944+0000","last_undegraded":"2023-05-17T12:25:06.298944+0000","last_fullsized":"2023-05-17T12:25:06.298944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:43:29.212877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995514+0000","last_change":"2023-05-17T12:24:55.792994+0000","last_active":"2023-05-17T12:25:06.995514+0000","last_peered":"2023-05-17T12:25:06.995514+0000","last_clean":"2023-05-17T12:25:06.995514+0000","last_became_active":"2023-05-17T12:24:55.792597+0000","last_became_peered":"2023-05-17T12:24:55.792597+0000","last_unstale":"2023-05-17T12:25:06.995514+0000","last_undegraded":"2023-05-17T12:25:06.995514+0000","last_fullsized":"2023-05-17T12:25:06.995514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494371+0000","last_change":"2023-05-17T12:25:01.307685+0000","last_active":"2023-05-17T12:25:06.494371+0000","last_peered":"2023-05-17T12:25:06.494371+0000","last_clean":"2023-05-17T12:25:06.494371+0000","last_became_active":"2023-05-17T12:25:01.307371+0000","last_became_peered":"2023-05-17T12:25:01.307371+0000","last_unstale":"2023-05-17T12:25:06.494371+0000","last_undegraded":"2023-05-17T12:25:06.494371+0000","last_fullsized":"2023-05-17T12:25:06.494371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:23.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325414+0000","last_change":"2023-05-17T12:25:01.809898+0000","last_active":"2023-05-17T12:25:06.325414+0000","last_peered":"2023-05-17T12:25:06.325414+0000","last_clean":"2023-05-17T12:25:06.325414+0000","last_became_active":"2023-05-17T12:25:01.809647+0000","last_became_peered":"2023-05-17T12:25:01.809647+0000","last_unstale":"2023-05-17T12:25:06.325414+0000","last_undegraded":"2023-05-17T12:25:06.325414+0000","last_fullsized":"2023-05-17T12:25:06.325414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995271+0000","last_change":"2023-05-17T12:25:05.837992+0000","last_active":"2023-05-17T12:25:06.995271+0000","last_peered":"2023-05-17T12:25:06.995271+0000","last_clean":"2023-05-17T12:25:06.995271+0000","last_became_active":"2023-05-17T12:25:05.836246+0000","last_became_peered":"2023-05-17T12:25:05.836246+0000","last_unstale":"2023-05-17T12:25:06.995271+0000","last_undegraded":"2023-05-17T12:25:06.995271+0000","last_fullsized":"2023-05-17T12:25:06.995271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:01:31.652913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994685+0000","last_change":"2023-05-17T12:25:01.303375+0000","last_active":"2023-05-17T12:25:06.994685+0000","last_peered":"2023-05-17T12:25:06.994685+0000","last_clean":"2023-05-17T12:25:06.994685+0000","last_became_active":"2023-05-17T12:25:01.303046+0000","last_became_peered":"2023-05-17T12:25:01.303046+0000","last_unstale":"2023-05-17T12:25:06.994685+0000","last_undegraded":"2023-05-17T12:25:06.994685+0000","last_fullsized":"2023-05-17T12:25:06.994685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:40:08.139475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494947+0000","last_change":"2023-05-17T12:24:55.755523+0000","last_active":"2023-05-17T12:25:06.494947+0000","last_peered":"2023-05-17T12:25:06.494947+0000","last_clean":"2023-05-17T12:25:06.494947+0000","last_became_active":"2023-05-17T12:24:55.755229+0000","last_became_peered":"2023-05-17T12:24:55.755229+0000","last_unstale":"2023-05-17T12:25:06.494947+0000","last_undegraded":"2023-05-17T12:25:06.494947+0000","last_fullsized":"2023-05-17T12:25:06.494947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.993978+0000","last_change":"2023-05-17T12:25:01.814467+0000","last_active":"2023-05-17T12:25:06.993978+0000","last_peered":"2023-05-17T12:25:06.993978+0000","last_clean":"2023-05-17T12:25:06.993978+0000","last_became_active":"2023-05-17T12:25:01.813813+0000","last_became_peered":"2023-05-17T12:25:01.813813+0000","last_unstale":"2023-05-17T12:25:06.993978+0000","last_undegraded":"2023-05-17T12:25:06.993978+0000","last_fullsized":"2023-05-17T12:25:06.993978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:22.759151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.993949+0000","last_change":"2023-05-17T12:25:05.826670+0000","last_active":"2023-05-17T12:25:06.993949+0000","last_peered":"2023-05-17T12:25:06.993949+0000","last_clean":"2023-05-17T12:25:06.993949+0000","last_became_active":"2023-05-17T12:25:05.826237+0000","last_became_peered":"2023-05-17T12:25:05.826237+0000","last_unstale":"2023-05-17T12:25:06.993949+0000","last_undegraded":"2023-05-17T12:25:06.993949+0000","last_fullsized":"2023-05-17T12:25:06.993949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:13:01.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298606+0000","last_change":"2023-05-17T12:24:55.755814+0000","last_active":"2023-05-17T12:25:06.298606+0000","last_peered":"2023-05-17T12:25:06.298606+0000","last_clean":"2023-05-17T12:25:06.298606+0000","last_became_active":"2023-05-17T12:24:55.755481+0000","last_became_peered":"2023-05-17T12:24:55.755481+0000","last_unstale":"2023-05-17T12:25:06.298606+0000","last_undegraded":"2023-05-17T12:25:06.298606+0000","last_fullsized":"2023-05-17T12:25:06.298606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:58:43.934611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325579+0000","last_change":"2023-05-17T12:25:01.310606+0000","last_active":"2023-05-17T12:25:06.325579+0000","last_peered":"2023-05-17T12:25:06.325579+0000","last_clean":"2023-05-17T12:25:06.325579+0000","last_became_active":"2023-05-17T12:25:01.309614+0000","last_became_peered":"2023-05-17T12:25:01.309614+0000","last_unstale":"2023-05-17T12:25:06.325579+0000","last_undegraded":"2023-05-17T12:25:06.325579+0000","last_fullsized":"2023-05-17T12:25:06.325579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:27.380050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994784+0000","last_change":"2023-05-17T12:25:01.801978+0000","last_active":"2023-05-17T12:25:06.994784+0000","last_peered":"2023-05-17T12:25:06.994784+0000","last_clean":"2023-05-17T12:25:06.994784+0000","last_became_active":"2023-05-17T12:25:01.801664+0000","last_became_peered":"2023-05-17T12:25:01.801664+0000","last_unstale":"2023-05-17T12:25:06.994784+0000","last_undegraded":"2023-05-17T12:25:06.994784+0000","last_fullsized":"2023-05-17T12:25:06.994784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:49:24.674805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494716+0000","last_change":"2023-05-17T12:25:05.827430+0000","last_active":"2023-05-17T12:25:06.494716+0000","last_peered":"2023-05-17T12:25:06.494716+0000","last_clean":"2023-05-17T12:25:06.494716+0000","last_became_active":"2023-05-17T12:25:05.827001+0000","last_became_peered":"2023-05-17T12:25:05.827001+0000","last_unstale":"2023-05-17T12:25:06.494716+0000","last_undegraded":"2023-05-17T12:25:06.494716+0000","last_fullsized":"2023-05-17T12:25:06.494716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:26.275442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325368+0000","last_change":"2023-05-17T12:25:01.311128+0000","last_active":"2023-05-17T12:25:06.325368+0000","last_peered":"2023-05-17T12:25:06.325368+0000","last_clean":"2023-05-17T12:25:06.325368+0000","last_became_active":"2023-05-17T12:25:01.310836+0000","last_became_peered":"2023-05-17T12:25:01.310836+0000","last_unstale":"2023-05-17T12:25:06.325368+0000","last_undegraded":"2023-05-17T12:25:06.325368+0000","last_fullsized":"2023-05-17T12:25:06.325368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:21.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296706+0000","last_change":"2023-05-17T12:25:01.802967+0000","last_active":"2023-05-17T12:25:06.296706+0000","last_peered":"2023-05-17T12:25:06.296706+0000","last_clean":"2023-05-17T12:25:06.296706+0000","last_became_active":"2023-05-17T12:25:01.802692+0000","last_became_peered":"2023-05-17T12:25:01.802692+0000","last_unstale":"2023-05-17T12:25:06.296706+0000","last_undegraded":"2023-05-17T12:25:06.296706+0000","last_fullsized":"2023-05-17T12:25:06.296706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:58:57.061496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996669+0000","last_change":"2023-05-17T12:25:05.842157+0000","last_active":"2023-05-17T12:25:06.996669+0000","last_peered":"2023-05-17T12:25:06.996669+0000","last_clean":"2023-05-17T12:25:06.996669+0000","last_became_active":"2023-05-17T12:25:05.841642+0000","last_became_peered":"2023-05-17T12:25:05.841642+0000","last_unstale":"2023-05-17T12:25:06.996669+0000","last_undegraded":"2023-05-17T12:25:06.996669+0000","last_fullsized":"2023-05-17T12:25:06.996669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:53:03.043259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299117+0000","last_change":"2023-05-17T12:25:01.309109+0000","last_active":"2023-05-17T12:25:06.299117+0000","last_peered":"2023-05-17T12:25:06.299117+0000","last_clean":"2023-05-17T12:25:06.299117+0000","last_became_active":"2023-05-17T12:25:01.308819+0000","last_became_peered":"2023-05-17T12:25:01.308819+0000","last_unstale":"2023-05-17T12:25:06.299117+0000","last_undegraded":"2023-05-17T12:25:06.299117+0000","last_fullsized":"2023-05-17T12:25:06.299117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:10.497260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995019+0000","last_change":"2023-05-17T12:25:01.807742+0000","last_active":"2023-05-17T12:25:06.995019+0000","last_peered":"2023-05-17T12:25:06.995019+0000","last_clean":"2023-05-17T12:25:06.995019+0000","last_became_active":"2023-05-17T12:25:01.807486+0000","last_became_peered":"2023-05-17T12:25:01.807486+0000","last_unstale":"2023-05-17T12:25:06.995019+0000","last_undegraded":"2023-05-17T12:25:06.995019+0000","last_fullsized":"2023-05-17T12:25:06.995019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:34:11.854588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298559+0000","last_change":"2023-05-17T12:25:05.828527+0000","last_active":"2023-05-17T12:25:06.298559+0000","last_peered":"2023-05-17T12:25:06.298559+0000","last_clean":"2023-05-17T12:25:06.298559+0000","last_became_active":"2023-05-17T12:25:05.828110+0000","last_became_peered":"2023-05-17T12:25:05.828110+0000","last_unstale":"2023-05-17T12:25:06.298559+0000","last_undegraded":"2023-05-17T12:25:06.298559+0000","last_fullsized":"2023-05-17T12:25:06.298559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:58.136837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299503+0000","last_change":"2023-05-17T12:25:01.309151+0000","last_active":"2023-05-17T12:25:06.299503+0000","last_peered":"2023-05-17T12:25:06.299503+0000","last_clean":"2023-05-17T12:25:06.299503+0000","last_became_active":"2023-05-17T12:25:01.308858+0000","last_became_peered":"2023-05-17T12:25:01.308858+0000","last_unstale":"2023-05-17T12:25:06.299503+0000","last_undegraded":"2023-05-17T12:25:06.299503+0000","last_fullsized":"2023-05-17T12:25:06.299503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:31.192844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996383+0000","last_change":"2023-05-17T12:25:01.803419+0000","last_active":"2023-05-17T12:25:06.996383+0000","last_peered":"2023-05-17T12:25:06.996383+0000","last_clean":"2023-05-17T12:25:06.996383+0000","last_became_active":"2023-05-17T12:25:01.802965+0000","last_became_peered":"2023-05-17T12:25:01.802965+0000","last_unstale":"2023-05-17T12:25:06.996383+0000","last_undegraded":"2023-05-17T12:25:06.996383+0000","last_fullsized":"2023-05-17T12:25:06.996383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:18:56.538552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994811+0000","last_change":"2023-05-17T12:25:05.825330+0000","last_active":"2023-05-17T12:25:06.994811+0000","last_peered":"2023-05-17T12:25:06.994811+0000","last_clean":"2023-05-17T12:25:06.994811+0000","last_became_active":"2023-05-17T12:25:05.824868+0000","last_became_peered":"2023-05-17T12:25:05.824868+0000","last_unstale":"2023-05-17T12:25:06.994811+0000","last_undegraded":"2023-05-17T12:25:06.994811+0000","last_fullsized":"2023-05-17T12:25:06.994811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:53:03.043259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994461+0000","last_change":"2023-05-17T12:25:01.304287+0000","last_active":"2023-05-17T12:25:06.994461+0000","last_peered":"2023-05-17T12:25:06.994461+0000","last_clean":"2023-05-17T12:25:06.994461+0000","last_became_active":"2023-05-17T12:25:01.304009+0000","last_became_peered":"2023-05-17T12:25:01.304009+0000","last_unstale":"2023-05-17T12:25:06.994461+0000","last_undegraded":"2023-05-17T12:25:06.994461+0000","last_fullsized":"2023-05-17T12:25:06.994461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994672+0000","last_change":"2023-05-17T12:25:01.795767+0000","last_active":"2023-05-17T12:25:06.994672+0000","last_peered":"2023-05-17T12:25:06.994672+0000","last_clean":"2023-05-17T12:25:06.994672+0000","last_became_active":"2023-05-17T12:25:01.795283+0000","last_became_peered":"2023-05-17T12:25:01.795283+0000","last_unstale":"2023-05-17T12:25:06.994672+0000","last_undegraded":"2023-05-17T12:25:06.994672+0000","last_fullsized":"2023-05-17T12:25:06.994672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:12.607072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494307+0000","last_change":"2023-05-17T12:25:05.835654+0000","last_active":"2023-05-17T12:25:06.494307+0000","last_peered":"2023-05-17T12:25:06.494307+0000","last_clean":"2023-05-17T12:25:06.494307+0000","last_became_active":"2023-05-17T12:25:05.835230+0000","last_became_peered":"2023-05-17T12:25:05.835230+0000","last_unstale":"2023-05-17T12:25:06.494307+0000","last_undegraded":"2023-05-17T12:25:06.494307+0000","last_fullsized":"2023-05-17T12:25:06.494307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:43:00.150100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325785+0000","last_change":"2023-05-17T12:25:01.302349+0000","last_active":"2023-05-17T12:25:06.325785+0000","last_peered":"2023-05-17T12:25:06.325785+0000","last_clean":"2023-05-17T12:25:06.325785+0000","last_became_active":"2023-05-17T12:25:01.302092+0000","last_became_peered":"2023-05-17T12:25:01.302092+0000","last_unstale":"2023-05-17T12:25:06.325785+0000","last_undegraded":"2023-05-17T12:25:06.325785+0000","last_fullsized":"2023-05-17T12:25:06.325785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994890+0000","last_change":"2023-05-17T12:25:01.815996+0000","last_active":"2023-05-17T12:25:06.994890+0000","last_peered":"2023-05-17T12:25:06.994890+0000","last_clean":"2023-05-17T12:25:06.994890+0000","last_became_active":"2023-05-17T12:25:01.812605+0000","last_became_peered":"2023-05-17T12:25:01.812605+0000","last_unstale":"2023-05-17T12:25:06.994890+0000","last_undegraded":"2023-05-17T12:25:06.994890+0000","last_fullsized":"2023-05-17T12:25:06.994890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:01:41.127461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298262+0000","last_change":"2023-05-17T12:25:01.805399+0000","last_active":"2023-05-17T12:25:06.298262+0000","last_peered":"2023-05-17T12:25:06.298262+0000","last_clean":"2023-05-17T12:25:06.298262+0000","last_became_active":"2023-05-17T12:25:01.805099+0000","last_became_peered":"2023-05-17T12:25:01.805099+0000","last_unstale":"2023-05-17T12:25:06.298262+0000","last_undegraded":"2023-05-17T12:25:06.298262+0000","last_fullsized":"2023-05-17T12:25:06.298262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:36:36.387439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994465+0000","last_change":"2023-05-17T12:25:01.802926+0000","last_active":"2023-05-17T12:25:06.994465+0000","last_peered":"2023-05-17T12:25:06.994465+0000","last_clean":"2023-05-17T12:25:06.994465+0000","last_became_active":"2023-05-17T12:25:01.802651+0000","last_became_peered":"2023-05-17T12:25:01.802651+0000","last_unstale":"2023-05-17T12:25:06.994465+0000","last_undegraded":"2023-05-17T12:25:06.994465+0000","last_fullsized":"2023-05-17T12:25:06.994465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:16.838754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995441+0000","last_change":"2023-05-17T12:25:01.812203+0000","last_active":"2023-05-17T12:25:06.995441+0000","last_peered":"2023-05-17T12:25:06.995441+0000","last_clean":"2023-05-17T12:25:06.995441+0000","last_became_active":"2023-05-17T12:25:01.811900+0000","last_became_peered":"2023-05-17T12:25:01.811900+0000","last_unstale":"2023-05-17T12:25:06.995441+0000","last_undegraded":"2023-05-17T12:25:06.995441+0000","last_fullsized":"2023-05-17T12:25:06.995441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:36:46.242202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994166+0000","last_change":"2023-05-17T12:25:01.814710+0000","last_active":"2023-05-17T12:25:06.994166+0000","last_peered":"2023-05-17T12:25:06.994166+0000","last_clean":"2023-05-17T12:25:06.994166+0000","last_became_active":"2023-05-17T12:25:01.814215+0000","last_became_peered":"2023-05-17T12:25:01.814215+0000","last_unstale":"2023-05-17T12:25:06.994166+0000","last_undegraded":"2023-05-17T12:25:06.994166+0000","last_fullsized":"2023-05-17T12:25:06.994166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494339+0000","last_change":"2023-05-17T12:25:01.802046+0000","last_active":"2023-05-17T12:25:06.494339+0000","last_peered":"2023-05-17T12:25:06.494339+0000","last_clean":"2023-05-17T12:25:06.494339+0000","last_became_active":"2023-05-17T12:25:01.801281+0000","last_became_peered":"2023-05-17T12:25:01.801281+0000","last_unstale":"2023-05-17T12:25:06.494339+0000","last_undegraded":"2023-05-17T12:25:06.494339+0000","last_fullsized":"2023-05-17T12:25:06.494339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:28:58.337893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8228,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363612,"statfs":{"total":96636764160,"available":96628338688,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T12:25:37.260 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T12:25:37.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.475+0000 7fde791ff700 1 Processor -- start 2023-05-17T12:25:37.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.475+0000 7fde791ff700 1 -- start start 2023-05-17T12:25:37.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.477+0000 7fde791ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406b0b0 0x7fde7406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.477+0000 7fde791ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fde7406c330 0x7fde7406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.477+0000 7fde791ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde740cd6b0 con 0x7fde7415c840 2023-05-17T12:25:37.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.477+0000 7fde791ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde740cdf50 con 0x7fde7406c330 2023-05-17T12:25:37.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.477+0000 7fde791ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7406ccf0 con 0x7fde7406b0b0 2023-05-17T12:25:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.477+0000 7fde7359e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fde7406c330 0x7fde7406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.477+0000 7fde7359e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fde7406c330 0x7fde7406c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:49130/0 (socket says 172.21.15.88:49130) 2023-05-17T12:25:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.477+0000 7fde7359e700 1 -- 172.21.15.88:0/2572822233 learned_addr learned my addr 172.21.15.88:0/2572822233 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.477+0000 7fde7259c700 1 --2- 172.21.15.88:0/2572822233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406b0b0 0x7fde7406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.478+0000 7fde7359e700 1 -- 172.21.15.88:0/2572822233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406b0b0 msgr2=0x7fde7406b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.478+0000 7fde7359e700 1 --2- 172.21.15.88:0/2572822233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406b0b0 0x7fde7406b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.478+0000 7fde7359e700 1 -- 172.21.15.88:0/2572822233 >> v1:172.21.15.187:6789/0 conn(0x7fde7415c840 legacy=0x7fde740cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.478+0000 7fde7359e700 1 -- 172.21.15.88:0/2572822233 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740b2460 con 0x7fde7406c330 2023-05-17T12:25:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.478+0000 7fde71d9b700 1 -- 172.21.15.88:0/2572822233 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197313334 0 0) 0x7fde740cd6b0 con 0x7fde7415c840 2023-05-17T12:25:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.478+0000 7fde7359e700 1 --2- 172.21.15.88:0/2572822233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde7406c330 0x7fde7406c7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009e50 tx=0x7fde6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f129a9b607e6fa1e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:37.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.478+0000 7fde71d9b700 1 -- 172.21.15.88:0/2572822233 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00e070 con 0x7fde7406c330 2023-05-17T12:25:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.478+0000 7fde71d9b700 1 -- 172.21.15.88:0/2572822233 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00b910 con 0x7fde7406c330 2023-05-17T12:25:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.478+0000 7fde71d9b700 1 -- 172.21.15.88:0/2572822233 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00bcc0 con 0x7fde7406c330 2023-05-17T12:25:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.479+0000 7fde791ff700 1 -- 172.21.15.88:0/2572822233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde7406c330 msgr2=0x7fde7406c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.479+0000 7fde791ff700 1 --2- 172.21.15.88:0/2572822233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde7406c330 0x7fde7406c7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009e50 tx=0x7fde6c00b330 comp rx=0 tx=0).stop 2023-05-17T12:25:37.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.479+0000 7fde791ff700 1 -- 172.21.15.88:0/2572822233 shutdown_connections 2023-05-17T12:25:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.479+0000 7fde791ff700 1 --2- 172.21.15.88:0/2572822233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde7406c330 0x7fde7406c7b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.479+0000 7fde791ff700 1 --2- 172.21.15.88:0/2572822233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406b0b0 0x7fde7406b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.479+0000 7fde791ff700 1 -- 172.21.15.88:0/2572822233 >> 172.21.15.88:0/2572822233 conn(0x7fde740d3060 msgr2=0x7fde740d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.479+0000 7fde791ff700 1 -- 172.21.15.88:0/2572822233 shutdown_connections 2023-05-17T12:25:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.479+0000 7fde791ff700 1 -- 172.21.15.88:0/2572822233 wait complete. 2023-05-17T12:25:37.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.480+0000 7fde791ff700 1 Processor -- start 2023-05-17T12:25:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.481+0000 7fde791ff700 1 -- start start 2023-05-17T12:25:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.481+0000 7fde791ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde7406b0b0 0x7fde74159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.481+0000 7fde791ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406c330 0x7fde740b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.481+0000 7fde791ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde7415c840 0x7fde74150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.481+0000 7fde791ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde741590f0 con 0x7fde7406b0b0 2023-05-17T12:25:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.481+0000 7fde791ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde74158570 con 0x7fde7415c840 2023-05-17T12:25:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.481+0000 7fde791ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde74158850 con 0x7fde7406c330 2023-05-17T12:25:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde72d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde7406b0b0 0x7fde74159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde72d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde7406b0b0 0x7fde74159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37656/0 (socket says 172.21.15.88:37656) 2023-05-17T12:25:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde72d9d700 1 -- 172.21.15.88:0/4257236056 learned_addr learned my addr 172.21.15.88:0/4257236056 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde7259c700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406c330 0x7fde740b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde7359e700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde7415c840 0x7fde74150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde72d9d700 1 -- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406c330 msgr2=0x7fde740b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde72d9d700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406c330 0x7fde740b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde72d9d700 1 -- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde7415c840 msgr2=0x7fde74150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde72d9d700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde7415c840 0x7fde74150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde72d9d700 1 -- 172.21.15.88:0/4257236056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c009b30 con 0x7fde7406b0b0 2023-05-17T12:25:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.482+0000 7fde72d9d700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde7406b0b0 0x7fde74159fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c550 tx=0x7fde6400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.483+0000 7fde5b7fe700 1 -- 172.21.15.88:0/4257236056 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640054e0 con 0x7fde7406b0b0 2023-05-17T12:25:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.483+0000 7fde5b7fe700 1 -- 172.21.15.88:0/4257236056 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde64003680 con 0x7fde7406b0b0 2023-05-17T12:25:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.483+0000 7fde5b7fe700 1 -- 172.21.15.88:0/4257236056 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64003a30 con 0x7fde7406b0b0 2023-05-17T12:25:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.483+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde740cd900 con 0x7fde7406b0b0 2023-05-17T12:25:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.483+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde740b2740 con 0x7fde7406b0b0 2023-05-17T12:25:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.484+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde740cdbe0 con 0x7fde7406b0b0 2023-05-17T12:25:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.485+0000 7fde5b7fe700 1 -- 172.21.15.88:0/4257236056 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde64003b90 con 0x7fde7406b0b0 2023-05-17T12:25:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.485+0000 7fde5b7fe700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fde6006ace0 0x7fde6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.486+0000 7fde5b7fe700 1 -- 172.21.15.88:0/4257236056 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde64088ac0 con 0x7fde7406b0b0 2023-05-17T12:25:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.486+0000 7fde7259c700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fde6006ace0 0x7fde6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.486+0000 7fde7259c700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fde6006ace0 0x7fde6006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde740b5ad0 tx=0x7fde68009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.490+0000 7fde5b7fe700 1 -- 172.21.15.88:0/4257236056 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fde64053870 con 0x7fde7406b0b0 2023-05-17T12:25:37.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.681+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 --> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde74074530 con 0x7fde6006ace0 2023-05-17T12:25:37.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.692+0000 7fde5b7fe700 1 -- 172.21.15.88:0/4257236056 <== mgr.4106 v2:172.21.15.187:6832/2490620069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367378 (secure 0 0 0) 0x7fde74074530 con 0x7fde6006ace0 2023-05-17T12:25:37.699 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fde6006ace0 msgr2=0x7fde6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fde6006ace0 0x7fde6006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde740b5ad0 tx=0x7fde68009210 comp rx=0 tx=0).stop 2023-05-17T12:25:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde7406b0b0 msgr2=0x7fde74159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde7406b0b0 0x7fde74159fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c550 tx=0x7fde6400c860 comp rx=0 tx=0).stop 2023-05-17T12:25:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 shutdown_connections 2023-05-17T12:25:37.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fde6006ace0 0x7fde6006d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde7415c840 0x7fde74150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde7406b0b0 0x7fde74159fc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 --2- 172.21.15.88:0/4257236056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde7406c330 0x7fde740b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 >> 172.21.15.88:0/4257236056 conn(0x7fde740d3060 msgr2=0x7fde740cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:37.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.696+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 shutdown_connections 2023-05-17T12:25:37.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.697+0000 7fde791ff700 1 -- 172.21.15.88:0/4257236056 wait complete. 2023-05-17T12:25:37.702 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-05-17T12:25:37.716 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-05-17T12:25:37.457857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67560,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907160,"statfs":{"total":773094113280,"available":773024931840,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004087"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296789+0000","last_change":"2023-05-17T12:25:01.795822+0000","last_active":"2023-05-17T12:25:06.296789+0000","last_peered":"2023-05-17T12:25:06.296789+0000","last_clean":"2023-05-17T12:25:06.296789+0000","last_became_active":"2023-05-17T12:25:01.795035+0000","last_became_peered":"2023-05-17T12:25:01.795035+0000","last_unstale":"2023-05-17T12:25:06.296789+0000","last_undegraded":"2023-05-17T12:25:06.296789+0000","last_fullsized":"2023-05-17T12:25:06.296789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:29:24.037566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299680+0000","last_change":"2023-05-17T12:25:01.804268+0000","last_active":"2023-05-17T12:25:06.299680+0000","last_peered":"2023-05-17T12:25:06.299680+0000","last_clean":"2023-05-17T12:25:06.299680+0000","last_became_active":"2023-05-17T12:25:01.803974+0000","last_became_peered":"2023-05-17T12:25:01.803974+0000","last_unstale":"2023-05-17T12:25:06.299680+0000","last_undegraded":"2023-05-17T12:25:06.299680+0000","last_fullsized":"2023-05-17T12:25:06.299680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:16.838754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996137+0000","last_change":"2023-05-17T12:25:01.808847+0000","last_active":"2023-05-17T12:25:06.996137+0000","last_peered":"2023-05-17T12:25:06.996137+0000","last_clean":"2023-05-17T12:25:06.996137+0000","last_became_active":"2023-05-17T12:25:01.808039+0000","last_became_peered":"2023-05-17T12:25:01.808039+0000","last_unstale":"2023-05-17T12:25:06.996137+0000","last_undegraded":"2023-05-17T12:25:06.996137+0000","last_fullsized":"2023-05-17T12:25:06.996137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:34:11.837824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298571+0000","last_change":"2023-05-17T12:25:01.804061+0000","last_active":"2023-05-17T12:25:06.298571+0000","last_peered":"2023-05-17T12:25:06.298571+0000","last_clean":"2023-05-17T12:25:06.298571+0000","last_became_active":"2023-05-17T12:25:01.803700+0000","last_became_peered":"2023-05-17T12:25:01.803700+0000","last_unstale":"2023-05-17T12:25:06.298571+0000","last_undegraded":"2023-05-17T12:25:06.298571+0000","last_fullsized":"2023-05-17T12:25:06.298571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:13:33.437413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325509+0000","last_change":"2023-05-17T12:25:01.799019+0000","last_active":"2023-05-17T12:25:06.325509+0000","last_peered":"2023-05-17T12:25:06.325509+0000","last_clean":"2023-05-17T12:25:06.325509+0000","last_became_active":"2023-05-17T12:25:01.798806+0000","last_became_peered":"2023-05-17T12:25:01.798806+0000","last_unstale":"2023-05-17T12:25:06.325509+0000","last_undegraded":"2023-05-17T12:25:06.325509+0000","last_fullsized":"2023-05-17T12:25:06.325509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995568+0000","last_change":"2023-05-17T12:25:01.803257+0000","last_active":"2023-05-17T12:25:06.995568+0000","last_peered":"2023-05-17T12:25:06.995568+0000","last_clean":"2023-05-17T12:25:06.995568+0000","last_became_active":"2023-05-17T12:25:01.802691+0000","last_became_peered":"2023-05-17T12:25:01.802691+0000","last_unstale":"2023-05-17T12:25:06.995568+0000","last_undegraded":"2023-05-17T12:25:06.995568+0000","last_fullsized":"2023-05-17T12:25:06.995568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:19:39.033646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996181+0000","last_change":"2023-05-17T12:25:01.806572+0000","last_active":"2023-05-17T12:25:06.996181+0000","last_peered":"2023-05-17T12:25:06.996181+0000","last_clean":"2023-05-17T12:25:06.996181+0000","last_became_active":"2023-05-17T12:25:01.806281+0000","last_became_peered":"2023-05-17T12:25:01.806281+0000","last_unstale":"2023-05-17T12:25:06.996181+0000","last_undegraded":"2023-05-17T12:25:06.996181+0000","last_fullsized":"2023-05-17T12:25:06.996181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:56:53.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299059+0000","last_change":"2023-05-17T12:25:01.803927+0000","last_active":"2023-05-17T12:25:06.299059+0000","last_peered":"2023-05-17T12:25:06.299059+0000","last_clean":"2023-05-17T12:25:06.299059+0000","last_became_active":"2023-05-17T12:25:01.803617+0000","last_became_peered":"2023-05-17T12:25:01.803617+0000","last_unstale":"2023-05-17T12:25:06.299059+0000","last_undegraded":"2023-05-17T12:25:06.299059+0000","last_fullsized":"2023-05-17T12:25:06.299059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:22.759151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325614+0000","last_change":"2023-05-17T12:25:01.799177+0000","last_active":"2023-05-17T12:25:06.325614+0000","last_peered":"2023-05-17T12:25:06.325614+0000","last_clean":"2023-05-17T12:25:06.325614+0000","last_became_active":"2023-05-17T12:25:01.798532+0000","last_became_peered":"2023-05-17T12:25:01.798532+0000","last_unstale":"2023-05-17T12:25:06.325614+0000","last_undegraded":"2023-05-17T12:25:06.325614+0000","last_fullsized":"2023-05-17T12:25:06.325614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:22.299274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299922+0000","last_change":"2023-05-17T12:25:01.798406+0000","last_active":"2023-05-17T12:25:06.299922+0000","last_peered":"2023-05-17T12:25:06.299922+0000","last_clean":"2023-05-17T12:25:06.299922+0000","last_became_active":"2023-05-17T12:25:01.798107+0000","last_became_peered":"2023-05-17T12:25:01.798107+0000","last_unstale":"2023-05-17T12:25:06.299922+0000","last_undegraded":"2023-05-17T12:25:06.299922+0000","last_fullsized":"2023-05-17T12:25:06.299922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:56.325526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996483+0000","last_change":"2023-05-17T12:25:01.810494+0000","last_active":"2023-05-17T12:25:06.996483+0000","last_peered":"2023-05-17T12:25:06.996483+0000","last_clean":"2023-05-17T12:25:06.996483+0000","last_became_active":"2023-05-17T12:25:01.810141+0000","last_became_peered":"2023-05-17T12:25:01.810141+0000","last_unstale":"2023-05-17T12:25:06.996483+0000","last_undegraded":"2023-05-17T12:25:06.996483+0000","last_fullsized":"2023-05-17T12:25:06.996483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:55:47.642675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296559+0000","last_change":"2023-05-17T12:25:01.810500+0000","last_active":"2023-05-17T12:25:06.296559+0000","last_peered":"2023-05-17T12:25:06.296559+0000","last_clean":"2023-05-17T12:25:06.296559+0000","last_became_active":"2023-05-17T12:25:01.810218+0000","last_became_peered":"2023-05-17T12:25:01.810218+0000","last_unstale":"2023-05-17T12:25:06.296559+0000","last_undegraded":"2023-05-17T12:25:06.296559+0000","last_fullsized":"2023-05-17T12:25:06.296559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:25.158644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296403+0000","last_change":"2023-05-17T12:25:01.795337+0000","last_active":"2023-05-17T12:25:06.296403+0000","last_peered":"2023-05-17T12:25:06.296403+0000","last_clean":"2023-05-17T12:25:06.296403+0000","last_became_active":"2023-05-17T12:25:01.795015+0000","last_became_peered":"2023-05-17T12:25:01.795015+0000","last_unstale":"2023-05-17T12:25:06.296403+0000","last_undegraded":"2023-05-17T12:25:06.296403+0000","last_fullsized":"2023-05-17T12:25:06.296403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:08:00.351240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298545+0000","last_change":"2023-05-17T12:25:01.794491+0000","last_active":"2023-05-17T12:25:06.298545+0000","last_peered":"2023-05-17T12:25:06.298545+0000","last_clean":"2023-05-17T12:25:06.298545+0000","last_became_active":"2023-05-17T12:25:01.794195+0000","last_became_peered":"2023-05-17T12:25:01.794195+0000","last_unstale":"2023-05-17T12:25:06.298545+0000","last_undegraded":"2023-05-17T12:25:06.298545+0000","last_fullsized":"2023-05-17T12:25:06.298545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:42:56.633809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995720+0000","last_change":"2023-05-17T12:25:01.806504+0000","last_active":"2023-05-17T12:25:06.995720+0000","last_peered":"2023-05-17T12:25:06.995720+0000","last_clean":"2023-05-17T12:25:06.995720+0000","last_became_active":"2023-05-17T12:25:01.806169+0000","last_became_peered":"2023-05-17T12:25:01.806169+0000","last_unstale":"2023-05-17T12:25:06.995720+0000","last_undegraded":"2023-05-17T12:25:06.995720+0000","last_fullsized":"2023-05-17T12:25:06.995720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995025+0000","last_change":"2023-05-17T12:25:01.810537+0000","last_active":"2023-05-17T12:25:06.995025+0000","last_peered":"2023-05-17T12:25:06.995025+0000","last_clean":"2023-05-17T12:25:06.995025+0000","last_became_active":"2023-05-17T12:25:01.809999+0000","last_became_peered":"2023-05-17T12:25:01.809999+0000","last_unstale":"2023-05-17T12:25:06.995025+0000","last_undegraded":"2023-05-17T12:25:06.995025+0000","last_fullsized":"2023-05-17T12:25:06.995025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:02:23.504157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325601+0000","last_change":"2023-05-17T12:25:01.798577+0000","last_active":"2023-05-17T12:25:06.325601+0000","last_peered":"2023-05-17T12:25:06.325601+0000","last_clean":"2023-05-17T12:25:06.325601+0000","last_became_active":"2023-05-17T12:25:01.798348+0000","last_became_peered":"2023-05-17T12:25:01.798348+0000","last_unstale":"2023-05-17T12:25:06.325601+0000","last_undegraded":"2023-05-17T12:25:06.325601+0000","last_fullsized":"2023-05-17T12:25:06.325601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996347+0000","last_change":"2023-05-17T12:25:01.810349+0000","last_active":"2023-05-17T12:25:06.996347+0000","last_peered":"2023-05-17T12:25:06.996347+0000","last_clean":"2023-05-17T12:25:06.996347+0000","last_became_active":"2023-05-17T12:25:01.809853+0000","last_became_peered":"2023-05-17T12:25:01.809853+0000","last_unstale":"2023-05-17T12:25:06.996347+0000","last_undegraded":"2023-05-17T12:25:06.996347+0000","last_fullsized":"2023-05-17T12:25:06.996347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:04:42.761172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296403+0000","last_change":"2023-05-17T12:25:01.811973+0000","last_active":"2023-05-17T12:25:06.296403+0000","last_peered":"2023-05-17T12:25:06.296403+0000","last_clean":"2023-05-17T12:25:06.296403+0000","last_became_active":"2023-05-17T12:25:01.811764+0000","last_became_peered":"2023-05-17T12:25:01.811764+0000","last_unstale":"2023-05-17T12:25:06.296403+0000","last_undegraded":"2023-05-17T12:25:06.296403+0000","last_fullsized":"2023-05-17T12:25:06.296403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:59:51.442756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995789+0000","last_change":"2023-05-17T12:25:01.812104+0000","last_active":"2023-05-17T12:25:06.995789+0000","last_peered":"2023-05-17T12:25:06.995789+0000","last_clean":"2023-05-17T12:25:06.995789+0000","last_became_active":"2023-05-17T12:25:01.811782+0000","last_became_peered":"2023-05-17T12:25:01.811782+0000","last_unstale":"2023-05-17T12:25:06.995789+0000","last_undegraded":"2023-05-17T12:25:06.995789+0000","last_fullsized":"2023-05-17T12:25:06.995789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:27:46.682969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995644+0000","last_change":"2023-05-17T12:25:01.800327+0000","last_active":"2023-05-17T12:25:06.995644+0000","last_peered":"2023-05-17T12:25:06.995644+0000","last_clean":"2023-05-17T12:25:06.995644+0000","last_became_active":"2023-05-17T12:25:01.799859+0000","last_became_peered":"2023-05-17T12:25:01.799859+0000","last_unstale":"2023-05-17T12:25:06.995644+0000","last_undegraded":"2023-05-17T12:25:06.995644+0000","last_fullsized":"2023-05-17T12:25:06.995644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:22.299274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325260+0000","last_change":"2023-05-17T12:25:01.804627+0000","last_active":"2023-05-17T12:25:06.325260+0000","last_peered":"2023-05-17T12:25:06.325260+0000","last_clean":"2023-05-17T12:25:06.325260+0000","last_became_active":"2023-05-17T12:25:01.804355+0000","last_became_peered":"2023-05-17T12:25:01.804355+0000","last_unstale":"2023-05-17T12:25:06.325260+0000","last_undegraded":"2023-05-17T12:25:06.325260+0000","last_fullsized":"2023-05-17T12:25:06.325260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:58.149661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994004+0000","last_change":"2023-05-17T12:25:01.795597+0000","last_active":"2023-05-17T12:25:06.994004+0000","last_peered":"2023-05-17T12:25:06.994004+0000","last_clean":"2023-05-17T12:25:06.994004+0000","last_became_active":"2023-05-17T12:25:01.794994+0000","last_became_peered":"2023-05-17T12:25:01.794994+0000","last_unstale":"2023-05-17T12:25:06.994004+0000","last_undegraded":"2023-05-17T12:25:06.994004+0000","last_fullsized":"2023-05-17T12:25:06.994004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995908+0000","last_change":"2023-05-17T12:25:01.799968+0000","last_active":"2023-05-17T12:25:06.995908+0000","last_peered":"2023-05-17T12:25:06.995908+0000","last_clean":"2023-05-17T12:25:06.995908+0000","last_became_active":"2023-05-17T12:25:01.799673+0000","last_became_peered":"2023-05-17T12:25:01.799673+0000","last_unstale":"2023-05-17T12:25:06.995908+0000","last_undegraded":"2023-05-17T12:25:06.995908+0000","last_fullsized":"2023-05-17T12:25:06.995908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:01.358359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494793+0000","last_change":"2023-05-17T12:25:01.808781+0000","last_active":"2023-05-17T12:25:06.494793+0000","last_peered":"2023-05-17T12:25:06.494793+0000","last_clean":"2023-05-17T12:25:06.494793+0000","last_became_active":"2023-05-17T12:25:01.808497+0000","last_became_peered":"2023-05-17T12:25:01.808497+0000","last_unstale":"2023-05-17T12:25:06.494793+0000","last_undegraded":"2023-05-17T12:25:06.494793+0000","last_fullsized":"2023-05-17T12:25:06.494793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.495101+0000","last_change":"2023-05-17T12:25:01.799943+0000","last_active":"2023-05-17T12:25:06.495101+0000","last_peered":"2023-05-17T12:25:06.495101+0000","last_clean":"2023-05-17T12:25:06.495101+0000","last_became_active":"2023-05-17T12:25:01.799590+0000","last_became_peered":"2023-05-17T12:25:01.799590+0000","last_unstale":"2023-05-17T12:25:06.495101+0000","last_undegraded":"2023-05-17T12:25:06.495101+0000","last_fullsized":"2023-05-17T12:25:06.495101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299616+0000","last_change":"2023-05-17T12:25:01.809762+0000","last_active":"2023-05-17T12:25:06.299616+0000","last_peered":"2023-05-17T12:25:06.299616+0000","last_clean":"2023-05-17T12:25:06.299616+0000","last_became_active":"2023-05-17T12:25:01.809453+0000","last_became_peered":"2023-05-17T12:25:01.809453+0000","last_unstale":"2023-05-17T12:25:06.299616+0000","last_undegraded":"2023-05-17T12:25:06.299616+0000","last_fullsized":"2023-05-17T12:25:06.299616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996398+0000","last_change":"2023-05-17T12:25:05.826281+0000","last_active":"2023-05-17T12:25:06.996398+0000","last_peered":"2023-05-17T12:25:06.996398+0000","last_clean":"2023-05-17T12:25:06.996398+0000","last_became_active":"2023-05-17T12:25:05.825799+0000","last_became_peered":"2023-05-17T12:25:05.825799+0000","last_unstale":"2023-05-17T12:25:06.996398+0000","last_undegraded":"2023-05-17T12:25:06.996398+0000","last_fullsized":"2023-05-17T12:25:06.996398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:29:56.321361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995190+0000","last_change":"2023-05-17T12:25:01.309876+0000","last_active":"2023-05-17T12:25:06.995190+0000","last_peered":"2023-05-17T12:25:06.995190+0000","last_clean":"2023-05-17T12:25:06.995190+0000","last_became_active":"2023-05-17T12:25:01.307886+0000","last_became_peered":"2023-05-17T12:25:01.307886+0000","last_unstale":"2023-05-17T12:25:06.995190+0000","last_undegraded":"2023-05-17T12:25:06.995190+0000","last_fullsized":"2023-05-17T12:25:06.995190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:18:49.877888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994778+0000","last_change":"2023-05-17T12:25:01.803127+0000","last_active":"2023-05-17T12:25:06.994778+0000","last_peered":"2023-05-17T12:25:06.994778+0000","last_clean":"2023-05-17T12:25:06.994778+0000","last_became_active":"2023-05-17T12:25:01.802844+0000","last_became_peered":"2023-05-17T12:25:01.802844+0000","last_unstale":"2023-05-17T12:25:06.994778+0000","last_undegraded":"2023-05-17T12:25:06.994778+0000","last_fullsized":"2023-05-17T12:25:06.994778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:52:59.526969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298648+0000","last_change":"2023-05-17T12:25:05.828211+0000","last_active":"2023-05-17T12:25:06.298648+0000","last_peered":"2023-05-17T12:25:06.298648+0000","last_clean":"2023-05-17T12:25:06.298648+0000","last_became_active":"2023-05-17T12:25:05.827748+0000","last_became_peered":"2023-05-17T12:25:05.827748+0000","last_unstale":"2023-05-17T12:25:06.298648+0000","last_undegraded":"2023-05-17T12:25:06.298648+0000","last_fullsized":"2023-05-17T12:25:06.298648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:07:33.893870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.493925+0000","last_change":"2023-05-17T12:25:01.302947+0000","last_active":"2023-05-17T12:25:06.493925+0000","last_peered":"2023-05-17T12:25:06.493925+0000","last_clean":"2023-05-17T12:25:06.493925+0000","last_became_active":"2023-05-17T12:25:01.302640+0000","last_became_peered":"2023-05-17T12:25:01.302640+0000","last_unstale":"2023-05-17T12:25:06.493925+0000","last_undegraded":"2023-05-17T12:25:06.493925+0000","last_fullsized":"2023-05-17T12:25:06.493925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:46:32.251609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325638+0000","last_change":"2023-05-17T12:25:01.810080+0000","last_active":"2023-05-17T12:25:06.325638+0000","last_peered":"2023-05-17T12:25:06.325638+0000","last_clean":"2023-05-17T12:25:06.325638+0000","last_became_active":"2023-05-17T12:25:01.808787+0000","last_became_peered":"2023-05-17T12:25:01.808787+0000","last_unstale":"2023-05-17T12:25:06.325638+0000","last_undegraded":"2023-05-17T12:25:06.325638+0000","last_fullsized":"2023-05-17T12:25:06.325638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325836+0000","last_change":"2023-05-17T12:25:05.831211+0000","last_active":"2023-05-17T12:25:06.325836+0000","last_peered":"2023-05-17T12:25:06.325836+0000","last_clean":"2023-05-17T12:25:06.325836+0000","last_became_active":"2023-05-17T12:25:05.830823+0000","last_became_peered":"2023-05-17T12:25:05.830823+0000","last_unstale":"2023-05-17T12:25:06.325836+0000","last_undegraded":"2023-05-17T12:25:06.325836+0000","last_fullsized":"2023-05-17T12:25:06.325836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:04.874650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994157+0000","last_change":"2023-05-17T12:25:01.304687+0000","last_active":"2023-05-17T12:25:06.994157+0000","last_peered":"2023-05-17T12:25:06.994157+0000","last_clean":"2023-05-17T12:25:06.994157+0000","last_became_active":"2023-05-17T12:25:01.304242+0000","last_became_peered":"2023-05-17T12:25:01.304242+0000","last_unstale":"2023-05-17T12:25:06.994157+0000","last_undegraded":"2023-05-17T12:25:06.994157+0000","last_fullsized":"2023-05-17T12:25:06.994157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:27.380050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298774+0000","last_change":"2023-05-17T12:25:01.807436+0000","last_active":"2023-05-17T12:25:06.298774+0000","last_peered":"2023-05-17T12:25:06.298774+0000","last_clean":"2023-05-17T12:25:06.298774+0000","last_became_active":"2023-05-17T12:25:01.807174+0000","last_became_peered":"2023-05-17T12:25:01.807174+0000","last_unstale":"2023-05-17T12:25:06.298774+0000","last_undegraded":"2023-05-17T12:25:06.298774+0000","last_fullsized":"2023-05-17T12:25:06.298774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:53:31.008703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298892+0000","last_change":"2023-05-17T12:25:05.833027+0000","last_active":"2023-05-17T12:25:06.298892+0000","last_peered":"2023-05-17T12:25:06.298892+0000","last_clean":"2023-05-17T12:25:06.298892+0000","last_became_active":"2023-05-17T12:25:05.832612+0000","last_became_peered":"2023-05-17T12:25:05.832612+0000","last_unstale":"2023-05-17T12:25:06.298892+0000","last_undegraded":"2023-05-17T12:25:06.298892+0000","last_fullsized":"2023-05-17T12:25:06.298892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:55:06.307490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325684+0000","last_change":"2023-05-17T12:25:01.310559+0000","last_active":"2023-05-17T12:25:06.325684+0000","last_peered":"2023-05-17T12:25:06.325684+0000","last_clean":"2023-05-17T12:25:06.325684+0000","last_became_active":"2023-05-17T12:25:01.310250+0000","last_became_peered":"2023-05-17T12:25:01.310250+0000","last_unstale":"2023-05-17T12:25:06.325684+0000","last_undegraded":"2023-05-17T12:25:06.325684+0000","last_fullsized":"2023-05-17T12:25:06.325684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:15.832901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994111+0000","last_change":"2023-05-17T12:25:01.805412+0000","last_active":"2023-05-17T12:25:06.994111+0000","last_peered":"2023-05-17T12:25:06.994111+0000","last_clean":"2023-05-17T12:25:06.994111+0000","last_became_active":"2023-05-17T12:25:01.805151+0000","last_became_peered":"2023-05-17T12:25:01.805151+0000","last_unstale":"2023-05-17T12:25:06.994111+0000","last_undegraded":"2023-05-17T12:25:06.994111+0000","last_fullsized":"2023-05-17T12:25:06.994111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995226+0000","last_change":"2023-05-17T12:25:05.838900+0000","last_active":"2023-05-17T12:25:06.995226+0000","last_peered":"2023-05-17T12:25:06.995226+0000","last_clean":"2023-05-17T12:25:06.995226+0000","last_became_active":"2023-05-17T12:25:05.838472+0000","last_became_peered":"2023-05-17T12:25:05.838472+0000","last_unstale":"2023-05-17T12:25:06.995226+0000","last_undegraded":"2023-05-17T12:25:06.995226+0000","last_fullsized":"2023-05-17T12:25:06.995226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:33.512949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299849+0000","last_change":"2023-05-17T12:25:01.303641+0000","last_active":"2023-05-17T12:25:06.299849+0000","last_peered":"2023-05-17T12:25:06.299849+0000","last_clean":"2023-05-17T12:25:06.299849+0000","last_became_active":"2023-05-17T12:25:01.303288+0000","last_became_peered":"2023-05-17T12:25:01.303288+0000","last_unstale":"2023-05-17T12:25:06.299849+0000","last_undegraded":"2023-05-17T12:25:06.299849+0000","last_fullsized":"2023-05-17T12:25:06.299849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:41.485809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994071+0000","last_change":"2023-05-17T12:25:01.813134+0000","last_active":"2023-05-17T12:25:06.994071+0000","last_peered":"2023-05-17T12:25:06.994071+0000","last_clean":"2023-05-17T12:25:06.994071+0000","last_became_active":"2023-05-17T12:25:01.812890+0000","last_became_peered":"2023-05-17T12:25:01.812890+0000","last_unstale":"2023-05-17T12:25:06.994071+0000","last_undegraded":"2023-05-17T12:25:06.994071+0000","last_fullsized":"2023-05-17T12:25:06.994071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:32.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994712+0000","last_change":"2023-05-17T12:25:05.825529+0000","last_active":"2023-05-17T12:25:06.994712+0000","last_peered":"2023-05-17T12:25:06.994712+0000","last_clean":"2023-05-17T12:25:06.994712+0000","last_became_active":"2023-05-17T12:25:05.825141+0000","last_became_peered":"2023-05-17T12:25:05.825141+0000","last_unstale":"2023-05-17T12:25:06.994712+0000","last_undegraded":"2023-05-17T12:25:06.994712+0000","last_fullsized":"2023-05-17T12:25:06.994712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:01.828288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995416+0000","last_change":"2023-05-17T12:25:01.312424+0000","last_active":"2023-05-17T12:25:06.995416+0000","last_peered":"2023-05-17T12:25:06.995416+0000","last_clean":"2023-05-17T12:25:06.995416+0000","last_became_active":"2023-05-17T12:25:01.312124+0000","last_became_peered":"2023-05-17T12:25:01.312124+0000","last_unstale":"2023-05-17T12:25:06.995416+0000","last_undegraded":"2023-05-17T12:25:06.995416+0000","last_fullsized":"2023-05-17T12:25:06.995416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:15.832901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494444+0000","last_change":"2023-05-17T12:25:01.808707+0000","last_active":"2023-05-17T12:25:06.494444+0000","last_peered":"2023-05-17T12:25:06.494444+0000","last_clean":"2023-05-17T12:25:06.494444+0000","last_became_active":"2023-05-17T12:25:01.808370+0000","last_became_peered":"2023-05-17T12:25:01.808370+0000","last_unstale":"2023-05-17T12:25:06.494444+0000","last_undegraded":"2023-05-17T12:25:06.494444+0000","last_fullsized":"2023-05-17T12:25:06.494444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:58.149661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494050+0000","last_change":"2023-05-17T12:25:05.828428+0000","last_active":"2023-05-17T12:25:06.494050+0000","last_peered":"2023-05-17T12:25:06.494050+0000","last_clean":"2023-05-17T12:25:06.494050+0000","last_became_active":"2023-05-17T12:25:05.828056+0000","last_became_peered":"2023-05-17T12:25:05.828056+0000","last_unstale":"2023-05-17T12:25:06.494050+0000","last_undegraded":"2023-05-17T12:25:06.494050+0000","last_fullsized":"2023-05-17T12:25:06.494050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:09:51.971442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:21.144736+0000","last_change":"2023-05-17T12:25:01.303424+0000","last_active":"2023-05-17T12:25:21.144736+0000","last_peered":"2023-05-17T12:25:21.144736+0000","last_clean":"2023-05-17T12:25:21.144736+0000","last_became_active":"2023-05-17T12:25:01.303056+0000","last_became_peered":"2023-05-17T12:25:01.303056+0000","last_unstale":"2023-05-17T12:25:21.144736+0000","last_undegraded":"2023-05-17T12:25:21.144736+0000","last_fullsized":"2023-05-17T12:25:21.144736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:08:00.689474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996178+0000","last_change":"2023-05-17T12:25:01.812617+0000","last_active":"2023-05-17T12:25:06.996178+0000","last_peered":"2023-05-17T12:25:06.996178+0000","last_clean":"2023-05-17T12:25:06.996178+0000","last_became_active":"2023-05-17T12:25:01.811849+0000","last_became_peered":"2023-05-17T12:25:01.811849+0000","last_unstale":"2023-05-17T12:25:06.996178+0000","last_undegraded":"2023-05-17T12:25:06.996178+0000","last_fullsized":"2023-05-17T12:25:06.996178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:45:31.781166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299814+0000","last_change":"2023-05-17T12:25:05.830416+0000","last_active":"2023-05-17T12:25:06.299814+0000","last_peered":"2023-05-17T12:25:06.299814+0000","last_clean":"2023-05-17T12:25:06.299814+0000","last_became_active":"2023-05-17T12:25:05.829972+0000","last_became_peered":"2023-05-17T12:25:05.829972+0000","last_unstale":"2023-05-17T12:25:06.299814+0000","last_undegraded":"2023-05-17T12:25:06.299814+0000","last_fullsized":"2023-05-17T12:25:06.299814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:04.874650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995420+0000","last_change":"2023-05-17T12:25:01.307020+0000","last_active":"2023-05-17T12:25:06.995420+0000","last_peered":"2023-05-17T12:25:06.995420+0000","last_clean":"2023-05-17T12:25:06.995420+0000","last_became_active":"2023-05-17T12:25:01.306785+0000","last_became_peered":"2023-05-17T12:25:01.306785+0000","last_unstale":"2023-05-17T12:25:06.995420+0000","last_undegraded":"2023-05-17T12:25:06.995420+0000","last_fullsized":"2023-05-17T12:25:06.995420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:45.367692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994598+0000","last_change":"2023-05-17T12:25:01.803384+0000","last_active":"2023-05-17T12:25:06.994598+0000","last_peered":"2023-05-17T12:25:06.994598+0000","last_clean":"2023-05-17T12:25:06.994598+0000","last_became_active":"2023-05-17T12:25:01.803098+0000","last_became_peered":"2023-05-17T12:25:01.803098+0000","last_unstale":"2023-05-17T12:25:06.994598+0000","last_undegraded":"2023-05-17T12:25:06.994598+0000","last_fullsized":"2023-05-17T12:25:06.994598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:56.325526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994382+0000","last_change":"2023-05-17T12:25:05.832871+0000","last_active":"2023-05-17T12:25:06.994382+0000","last_peered":"2023-05-17T12:25:06.994382+0000","last_clean":"2023-05-17T12:25:06.994382+0000","last_became_active":"2023-05-17T12:25:05.832188+0000","last_became_peered":"2023-05-17T12:25:05.832188+0000","last_unstale":"2023-05-17T12:25:06.994382+0000","last_undegraded":"2023-05-17T12:25:06.994382+0000","last_fullsized":"2023-05-17T12:25:06.994382+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:09.673142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325005+0000","last_change":"2023-05-17T12:25:01.299295+0000","last_active":"2023-05-17T12:25:06.325005+0000","last_peered":"2023-05-17T12:25:06.325005+0000","last_clean":"2023-05-17T12:25:06.325005+0000","last_became_active":"2023-05-17T12:25:01.298965+0000","last_became_peered":"2023-05-17T12:25:01.298965+0000","last_unstale":"2023-05-17T12:25:06.325005+0000","last_undegraded":"2023-05-17T12:25:06.325005+0000","last_fullsized":"2023-05-17T12:25:06.325005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:53.614694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299614+0000","last_change":"2023-05-17T12:25:01.809638+0000","last_active":"2023-05-17T12:25:06.299614+0000","last_peered":"2023-05-17T12:25:06.299614+0000","last_clean":"2023-05-17T12:25:06.299614+0000","last_became_active":"2023-05-17T12:25:01.809317+0000","last_became_peered":"2023-05-17T12:25:01.809317+0000","last_unstale":"2023-05-17T12:25:06.299614+0000","last_undegraded":"2023-05-17T12:25:06.299614+0000","last_fullsized":"2023-05-17T12:25:06.299614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994585+0000","last_change":"2023-05-17T12:25:05.834920+0000","last_active":"2023-05-17T12:25:06.994585+0000","last_peered":"2023-05-17T12:25:06.994585+0000","last_clean":"2023-05-17T12:25:06.994585+0000","last_became_active":"2023-05-17T12:25:05.834577+0000","last_became_peered":"2023-05-17T12:25:05.834577+0000","last_unstale":"2023-05-17T12:25:06.994585+0000","last_undegraded":"2023-05-17T12:25:06.994585+0000","last_fullsized":"2023-05-17T12:25:06.994585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:46.007953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995874+0000","last_change":"2023-05-17T12:25:01.307004+0000","last_active":"2023-05-17T12:25:06.995874+0000","last_peered":"2023-05-17T12:25:06.995874+0000","last_clean":"2023-05-17T12:25:06.995874+0000","last_became_active":"2023-05-17T12:25:01.306682+0000","last_became_peered":"2023-05-17T12:25:01.306682+0000","last_unstale":"2023-05-17T12:25:06.995874+0000","last_undegraded":"2023-05-17T12:25:06.995874+0000","last_fullsized":"2023-05-17T12:25:06.995874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325659+0000","last_change":"2023-05-17T12:25:01.798105+0000","last_active":"2023-05-17T12:25:06.325659+0000","last_peered":"2023-05-17T12:25:06.325659+0000","last_clean":"2023-05-17T12:25:06.325659+0000","last_became_active":"2023-05-17T12:25:01.797871+0000","last_became_peered":"2023-05-17T12:25:01.797871+0000","last_unstale":"2023-05-17T12:25:06.325659+0000","last_undegraded":"2023-05-17T12:25:06.325659+0000","last_fullsized":"2023-05-17T12:25:06.325659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:16:06.156852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299751+0000","last_change":"2023-05-17T12:25:05.830239+0000","last_active":"2023-05-17T12:25:06.299751+0000","last_peered":"2023-05-17T12:25:06.299751+0000","last_clean":"2023-05-17T12:25:06.299751+0000","last_became_active":"2023-05-17T12:25:05.829812+0000","last_became_peered":"2023-05-17T12:25:05.829812+0000","last_unstale":"2023-05-17T12:25:06.299751+0000","last_undegraded":"2023-05-17T12:25:06.299751+0000","last_fullsized":"2023-05-17T12:25:06.299751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:42.636103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298742+0000","last_change":"2023-05-17T12:25:01.301970+0000","last_active":"2023-05-17T12:25:06.298742+0000","last_peered":"2023-05-17T12:25:06.298742+0000","last_clean":"2023-05-17T12:25:06.298742+0000","last_became_active":"2023-05-17T12:25:01.301645+0000","last_became_peered":"2023-05-17T12:25:01.301645+0000","last_unstale":"2023-05-17T12:25:06.298742+0000","last_undegraded":"2023-05-17T12:25:06.298742+0000","last_fullsized":"2023-05-17T12:25:06.298742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:01:41.050026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994656+0000","last_change":"2023-05-17T12:25:01.814151+0000","last_active":"2023-05-17T12:25:06.994656+0000","last_peered":"2023-05-17T12:25:06.994656+0000","last_clean":"2023-05-17T12:25:06.994656+0000","last_became_active":"2023-05-17T12:25:01.813749+0000","last_became_peered":"2023-05-17T12:25:01.813749+0000","last_unstale":"2023-05-17T12:25:06.994656+0000","last_undegraded":"2023-05-17T12:25:06.994656+0000","last_fullsized":"2023-05-17T12:25:06.994656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:56:53.310216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996349+0000","last_change":"2023-05-17T12:25:05.841929+0000","last_active":"2023-05-17T12:25:06.996349+0000","last_peered":"2023-05-17T12:25:06.996349+0000","last_clean":"2023-05-17T12:25:06.996349+0000","last_became_active":"2023-05-17T12:25:05.841487+0000","last_became_peered":"2023-05-17T12:25:05.841487+0000","last_unstale":"2023-05-17T12:25:06.996349+0000","last_undegraded":"2023-05-17T12:25:06.996349+0000","last_fullsized":"2023-05-17T12:25:06.996349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:48:01.828288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996446+0000","last_change":"2023-05-17T12:25:01.304576+0000","last_active":"2023-05-17T12:25:06.996446+0000","last_peered":"2023-05-17T12:25:06.996446+0000","last_clean":"2023-05-17T12:25:06.996446+0000","last_became_active":"2023-05-17T12:25:01.304198+0000","last_became_peered":"2023-05-17T12:25:01.304198+0000","last_unstale":"2023-05-17T12:25:06.996446+0000","last_undegraded":"2023-05-17T12:25:06.996446+0000","last_fullsized":"2023-05-17T12:25:06.996446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:11.601219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298936+0000","last_change":"2023-05-17T12:25:01.802054+0000","last_active":"2023-05-17T12:25:06.298936+0000","last_peered":"2023-05-17T12:25:06.298936+0000","last_clean":"2023-05-17T12:25:06.298936+0000","last_became_active":"2023-05-17T12:25:01.801727+0000","last_became_peered":"2023-05-17T12:25:01.801727+0000","last_unstale":"2023-05-17T12:25:06.298936+0000","last_undegraded":"2023-05-17T12:25:06.298936+0000","last_fullsized":"2023-05-17T12:25:06.298936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:24.353901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296090+0000","last_change":"2023-05-17T12:25:05.831343+0000","last_active":"2023-05-17T12:25:06.296090+0000","last_peered":"2023-05-17T12:25:06.296090+0000","last_clean":"2023-05-17T12:25:06.296090+0000","last_became_active":"2023-05-17T12:25:05.830962+0000","last_became_peered":"2023-05-17T12:25:05.830962+0000","last_unstale":"2023-05-17T12:25:06.296090+0000","last_undegraded":"2023-05-17T12:25:06.296090+0000","last_fullsized":"2023-05-17T12:25:06.296090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:31:26.034991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996563+0000","last_change":"2023-05-17T12:25:01.307148+0000","last_active":"2023-05-17T12:25:06.996563+0000","last_peered":"2023-05-17T12:25:06.996563+0000","last_clean":"2023-05-17T12:25:06.996563+0000","last_became_active":"2023-05-17T12:25:01.306796+0000","last_became_peered":"2023-05-17T12:25:01.306796+0000","last_unstale":"2023-05-17T12:25:06.996563+0000","last_undegraded":"2023-05-17T12:25:06.996563+0000","last_fullsized":"2023-05-17T12:25:06.996563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:40:08.139475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995053+0000","last_change":"2023-05-17T12:25:01.810661+0000","last_active":"2023-05-17T12:25:06.995053+0000","last_peered":"2023-05-17T12:25:06.995053+0000","last_clean":"2023-05-17T12:25:06.995053+0000","last_became_active":"2023-05-17T12:25:01.810315+0000","last_became_peered":"2023-05-17T12:25:01.810315+0000","last_unstale":"2023-05-17T12:25:06.995053+0000","last_undegraded":"2023-05-17T12:25:06.995053+0000","last_fullsized":"2023-05-17T12:25:06.995053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:11:45.271597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296256+0000","last_change":"2023-05-17T12:25:05.827003+0000","last_active":"2023-05-17T12:25:06.296256+0000","last_peered":"2023-05-17T12:25:06.296256+0000","last_clean":"2023-05-17T12:25:06.296256+0000","last_became_active":"2023-05-17T12:25:05.826640+0000","last_became_peered":"2023-05-17T12:25:05.826640+0000","last_unstale":"2023-05-17T12:25:06.296256+0000","last_undegraded":"2023-05-17T12:25:06.296256+0000","last_fullsized":"2023-05-17T12:25:06.296256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:46:35.905087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995688+0000","last_change":"2023-05-17T12:25:01.309404+0000","last_active":"2023-05-17T12:25:06.995688+0000","last_peered":"2023-05-17T12:25:06.995688+0000","last_clean":"2023-05-17T12:25:06.995688+0000","last_became_active":"2023-05-17T12:25:01.309104+0000","last_became_peered":"2023-05-17T12:25:01.309104+0000","last_unstale":"2023-05-17T12:25:06.995688+0000","last_undegraded":"2023-05-17T12:25:06.995688+0000","last_fullsized":"2023-05-17T12:25:06.995688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:17.774402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298561+0000","last_change":"2023-05-17T12:25:01.806638+0000","last_active":"2023-05-17T12:25:06.298561+0000","last_peered":"2023-05-17T12:25:06.298561+0000","last_clean":"2023-05-17T12:25:06.298561+0000","last_became_active":"2023-05-17T12:25:01.806398+0000","last_became_peered":"2023-05-17T12:25:01.806398+0000","last_unstale":"2023-05-17T12:25:06.298561+0000","last_undegraded":"2023-05-17T12:25:06.298561+0000","last_fullsized":"2023-05-17T12:25:06.298561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:32:04.677765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296330+0000","last_change":"2023-05-17T12:25:05.825320+0000","last_active":"2023-05-17T12:25:06.296330+0000","last_peered":"2023-05-17T12:25:06.296330+0000","last_clean":"2023-05-17T12:25:06.296330+0000","last_became_active":"2023-05-17T12:25:05.824918+0000","last_became_peered":"2023-05-17T12:25:05.824918+0000","last_unstale":"2023-05-17T12:25:06.296330+0000","last_undegraded":"2023-05-17T12:25:06.296330+0000","last_fullsized":"2023-05-17T12:25:06.296330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:12:01.541988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298981+0000","last_change":"2023-05-17T12:25:01.311086+0000","last_active":"2023-05-17T12:25:06.298981+0000","last_peered":"2023-05-17T12:25:06.298981+0000","last_clean":"2023-05-17T12:25:06.298981+0000","last_became_active":"2023-05-17T12:25:01.310778+0000","last_became_peered":"2023-05-17T12:25:01.310778+0000","last_unstale":"2023-05-17T12:25:06.298981+0000","last_undegraded":"2023-05-17T12:25:06.298981+0000","last_fullsized":"2023-05-17T12:25:06.298981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:12:57.143808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325238+0000","last_change":"2023-05-17T12:25:01.803984+0000","last_active":"2023-05-17T12:25:06.325238+0000","last_peered":"2023-05-17T12:25:06.325238+0000","last_clean":"2023-05-17T12:25:06.325238+0000","last_became_active":"2023-05-17T12:25:01.803655+0000","last_became_peered":"2023-05-17T12:25:01.803655+0000","last_unstale":"2023-05-17T12:25:06.325238+0000","last_undegraded":"2023-05-17T12:25:06.325238+0000","last_fullsized":"2023-05-17T12:25:06.325238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:24.353901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296620+0000","last_change":"2023-05-17T12:25:05.827683+0000","last_active":"2023-05-17T12:25:06.296620+0000","last_peered":"2023-05-17T12:25:06.296620+0000","last_clean":"2023-05-17T12:25:06.296620+0000","last_became_active":"2023-05-17T12:25:05.827247+0000","last_became_peered":"2023-05-17T12:25:05.827247+0000","last_unstale":"2023-05-17T12:25:06.296620+0000","last_undegraded":"2023-05-17T12:25:06.296620+0000","last_fullsized":"2023-05-17T12:25:06.296620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:26:50.186275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994317+0000","last_change":"2023-05-17T12:25:01.302898+0000","last_active":"2023-05-17T12:25:06.994317+0000","last_peered":"2023-05-17T12:25:06.994317+0000","last_clean":"2023-05-17T12:25:06.994317+0000","last_became_active":"2023-05-17T12:25:01.302511+0000","last_became_peered":"2023-05-17T12:25:01.302511+0000","last_unstale":"2023-05-17T12:25:06.994317+0000","last_undegraded":"2023-05-17T12:25:06.994317+0000","last_fullsized":"2023-05-17T12:25:06.994317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:43:00.352507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995431+0000","last_change":"2023-05-17T12:25:01.809822+0000","last_active":"2023-05-17T12:25:06.995431+0000","last_peered":"2023-05-17T12:25:06.995431+0000","last_clean":"2023-05-17T12:25:06.995431+0000","last_became_active":"2023-05-17T12:25:01.809341+0000","last_became_peered":"2023-05-17T12:25:01.809341+0000","last_unstale":"2023-05-17T12:25:06.995431+0000","last_undegraded":"2023-05-17T12:25:06.995431+0000","last_fullsized":"2023-05-17T12:25:06.995431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:55:38.616795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494179+0000","last_change":"2023-05-17T12:25:05.823841+0000","last_active":"2023-05-17T12:25:06.494179+0000","last_peered":"2023-05-17T12:25:06.494179+0000","last_clean":"2023-05-17T12:25:06.494179+0000","last_became_active":"2023-05-17T12:25:05.823477+0000","last_became_peered":"2023-05-17T12:25:05.823477+0000","last_unstale":"2023-05-17T12:25:06.494179+0000","last_undegraded":"2023-05-17T12:25:06.494179+0000","last_fullsized":"2023-05-17T12:25:06.494179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:35:08.935796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298699+0000","last_change":"2023-05-17T12:25:01.304712+0000","last_active":"2023-05-17T12:25:06.298699+0000","last_peered":"2023-05-17T12:25:06.298699+0000","last_clean":"2023-05-17T12:25:06.298699+0000","last_became_active":"2023-05-17T12:25:01.304393+0000","last_became_peered":"2023-05-17T12:25:01.304393+0000","last_unstale":"2023-05-17T12:25:06.298699+0000","last_undegraded":"2023-05-17T12:25:06.298699+0000","last_fullsized":"2023-05-17T12:25:06.298699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:26:28.248372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995773+0000","last_change":"2023-05-17T12:25:01.798453+0000","last_active":"2023-05-17T12:25:06.995773+0000","last_peered":"2023-05-17T12:25:06.995773+0000","last_clean":"2023-05-17T12:25:06.995773+0000","last_became_active":"2023-05-17T12:25:01.798156+0000","last_became_peered":"2023-05-17T12:25:01.798156+0000","last_unstale":"2023-05-17T12:25:06.995773+0000","last_undegraded":"2023-05-17T12:25:06.995773+0000","last_fullsized":"2023-05-17T12:25:06.995773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:43.116514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299389+0000","last_change":"2023-05-17T12:25:05.830481+0000","last_active":"2023-05-17T12:25:06.299389+0000","last_peered":"2023-05-17T12:25:06.299389+0000","last_clean":"2023-05-17T12:25:06.299389+0000","last_became_active":"2023-05-17T12:25:05.829790+0000","last_became_peered":"2023-05-17T12:25:05.829790+0000","last_unstale":"2023-05-17T12:25:06.299389+0000","last_undegraded":"2023-05-17T12:25:06.299389+0000","last_fullsized":"2023-05-17T12:25:06.299389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:49.889835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995559+0000","last_change":"2023-05-17T12:25:01.303346+0000","last_active":"2023-05-17T12:25:06.995559+0000","last_peered":"2023-05-17T12:25:06.995559+0000","last_clean":"2023-05-17T12:25:06.995559+0000","last_became_active":"2023-05-17T12:25:01.303010+0000","last_became_peered":"2023-05-17T12:25:01.303010+0000","last_unstale":"2023-05-17T12:25:06.995559+0000","last_undegraded":"2023-05-17T12:25:06.995559+0000","last_fullsized":"2023-05-17T12:25:06.995559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:05:24.193334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996498+0000","last_change":"2023-05-17T12:25:01.812147+0000","last_active":"2023-05-17T12:25:06.996498+0000","last_peered":"2023-05-17T12:25:06.996498+0000","last_clean":"2023-05-17T12:25:06.996498+0000","last_became_active":"2023-05-17T12:25:01.811794+0000","last_became_peered":"2023-05-17T12:25:01.811794+0000","last_unstale":"2023-05-17T12:25:06.996498+0000","last_undegraded":"2023-05-17T12:25:06.996498+0000","last_fullsized":"2023-05-17T12:25:06.996498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:21:08.368476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996608+0000","last_change":"2023-05-17T12:25:05.825191+0000","last_active":"2023-05-17T12:25:06.996608+0000","last_peered":"2023-05-17T12:25:06.996608+0000","last_clean":"2023-05-17T12:25:06.996608+0000","last_became_active":"2023-05-17T12:25:05.824783+0000","last_became_peered":"2023-05-17T12:25:05.824783+0000","last_unstale":"2023-05-17T12:25:06.996608+0000","last_undegraded":"2023-05-17T12:25:06.996608+0000","last_fullsized":"2023-05-17T12:25:06.996608+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:37.899306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994023+0000","last_change":"2023-05-17T12:25:01.308187+0000","last_active":"2023-05-17T12:25:06.994023+0000","last_peered":"2023-05-17T12:25:06.994023+0000","last_clean":"2023-05-17T12:25:06.994023+0000","last_became_active":"2023-05-17T12:25:01.307806+0000","last_became_peered":"2023-05-17T12:25:01.307806+0000","last_unstale":"2023-05-17T12:25:06.994023+0000","last_undegraded":"2023-05-17T12:25:06.994023+0000","last_fullsized":"2023-05-17T12:25:06.994023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:28.990806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494856+0000","last_change":"2023-05-17T12:25:01.801432+0000","last_active":"2023-05-17T12:25:06.494856+0000","last_peered":"2023-05-17T12:25:06.494856+0000","last_clean":"2023-05-17T12:25:06.494856+0000","last_became_active":"2023-05-17T12:25:01.801009+0000","last_became_peered":"2023-05-17T12:25:01.801009+0000","last_unstale":"2023-05-17T12:25:06.494856+0000","last_undegraded":"2023-05-17T12:25:06.494856+0000","last_fullsized":"2023-05-17T12:25:06.494856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:42:46.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325252+0000","last_change":"2023-05-17T12:25:05.822949+0000","last_active":"2023-05-17T12:25:06.325252+0000","last_peered":"2023-05-17T12:25:06.325252+0000","last_clean":"2023-05-17T12:25:06.325252+0000","last_became_active":"2023-05-17T12:25:05.822299+0000","last_became_peered":"2023-05-17T12:25:05.822299+0000","last_unstale":"2023-05-17T12:25:06.325252+0000","last_undegraded":"2023-05-17T12:25:06.325252+0000","last_fullsized":"2023-05-17T12:25:06.325252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:43:00.150100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494254+0000","last_change":"2023-05-17T12:24:55.792670+0000","last_active":"2023-05-17T12:25:06.494254+0000","last_peered":"2023-05-17T12:25:06.494254+0000","last_clean":"2023-05-17T12:25:06.494254+0000","last_became_active":"2023-05-17T12:24:55.792363+0000","last_became_peered":"2023-05-17T12:24:55.792363+0000","last_unstale":"2023-05-17T12:25:06.494254+0000","last_undegraded":"2023-05-17T12:25:06.494254+0000","last_fullsized":"2023-05-17T12:25:06.494254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:48.078768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299528+0000","last_change":"2023-05-17T12:25:01.311296+0000","last_active":"2023-05-17T12:25:06.299528+0000","last_peered":"2023-05-17T12:25:06.299528+0000","last_clean":"2023-05-17T12:25:06.299528+0000","last_became_active":"2023-05-17T12:25:01.310946+0000","last_became_peered":"2023-05-17T12:25:01.310946+0000","last_unstale":"2023-05-17T12:25:06.299528+0000","last_undegraded":"2023-05-17T12:25:06.299528+0000","last_fullsized":"2023-05-17T12:25:06.299528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:21.293421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494247+0000","last_change":"2023-05-17T12:25:01.798812+0000","last_active":"2023-05-17T12:25:06.494247+0000","last_peered":"2023-05-17T12:25:06.494247+0000","last_clean":"2023-05-17T12:25:06.494247+0000","last_became_active":"2023-05-17T12:25:01.798536+0000","last_became_peered":"2023-05-17T12:25:01.798536+0000","last_unstale":"2023-05-17T12:25:06.494247+0000","last_undegraded":"2023-05-17T12:25:06.494247+0000","last_fullsized":"2023-05-17T12:25:06.494247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:52:17.557383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325259+0000","last_change":"2023-05-17T12:25:05.830657+0000","last_active":"2023-05-17T12:25:06.325259+0000","last_peered":"2023-05-17T12:25:06.325259+0000","last_clean":"2023-05-17T12:25:06.325259+0000","last_became_active":"2023-05-17T12:25:05.830173+0000","last_became_peered":"2023-05-17T12:25:05.830173+0000","last_unstale":"2023-05-17T12:25:06.325259+0000","last_undegraded":"2023-05-17T12:25:06.325259+0000","last_fullsized":"2023-05-17T12:25:06.325259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:29:01.854184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298702+0000","last_change":"2023-05-17T12:24:55.754074+0000","last_active":"2023-05-17T12:25:06.298702+0000","last_peered":"2023-05-17T12:25:06.298702+0000","last_clean":"2023-05-17T12:25:06.298702+0000","last_became_active":"2023-05-17T12:24:55.753544+0000","last_became_peered":"2023-05-17T12:24:55.753544+0000","last_unstale":"2023-05-17T12:25:06.298702+0000","last_undegraded":"2023-05-17T12:25:06.298702+0000","last_fullsized":"2023-05-17T12:25:06.298702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:28:51.796115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995192+0000","last_change":"2023-05-17T12:25:01.305764+0000","last_active":"2023-05-17T12:25:06.995192+0000","last_peered":"2023-05-17T12:25:06.995192+0000","last_clean":"2023-05-17T12:25:06.995192+0000","last_became_active":"2023-05-17T12:25:01.304391+0000","last_became_peered":"2023-05-17T12:25:01.304391+0000","last_unstale":"2023-05-17T12:25:06.995192+0000","last_undegraded":"2023-05-17T12:25:06.995192+0000","last_fullsized":"2023-05-17T12:25:06.995192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:59:10.917259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494223+0000","last_change":"2023-05-17T12:25:01.796749+0000","last_active":"2023-05-17T12:25:06.494223+0000","last_peered":"2023-05-17T12:25:06.494223+0000","last_clean":"2023-05-17T12:25:06.494223+0000","last_became_active":"2023-05-17T12:25:01.796483+0000","last_became_peered":"2023-05-17T12:25:01.796483+0000","last_unstale":"2023-05-17T12:25:06.494223+0000","last_undegraded":"2023-05-17T12:25:06.494223+0000","last_fullsized":"2023-05-17T12:25:06.494223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:41:28.654953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296765+0000","last_change":"2023-05-17T12:25:05.831371+0000","last_active":"2023-05-17T12:25:06.296765+0000","last_peered":"2023-05-17T12:25:06.296765+0000","last_clean":"2023-05-17T12:25:06.296765+0000","last_became_active":"2023-05-17T12:25:05.830975+0000","last_became_peered":"2023-05-17T12:25:05.830975+0000","last_unstale":"2023-05-17T12:25:06.296765+0000","last_undegraded":"2023-05-17T12:25:06.296765+0000","last_fullsized":"2023-05-17T12:25:06.296765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:20.938620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296249+0000","last_change":"2023-05-17T12:24:56.008501+0000","last_active":"2023-05-17T12:25:06.296249+0000","last_peered":"2023-05-17T12:25:06.296249+0000","last_clean":"2023-05-17T12:25:06.296249+0000","last_became_active":"2023-05-17T12:24:56.008203+0000","last_became_peered":"2023-05-17T12:24:56.008203+0000","last_unstale":"2023-05-17T12:25:06.296249+0000","last_undegraded":"2023-05-17T12:25:06.296249+0000","last_fullsized":"2023-05-17T12:25:06.296249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:04:51.599706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.493981+0000","last_change":"2023-05-17T12:25:01.301806+0000","last_active":"2023-05-17T12:25:06.493981+0000","last_peered":"2023-05-17T12:25:06.493981+0000","last_clean":"2023-05-17T12:25:06.493981+0000","last_became_active":"2023-05-17T12:25:01.301537+0000","last_became_peered":"2023-05-17T12:25:01.301537+0000","last_unstale":"2023-05-17T12:25:06.493981+0000","last_undegraded":"2023-05-17T12:25:06.493981+0000","last_fullsized":"2023-05-17T12:25:06.493981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:34:24.246684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494836+0000","last_change":"2023-05-17T12:25:01.801261+0000","last_active":"2023-05-17T12:25:06.494836+0000","last_peered":"2023-05-17T12:25:06.494836+0000","last_clean":"2023-05-17T12:25:06.494836+0000","last_became_active":"2023-05-17T12:25:01.800721+0000","last_became_peered":"2023-05-17T12:25:01.800721+0000","last_unstale":"2023-05-17T12:25:06.494836+0000","last_undegraded":"2023-05-17T12:25:06.494836+0000","last_fullsized":"2023-05-17T12:25:06.494836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:29.996659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996033+0000","last_change":"2023-05-17T12:25:05.844206+0000","last_active":"2023-05-17T12:25:06.996033+0000","last_peered":"2023-05-17T12:25:06.996033+0000","last_clean":"2023-05-17T12:25:06.996033+0000","last_became_active":"2023-05-17T12:25:05.843845+0000","last_became_peered":"2023-05-17T12:25:05.843845+0000","last_unstale":"2023-05-17T12:25:06.996033+0000","last_undegraded":"2023-05-17T12:25:06.996033+0000","last_fullsized":"2023-05-17T12:25:06.996033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:46.007953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299370+0000","last_change":"2023-05-17T12:24:55.753963+0000","last_active":"2023-05-17T12:25:06.299370+0000","last_peered":"2023-05-17T12:25:06.299370+0000","last_clean":"2023-05-17T12:25:06.299370+0000","last_became_active":"2023-05-17T12:24:55.753582+0000","last_became_peered":"2023-05-17T12:24:55.753582+0000","last_unstale":"2023-05-17T12:25:06.299370+0000","last_undegraded":"2023-05-17T12:25:06.299370+0000","last_fullsized":"2023-05-17T12:25:06.299370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995510+0000","last_change":"2023-05-17T12:24:48.829166+0000","last_active":"2023-05-17T12:25:06.995510+0000","last_peered":"2023-05-17T12:25:06.995510+0000","last_clean":"2023-05-17T12:25:06.995510+0000","last_became_active":"2023-05-17T12:24:48.828767+0000","last_became_peered":"2023-05-17T12:24:48.828767+0000","last_unstale":"2023-05-17T12:25:06.995510+0000","last_undegraded":"2023-05-17T12:25:06.995510+0000","last_fullsized":"2023-05-17T12:25:06.995510+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_clean_scrub_stamp":"2023-05-17T12:24:47.688706+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:18.612053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994251+0000","last_change":"2023-05-17T12:25:01.310793+0000","last_active":"2023-05-17T12:25:06.994251+0000","last_peered":"2023-05-17T12:25:06.994251+0000","last_clean":"2023-05-17T12:25:06.994251+0000","last_became_active":"2023-05-17T12:25:01.310471+0000","last_became_peered":"2023-05-17T12:25:01.310471+0000","last_unstale":"2023-05-17T12:25:06.994251+0000","last_undegraded":"2023-05-17T12:25:06.994251+0000","last_fullsized":"2023-05-17T12:25:06.994251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:21.293421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299111+0000","last_change":"2023-05-17T12:25:01.813237+0000","last_active":"2023-05-17T12:25:06.299111+0000","last_peered":"2023-05-17T12:25:06.299111+0000","last_clean":"2023-05-17T12:25:06.299111+0000","last_became_active":"2023-05-17T12:25:01.812856+0000","last_became_peered":"2023-05-17T12:25:01.812856+0000","last_unstale":"2023-05-17T12:25:06.299111+0000","last_undegraded":"2023-05-17T12:25:06.299111+0000","last_fullsized":"2023-05-17T12:25:06.299111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:03:48.424581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299344+0000","last_change":"2023-05-17T12:25:05.831353+0000","last_active":"2023-05-17T12:25:06.299344+0000","last_peered":"2023-05-17T12:25:06.299344+0000","last_clean":"2023-05-17T12:25:06.299344+0000","last_became_active":"2023-05-17T12:25:05.830895+0000","last_became_peered":"2023-05-17T12:25:05.830895+0000","last_unstale":"2023-05-17T12:25:06.299344+0000","last_undegraded":"2023-05-17T12:25:06.299344+0000","last_fullsized":"2023-05-17T12:25:06.299344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:33.512949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996042+0000","last_change":"2023-05-17T12:24:55.756595+0000","last_active":"2023-05-17T12:25:06.996042+0000","last_peered":"2023-05-17T12:25:06.996042+0000","last_clean":"2023-05-17T12:25:06.996042+0000","last_became_active":"2023-05-17T12:24:55.756274+0000","last_became_peered":"2023-05-17T12:24:55.756274+0000","last_unstale":"2023-05-17T12:25:06.996042+0000","last_undegraded":"2023-05-17T12:25:06.996042+0000","last_fullsized":"2023-05-17T12:25:06.996042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:16:49.783748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.324875+0000","last_change":"2023-05-17T12:25:01.304992+0000","last_active":"2023-05-17T12:25:06.324875+0000","last_peered":"2023-05-17T12:25:06.324875+0000","last_clean":"2023-05-17T12:25:06.324875+0000","last_became_active":"2023-05-17T12:25:01.304670+0000","last_became_peered":"2023-05-17T12:25:01.304670+0000","last_unstale":"2023-05-17T12:25:06.324875+0000","last_undegraded":"2023-05-17T12:25:06.324875+0000","last_fullsized":"2023-05-17T12:25:06.324875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:52:16.551530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325454+0000","last_change":"2023-05-17T12:25:01.804023+0000","last_active":"2023-05-17T12:25:06.325454+0000","last_peered":"2023-05-17T12:25:06.325454+0000","last_clean":"2023-05-17T12:25:06.325454+0000","last_became_active":"2023-05-17T12:25:01.803777+0000","last_became_peered":"2023-05-17T12:25:01.803777+0000","last_unstale":"2023-05-17T12:25:06.325454+0000","last_undegraded":"2023-05-17T12:25:06.325454+0000","last_fullsized":"2023-05-17T12:25:06.325454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:34:29.996659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298944+0000","last_change":"2023-05-17T12:25:05.834950+0000","last_active":"2023-05-17T12:25:06.298944+0000","last_peered":"2023-05-17T12:25:06.298944+0000","last_clean":"2023-05-17T12:25:06.298944+0000","last_became_active":"2023-05-17T12:25:05.833927+0000","last_became_peered":"2023-05-17T12:25:05.833927+0000","last_unstale":"2023-05-17T12:25:06.298944+0000","last_undegraded":"2023-05-17T12:25:06.298944+0000","last_fullsized":"2023-05-17T12:25:06.298944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:43:29.212877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995514+0000","last_change":"2023-05-17T12:24:55.792994+0000","last_active":"2023-05-17T12:25:06.995514+0000","last_peered":"2023-05-17T12:25:06.995514+0000","last_clean":"2023-05-17T12:25:06.995514+0000","last_became_active":"2023-05-17T12:24:55.792597+0000","last_became_peered":"2023-05-17T12:24:55.792597+0000","last_unstale":"2023-05-17T12:25:06.995514+0000","last_undegraded":"2023-05-17T12:25:06.995514+0000","last_fullsized":"2023-05-17T12:25:06.995514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494371+0000","last_change":"2023-05-17T12:25:01.307685+0000","last_active":"2023-05-17T12:25:06.494371+0000","last_peered":"2023-05-17T12:25:06.494371+0000","last_clean":"2023-05-17T12:25:06.494371+0000","last_became_active":"2023-05-17T12:25:01.307371+0000","last_became_peered":"2023-05-17T12:25:01.307371+0000","last_unstale":"2023-05-17T12:25:06.494371+0000","last_undegraded":"2023-05-17T12:25:06.494371+0000","last_fullsized":"2023-05-17T12:25:06.494371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:37:23.348048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325414+0000","last_change":"2023-05-17T12:25:01.809898+0000","last_active":"2023-05-17T12:25:06.325414+0000","last_peered":"2023-05-17T12:25:06.325414+0000","last_clean":"2023-05-17T12:25:06.325414+0000","last_became_active":"2023-05-17T12:25:01.809647+0000","last_became_peered":"2023-05-17T12:25:01.809647+0000","last_unstale":"2023-05-17T12:25:06.325414+0000","last_undegraded":"2023-05-17T12:25:06.325414+0000","last_fullsized":"2023-05-17T12:25:06.325414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:11.503113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995271+0000","last_change":"2023-05-17T12:25:05.837992+0000","last_active":"2023-05-17T12:25:06.995271+0000","last_peered":"2023-05-17T12:25:06.995271+0000","last_clean":"2023-05-17T12:25:06.995271+0000","last_became_active":"2023-05-17T12:25:05.836246+0000","last_became_peered":"2023-05-17T12:25:05.836246+0000","last_unstale":"2023-05-17T12:25:06.995271+0000","last_undegraded":"2023-05-17T12:25:06.995271+0000","last_fullsized":"2023-05-17T12:25:06.995271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:01:31.652913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994685+0000","last_change":"2023-05-17T12:25:01.303375+0000","last_active":"2023-05-17T12:25:06.994685+0000","last_peered":"2023-05-17T12:25:06.994685+0000","last_clean":"2023-05-17T12:25:06.994685+0000","last_became_active":"2023-05-17T12:25:01.303046+0000","last_became_peered":"2023-05-17T12:25:01.303046+0000","last_unstale":"2023-05-17T12:25:06.994685+0000","last_undegraded":"2023-05-17T12:25:06.994685+0000","last_fullsized":"2023-05-17T12:25:06.994685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:40:08.139475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494947+0000","last_change":"2023-05-17T12:24:55.755523+0000","last_active":"2023-05-17T12:25:06.494947+0000","last_peered":"2023-05-17T12:25:06.494947+0000","last_clean":"2023-05-17T12:25:06.494947+0000","last_became_active":"2023-05-17T12:24:55.755229+0000","last_became_peered":"2023-05-17T12:24:55.755229+0000","last_unstale":"2023-05-17T12:25:06.494947+0000","last_undegraded":"2023-05-17T12:25:06.494947+0000","last_fullsized":"2023-05-17T12:25:06.494947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:21.844124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.993978+0000","last_change":"2023-05-17T12:25:01.814467+0000","last_active":"2023-05-17T12:25:06.993978+0000","last_peered":"2023-05-17T12:25:06.993978+0000","last_clean":"2023-05-17T12:25:06.993978+0000","last_became_active":"2023-05-17T12:25:01.813813+0000","last_became_peered":"2023-05-17T12:25:01.813813+0000","last_unstale":"2023-05-17T12:25:06.993978+0000","last_undegraded":"2023-05-17T12:25:06.993978+0000","last_fullsized":"2023-05-17T12:25:06.993978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:22.759151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.993949+0000","last_change":"2023-05-17T12:25:05.826670+0000","last_active":"2023-05-17T12:25:06.993949+0000","last_peered":"2023-05-17T12:25:06.993949+0000","last_clean":"2023-05-17T12:25:06.993949+0000","last_became_active":"2023-05-17T12:25:05.826237+0000","last_became_peered":"2023-05-17T12:25:05.826237+0000","last_unstale":"2023-05-17T12:25:06.993949+0000","last_undegraded":"2023-05-17T12:25:06.993949+0000","last_fullsized":"2023-05-17T12:25:06.993949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:13:01.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298606+0000","last_change":"2023-05-17T12:24:55.755814+0000","last_active":"2023-05-17T12:25:06.298606+0000","last_peered":"2023-05-17T12:25:06.298606+0000","last_clean":"2023-05-17T12:25:06.298606+0000","last_became_active":"2023-05-17T12:24:55.755481+0000","last_became_peered":"2023-05-17T12:24:55.755481+0000","last_unstale":"2023-05-17T12:25:06.298606+0000","last_undegraded":"2023-05-17T12:25:06.298606+0000","last_fullsized":"2023-05-17T12:25:06.298606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:58:43.934611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325579+0000","last_change":"2023-05-17T12:25:01.310606+0000","last_active":"2023-05-17T12:25:06.325579+0000","last_peered":"2023-05-17T12:25:06.325579+0000","last_clean":"2023-05-17T12:25:06.325579+0000","last_became_active":"2023-05-17T12:25:01.309614+0000","last_became_peered":"2023-05-17T12:25:01.309614+0000","last_unstale":"2023-05-17T12:25:06.325579+0000","last_undegraded":"2023-05-17T12:25:06.325579+0000","last_fullsized":"2023-05-17T12:25:06.325579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:45:27.380050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994784+0000","last_change":"2023-05-17T12:25:01.801978+0000","last_active":"2023-05-17T12:25:06.994784+0000","last_peered":"2023-05-17T12:25:06.994784+0000","last_clean":"2023-05-17T12:25:06.994784+0000","last_became_active":"2023-05-17T12:25:01.801664+0000","last_became_peered":"2023-05-17T12:25:01.801664+0000","last_unstale":"2023-05-17T12:25:06.994784+0000","last_undegraded":"2023-05-17T12:25:06.994784+0000","last_fullsized":"2023-05-17T12:25:06.994784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:49:24.674805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494716+0000","last_change":"2023-05-17T12:25:05.827430+0000","last_active":"2023-05-17T12:25:06.494716+0000","last_peered":"2023-05-17T12:25:06.494716+0000","last_clean":"2023-05-17T12:25:06.494716+0000","last_became_active":"2023-05-17T12:25:05.827001+0000","last_became_peered":"2023-05-17T12:25:05.827001+0000","last_unstale":"2023-05-17T12:25:06.494716+0000","last_undegraded":"2023-05-17T12:25:06.494716+0000","last_fullsized":"2023-05-17T12:25:06.494716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:26.275442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325368+0000","last_change":"2023-05-17T12:25:01.311128+0000","last_active":"2023-05-17T12:25:06.325368+0000","last_peered":"2023-05-17T12:25:06.325368+0000","last_clean":"2023-05-17T12:25:06.325368+0000","last_became_active":"2023-05-17T12:25:01.310836+0000","last_became_peered":"2023-05-17T12:25:01.310836+0000","last_unstale":"2023-05-17T12:25:06.325368+0000","last_undegraded":"2023-05-17T12:25:06.325368+0000","last_fullsized":"2023-05-17T12:25:06.325368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:47:21.753298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.296706+0000","last_change":"2023-05-17T12:25:01.802967+0000","last_active":"2023-05-17T12:25:06.296706+0000","last_peered":"2023-05-17T12:25:06.296706+0000","last_clean":"2023-05-17T12:25:06.296706+0000","last_became_active":"2023-05-17T12:25:01.802692+0000","last_became_peered":"2023-05-17T12:25:01.802692+0000","last_unstale":"2023-05-17T12:25:06.296706+0000","last_undegraded":"2023-05-17T12:25:06.296706+0000","last_fullsized":"2023-05-17T12:25:06.296706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:58:57.061496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996669+0000","last_change":"2023-05-17T12:25:05.842157+0000","last_active":"2023-05-17T12:25:06.996669+0000","last_peered":"2023-05-17T12:25:06.996669+0000","last_clean":"2023-05-17T12:25:06.996669+0000","last_became_active":"2023-05-17T12:25:05.841642+0000","last_became_peered":"2023-05-17T12:25:05.841642+0000","last_unstale":"2023-05-17T12:25:06.996669+0000","last_undegraded":"2023-05-17T12:25:06.996669+0000","last_fullsized":"2023-05-17T12:25:06.996669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:53:03.043259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299117+0000","last_change":"2023-05-17T12:25:01.309109+0000","last_active":"2023-05-17T12:25:06.299117+0000","last_peered":"2023-05-17T12:25:06.299117+0000","last_clean":"2023-05-17T12:25:06.299117+0000","last_became_active":"2023-05-17T12:25:01.308819+0000","last_became_peered":"2023-05-17T12:25:01.308819+0000","last_unstale":"2023-05-17T12:25:06.299117+0000","last_undegraded":"2023-05-17T12:25:06.299117+0000","last_fullsized":"2023-05-17T12:25:06.299117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:16:10.497260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995019+0000","last_change":"2023-05-17T12:25:01.807742+0000","last_active":"2023-05-17T12:25:06.995019+0000","last_peered":"2023-05-17T12:25:06.995019+0000","last_clean":"2023-05-17T12:25:06.995019+0000","last_became_active":"2023-05-17T12:25:01.807486+0000","last_became_peered":"2023-05-17T12:25:01.807486+0000","last_unstale":"2023-05-17T12:25:06.995019+0000","last_undegraded":"2023-05-17T12:25:06.995019+0000","last_fullsized":"2023-05-17T12:25:06.995019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:34:11.854588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298559+0000","last_change":"2023-05-17T12:25:05.828527+0000","last_active":"2023-05-17T12:25:06.298559+0000","last_peered":"2023-05-17T12:25:06.298559+0000","last_clean":"2023-05-17T12:25:06.298559+0000","last_became_active":"2023-05-17T12:25:05.828110+0000","last_became_peered":"2023-05-17T12:25:05.828110+0000","last_unstale":"2023-05-17T12:25:06.298559+0000","last_undegraded":"2023-05-17T12:25:06.298559+0000","last_fullsized":"2023-05-17T12:25:06.298559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:08:58.136837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.299503+0000","last_change":"2023-05-17T12:25:01.309151+0000","last_active":"2023-05-17T12:25:06.299503+0000","last_peered":"2023-05-17T12:25:06.299503+0000","last_clean":"2023-05-17T12:25:06.299503+0000","last_became_active":"2023-05-17T12:25:01.308858+0000","last_became_peered":"2023-05-17T12:25:01.308858+0000","last_unstale":"2023-05-17T12:25:06.299503+0000","last_undegraded":"2023-05-17T12:25:06.299503+0000","last_fullsized":"2023-05-17T12:25:06.299503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:31.192844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.996383+0000","last_change":"2023-05-17T12:25:01.803419+0000","last_active":"2023-05-17T12:25:06.996383+0000","last_peered":"2023-05-17T12:25:06.996383+0000","last_clean":"2023-05-17T12:25:06.996383+0000","last_became_active":"2023-05-17T12:25:01.802965+0000","last_became_peered":"2023-05-17T12:25:01.802965+0000","last_unstale":"2023-05-17T12:25:06.996383+0000","last_undegraded":"2023-05-17T12:25:06.996383+0000","last_fullsized":"2023-05-17T12:25:06.996383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:18:56.538552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994811+0000","last_change":"2023-05-17T12:25:05.825330+0000","last_active":"2023-05-17T12:25:06.994811+0000","last_peered":"2023-05-17T12:25:06.994811+0000","last_clean":"2023-05-17T12:25:06.994811+0000","last_became_active":"2023-05-17T12:25:05.824868+0000","last_became_peered":"2023-05-17T12:25:05.824868+0000","last_unstale":"2023-05-17T12:25:06.994811+0000","last_undegraded":"2023-05-17T12:25:06.994811+0000","last_fullsized":"2023-05-17T12:25:06.994811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:53:03.043259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994461+0000","last_change":"2023-05-17T12:25:01.304287+0000","last_active":"2023-05-17T12:25:06.994461+0000","last_peered":"2023-05-17T12:25:06.994461+0000","last_clean":"2023-05-17T12:25:06.994461+0000","last_became_active":"2023-05-17T12:25:01.304009+0000","last_became_peered":"2023-05-17T12:25:01.304009+0000","last_unstale":"2023-05-17T12:25:06.994461+0000","last_undegraded":"2023-05-17T12:25:06.994461+0000","last_fullsized":"2023-05-17T12:25:06.994461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994672+0000","last_change":"2023-05-17T12:25:01.795767+0000","last_active":"2023-05-17T12:25:06.994672+0000","last_peered":"2023-05-17T12:25:06.994672+0000","last_clean":"2023-05-17T12:25:06.994672+0000","last_became_active":"2023-05-17T12:25:01.795283+0000","last_became_peered":"2023-05-17T12:25:01.795283+0000","last_unstale":"2023-05-17T12:25:06.994672+0000","last_undegraded":"2023-05-17T12:25:06.994672+0000","last_fullsized":"2023-05-17T12:25:06.994672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:16:12.607072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494307+0000","last_change":"2023-05-17T12:25:05.835654+0000","last_active":"2023-05-17T12:25:06.494307+0000","last_peered":"2023-05-17T12:25:06.494307+0000","last_clean":"2023-05-17T12:25:06.494307+0000","last_became_active":"2023-05-17T12:25:05.835230+0000","last_became_peered":"2023-05-17T12:25:05.835230+0000","last_unstale":"2023-05-17T12:25:06.494307+0000","last_undegraded":"2023-05-17T12:25:06.494307+0000","last_fullsized":"2023-05-17T12:25:06.494307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:04.791639+0000","last_clean_scrub_stamp":"2023-05-17T12:25:04.791639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:43:00.150100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.325785+0000","last_change":"2023-05-17T12:25:01.302349+0000","last_active":"2023-05-17T12:25:06.325785+0000","last_peered":"2023-05-17T12:25:06.325785+0000","last_clean":"2023-05-17T12:25:06.325785+0000","last_became_active":"2023-05-17T12:25:01.302092+0000","last_became_peered":"2023-05-17T12:25:01.302092+0000","last_unstale":"2023-05-17T12:25:06.325785+0000","last_undegraded":"2023-05-17T12:25:06.325785+0000","last_fullsized":"2023-05-17T12:25:06.325785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:00.269496+0000","last_clean_scrub_stamp":"2023-05-17T12:25:00.269496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:00:38.113959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994890+0000","last_change":"2023-05-17T12:25:01.815996+0000","last_active":"2023-05-17T12:25:06.994890+0000","last_peered":"2023-05-17T12:25:06.994890+0000","last_clean":"2023-05-17T12:25:06.994890+0000","last_became_active":"2023-05-17T12:25:01.812605+0000","last_became_peered":"2023-05-17T12:25:01.812605+0000","last_unstale":"2023-05-17T12:25:06.994890+0000","last_undegraded":"2023-05-17T12:25:06.994890+0000","last_fullsized":"2023-05-17T12:25:06.994890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:01:41.127461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.298262+0000","last_change":"2023-05-17T12:25:01.805399+0000","last_active":"2023-05-17T12:25:06.298262+0000","last_peered":"2023-05-17T12:25:06.298262+0000","last_clean":"2023-05-17T12:25:06.298262+0000","last_became_active":"2023-05-17T12:25:01.805099+0000","last_became_peered":"2023-05-17T12:25:01.805099+0000","last_unstale":"2023-05-17T12:25:06.298262+0000","last_undegraded":"2023-05-17T12:25:06.298262+0000","last_fullsized":"2023-05-17T12:25:06.298262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:36:36.387439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994465+0000","last_change":"2023-05-17T12:25:01.802926+0000","last_active":"2023-05-17T12:25:06.994465+0000","last_peered":"2023-05-17T12:25:06.994465+0000","last_clean":"2023-05-17T12:25:06.994465+0000","last_became_active":"2023-05-17T12:25:01.802651+0000","last_became_peered":"2023-05-17T12:25:01.802651+0000","last_unstale":"2023-05-17T12:25:06.994465+0000","last_undegraded":"2023-05-17T12:25:06.994465+0000","last_fullsized":"2023-05-17T12:25:06.994465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:16:16.838754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.995441+0000","last_change":"2023-05-17T12:25:01.812203+0000","last_active":"2023-05-17T12:25:06.995441+0000","last_peered":"2023-05-17T12:25:06.995441+0000","last_clean":"2023-05-17T12:25:06.995441+0000","last_became_active":"2023-05-17T12:25:01.811900+0000","last_became_peered":"2023-05-17T12:25:01.811900+0000","last_unstale":"2023-05-17T12:25:06.995441+0000","last_undegraded":"2023-05-17T12:25:06.995441+0000","last_fullsized":"2023-05-17T12:25:06.995441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:36:46.242202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.994166+0000","last_change":"2023-05-17T12:25:01.814710+0000","last_active":"2023-05-17T12:25:06.994166+0000","last_peered":"2023-05-17T12:25:06.994166+0000","last_clean":"2023-05-17T12:25:06.994166+0000","last_became_active":"2023-05-17T12:25:01.814215+0000","last_became_peered":"2023-05-17T12:25:01.814215+0000","last_unstale":"2023-05-17T12:25:06.994166+0000","last_undegraded":"2023-05-17T12:25:06.994166+0000","last_fullsized":"2023-05-17T12:25:06.994166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:24:18.780255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-17T12:25:06.494339+0000","last_change":"2023-05-17T12:25:01.802046+0000","last_active":"2023-05-17T12:25:06.494339+0000","last_peered":"2023-05-17T12:25:06.494339+0000","last_clean":"2023-05-17T12:25:06.494339+0000","last_became_active":"2023-05-17T12:25:01.801281+0000","last_became_peered":"2023-05-17T12:25:01.801281+0000","last_unstale":"2023-05-17T12:25:06.494339+0000","last_undegraded":"2023-05-17T12:25:06.494339+0000","last_fullsized":"2023-05-17T12:25:06.494339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:25:01.275349+0000","last_clean_scrub_stamp":"2023-05-17T12:25:01.275349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:28:58.337893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8228,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363612,"statfs":{"total":96636764160,"available":96628338688,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8100,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363740,"statfs":{"total":96636764160,"available":96628469760,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8248,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363592,"statfs":{"total":96636764160,"available":96628318208,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8172,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363668,"statfs":{"total":96636764160,"available":96628396032,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T12:25:37.724 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-17T12:25:37.725 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-17T12:25:37.725 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-17T12:25:37.725 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-17T12:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.941+0000 7fbe811ff700 1 Processor -- start 2023-05-17T12:25:37.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.941+0000 7fbe811ff700 1 -- start start 2023-05-17T12:25:37.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe811ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 0x7fbe7c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe811ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbe7c06c330 0x7fbe7c06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe811ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c0cd6b0 con 0x7fbe7c15c840 2023-05-17T12:25:37.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe811ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c0cdf50 con 0x7fbe7c06c330 2023-05-17T12:25:37.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe811ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c06ccf0 con 0x7fbe7c06b0b0 2023-05-17T12:25:37.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe73fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 0x7fbe7c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe7b59e700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbe7c06c330 0x7fbe7c06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe73fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 0x7fbe7c06b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:36320/0 (socket says 172.21.15.88:36320) 2023-05-17T12:25:37.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe73fff700 1 -- 172.21.15.88:0/1439919405 learned_addr learned my addr 172.21.15.88:0/1439919405 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.943+0000 7fbe7ad9d700 1 --1- 172.21.15.88:0/1439919405 >> v1:172.21.15.187:6789/0 conn(0x7fbe7c15c840 0x7fbe7c0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:40958/0 (socket says 172.21.15.88:40958) 2023-05-17T12:25:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.944+0000 7fbe7b59e700 1 -- 172.21.15.88:0/1439919405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 msgr2=0x7fbe7c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.944+0000 7fbe7b59e700 1 --2- 172.21.15.88:0/1439919405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 0x7fbe7c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.944+0000 7fbe7b59e700 1 -- 172.21.15.88:0/1439919405 >> v1:172.21.15.187:6789/0 conn(0x7fbe7c15c840 legacy=0x7fbe7c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.944+0000 7fbe7b59e700 1 -- 172.21.15.88:0/1439919405 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0b2460 con 0x7fbe7c06c330 2023-05-17T12:25:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.944+0000 7fbe7b59e700 1 --2- 172.21.15.88:0/1439919405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c06c330 0x7fbe7c06c7b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009d90 tx=0x7fbe7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4ac357ad9395b9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:37.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.944+0000 7fbe7a59c700 1 -- 172.21.15.88:0/1439919405 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7400e070 con 0x7fbe7c06c330 2023-05-17T12:25:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.944+0000 7fbe7a59c700 1 -- 172.21.15.88:0/1439919405 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7400bb20 con 0x7fbe7c06c330 2023-05-17T12:25:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.944+0000 7fbe7a59c700 1 -- 172.21.15.88:0/1439919405 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74012430 con 0x7fbe7c06c330 2023-05-17T12:25:37.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.945+0000 7fbe811ff700 1 -- 172.21.15.88:0/1439919405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c06c330 msgr2=0x7fbe7c06c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.945+0000 7fbe811ff700 1 --2- 172.21.15.88:0/1439919405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c06c330 0x7fbe7c06c7b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009d90 tx=0x7fbe7400b330 comp rx=0 tx=0).stop 2023-05-17T12:25:37.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.945+0000 7fbe811ff700 1 -- 172.21.15.88:0/1439919405 shutdown_connections 2023-05-17T12:25:37.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.945+0000 7fbe811ff700 1 --2- 172.21.15.88:0/1439919405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c06c330 0x7fbe7c06c7b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.945+0000 7fbe811ff700 1 --2- 172.21.15.88:0/1439919405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 0x7fbe7c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.945+0000 7fbe811ff700 1 -- 172.21.15.88:0/1439919405 >> 172.21.15.88:0/1439919405 conn(0x7fbe7c0d3060 msgr2=0x7fbe7c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:37.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.945+0000 7fbe811ff700 1 -- 172.21.15.88:0/1439919405 shutdown_connections 2023-05-17T12:25:37.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.945+0000 7fbe811ff700 1 -- 172.21.15.88:0/1439919405 wait complete. 2023-05-17T12:25:37.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.947+0000 7fbe811ff700 1 Processor -- start 2023-05-17T12:25:37.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.947+0000 7fbe811ff700 1 -- start start 2023-05-17T12:25:37.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe811ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 0x7fbe7c1e3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe811ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c06c330 0x7fbe7c0b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe811ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c15c840 0x7fbe7c157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe811ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0b3880 con 0x7fbe7c06c330 2023-05-17T12:25:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe811ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0b3ae0 con 0x7fbe7c15c840 2023-05-17T12:25:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe811ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0b3dc0 con 0x7fbe7c06b0b0 2023-05-17T12:25:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe73fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c06c330 0x7fbe7c0b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe73fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c06c330 0x7fbe7c0b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37666/0 (socket says 172.21.15.88:37666) 2023-05-17T12:25:37.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe73fff700 1 -- 172.21.15.88:0/942090126 learned_addr learned my addr 172.21.15.88:0/942090126 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:37.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe7b59e700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c15c840 0x7fbe7c157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe7ad9d700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 0x7fbe7c1e3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe73fff700 1 -- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 msgr2=0x7fbe7c1e3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.948+0000 7fbe73fff700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 0x7fbe7c1e3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.949+0000 7fbe73fff700 1 -- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c15c840 msgr2=0x7fbe7c157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:37.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.949+0000 7fbe73fff700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c15c840 0x7fbe7c157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:37.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.949+0000 7fbe73fff700 1 -- 172.21.15.88:0/942090126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74009a70 con 0x7fbe7c06c330 2023-05-17T12:25:37.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.949+0000 7fbe73fff700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c06c330 0x7fbe7c0b3340 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400e910 tx=0x7fbe6400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:37.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.949+0000 7fbe737fe700 1 -- 172.21.15.88:0/942090126 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640096a0 con 0x7fbe7c06c330 2023-05-17T12:25:37.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.949+0000 7fbe737fe700 1 -- 172.21.15.88:0/942090126 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6400ee60 con 0x7fbe7c06c330 2023-05-17T12:25:37.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.949+0000 7fbe737fe700 1 -- 172.21.15.88:0/942090126 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6400ca90 con 0x7fbe7c06c330 2023-05-17T12:25:37.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.949+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c0cd900 con 0x7fbe7c06c330 2023-05-17T12:25:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.949+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c0b2740 con 0x7fbe7c06c330 2023-05-17T12:25:37.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.950+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c0cdbe0 con 0x7fbe7c06c330 2023-05-17T12:25:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.951+0000 7fbe737fe700 1 -- 172.21.15.88:0/942090126 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe6400cbf0 con 0x7fbe7c06c330 2023-05-17T12:25:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.952+0000 7fbe737fe700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbe5c06ace0 0x7fbe5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.952+0000 7fbe737fe700 1 -- 172.21.15.88:0/942090126 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe64089ad0 con 0x7fbe7c06c330 2023-05-17T12:25:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.953+0000 7fbe7ad9d700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbe5c06ace0 0x7fbe5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:37.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.954+0000 7fbe7ad9d700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbe5c06ace0 0x7fbe5c06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c000f60 tx=0x7fbe6c007d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:37.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:37.957+0000 7fbe737fe700 1 -- 172.21.15.88:0/942090126 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbe64058310 con 0x7fbe7c06c330 2023-05-17T12:25:38.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.191+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbe7c06bf70 con 0x7fbe7c06c330 2023-05-17T12:25:38.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.192+0000 7fbe737fe700 1 -- 172.21.15.88:0/942090126 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbe6400cea0 con 0x7fbe7c06c330 2023-05-17T12:25:38.195 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:38.195 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-17T12:25:38.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbe5c06ace0 msgr2=0x7fbe5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbe5c06ace0 0x7fbe5c06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c000f60 tx=0x7fbe6c007d10 comp rx=0 tx=0).stop 2023-05-17T12:25:38.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c06c330 msgr2=0x7fbe7c0b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c06c330 0x7fbe7c0b3340 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400e910 tx=0x7fbe6400ec20 comp rx=0 tx=0).stop 2023-05-17T12:25:38.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 shutdown_connections 2023-05-17T12:25:38.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbe5c06ace0 0x7fbe5c06d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c15c840 0x7fbe7c157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c06b0b0 0x7fbe7c1e3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 --2- 172.21.15.88:0/942090126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c06c330 0x7fbe7c0b3340 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 >> 172.21.15.88:0/942090126 conn(0x7fbe7c0d3060 msgr2=0x7fbe7c0ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:38.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 shutdown_connections 2023-05-17T12:25:38.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.194+0000 7fbe811ff700 1 -- 172.21.15.88:0/942090126 wait complete. 2023-05-17T12:25:38.214 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-17T12:25:38.214 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.397+0000 7fb5cdfff700 1 Processor -- start 2023-05-17T12:25:38.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.397+0000 7fb5cdfff700 1 -- start start 2023-05-17T12:25:38.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.398+0000 7fb5cdfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.398+0000 7fb5cdfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb5c806b0b0 0x7fb5c80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.398+0000 7fb5cdfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c80cd6b0 con 0x7fb5c806c330 2023-05-17T12:25:38.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.398+0000 7fb5cdfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c80cdf50 con 0x7fb5c806b0b0 2023-05-17T12:25:38.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.398+0000 7fb5cdfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80cf860 con 0x7fb5c815c840 2023-05-17T12:25:38.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.398+0000 7fb5c6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb5c806b0b0 0x7fb5c80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.398+0000 7fb5c7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb5c806c330 0x7fb5c8160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52060/0 (socket says 172.21.15.88:52060) 2023-05-17T12:25:38.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.398+0000 7fb5c7fff700 1 -- 172.21.15.88:0/2905961289 learned_addr learned my addr 172.21.15.88:0/2905961289 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:38.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c77fe700 1 --2- 172.21.15.88:0/2905961289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c6ffd700 1 -- 172.21.15.88:0/2905961289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 msgr2=0x7fb5c806b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:38.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c6ffd700 1 --2- 172.21.15.88:0/2905961289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c806b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c6ffd700 1 -- 172.21.15.88:0/2905961289 >> v1:172.21.15.88:6789/0 conn(0x7fb5c806c330 legacy=0x7fb5c8160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c6ffd700 1 -- 172.21.15.88:0/2905961289 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80b2460 con 0x7fb5c806b0b0 2023-05-17T12:25:38.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c77fe700 1 --2- 172.21.15.88:0/2905961289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:38.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c67fc700 1 -- 172.21.15.88:0/2905961289 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423570321 0 0) 0x7fb5c80cd6b0 con 0x7fb5c806c330 2023-05-17T12:25:38.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c6ffd700 1 --2- 172.21.15.88:0/2905961289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806b0b0 0x7fb5c80cf320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009840 tx=0x7fb5bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d9b4a3d85e8be2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:38.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c67fc700 1 -- 172.21.15.88:0/2905961289 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc011830 con 0x7fb5c806b0b0 2023-05-17T12:25:38.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c67fc700 1 -- 172.21.15.88:0/2905961289 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc011990 con 0x7fb5c806b0b0 2023-05-17T12:25:38.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.399+0000 7fb5c67fc700 1 -- 172.21.15.88:0/2905961289 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc011d20 con 0x7fb5c806b0b0 2023-05-17T12:25:38.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.400+0000 7fb5cdfff700 1 -- 172.21.15.88:0/2905961289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806b0b0 msgr2=0x7fb5c80cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.400+0000 7fb5cdfff700 1 --2- 172.21.15.88:0/2905961289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806b0b0 0x7fb5c80cf320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009840 tx=0x7fb5bc009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:38.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.400+0000 7fb5cdfff700 1 -- 172.21.15.88:0/2905961289 shutdown_connections 2023-05-17T12:25:38.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.400+0000 7fb5cdfff700 1 --2- 172.21.15.88:0/2905961289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.400+0000 7fb5cdfff700 1 --2- 172.21.15.88:0/2905961289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806b0b0 0x7fb5c80cf320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.400+0000 7fb5cdfff700 1 -- 172.21.15.88:0/2905961289 >> 172.21.15.88:0/2905961289 conn(0x7fb5c80d3060 msgr2=0x7fb5c80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:38.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.400+0000 7fb5cdfff700 1 -- 172.21.15.88:0/2905961289 shutdown_connections 2023-05-17T12:25:38.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.400+0000 7fb5cdfff700 1 -- 172.21.15.88:0/2905961289 wait complete. 2023-05-17T12:25:38.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.402+0000 7fb5cdfff700 1 Processor -- start 2023-05-17T12:25:38.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.402+0000 7fb5cdfff700 1 -- start start 2023-05-17T12:25:38.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.402+0000 7fb5cdfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5c806b0b0 0x7fb5c80b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5cdfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806c330 0x7fb5c8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5cdfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c8159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5cdfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80b3190 con 0x7fb5c806c330 2023-05-17T12:25:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5cdfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80b3470 con 0x7fb5c806b0b0 2023-05-17T12:25:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5cdfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80b3750 con 0x7fb5c815c840 2023-05-17T12:25:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806c330 0x7fb5c8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806c330 0x7fb5c8157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37694/0 (socket says 172.21.15.88:37694) 2023-05-17T12:25:38.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c6ffd700 1 -- 172.21.15.88:0/3853279522 learned_addr learned my addr 172.21.15.88:0/3853279522 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c77fe700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5c806b0b0 0x7fb5c80b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c7fff700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c8159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c6ffd700 1 -- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 msgr2=0x7fb5c8159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c6ffd700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c8159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c6ffd700 1 -- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5c806b0b0 msgr2=0x7fb5c80b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c6ffd700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5c806b0b0 0x7fb5c80b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c6ffd700 1 -- 172.21.15.88:0/3853279522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc0094a0 con 0x7fb5c806c330 2023-05-17T12:25:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c7fff700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c8159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.403+0000 7fb5c6ffd700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806c330 0x7fb5c8157590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0090b0 tx=0x7fb5bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.404+0000 7fb5affff700 1 -- 172.21.15.88:0/3853279522 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0038a0 con 0x7fb5c806c330 2023-05-17T12:25:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.404+0000 7fb5affff700 1 -- 172.21.15.88:0/3853279522 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc01f070 con 0x7fb5c806c330 2023-05-17T12:25:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.404+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c80cd900 con 0x7fb5c806c330 2023-05-17T12:25:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.404+0000 7fb5affff700 1 -- 172.21.15.88:0/3853279522 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc003c40 con 0x7fb5c806c330 2023-05-17T12:25:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.404+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c80b2740 con 0x7fb5c806c330 2023-05-17T12:25:38.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.405+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c80cdbe0 con 0x7fb5c806c330 2023-05-17T12:25:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.406+0000 7fb5affff700 1 -- 172.21.15.88:0/3853279522 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb5bc01a430 con 0x7fb5c806c330 2023-05-17T12:25:38.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.407+0000 7fb5affff700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb5b406ace0 0x7fb5b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.407+0000 7fb5affff700 1 -- 172.21.15.88:0/3853279522 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5bc021070 con 0x7fb5c806c330 2023-05-17T12:25:38.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.407+0000 7fb5c77fe700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb5b406ace0 0x7fb5b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.408+0000 7fb5c77fe700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb5b406ace0 0x7fb5b406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8006fd0 tx=0x7fb5b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:38.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.411+0000 7fb5affff700 1 -- 172.21.15.88:0/3853279522 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb5bc056070 con 0x7fb5c806c330 2023-05-17T12:25:38.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.610+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5c8074530 con 0x7fb5c806c330 2023-05-17T12:25:38.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.612+0000 7fb5affff700 1 -- 172.21.15.88:0/3853279522 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fb5bc059690 con 0x7fb5c806c330 2023-05-17T12:25:38.615 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:38.615 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb5b406ace0 msgr2=0x7fb5b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb5b406ace0 0x7fb5b406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8006fd0 tx=0x7fb5b8008040 comp rx=0 tx=0).stop 2023-05-17T12:25:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806c330 msgr2=0x7fb5c8157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806c330 0x7fb5c8157590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0090b0 tx=0x7fb5bc004750 comp rx=0 tx=0).stop 2023-05-17T12:25:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 shutdown_connections 2023-05-17T12:25:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb5b406ace0 0x7fb5b406d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb5c815c840 0x7fb5c8159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5c806b0b0 0x7fb5c80b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 --2- 172.21.15.88:0/3853279522 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb5c806c330 0x7fb5c8157590 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 >> 172.21.15.88:0/3853279522 conn(0x7fb5c80d3060 msgr2=0x7fb5c80cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.614+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 shutdown_connections 2023-05-17T12:25:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.615+0000 7fb5cdfff700 1 -- 172.21.15.88:0/3853279522 wait complete. 2023-05-17T12:25:38.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:25:38.636 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:25:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.821+0000 7ffa41fff700 1 Processor -- start 2023-05-17T12:25:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.821+0000 7ffa41fff700 1 -- start start 2023-05-17T12:25:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.822+0000 7ffa41fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffa3c0c9370 0x7ffa3c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.822+0000 7ffa41fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa3c0b4750 0x7ffa3c15e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.822+0000 7ffa41fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3c06b430 con 0x7ffa3c06a510 2023-05-17T12:25:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.822+0000 7ffa41fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3c0c9c80 con 0x7ffa3c0b4750 2023-05-17T12:25:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.822+0000 7ffa41fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3c06b680 con 0x7ffa3c0c9370 2023-05-17T12:25:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa3c0b4750 0x7ffa3c15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffa3c06a510 0x7ffa3c15e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52066/0 (socket says 172.21.15.88:52066) 2023-05-17T12:25:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3affd700 1 -- 172.21.15.88:0/629005342 learned_addr learned my addr 172.21.15.88:0/629005342 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3b7fe700 1 --2- 172.21.15.88:0/629005342 >> v2:172.21.15.187:3300/0 conn(0x7ffa3c0c9370 0x7ffa3c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3bfff700 1 -- 172.21.15.88:0/629005342 >> v2:172.21.15.187:3300/0 conn(0x7ffa3c0c9370 msgr2=0x7ffa3c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3bfff700 1 --2- 172.21.15.88:0/629005342 >> v2:172.21.15.187:3300/0 conn(0x7ffa3c0c9370 0x7ffa3c0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3bfff700 1 -- 172.21.15.88:0/629005342 >> v1:172.21.15.88:6789/0 conn(0x7ffa3c06a510 legacy=0x7ffa3c15e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3bfff700 1 -- 172.21.15.88:0/629005342 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c06b960 con 0x7ffa3c0b4750 2023-05-17T12:25:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3a7fc700 1 -- 172.21.15.88:0/629005342 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949973669 0 0) 0x7ffa3c06b430 con 0x7ffa3c06a510 2023-05-17T12:25:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3bfff700 1 --2- 172.21.15.88:0/629005342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 0x7ffa3c15e860 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c06f430 tx=0x7ffa3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbac33e49e7245e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3a7fc700 1 -- 172.21.15.88:0/629005342 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400e070 con 0x7ffa3c0b4750 2023-05-17T12:25:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.823+0000 7ffa3a7fc700 1 -- 172.21.15.88:0/629005342 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3400bb20 con 0x7ffa3c0b4750 2023-05-17T12:25:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.824+0000 7ffa3a7fc700 1 -- 172.21.15.88:0/629005342 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34012430 con 0x7ffa3c0b4750 2023-05-17T12:25:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.824+0000 7ffa41fff700 1 -- 172.21.15.88:0/629005342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 msgr2=0x7ffa3c15e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.824+0000 7ffa41fff700 1 --2- 172.21.15.88:0/629005342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 0x7ffa3c15e860 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c06f430 tx=0x7ffa3400b330 comp rx=0 tx=0).stop 2023-05-17T12:25:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.824+0000 7ffa41fff700 1 -- 172.21.15.88:0/629005342 shutdown_connections 2023-05-17T12:25:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.824+0000 7ffa41fff700 1 --2- 172.21.15.88:0/629005342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 0x7ffa3c15e860 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.824+0000 7ffa41fff700 1 --2- 172.21.15.88:0/629005342 >> v2:172.21.15.187:3300/0 conn(0x7ffa3c0c9370 0x7ffa3c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.824+0000 7ffa41fff700 1 -- 172.21.15.88:0/629005342 >> 172.21.15.88:0/629005342 conn(0x7ffa3c0cf970 msgr2=0x7ffa3c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.824+0000 7ffa41fff700 1 -- 172.21.15.88:0/629005342 shutdown_connections 2023-05-17T12:25:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.824+0000 7ffa41fff700 1 -- 172.21.15.88:0/629005342 wait complete. 2023-05-17T12:25:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.826+0000 7ffa41fff700 1 Processor -- start 2023-05-17T12:25:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.826+0000 7ffa41fff700 1 -- start start 2023-05-17T12:25:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.827+0000 7ffa41fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa3c06a510 0x7ffa3c157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.827+0000 7ffa41fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 0x7ffa3c153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.827+0000 7ffa41fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa3c0c9370 0x7ffa3c153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.827+0000 7ffa41fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c13d5e0 con 0x7ffa3c0b4750 2023-05-17T12:25:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.827+0000 7ffa41fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c153bc0 con 0x7ffa3c06a510 2023-05-17T12:25:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.827+0000 7ffa41fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c153ea0 con 0x7ffa3c0c9370 2023-05-17T12:25:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.827+0000 7ffa3affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 0x7ffa3c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.827+0000 7ffa3affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 0x7ffa3c153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37708/0 (socket says 172.21.15.88:37708) 2023-05-17T12:25:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.827+0000 7ffa3affd700 1 -- 172.21.15.88:0/1750349095 learned_addr learned my addr 172.21.15.88:0/1750349095 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa3bfff700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa3c0c9370 0x7ffa3c153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa3b7fe700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa3c06a510 0x7ffa3c157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa3affd700 1 -- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa3c0c9370 msgr2=0x7ffa3c153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa3affd700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa3c0c9370 0x7ffa3c153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa3affd700 1 -- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa3c06a510 msgr2=0x7ffa3c157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa3affd700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa3c06a510 0x7ffa3c157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa3affd700 1 -- 172.21.15.88:0/1750349095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34009a70 con 0x7ffa3c0b4750 2023-05-17T12:25:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa3b7fe700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa3c06a510 0x7ffa3c157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa3affd700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 0x7ffa3c153020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa300011e0 tx=0x7ffa3000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa23fff700 1 -- 172.21.15.88:0/1750349095 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30004c80 con 0x7ffa3c0b4750 2023-05-17T12:25:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa23fff700 1 -- 172.21.15.88:0/1750349095 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa30004e00 con 0x7ffa3c0b4750 2023-05-17T12:25:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3c15a8e0 con 0x7ffa3c0b4750 2023-05-17T12:25:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa23fff700 1 -- 172.21.15.88:0/1750349095 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30007310 con 0x7ffa3c0b4750 2023-05-17T12:25:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.828+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3c06bc40 con 0x7ffa3c0b4750 2023-05-17T12:25:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.829+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3c071f30 con 0x7ffa3c0b4750 2023-05-17T12:25:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.830+0000 7ffa23fff700 1 -- 172.21.15.88:0/1750349095 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa30007470 con 0x7ffa3c0b4750 2023-05-17T12:25:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.831+0000 7ffa23fff700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ffa2806ace0 0x7ffa2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.831+0000 7ffa23fff700 1 -- 172.21.15.88:0/1750349095 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa30089520 con 0x7ffa3c0b4750 2023-05-17T12:25:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.831+0000 7ffa3b7fe700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ffa2806ace0 0x7ffa2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.832+0000 7ffa3b7fe700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ffa2806ace0 0x7ffa2806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009ac0 tx=0x7ffa2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:38.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:38.836+0000 7ffa23fff700 1 -- 172.21.15.88:0/1750349095 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ffa300542d0 con 0x7ffa3c0b4750 2023-05-17T12:25:39.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.029+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa3c154060 con 0x7ffa3c0b4750 2023-05-17T12:25:39.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.029+0000 7ffa23fff700 1 -- 172.21.15.88:0/1750349095 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa300578f0 con 0x7ffa3c0b4750 2023-05-17T12:25:39.032 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:25:39.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ffa2806ace0 msgr2=0x7ffa2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ffa2806ace0 0x7ffa2806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009ac0 tx=0x7ffa2c008040 comp rx=0 tx=0).stop 2023-05-17T12:25:39.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 msgr2=0x7ffa3c153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 0x7ffa3c153020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa300011e0 tx=0x7ffa3000cae0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 shutdown_connections 2023-05-17T12:25:39.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ffa2806ace0 0x7ffa2806d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa3c0c9370 0x7ffa3c153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa3c06a510 0x7ffa3c157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 --2- 172.21.15.88:0/1750349095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa3c0b4750 0x7ffa3c153020 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 >> 172.21.15.88:0/1750349095 conn(0x7ffa3c0cf970 msgr2=0x7ffa3c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:39.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 shutdown_connections 2023-05-17T12:25:39.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.031+0000 7ffa41fff700 1 -- 172.21.15.88:0/1750349095 wait complete. 2023-05-17T12:25:39.051 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:25:39.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.235+0000 7f8fa9fff700 1 Processor -- start 2023-05-17T12:25:39.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.235+0000 7f8fa9fff700 1 -- start start 2023-05-17T12:25:39.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.236+0000 7f8fa9fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8fa406af60 0x7f8fa4160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa9fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa406a510 con 0x7f8fa406c760 2023-05-17T12:25:39.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa9fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa40cf8a0 con 0x7f8fa40b23a0 2023-05-17T12:25:39.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa9fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa40cd840 con 0x7f8fa406af60 2023-05-17T12:25:39.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8fa406af60 0x7f8fa4160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8fa406c760 0x7f8fa406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52080/0 (socket says 172.21.15.88:52080) 2023-05-17T12:25:39.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa37fe700 1 -- 172.21.15.88:0/498446013 learned_addr learned my addr 172.21.15.88:0/498446013 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:39.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa3fff700 1 -- 172.21.15.88:0/498446013 >> v1:172.21.15.187:6789/0 conn(0x7f8fa40b23a0 legacy=0x7f8fa40cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa3fff700 1 -- 172.21.15.88:0/498446013 >> v1:172.21.15.88:6789/0 conn(0x7f8fa406c760 legacy=0x7f8fa406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa3fff700 1 -- 172.21.15.88:0/498446013 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40cdb20 con 0x7f8fa406af60 2023-05-17T12:25:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.237+0000 7f8fa2ffd700 1 -- 172.21.15.88:0/498446013 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177718176 0 0) 0x7f8fa406a510 con 0x7f8fa406c760 2023-05-17T12:25:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.238+0000 7f8fa3fff700 1 --2- 172.21.15.88:0/498446013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 0x7f8fa4160380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009d90 tx=0x7f8f9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c9ec71885d2be2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.238+0000 7f8fa2ffd700 1 -- 172.21.15.88:0/498446013 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00e070 con 0x7f8fa406af60 2023-05-17T12:25:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.238+0000 7f8fa2ffd700 1 -- 172.21.15.88:0/498446013 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00bbd0 con 0x7f8fa406af60 2023-05-17T12:25:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.238+0000 7f8fa2ffd700 1 -- 172.21.15.88:0/498446013 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c012430 con 0x7f8fa406af60 2023-05-17T12:25:39.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.238+0000 7f8fa9fff700 1 -- 172.21.15.88:0/498446013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 msgr2=0x7f8fa4160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.238+0000 7f8fa9fff700 1 --2- 172.21.15.88:0/498446013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 0x7f8fa4160380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009d90 tx=0x7f8f9c00b330 comp rx=0 tx=0).stop 2023-05-17T12:25:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.238+0000 7f8fa9fff700 1 -- 172.21.15.88:0/498446013 shutdown_connections 2023-05-17T12:25:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.238+0000 7f8fa9fff700 1 --2- 172.21.15.88:0/498446013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 0x7f8fa4160380 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.238+0000 7f8fa9fff700 1 -- 172.21.15.88:0/498446013 >> 172.21.15.88:0/498446013 conn(0x7f8fa40d06f0 msgr2=0x7f8fa40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.239+0000 7f8fa9fff700 1 -- 172.21.15.88:0/498446013 shutdown_connections 2023-05-17T12:25:39.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.239+0000 7f8fa9fff700 1 -- 172.21.15.88:0/498446013 wait complete. 2023-05-17T12:25:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.240+0000 7f8fa9fff700 1 Processor -- start 2023-05-17T12:25:39.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.240+0000 7f8fa9fff700 1 -- start start 2023-05-17T12:25:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.241+0000 7f8fa9fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 0x7f8fa40c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.241+0000 7f8fa9fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa406c760 0x7f8fa40b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.241+0000 7f8fa9fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fa40b86c0 0x7f8fa40c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.241+0000 7f8fa9fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40b8b40 con 0x7f8fa406af60 2023-05-17T12:25:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.241+0000 7f8fa9fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41f5ad0 con 0x7f8fa406c760 2023-05-17T12:25:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.241+0000 7f8fa9fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41f5d70 con 0x7f8fa40b86c0 2023-05-17T12:25:39.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.241+0000 7f8fa37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 0x7f8fa40c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 0x7f8fa40c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37726/0 (socket says 172.21.15.88:37726) 2023-05-17T12:25:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa37fe700 1 -- 172.21.15.88:0/900109407 learned_addr learned my addr 172.21.15.88:0/900109407 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa3fff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fa40b86c0 0x7f8fa40c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8f9bfff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa406c760 0x7f8fa40b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa37fe700 1 -- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fa40b86c0 msgr2=0x7f8fa40c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa37fe700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fa40b86c0 0x7f8fa40c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa37fe700 1 -- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa406c760 msgr2=0x7f8fa40b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa37fe700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa406c760 0x7f8fa40b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa37fe700 1 -- 172.21.15.88:0/900109407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c009a70 con 0x7f8fa406af60 2023-05-17T12:25:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa37fe700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 0x7f8fa40c7120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400c520 tx=0x7f8f9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa0ff9700 1 -- 172.21.15.88:0/900109407 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94004c80 con 0x7f8fa406af60 2023-05-17T12:25:39.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa0ff9700 1 -- 172.21.15.88:0/900109407 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f94004e00 con 0x7f8fa406af60 2023-05-17T12:25:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa0ff9700 1 -- 172.21.15.88:0/900109407 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94007310 con 0x7f8fa406af60 2023-05-17T12:25:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.242+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa406aa40 con 0x7f8fa406af60 2023-05-17T12:25:39.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.243+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa406a760 con 0x7f8fa406af60 2023-05-17T12:25:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.244+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa415cb40 con 0x7f8fa406af60 2023-05-17T12:25:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.244+0000 7f8fa0ff9700 1 -- 172.21.15.88:0/900109407 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8f94007470 con 0x7f8fa406af60 2023-05-17T12:25:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.245+0000 7f8fa0ff9700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f8406ace0 0x7f8f8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.245+0000 7f8fa0ff9700 1 -- 172.21.15.88:0/900109407 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8f940893f0 con 0x7f8fa406af60 2023-05-17T12:25:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.246+0000 7f8f9bfff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f8406ace0 0x7f8f8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.246+0000 7f8f9bfff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f8406ace0 0x7f8f8406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4066e50 tx=0x7f8f8c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:39.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.250+0000 7f8fa0ff9700 1 -- 172.21.15.88:0/900109407 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8f94054110 con 0x7f8fa406af60 2023-05-17T12:25:39.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.447+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8fa4074530 con 0x7f8fa406af60 2023-05-17T12:25:39.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.448+0000 7f8fa0ff9700 1 -- 172.21.15.88:0/900109407 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8f94057730 con 0x7f8fa406af60 2023-05-17T12:25:39.451 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:25:39.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f8406ace0 msgr2=0x7f8f8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f8406ace0 0x7f8f8406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4066e50 tx=0x7f8f8c009040 comp rx=0 tx=0).stop 2023-05-17T12:25:39.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 msgr2=0x7f8fa40c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 0x7f8fa40c7120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400c520 tx=0x7f8f9400c830 comp rx=0 tx=0).stop 2023-05-17T12:25:39.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 shutdown_connections 2023-05-17T12:25:39.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f8406ace0 0x7f8f8406d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8fa40b86c0 0x7f8fa40c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa406af60 0x7f8fa40c7120 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 --2- 172.21.15.88:0/900109407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa406c760 0x7f8fa40b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 >> 172.21.15.88:0/900109407 conn(0x7f8fa40d06f0 msgr2=0x7f8fa406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 shutdown_connections 2023-05-17T12:25:39.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.450+0000 7f8fa9fff700 1 -- 172.21.15.88:0/900109407 wait complete. 2023-05-17T12:25:39.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:25:39.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.654+0000 7f13167ff700 1 Processor -- start 2023-05-17T12:25:39.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.654+0000 7f13167ff700 1 -- start start 2023-05-17T12:25:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.655+0000 7f13167ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f131006c760 0x7f131006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.655+0000 7f13167ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f13100cf190 0x7f1310160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.655+0000 7f13167ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131006b4a0 con 0x7f13100b23a0 2023-05-17T12:25:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.655+0000 7f13167ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131006a510 con 0x7f131006c760 2023-05-17T12:25:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f13167ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100cd840 con 0x7f13100cf190 2023-05-17T12:25:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f1307fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f13100b23a0 0x7f131006cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52096/0 (socket says 172.21.15.88:52096) 2023-05-17T12:25:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f1307fff700 1 -- 172.21.15.88:0/1981930837 learned_addr learned my addr 172.21.15.88:0/1981930837 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f130ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f131006c760 0x7f131006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f1314d9c700 1 --2- 172.21.15.88:0/1981930837 >> v2:172.21.15.187:3300/0 conn(0x7f13100cf190 0x7f1310160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f130f7fe700 1 -- 172.21.15.88:0/1981930837 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873573093 0 0) 0x7f12f8001110 con 0x7f13100b23a0 2023-05-17T12:25:39.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f130f7fe700 1 -- 172.21.15.88:0/1981930837 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12fc0035b0 con 0x7f13100b23a0 2023-05-17T12:25:39.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f130ffff700 1 -- 172.21.15.88:0/1981930837 >> v2:172.21.15.187:3300/0 conn(0x7f13100cf190 msgr2=0x7f1310160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:39.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f130ffff700 1 --2- 172.21.15.88:0/1981930837 >> v2:172.21.15.187:3300/0 conn(0x7f13100cf190 0x7f1310160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f130ffff700 1 -- 172.21.15.88:0/1981930837 >> v1:172.21.15.88:6789/0 conn(0x7f13100b23a0 legacy=0x7f131006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.656+0000 7f130ffff700 1 -- 172.21.15.88:0/1981930837 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13100cdb20 con 0x7f131006c760 2023-05-17T12:25:39.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f130ffff700 1 --2- 172.21.15.88:0/1981930837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131006c760 0x7f131006af60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f131008c360 tx=0x7f1300009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a29eea7a5433a4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f130f7fe700 1 -- 172.21.15.88:0/1981930837 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300011830 con 0x7f131006c760 2023-05-17T12:25:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f130f7fe700 1 -- 172.21.15.88:0/1981930837 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300011990 con 0x7f131006c760 2023-05-17T12:25:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f130f7fe700 1 -- 172.21.15.88:0/1981930837 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300011d20 con 0x7f131006c760 2023-05-17T12:25:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f13167ff700 1 -- 172.21.15.88:0/1981930837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131006c760 msgr2=0x7f131006af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f13167ff700 1 --2- 172.21.15.88:0/1981930837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131006c760 0x7f131006af60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f131008c360 tx=0x7f1300009b20 comp rx=0 tx=0).stop 2023-05-17T12:25:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f13167ff700 1 -- 172.21.15.88:0/1981930837 shutdown_connections 2023-05-17T12:25:39.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f13167ff700 1 --2- 172.21.15.88:0/1981930837 >> v2:172.21.15.187:3300/0 conn(0x7f13100cf190 0x7f1310160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f13167ff700 1 --2- 172.21.15.88:0/1981930837 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f131006c760 0x7f131006af60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.657+0000 7f13167ff700 1 -- 172.21.15.88:0/1981930837 >> 172.21.15.88:0/1981930837 conn(0x7f13100d06f0 msgr2=0x7f13100d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:39.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.658+0000 7f13167ff700 1 -- 172.21.15.88:0/1981930837 shutdown_connections 2023-05-17T12:25:39.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.658+0000 7f13167ff700 1 -- 172.21.15.88:0/1981930837 wait complete. 2023-05-17T12:25:39.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.659+0000 7f13167ff700 1 Processor -- start 2023-05-17T12:25:39.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.659+0000 7f13167ff700 1 -- start start 2023-05-17T12:25:39.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.660+0000 7f13167ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f131006c760 0x7f13100ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.660+0000 7f13167ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100cf190 0x7f1310158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.660+0000 7f13167ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131014ee30 0x7f13100ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.660+0000 7f13167ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1310159310 con 0x7f13100cf190 2023-05-17T12:25:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.660+0000 7f13167ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131015b3d0 con 0x7f131006c760 2023-05-17T12:25:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.660+0000 7f13167ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131015b6b0 con 0x7f131014ee30 2023-05-17T12:25:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.660+0000 7f1307fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100cf190 0x7f1310158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1307fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100cf190 0x7f1310158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37746/0 (socket says 172.21.15.88:37746) 2023-05-17T12:25:39.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1307fff700 1 -- 172.21.15.88:0/222487173 learned_addr learned my addr 172.21.15.88:0/222487173 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:39.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f130ffff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f131006c760 0x7f13100ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1314d9c700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131014ee30 0x7f13100ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1307fff700 1 -- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131014ee30 msgr2=0x7f13100ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1307fff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131014ee30 0x7f13100ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1307fff700 1 -- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f131006c760 msgr2=0x7f13100ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1307fff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f131006c760 0x7f13100ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1307fff700 1 -- 172.21.15.88:0/222487173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000094a0 con 0x7f13100cf190 2023-05-17T12:25:39.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1314d9c700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131014ee30 0x7f13100ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f1307fff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100cf190 0x7f1310158dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f12f8007fd0 tx=0x7f12f800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f130d7fa700 1 -- 172.21.15.88:0/222487173 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8005d70 con 0x7f13100cf190 2023-05-17T12:25:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f130d7fa700 1 -- 172.21.15.88:0/222487173 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f80070d0 con 0x7f13100cf190 2023-05-17T12:25:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131006aa40 con 0x7f13100cf190 2023-05-17T12:25:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.661+0000 7f130d7fa700 1 -- 172.21.15.88:0/222487173 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8007460 con 0x7f13100cf190 2023-05-17T12:25:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.662+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131006a760 con 0x7f13100cf190 2023-05-17T12:25:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.663+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131015cb40 con 0x7f13100cf190 2023-05-17T12:25:39.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.664+0000 7f130d7fa700 1 -- 172.21.15.88:0/222487173 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12f80075c0 con 0x7f13100cf190 2023-05-17T12:25:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.664+0000 7f130d7fa700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12f006ace0 0x7f12f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.665+0000 7f130d7fa700 1 -- 172.21.15.88:0/222487173 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12f8088b70 con 0x7f13100cf190 2023-05-17T12:25:39.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.665+0000 7f130ffff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12f006ace0 0x7f12f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:39.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.665+0000 7f130ffff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12f006ace0 0x7f12f006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f13000090b0 tx=0x7f1300008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:39.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.669+0000 7f130d7fa700 1 -- 172.21.15.88:0/222487173 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f12f8053890 con 0x7f13100cf190 2023-05-17T12:25:39.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.861+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f131006b4a0 con 0x7f13100cf190 2023-05-17T12:25:39.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.862+0000 7f130d7fa700 1 -- 172.21.15.88:0/222487173 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f131006b4a0 con 0x7f13100cf190 2023-05-17T12:25:39.865 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12f006ace0 msgr2=0x7f12f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12f006ace0 0x7f12f006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f13000090b0 tx=0x7f1300008030 comp rx=0 tx=0).stop 2023-05-17T12:25:39.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100cf190 msgr2=0x7f1310158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100cf190 0x7f1310158dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f12f8007fd0 tx=0x7f12f800c9e0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 shutdown_connections 2023-05-17T12:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12f006ace0 0x7f12f006d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131014ee30 0x7f13100ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f131006c760 0x7f13100ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 --2- 172.21.15.88:0/222487173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100cf190 0x7f1310158dd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:39.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 >> 172.21.15.88:0/222487173 conn(0x7f13100d06f0 msgr2=0x7f13100b70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:39.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 shutdown_connections 2023-05-17T12:25:39.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:39.864+0000 7f13167ff700 1 -- 172.21.15.88:0/222487173 wait complete. 2023-05-17T12:25:39.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:25:40.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.070+0000 7f8c6f5ff700 1 Processor -- start 2023-05-17T12:25:40.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.070+0000 7f8c6f5ff700 1 -- start start 2023-05-17T12:25:40.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.071+0000 7f8c6f5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806af60 0x7f8c68160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.071+0000 7f8c6f5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6806a510 con 0x7f8c680b23a0 2023-05-17T12:25:40.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.071+0000 7f8c6f5ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680cf8a0 con 0x7f8c6806c760 2023-05-17T12:25:40.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.071+0000 7f8c6f5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680cd840 con 0x7f8c6806af60 2023-05-17T12:25:40.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c6cb9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8c680b23a0 0x7f8c680cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52104/0 (socket says 172.21.15.88:52104) 2023-05-17T12:25:40.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c6cb9a700 1 -- 172.21.15.88:0/1958462276 learned_addr learned my addr 172.21.15.88:0/1958462276 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:40.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c6db9c700 1 --2- 172.21.15.88:0/1958462276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806af60 0x7f8c68160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c5ffff700 1 -- 172.21.15.88:0/1958462276 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109323871 0 0) 0x7f8c6806a510 con 0x7f8c680b23a0 2023-05-17T12:25:40.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c5ffff700 1 -- 172.21.15.88:0/1958462276 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c540035b0 con 0x7f8c680b23a0 2023-05-17T12:25:40.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c5ffff700 1 -- 172.21.15.88:0/1958462276 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888440518 0 0) 0x7f8c680cf8a0 con 0x7f8c6806c760 2023-05-17T12:25:40.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c5ffff700 1 -- 172.21.15.88:0/1958462276 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c6806a510 con 0x7f8c6806c760 2023-05-17T12:25:40.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c6db9c700 1 -- 172.21.15.88:0/1958462276 >> v1:172.21.15.187:6789/0 conn(0x7f8c6806c760 legacy=0x7f8c6806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c6db9c700 1 -- 172.21.15.88:0/1958462276 >> v1:172.21.15.88:6789/0 conn(0x7f8c680b23a0 legacy=0x7f8c680cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.072+0000 7f8c6db9c700 1 -- 172.21.15.88:0/1958462276 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680cdb20 con 0x7f8c6806af60 2023-05-17T12:25:40.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.073+0000 7f8c6db9c700 1 --2- 172.21.15.88:0/1958462276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806af60 0x7f8c68160380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009dc0 tx=0x7f8c6000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d192dbe0bb17d22 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:40.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.073+0000 7f8c5ffff700 1 -- 172.21.15.88:0/1958462276 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000e070 con 0x7f8c6806af60 2023-05-17T12:25:40.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.073+0000 7f8c5ffff700 1 -- 172.21.15.88:0/1958462276 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6000bb20 con 0x7f8c6806af60 2023-05-17T12:25:40.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.073+0000 7f8c5ffff700 1 -- 172.21.15.88:0/1958462276 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60012430 con 0x7f8c6806af60 2023-05-17T12:25:40.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.073+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1958462276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806af60 msgr2=0x7f8c68160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.073+0000 7f8c6f5ff700 1 --2- 172.21.15.88:0/1958462276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806af60 0x7f8c68160380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009dc0 tx=0x7f8c6000b330 comp rx=0 tx=0).stop 2023-05-17T12:25:40.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.074+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1958462276 shutdown_connections 2023-05-17T12:25:40.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.074+0000 7f8c6f5ff700 1 --2- 172.21.15.88:0/1958462276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806af60 0x7f8c68160380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.074+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1958462276 >> 172.21.15.88:0/1958462276 conn(0x7f8c680d06f0 msgr2=0x7f8c680d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:40.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.074+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1958462276 shutdown_connections 2023-05-17T12:25:40.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.074+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1958462276 wait complete. 2023-05-17T12:25:40.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.075+0000 7f8c6f5ff700 1 Processor -- start 2023-05-17T12:25:40.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.075+0000 7f8c6f5ff700 1 -- start start 2023-05-17T12:25:40.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.076+0000 7f8c6f5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c6806af60 0x7f8c6815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.076+0000 7f8c6f5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806c760 0x7f8c680b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.076+0000 7f8c6f5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6814f010 0x7f8c6814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.076+0000 7f8c6f5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6814c6d0 con 0x7f8c6814f010 2023-05-17T12:25:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.076+0000 7f8c6f5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6815b170 con 0x7f8c6806af60 2023-05-17T12:25:40.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.076+0000 7f8c6f5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6815b450 con 0x7f8c6806c760 2023-05-17T12:25:40.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6cb9a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806c760 0x7f8c680b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6db9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6814f010 0x7f8c6814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6d39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c6806af60 0x7f8c6815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6cb9a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806c760 0x7f8c680b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:36378/0 (socket says 172.21.15.88:36378) 2023-05-17T12:25:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6d39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c6806af60 0x7f8c6815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:49192/0 (socket says 172.21.15.88:49192) 2023-05-17T12:25:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6cb9a700 1 -- 172.21.15.88:0/1615207382 learned_addr learned my addr 172.21.15.88:0/1615207382 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:40.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6db9c700 1 -- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806c760 msgr2=0x7f8c680b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6db9c700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806c760 0x7f8c680b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6db9c700 1 -- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c6806af60 msgr2=0x7f8c6815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6db9c700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c6806af60 0x7f8c6815a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6db9c700 1 -- 172.21.15.88:0/1615207382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60009a70 con 0x7f8c6814f010 2023-05-17T12:25:40.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c6db9c700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6814f010 0x7f8c6814e350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c60016000 tx=0x7f8c60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:40.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c5dffb700 1 -- 172.21.15.88:0/1615207382 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60012430 con 0x7f8c6814f010 2023-05-17T12:25:40.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c5dffb700 1 -- 172.21.15.88:0/1615207382 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60020070 con 0x7f8c6814f010 2023-05-17T12:25:40.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.077+0000 7f8c5dffb700 1 -- 172.21.15.88:0/1615207382 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6001ba90 con 0x7f8c6814f010 2023-05-17T12:25:40.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.078+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6806aa40 con 0x7f8c6814f010 2023-05-17T12:25:40.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.078+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6806a760 con 0x7f8c6814f010 2023-05-17T12:25:40.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.079+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6806b3c0 con 0x7f8c6814f010 2023-05-17T12:25:40.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.079+0000 7f8c5dffb700 1 -- 172.21.15.88:0/1615207382 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c6001bbf0 con 0x7f8c6814f010 2023-05-17T12:25:40.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.080+0000 7f8c5dffb700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8c4c06ace0 0x7f8c4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.080+0000 7f8c5dffb700 1 -- 172.21.15.88:0/1615207382 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c60022070 con 0x7f8c6814f010 2023-05-17T12:25:40.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.081+0000 7f8c6d39b700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8c4c06ace0 0x7f8c4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.081+0000 7f8c6d39b700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8c4c06ace0 0x7f8c4c06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001220 tx=0x7f8c64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:40.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.084+0000 7f8c5dffb700 1 -- 172.21.15.88:0/1615207382 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8c60056720 con 0x7f8c6814f010 2023-05-17T12:25:40.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.276+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c68074530 con 0x7f8c6814f010 2023-05-17T12:25:40.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.276+0000 7f8c5dffb700 1 -- 172.21.15.88:0/1615207382 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c6002c020 con 0x7f8c6814f010 2023-05-17T12:25:40.279 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:25:40.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8c4c06ace0 msgr2=0x7f8c4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8c4c06ace0 0x7f8c4c06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001220 tx=0x7f8c64009040 comp rx=0 tx=0).stop 2023-05-17T12:25:40.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6814f010 msgr2=0x7f8c6814e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6814f010 0x7f8c6814e350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c60016000 tx=0x7f8c60004ad0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 shutdown_connections 2023-05-17T12:25:40.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8c4c06ace0 0x7f8c4c06d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6814f010 0x7f8c6814e350 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c6806af60 0x7f8c6815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 --2- 172.21.15.88:0/1615207382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c6806c760 0x7f8c680b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.278+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 >> 172.21.15.88:0/1615207382 conn(0x7f8c680d06f0 msgr2=0x7f8c680b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:40.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.279+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 shutdown_connections 2023-05-17T12:25:40.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.279+0000 7f8c6f5ff700 1 -- 172.21.15.88:0/1615207382 wait complete. 2023-05-17T12:25:40.299 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:25:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.484+0000 7f94f49ff700 1 Processor -- start 2023-05-17T12:25:40.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.485+0000 7f94f49ff700 1 -- start start 2023-05-17T12:25:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94f49ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94f00716e0 0x7f94f0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94f49ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f94f0159070 0x7f94f015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94f49ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f00ca950 con 0x7f94f015cee0 2023-05-17T12:25:40.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94f49ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f0071ff0 con 0x7f94f00716e0 2023-05-17T12:25:40.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94f49ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f015d6d0 con 0x7f94f0159070 2023-05-17T12:25:40.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94ee59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94f00716e0 0x7f94f0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94ee59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94f00716e0 0x7f94f0071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37764/0 (socket says 172.21.15.88:37764) 2023-05-17T12:25:40.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94ee59c700 1 -- 172.21.15.88:0/3985118945 learned_addr learned my addr 172.21.15.88:0/3985118945 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:40.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94e7fff700 1 --2- 172.21.15.88:0/3985118945 >> v2:172.21.15.187:3300/0 conn(0x7f94f0159070 0x7f94f015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94ee59c700 1 -- 172.21.15.88:0/3985118945 >> v2:172.21.15.187:3300/0 conn(0x7f94f0159070 msgr2=0x7f94f015c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:40.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94ee59c700 1 --2- 172.21.15.88:0/3985118945 >> v2:172.21.15.187:3300/0 conn(0x7f94f0159070 0x7f94f015c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94ee59c700 1 -- 172.21.15.88:0/3985118945 >> v1:172.21.15.187:6789/0 conn(0x7f94f015cee0 legacy=0x7f94f006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.486+0000 7f94ee59c700 1 -- 172.21.15.88:0/3985118945 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f01595e0 con 0x7f94f00716e0 2023-05-17T12:25:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.487+0000 7f94ee59c700 1 --2- 172.21.15.88:0/3985118945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 0x7f94f0071ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94f00cf920 tx=0x7f94e000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5484f3b6776276f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.487+0000 7f94edd9b700 1 -- 172.21.15.88:0/3985118945 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000dc70 con 0x7f94f00716e0 2023-05-17T12:25:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.487+0000 7f94edd9b700 1 -- 172.21.15.88:0/3985118945 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e000ddd0 con 0x7f94f00716e0 2023-05-17T12:25:40.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.487+0000 7f94edd9b700 1 -- 172.21.15.88:0/3985118945 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0010690 con 0x7f94f00716e0 2023-05-17T12:25:40.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.488+0000 7f94f49ff700 1 -- 172.21.15.88:0/3985118945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 msgr2=0x7f94f0071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.488+0000 7f94f49ff700 1 --2- 172.21.15.88:0/3985118945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 0x7f94f0071ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94f00cf920 tx=0x7f94e000be70 comp rx=0 tx=0).stop 2023-05-17T12:25:40.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.488+0000 7f94f49ff700 1 -- 172.21.15.88:0/3985118945 shutdown_connections 2023-05-17T12:25:40.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.488+0000 7f94f49ff700 1 --2- 172.21.15.88:0/3985118945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 0x7f94f0071ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.488+0000 7f94f49ff700 1 --2- 172.21.15.88:0/3985118945 >> v2:172.21.15.187:3300/0 conn(0x7f94f0159070 0x7f94f015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.488+0000 7f94f49ff700 1 -- 172.21.15.88:0/3985118945 >> 172.21.15.88:0/3985118945 conn(0x7f94f00cecf0 msgr2=0x7f94f00cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:40.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.488+0000 7f94f49ff700 1 -- 172.21.15.88:0/3985118945 shutdown_connections 2023-05-17T12:25:40.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.488+0000 7f94f49ff700 1 -- 172.21.15.88:0/3985118945 wait complete. 2023-05-17T12:25:40.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.489+0000 7f94f49ff700 1 Processor -- start 2023-05-17T12:25:40.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.490+0000 7f94f49ff700 1 -- start start 2023-05-17T12:25:40.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.490+0000 7f94f49ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 0x7f94f01f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.490+0000 7f94f49ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94f0159070 0x7f94f0154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.490+0000 7f94f49ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94f015cee0 0x7f94f014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.490+0000 7f94f49ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00c6210 con 0x7f94f00716e0 2023-05-17T12:25:40.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.490+0000 7f94f49ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00c8d40 con 0x7f94f0159070 2023-05-17T12:25:40.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.490+0000 7f94f49ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00c5780 con 0x7f94f015cee0 2023-05-17T12:25:40.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94ee59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 0x7f94f01f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94ee59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 0x7f94f01f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37768/0 (socket says 172.21.15.88:37768) 2023-05-17T12:25:40.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94ee59c700 1 -- 172.21.15.88:0/2481288369 learned_addr learned my addr 172.21.15.88:0/2481288369 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:40.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94e7fff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94f0159070 0x7f94f0154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94eed9d700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94f015cee0 0x7f94f014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94ee59c700 1 -- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94f015cee0 msgr2=0x7f94f014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94ee59c700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94f015cee0 0x7f94f014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94ee59c700 1 -- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94f0159070 msgr2=0x7f94f0154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94ee59c700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94f0159070 0x7f94f0154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94ee59c700 1 -- 172.21.15.88:0/2481288369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e000b7f0 con 0x7f94f00716e0 2023-05-17T12:25:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94e7fff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94f0159070 0x7f94f0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94eed9d700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94f015cee0 0x7f94f014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94ee59c700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 0x7f94f01f2710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94f00cfb80 tx=0x7f94e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.491+0000 7f94e6ffd700 1 -- 172.21.15.88:0/2481288369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e001f070 con 0x7f94f00716e0 2023-05-17T12:25:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.492+0000 7f94e6ffd700 1 -- 172.21.15.88:0/2481288369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e00039f0 con 0x7f94f00716e0 2023-05-17T12:25:40.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.492+0000 7f94e6ffd700 1 -- 172.21.15.88:0/2481288369 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0003dc0 con 0x7f94f00716e0 2023-05-17T12:25:40.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.492+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f0159ba0 con 0x7f94f00716e0 2023-05-17T12:25:40.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.492+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f01598c0 con 0x7f94f00716e0 2023-05-17T12:25:40.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.493+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f015d360 con 0x7f94f00716e0 2023-05-17T12:25:40.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.493+0000 7f94e6ffd700 1 -- 172.21.15.88:0/2481288369 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94e0019400 con 0x7f94f00716e0 2023-05-17T12:25:40.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.494+0000 7f94e6ffd700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94d006ace0 0x7f94d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.494+0000 7f94e6ffd700 1 -- 172.21.15.88:0/2481288369 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94e008cbc0 con 0x7f94f00716e0 2023-05-17T12:25:40.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.495+0000 7f94e7fff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94d006ace0 0x7f94d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.495+0000 7f94e7fff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94d006ace0 0x7f94d006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f94f00cc350 tx=0x7f94d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:40.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.499+0000 7f94e6ffd700 1 -- 172.21.15.88:0/2481288369 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f94e0057970 con 0x7f94f00716e0 2023-05-17T12:25:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.689+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f94f01549f0 con 0x7f94f00716e0 2023-05-17T12:25:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.690+0000 7f94e6ffd700 1 -- 172.21.15.88:0/2481288369 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f94f01549f0 con 0x7f94f00716e0 2023-05-17T12:25:40.693 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:25:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94d006ace0 msgr2=0x7f94d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94d006ace0 0x7f94d006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f94f00cc350 tx=0x7f94d8008040 comp rx=0 tx=0).stop 2023-05-17T12:25:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 msgr2=0x7f94f01f2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 0x7f94f01f2710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94f00cfb80 tx=0x7f94e0004750 comp rx=0 tx=0).stop 2023-05-17T12:25:40.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 shutdown_connections 2023-05-17T12:25:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94d006ace0 0x7f94d006d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94f015cee0 0x7f94f014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94f00716e0 0x7f94f01f2710 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 --2- 172.21.15.88:0/2481288369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94f0159070 0x7f94f0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 >> 172.21.15.88:0/2481288369 conn(0x7f94f00cecf0 msgr2=0x7f94f00cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 shutdown_connections 2023-05-17T12:25:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.692+0000 7f94f49ff700 1 -- 172.21.15.88:0/2481288369 wait complete. 2023-05-17T12:25:40.712 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:25:40.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.894+0000 7fa2e27ff700 1 Processor -- start 2023-05-17T12:25:40.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.894+0000 7fa2e27ff700 1 -- start start 2023-05-17T12:25:40.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.895+0000 7fa2e27ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2dc06b0b0 0x7fa2dc06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.895+0000 7fa2e27ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2dc06c330 0x7fa2dc06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.895+0000 7fa2e27ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0cd6b0 con 0x7fa2dc15c840 2023-05-17T12:25:40.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.895+0000 7fa2e27ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0cdf50 con 0x7fa2dc06b0b0 2023-05-17T12:25:40.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.895+0000 7fa2e27ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc06ccb0 con 0x7fa2dc06c330 2023-05-17T12:25:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2db7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2dc06b0b0 0x7fa2dc06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2dbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa2dc15c840 0x7fa2dc0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52114/0 (socket says 172.21.15.88:52114) 2023-05-17T12:25:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2dbfff700 1 -- 172.21.15.88:0/4289556360 learned_addr learned my addr 172.21.15.88:0/4289556360 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2e0d9c700 1 --2- 172.21.15.88:0/4289556360 >> v2:172.21.15.187:3300/0 conn(0x7fa2dc06c330 0x7fa2dc06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2db7fe700 1 -- 172.21.15.88:0/4289556360 >> v2:172.21.15.187:3300/0 conn(0x7fa2dc06c330 msgr2=0x7fa2dc06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2db7fe700 1 --2- 172.21.15.88:0/4289556360 >> v2:172.21.15.187:3300/0 conn(0x7fa2dc06c330 0x7fa2dc06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2db7fe700 1 -- 172.21.15.88:0/4289556360 >> v1:172.21.15.88:6789/0 conn(0x7fa2dc15c840 legacy=0x7fa2dc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2db7fe700 1 -- 172.21.15.88:0/4289556360 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0b2460 con 0x7fa2dc06b0b0 2023-05-17T12:25:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2daffd700 1 -- 172.21.15.88:0/4289556360 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210993987 0 0) 0x7fa2dc0cd6b0 con 0x7fa2dc15c840 2023-05-17T12:25:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.896+0000 7fa2db7fe700 1 --2- 172.21.15.88:0/4289556360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc06b0b0 0x7fa2dc06b940 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0d2220 tx=0x7fa2d0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bd8f05aafef337 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2daffd700 1 -- 172.21.15.88:0/4289556360 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0011830 con 0x7fa2dc06b0b0 2023-05-17T12:25:40.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2daffd700 1 -- 172.21.15.88:0/4289556360 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0011990 con 0x7fa2dc06b0b0 2023-05-17T12:25:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2daffd700 1 -- 172.21.15.88:0/4289556360 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0011d20 con 0x7fa2dc06b0b0 2023-05-17T12:25:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2e27ff700 1 -- 172.21.15.88:0/4289556360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc06b0b0 msgr2=0x7fa2dc06b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2e27ff700 1 --2- 172.21.15.88:0/4289556360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc06b0b0 0x7fa2dc06b940 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0d2220 tx=0x7fa2d0009b20 comp rx=0 tx=0).stop 2023-05-17T12:25:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2e27ff700 1 -- 172.21.15.88:0/4289556360 shutdown_connections 2023-05-17T12:25:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2e27ff700 1 --2- 172.21.15.88:0/4289556360 >> v2:172.21.15.187:3300/0 conn(0x7fa2dc06c330 0x7fa2dc06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2e27ff700 1 --2- 172.21.15.88:0/4289556360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc06b0b0 0x7fa2dc06b940 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2e27ff700 1 -- 172.21.15.88:0/4289556360 >> 172.21.15.88:0/4289556360 conn(0x7fa2dc0d3060 msgr2=0x7fa2dc0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:40.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2e27ff700 1 -- 172.21.15.88:0/4289556360 shutdown_connections 2023-05-17T12:25:40.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.897+0000 7fa2e27ff700 1 -- 172.21.15.88:0/4289556360 wait complete. 2023-05-17T12:25:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.899+0000 7fa2e27ff700 1 Processor -- start 2023-05-17T12:25:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.899+0000 7fa2e27ff700 1 -- start start 2023-05-17T12:25:40.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.900+0000 7fa2e27ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2dc06b0b0 0x7fa2dc15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.900+0000 7fa2e27ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2dc06c330 0x7fa2dc157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.900+0000 7fa2e27ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc15c840 0x7fa2dc157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.900+0000 7fa2e27ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc157b90 con 0x7fa2dc15c840 2023-05-17T12:25:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.900+0000 7fa2e27ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0b5770 con 0x7fa2dc06b0b0 2023-05-17T12:25:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.900+0000 7fa2e27ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc1f2760 con 0x7fa2dc06c330 2023-05-17T12:25:40.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.900+0000 7fa2e0d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc15c840 0x7fa2dc157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.900+0000 7fa2e0d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc15c840 0x7fa2dc157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37782/0 (socket says 172.21.15.88:37782) 2023-05-17T12:25:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.900+0000 7fa2e0d9c700 1 -- 172.21.15.88:0/3242553158 learned_addr learned my addr 172.21.15.88:0/3242553158 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2db7fe700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2dc06c330 0x7fa2dc157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2dbfff700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2dc06b0b0 0x7fa2dc15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2e0d9c700 1 -- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2dc06c330 msgr2=0x7fa2dc157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2e0d9c700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2dc06c330 0x7fa2dc157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2e0d9c700 1 -- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2dc06b0b0 msgr2=0x7fa2dc15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2e0d9c700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2dc06b0b0 0x7fa2dc15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2e0d9c700 1 -- 172.21.15.88:0/3242553158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00094a0 con 0x7fa2dc15c840 2023-05-17T12:25:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2e0d9c700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc15c840 0x7fa2dc157650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4007e40 tx=0x7fa2d400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2d8ff9700 1 -- 172.21.15.88:0/3242553158 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d400ee40 con 0x7fa2dc15c840 2023-05-17T12:25:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2d8ff9700 1 -- 172.21.15.88:0/3242553158 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4014420 con 0x7fa2dc15c840 2023-05-17T12:25:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc0cd900 con 0x7fa2dc15c840 2023-05-17T12:25:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2d8ff9700 1 -- 172.21.15.88:0/3242553158 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40147d0 con 0x7fa2dc15c840 2023-05-17T12:25:40.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.901+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc0b2740 con 0x7fa2dc15c840 2023-05-17T12:25:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.902+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc0cdbe0 con 0x7fa2dc15c840 2023-05-17T12:25:40.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.903+0000 7fa2d8ff9700 1 -- 172.21.15.88:0/3242553158 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa2d4014930 con 0x7fa2dc15c840 2023-05-17T12:25:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.904+0000 7fa2d8ff9700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2c806ace0 0x7fa2c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.904+0000 7fa2d8ff9700 1 -- 172.21.15.88:0/3242553158 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa2d4089fc0 con 0x7fa2dc15c840 2023-05-17T12:25:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.904+0000 7fa2dbfff700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2c806ace0 0x7fa2c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:40.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.905+0000 7fa2dbfff700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2c806ace0 0x7fa2c806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc000f60 tx=0x7fa2cc007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:40.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:40.908+0000 7fa2d8ff9700 1 -- 172.21.15.88:0/3242553158 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa2d4054ce0 con 0x7fa2dc15c840 2023-05-17T12:25:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.146+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2dc074530 con 0x7fa2dc15c840 2023-05-17T12:25:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.147+0000 7fa2d8ff9700 1 -- 172.21.15.88:0/3242553158 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fa2d4058300 con 0x7fa2dc15c840 2023-05-17T12:25:41.150 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:41.151 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:30.331217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T12:25:41.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2c806ace0 msgr2=0x7fa2c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2c806ace0 0x7fa2c806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc000f60 tx=0x7fa2cc007c90 comp rx=0 tx=0).stop 2023-05-17T12:25:41.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc15c840 msgr2=0x7fa2dc157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc15c840 0x7fa2dc157650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4007e40 tx=0x7fa2d400e3c0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 shutdown_connections 2023-05-17T12:25:41.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2c806ace0 0x7fa2c806d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2dc15c840 0x7fa2dc157650 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2dc06b0b0 0x7fa2dc15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 --2- 172.21.15.88:0/3242553158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2dc06c330 0x7fa2dc157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 >> 172.21.15.88:0/3242553158 conn(0x7fa2dc0d3060 msgr2=0x7fa2dc0cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:41.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 shutdown_connections 2023-05-17T12:25:41.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.149+0000 7fa2e27ff700 1 -- 172.21.15.88:0/3242553158 wait complete. 2023-05-17T12:25:41.154 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-05-17T12:25:41.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:41.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.353+0000 7f38257ff700 1 Processor -- start 2023-05-17T12:25:41.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.353+0000 7f38257ff700 1 -- start start 2023-05-17T12:25:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f38257ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f382015a580 0x7f38200c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f38257ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a950 0x7f3820070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f38257ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f38200c98a0 0x7f3820071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f38257ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382015ec80 con 0x7f382015a580 2023-05-17T12:25:41.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f38257ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382015f110 con 0x7f38200c98a0 2023-05-17T12:25:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f38257ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382015e350 con 0x7f382015a950 2023-05-17T12:25:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f381effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f382015a580 0x7f38200c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f381effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f382015a580 0x7f38200c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47454/0 (socket says 172.21.15.88:47454) 2023-05-17T12:25:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f381effd700 1 -- 172.21.15.88:0/3264846705 learned_addr learned my addr 172.21.15.88:0/3264846705 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f381f7fe700 1 --2- 172.21.15.88:0/3264846705 >> v2:172.21.15.187:3300/0 conn(0x7f38200c98a0 0x7f3820071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.354+0000 7f3817fff700 1 --2- 172.21.15.88:0/3264846705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a950 0x7f3820070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.355+0000 7f381effd700 1 -- 172.21.15.88:0/3264846705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a950 msgr2=0x7f3820070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.355+0000 7f381effd700 1 --2- 172.21.15.88:0/3264846705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a950 0x7f3820070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.355+0000 7f381effd700 1 -- 172.21.15.88:0/3264846705 >> v2:172.21.15.187:3300/0 conn(0x7f38200c98a0 msgr2=0x7f3820071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.355+0000 7f381effd700 1 --2- 172.21.15.88:0/3264846705 >> v2:172.21.15.187:3300/0 conn(0x7f38200c98a0 0x7f3820071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.355+0000 7f381effd700 1 -- 172.21.15.88:0/3264846705 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382015e630 con 0x7f382015a580 2023-05-17T12:25:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.355+0000 7f381effd700 1 --2- 172.21.15.88:0/3264846705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382015a580 0x7f38200c9360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f382015e1f0 tx=0x7f3810009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a151b78b728e653 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.355+0000 7f381e7fc700 1 -- 172.21.15.88:0/3264846705 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810011830 con 0x7f382015a580 2023-05-17T12:25:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.355+0000 7f381e7fc700 1 -- 172.21.15.88:0/3264846705 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810011990 con 0x7f382015a580 2023-05-17T12:25:41.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.355+0000 7f381e7fc700 1 -- 172.21.15.88:0/3264846705 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810011d20 con 0x7f382015a580 2023-05-17T12:25:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.356+0000 7f38257ff700 1 -- 172.21.15.88:0/3264846705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382015a580 msgr2=0x7f38200c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.356+0000 7f38257ff700 1 --2- 172.21.15.88:0/3264846705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382015a580 0x7f38200c9360 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f382015e1f0 tx=0x7f3810009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.356+0000 7f38257ff700 1 -- 172.21.15.88:0/3264846705 shutdown_connections 2023-05-17T12:25:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.356+0000 7f38257ff700 1 --2- 172.21.15.88:0/3264846705 >> v2:172.21.15.187:3300/0 conn(0x7f38200c98a0 0x7f3820071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.356+0000 7f38257ff700 1 --2- 172.21.15.88:0/3264846705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382015a580 0x7f38200c9360 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.356+0000 7f38257ff700 1 --2- 172.21.15.88:0/3264846705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a950 0x7f3820070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.356+0000 7f38257ff700 1 -- 172.21.15.88:0/3264846705 >> 172.21.15.88:0/3264846705 conn(0x7f38200ced10 msgr2=0x7f38200cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.356+0000 7f38257ff700 1 -- 172.21.15.88:0/3264846705 shutdown_connections 2023-05-17T12:25:41.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.356+0000 7f38257ff700 1 -- 172.21.15.88:0/3264846705 wait complete. 2023-05-17T12:25:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.358+0000 7f38257ff700 1 Processor -- start 2023-05-17T12:25:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.358+0000 7f38257ff700 1 -- start start 2023-05-17T12:25:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f38257ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38200c98a0 0x7f38200c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f38257ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a580 0x7f382014df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f38257ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f382015a950 0x7f38201504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f38257ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382014e490 con 0x7f38200c98a0 2023-05-17T12:25:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f38257ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382014f4b0 con 0x7f382015a950 2023-05-17T12:25:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f38257ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382014f700 con 0x7f382015a580 2023-05-17T12:25:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f381effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38200c98a0 0x7f38200c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f381effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38200c98a0 0x7f38200c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47466/0 (socket says 172.21.15.88:47466) 2023-05-17T12:25:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f381effd700 1 -- 172.21.15.88:0/4161194002 learned_addr learned my addr 172.21.15.88:0/4161194002 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f381effd700 1 -- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a580 msgr2=0x7f382014df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f381f7fe700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f382015a950 0x7f38201504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f3817fff700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a580 0x7f382014df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f381effd700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a580 0x7f382014df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f381effd700 1 -- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f382015a950 msgr2=0x7f38201504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f381effd700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f382015a950 0x7f38201504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.359+0000 7f381effd700 1 -- 172.21.15.88:0/4161194002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3810009550 con 0x7f38200c98a0 2023-05-17T12:25:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.360+0000 7f381effd700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38200c98a0 0x7f38200c40c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3810009c10 tx=0x7f3810004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:41.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.360+0000 7f38177fe700 1 -- 172.21.15.88:0/4161194002 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810004300 con 0x7f38200c98a0 2023-05-17T12:25:41.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.360+0000 7f38177fe700 1 -- 172.21.15.88:0/4161194002 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381001f070 con 0x7f38200c98a0 2023-05-17T12:25:41.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.360+0000 7f38177fe700 1 -- 172.21.15.88:0/4161194002 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38100036a0 con 0x7f38200c98a0 2023-05-17T12:25:41.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.360+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38200cea60 con 0x7f38200c98a0 2023-05-17T12:25:41.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.360+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382015e910 con 0x7f38200c98a0 2023-05-17T12:25:41.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.361+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38200c9e00 con 0x7f38200c98a0 2023-05-17T12:25:41.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.362+0000 7f38177fe700 1 -- 172.21.15.88:0/4161194002 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3810021030 con 0x7f38200c98a0 2023-05-17T12:25:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.363+0000 7f38177fe700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f380006ace0 0x7f380006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.363+0000 7f38177fe700 1 -- 172.21.15.88:0/4161194002 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f381008a8e0 con 0x7f38200c98a0 2023-05-17T12:25:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.363+0000 7f3817fff700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f380006ace0 0x7f380006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.364+0000 7f3817fff700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f380006ace0 0x7f380006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38200c3d20 tx=0x7f3808008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:41.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.367+0000 7f38177fe700 1 -- 172.21.15.88:0/4161194002 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3810055850 con 0x7f38200c98a0 2023-05-17T12:25:41.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.560+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38200c3870 con 0x7f38200c98a0 2023-05-17T12:25:41.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.562+0000 7f38177fe700 1 -- 172.21.15.88:0/4161194002 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f3810058e70 con 0x7f38200c98a0 2023-05-17T12:25:41.565 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:41.565 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:06.291796+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:41.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f380006ace0 msgr2=0x7f380006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f380006ace0 0x7f380006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f38200c3d20 tx=0x7f3808008040 comp rx=0 tx=0).stop 2023-05-17T12:25:41.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38200c98a0 msgr2=0x7f38200c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38200c98a0 0x7f38200c40c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3810009c10 tx=0x7f3810004750 comp rx=0 tx=0).stop 2023-05-17T12:25:41.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 shutdown_connections 2023-05-17T12:25:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f380006ace0 0x7f380006d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f382015a950 0x7f38201504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38200c98a0 0x7f38200c40c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 --2- 172.21.15.88:0/4161194002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382015a580 0x7f382014df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 >> 172.21.15.88:0/4161194002 conn(0x7f38200ced10 msgr2=0x7f382006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:41.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 shutdown_connections 2023-05-17T12:25:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.564+0000 7f38257ff700 1 -- 172.21.15.88:0/4161194002 wait complete. 2023-05-17T12:25:41.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:25:41.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:25:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.769+0000 7f4a819ff700 1 Processor -- start 2023-05-17T12:25:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.769+0000 7f4a819ff700 1 -- start start 2023-05-17T12:25:41.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.771+0000 7f4a819ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a7c0b23a0 0x7f4a7c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.771+0000 7f4a819ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c06b4a0 con 0x7f4a7c06c760 2023-05-17T12:25:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.771+0000 7f4a819ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c06a510 con 0x7f4a7c0cf190 2023-05-17T12:25:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.771+0000 7f4a819ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0cd840 con 0x7f4a7c0b23a0 2023-05-17T12:25:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.771+0000 7f4a7affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4a7c06c760 0x7f4a7c06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53650/0 (socket says 172.21.15.88:53650) 2023-05-17T12:25:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.771+0000 7f4a7affd700 1 -- 172.21.15.88:0/2548093336 learned_addr learned my addr 172.21.15.88:0/2548093336 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.771+0000 7f4a73fff700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a7c0b23a0 0x7f4a7c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.771+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856212010 0 0) 0x7f4a6c001110 con 0x7f4a7c06c760 2023-05-17T12:25:41.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.771+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a680035b0 con 0x7f4a7c06c760 2023-05-17T12:25:41.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977647473 0 0) 0x7f4a7c06a510 con 0x7f4a7c0cf190 2023-05-17T12:25:41.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c001110 con 0x7f4a7c0cf190 2023-05-17T12:25:41.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 385040841 0 0) 0x7f4a680035b0 con 0x7f4a7c06c760 2023-05-17T12:25:41.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a7c0b23a0 msgr2=0x7f4a7c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:41.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a7c0b23a0 0x7f4a7c06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 >> v1:172.21.15.187:6789/0 conn(0x7f4a7c0cf190 legacy=0x7f4a7c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c0cdb20 con 0x7f4a7c06c760 2023-05-17T12:25:41.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f4a6c001800 con 0x7f4a7c06c760 2023-05-17T12:25:41.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 >> v1:172.21.15.88:6789/0 conn(0x7f4a7c06c760 legacy=0x7f4a7c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a68003bc0 0x7f4a68003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68004850 0x7f4a68004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a68005200 0x7f4a6800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c0cd840 con 0x7f4a68003bc0 2023-05-17T12:25:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6800bf50 con 0x7f4a68004850 2023-05-17T12:25:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6800c090 con 0x7f4a68005200 2023-05-17T12:25:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7affd700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a68003bc0 0x7f4a68003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a73fff700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68004850 0x7f4a68004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7b7fe700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a68005200 0x7f4a6800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7affd700 1 -- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a68005200 msgr2=0x7f4a6800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7affd700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a68005200 0x7f4a6800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7affd700 1 -- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68004850 msgr2=0x7f4a68004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7affd700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68004850 0x7f4a68004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7affd700 1 -- 172.21.15.88:0/2548093336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680035b0 con 0x7f4a68003bc0 2023-05-17T12:25:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a7b7fe700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a68005200 0x7f4a6800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.772+0000 7f4a73fff700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68004850 0x7f4a68004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a7affd700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a68003bc0 0x7f4a68003fb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c210 tx=0x7f4a68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854b1553f3a07a8d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00cd50 con 0x7f4a68003bc0 2023-05-17T12:25:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c001c80 con 0x7f4a68003bc0 2023-05-17T12:25:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a7a7fc700 1 -- 172.21.15.88:0/2548093336 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c005ba0 con 0x7f4a68003bc0 2023-05-17T12:25:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a819ff700 1 -- 172.21.15.88:0/2548093336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a68003bc0 msgr2=0x7f4a68003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a819ff700 1 --2- 172.21.15.88:0/2548093336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a68003bc0 0x7f4a68003fb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c210 tx=0x7f4a68005880 comp rx=0 tx=0).stop 2023-05-17T12:25:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a7b7fe700 1 -- 172.21.15.88:0/2548093336 reap_dead start 2023-05-17T12:25:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a819ff700 1 -- 172.21.15.88:0/2548093336 shutdown_connections 2023-05-17T12:25:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a819ff700 1 -- 172.21.15.88:0/2548093336 >> 172.21.15.88:0/2548093336 conn(0x7f4a7c0d06f0 msgr2=0x7f4a7c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:41.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a819ff700 1 -- 172.21.15.88:0/2548093336 shutdown_connections 2023-05-17T12:25:41.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.773+0000 7f4a819ff700 1 -- 172.21.15.88:0/2548093336 wait complete. 2023-05-17T12:25:41.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.775+0000 7f4a819ff700 1 Processor -- start 2023-05-17T12:25:41.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.775+0000 7f4a819ff700 1 -- start start 2023-05-17T12:25:41.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.776+0000 7f4a819ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68003bc0 0x7f4a7c147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.776+0000 7f4a819ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a7c0c5d40 0x7f4a7c159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.776+0000 7f4a819ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a7c15a0a0 0x7f4a7c1e8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.776+0000 7f4a819ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c15a510 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.776+0000 7f4a819ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c15b330 con 0x7f4a68003bc0 2023-05-17T12:25:41.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.776+0000 7f4a819ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c1482a0 con 0x7f4a7c15a0a0 2023-05-17T12:25:41.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.776+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a7c0c5d40 0x7f4a7c159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.776+0000 7f4a73fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a7c0c5d40 0x7f4a7c159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47482/0 (socket says 172.21.15.88:47482) 2023-05-17T12:25:41.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.776+0000 7f4a73fff700 1 -- 172.21.15.88:0/4003942663 learned_addr learned my addr 172.21.15.88:0/4003942663 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:41.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a7affd700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68003bc0 0x7f4a7c147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a7b7fe700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a7c15a0a0 0x7f4a7c1e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a73fff700 1 -- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a7c15a0a0 msgr2=0x7f4a7c1e8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a73fff700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a7c15a0a0 0x7f4a7c1e8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a73fff700 1 -- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68003bc0 msgr2=0x7f4a7c147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a73fff700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68003bc0 0x7f4a7c147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a73fff700 1 -- 172.21.15.88:0/4003942663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c06aa40 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a73fff700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a7c0c5d40 0x7f4a7c159b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a640118d0 tx=0x7f4a64011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:41.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a78ff9700 1 -- 172.21.15.88:0/4003942663 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64004220 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a78ff9700 1 -- 172.21.15.88:0/4003942663 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64004380 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a78ff9700 1 -- 172.21.15.88:0/4003942663 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640036a0 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.777+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7c06a760 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.778+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7c15cb40 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.779+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7c074530 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.779+0000 7f4a78ff9700 1 -- 172.21.15.88:0/4003942663 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a64003800 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.780+0000 7f4a78ff9700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4a5c06ace0 0x7f4a5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:41.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.780+0000 7f4a78ff9700 1 -- 172.21.15.88:0/4003942663 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4a64089b70 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.781+0000 7f4a7affd700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4a5c06ace0 0x7f4a5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:41.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.781+0000 7f4a7affd700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4a5c06ace0 0x7f4a5c06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001a40 tx=0x7f4a6c00a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:41.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.784+0000 7f4a78ff9700 1 -- 172.21.15.88:0/4003942663 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4a64054890 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.982+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a7c066c30 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.982+0000 7f4a78ff9700 1 -- 172.21.15.88:0/4003942663 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a64057eb0 con 0x7f4a7c0c5d40 2023-05-17T12:25:41.985 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:25:41.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4a5c06ace0 msgr2=0x7f4a5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4a5c06ace0 0x7f4a5c06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c001a40 tx=0x7f4a6c00a000 comp rx=0 tx=0).stop 2023-05-17T12:25:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a7c0c5d40 msgr2=0x7f4a7c159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a7c0c5d40 0x7f4a7c159b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a640118d0 tx=0x7f4a64011be0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 shutdown_connections 2023-05-17T12:25:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4a5c06ace0 0x7f4a5c06d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a7c15a0a0 0x7f4a7c1e8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a68003bc0 0x7f4a7c147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 --2- 172.21.15.88:0/4003942663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4a7c0c5d40 0x7f4a7c159b60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 >> 172.21.15.88:0/4003942663 conn(0x7f4a7c0d06f0 msgr2=0x7f4a7c0b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.984+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 shutdown_connections 2023-05-17T12:25:41.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:41.985+0000 7f4a819ff700 1 -- 172.21.15.88:0/4003942663 wait complete. 2023-05-17T12:25:42.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:25:42.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.188+0000 7fda5edff700 1 Processor -- start 2023-05-17T12:25:42.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.189+0000 7fda5edff700 1 -- start start 2023-05-17T12:25:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.190+0000 7fda5edff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda5806c760 0x7fda5806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.190+0000 7fda5edff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5806b4a0 con 0x7fda580cf190 2023-05-17T12:25:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.190+0000 7fda5edff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5806a510 con 0x7fda580b23a0 2023-05-17T12:25:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.190+0000 7fda5edff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda580cd840 con 0x7fda5806c760 2023-05-17T12:25:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.190+0000 7fda5d39c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fda580cf190 0x7fda58160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53652/0 (socket says 172.21.15.88:53652) 2023-05-17T12:25:42.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.190+0000 7fda5d39c700 1 -- 172.21.15.88:0/892624590 learned_addr learned my addr 172.21.15.88:0/892624590 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:42.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.190+0000 7fda5cb9b700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda5806c760 0x7fda5806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.190+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073913331 0 0) 0x7fda50001490 con 0x7fda580cf190 2023-05-17T12:25:42.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.190+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda480035b0 con 0x7fda580cf190 2023-05-17T12:25:42.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3865031759 0 0) 0x7fda480035b0 con 0x7fda580cf190 2023-05-17T12:25:42.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda5806c760 msgr2=0x7fda5806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:42.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda5806c760 0x7fda5806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 >> v1:172.21.15.187:6789/0 conn(0x7fda580b23a0 legacy=0x7fda5806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda580cdb20 con 0x7fda580cf190 2023-05-17T12:25:42.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7fda50001b80 con 0x7fda580cf190 2023-05-17T12:25:42.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 >> v1:172.21.15.88:6789/0 conn(0x7fda580cf190 legacy=0x7fda58160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda48003a30 0x7fda48003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda5806c760 0x7fda48004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda48004d90 0x7fda48005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580cd840 con 0x7fda48003a30 2023-05-17T12:25:42.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4800bac0 con 0x7fda48004d90 2023-05-17T12:25:42.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4800bc50 con 0x7fda5806c760 2023-05-17T12:25:42.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda5cb9b700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda48003a30 0x7fda48003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda57fff700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda5806c760 0x7fda48004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.191+0000 7fda5d39c700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda48004d90 0x7fda48005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.192+0000 7fda5cb9b700 1 -- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda5806c760 msgr2=0x7fda48004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:42.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.192+0000 7fda5cb9b700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda5806c760 0x7fda48004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.192+0000 7fda5cb9b700 1 -- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda48004d90 msgr2=0x7fda48005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:42.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.192+0000 7fda5cb9b700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda48004d90 0x7fda48005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.192+0000 7fda5cb9b700 1 -- 172.21.15.88:0/892624590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480035b0 con 0x7fda48003a30 2023-05-17T12:25:42.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.192+0000 7fda5cb9b700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda48003a30 0x7fda48003e40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009b60 tx=0x7fda48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ce0cf648329e45 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:42.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.192+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00e6c0 con 0x7fda48003a30 2023-05-17T12:25:42.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.192+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c00e820 con 0x7fda48003a30 2023-05-17T12:25:42.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.192+0000 7fda577fe700 1 -- 172.21.15.88:0/892624590 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00eb90 con 0x7fda48003a30 2023-05-17T12:25:42.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.193+0000 7fda5edff700 1 -- 172.21.15.88:0/892624590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda48003a30 msgr2=0x7fda48003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.193+0000 7fda5edff700 1 --2- 172.21.15.88:0/892624590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda48003a30 0x7fda48003e40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009b60 tx=0x7fda48005880 comp rx=0 tx=0).stop 2023-05-17T12:25:42.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.193+0000 7fda5d39c700 1 -- 172.21.15.88:0/892624590 reap_dead start 2023-05-17T12:25:42.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.193+0000 7fda5edff700 1 -- 172.21.15.88:0/892624590 shutdown_connections 2023-05-17T12:25:42.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.193+0000 7fda5edff700 1 -- 172.21.15.88:0/892624590 >> 172.21.15.88:0/892624590 conn(0x7fda580d06f0 msgr2=0x7fda580d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:42.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.193+0000 7fda5edff700 1 -- 172.21.15.88:0/892624590 shutdown_connections 2023-05-17T12:25:42.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.193+0000 7fda5edff700 1 -- 172.21.15.88:0/892624590 wait complete. 2023-05-17T12:25:42.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.195+0000 7fda5edff700 1 Processor -- start 2023-05-17T12:25:42.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.195+0000 7fda5edff700 1 -- start start 2023-05-17T12:25:42.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5edff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda48003a30 0x7fda581593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5edff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda580b7590 0x7fda581482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5edff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda580b6bc0 0x7fda58156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5edff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda58159920 con 0x7fda580b6bc0 2023-05-17T12:25:42.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5edff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580b7a70 con 0x7fda580b7590 2023-05-17T12:25:42.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5edff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda580b7d50 con 0x7fda48003a30 2023-05-17T12:25:42.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5d39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda580b6bc0 0x7fda58156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5d39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda580b6bc0 0x7fda58156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47502/0 (socket says 172.21.15.88:47502) 2023-05-17T12:25:42.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5d39c700 1 -- 172.21.15.88:0/3038579390 learned_addr learned my addr 172.21.15.88:0/3038579390 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:42.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5cb9b700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda48003a30 0x7fda581593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda57fff700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda580b7590 0x7fda581482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5d39c700 1 -- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda48003a30 msgr2=0x7fda581593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5d39c700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda48003a30 0x7fda581593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5d39c700 1 -- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda580b7590 msgr2=0x7fda581482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5d39c700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda580b7590 0x7fda581482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5d39c700 1 -- 172.21.15.88:0/3038579390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5806aa40 con 0x7fda580b6bc0 2023-05-17T12:25:42.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.196+0000 7fda5d39c700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda580b6bc0 0x7fda58156180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fda580cf560 tx=0x7fda50007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:42.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.197+0000 7fda557fa700 1 -- 172.21.15.88:0/3038579390 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50007980 con 0x7fda580b6bc0 2023-05-17T12:25:42.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.197+0000 7fda557fa700 1 -- 172.21.15.88:0/3038579390 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda50007b00 con 0x7fda580b6bc0 2023-05-17T12:25:42.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.197+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5806a760 con 0x7fda580b6bc0 2023-05-17T12:25:42.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.197+0000 7fda557fa700 1 -- 172.21.15.88:0/3038579390 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50013630 con 0x7fda580b6bc0 2023-05-17T12:25:42.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.197+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5815cb40 con 0x7fda580b6bc0 2023-05-17T12:25:42.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.198+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda580cf610 con 0x7fda580b6bc0 2023-05-17T12:25:42.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.199+0000 7fda557fa700 1 -- 172.21.15.88:0/3038579390 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda50013790 con 0x7fda580b6bc0 2023-05-17T12:25:42.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.200+0000 7fda557fa700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fda3c06ace0 0x7fda3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.200+0000 7fda557fa700 1 -- 172.21.15.88:0/3038579390 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fda50089dc0 con 0x7fda580b6bc0 2023-05-17T12:25:42.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.200+0000 7fda5cb9b700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fda3c06ace0 0x7fda3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.201+0000 7fda5cb9b700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fda3c06ace0 0x7fda3c06d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0090b0 tx=0x7fda4c01f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:42.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.204+0000 7fda557fa700 1 -- 172.21.15.88:0/3038579390 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fda50054b80 con 0x7fda580b6bc0 2023-05-17T12:25:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.397+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda58074530 con 0x7fda580b6bc0 2023-05-17T12:25:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.400+0000 7fda557fa700 1 -- 172.21.15.88:0/3038579390 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda500581a0 con 0x7fda580b6bc0 2023-05-17T12:25:42.403 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:25:42.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fda3c06ace0 msgr2=0x7fda3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fda3c06ace0 0x7fda3c06d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0090b0 tx=0x7fda4c01f040 comp rx=0 tx=0).stop 2023-05-17T12:25:42.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda580b6bc0 msgr2=0x7fda58156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda580b6bc0 0x7fda58156180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fda580cf560 tx=0x7fda50007340 comp rx=0 tx=0).stop 2023-05-17T12:25:42.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 shutdown_connections 2023-05-17T12:25:42.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fda3c06ace0 0x7fda3c06d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda580b6bc0 0x7fda58156180 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda48003a30 0x7fda581593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 --2- 172.21.15.88:0/3038579390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda580b7590 0x7fda581482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.402+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 >> 172.21.15.88:0/3038579390 conn(0x7fda580d06f0 msgr2=0x7fda580c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:42.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.403+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 shutdown_connections 2023-05-17T12:25:42.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.403+0000 7fda5edff700 1 -- 172.21.15.88:0/3038579390 wait complete. 2023-05-17T12:25:42.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:25:42.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.612+0000 7ff2ec5ff700 1 Processor -- start 2023-05-17T12:25:42.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.612+0000 7ff2ec5ff700 1 -- start start 2023-05-17T12:25:42.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.613+0000 7ff2ec5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2e40b23a0 0x7ff2e406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.613+0000 7ff2ec5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 0x7ff2e4160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.613+0000 7ff2ec5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e406b4a0 con 0x7ff2e406c760 2023-05-17T12:25:42.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.613+0000 7ff2ec5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e406a510 con 0x7ff2e40b23a0 2023-05-17T12:25:42.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.613+0000 7ff2ec5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40cd840 con 0x7ff2e40cf190 2023-05-17T12:25:42.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2ea39b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff2e406c760 0x7ff2e406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53658/0 (socket says 172.21.15.88:53658) 2023-05-17T12:25:42.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2e9b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2e40b23a0 0x7ff2e406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2ea39b700 1 -- 172.21.15.88:0/3691736308 learned_addr learned my addr 172.21.15.88:0/3691736308 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:42.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2eab9c700 1 --2- 172.21.15.88:0/3691736308 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 0x7ff2e4160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2e9b9a700 1 -- 172.21.15.88:0/3691736308 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 msgr2=0x7ff2e4160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:42.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2e9b9a700 1 --2- 172.21.15.88:0/3691736308 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 0x7ff2e4160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2e9b9a700 1 -- 172.21.15.88:0/3691736308 >> v1:172.21.15.88:6789/0 conn(0x7ff2e406c760 legacy=0x7ff2e406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2e9b9a700 1 -- 172.21.15.88:0/3691736308 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40cdb20 con 0x7ff2e40b23a0 2023-05-17T12:25:42.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2e9399700 1 -- 172.21.15.88:0/3691736308 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545219089 0 0) 0x7ff2e0001110 con 0x7ff2e406c760 2023-05-17T12:25:42.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.614+0000 7ff2e9b9a700 1 --2- 172.21.15.88:0/3691736308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e40b23a0 0x7ff2e406af60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009840 tx=0x7ff2d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df55cdf27734152c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:42.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2e9399700 1 -- 172.21.15.88:0/3691736308 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4011830 con 0x7ff2e40b23a0 2023-05-17T12:25:42.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2e9399700 1 -- 172.21.15.88:0/3691736308 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d4011990 con 0x7ff2e40b23a0 2023-05-17T12:25:42.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2e9399700 1 -- 172.21.15.88:0/3691736308 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4011d20 con 0x7ff2e40b23a0 2023-05-17T12:25:42.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/3691736308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e40b23a0 msgr2=0x7ff2e406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2ec5ff700 1 --2- 172.21.15.88:0/3691736308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e40b23a0 0x7ff2e406af60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009840 tx=0x7ff2d4009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:42.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/3691736308 shutdown_connections 2023-05-17T12:25:42.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2ec5ff700 1 --2- 172.21.15.88:0/3691736308 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 0x7ff2e4160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2ec5ff700 1 --2- 172.21.15.88:0/3691736308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e40b23a0 0x7ff2e406af60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/3691736308 >> 172.21.15.88:0/3691736308 conn(0x7ff2e40d06f0 msgr2=0x7ff2e40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:42.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/3691736308 shutdown_connections 2023-05-17T12:25:42.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.615+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/3691736308 wait complete. 2023-05-17T12:25:42.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.617+0000 7ff2ec5ff700 1 Processor -- start 2023-05-17T12:25:42.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.617+0000 7ff2ec5ff700 1 -- start start 2023-05-17T12:25:42.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2ec5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e406c760 0x7ff2e40c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2ec5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 0x7ff2e40b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2ec5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e40d0d30 0x7ff2e41f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2ec5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40b2ef0 con 0x7ff2e406c760 2023-05-17T12:25:42.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2ec5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40b3120 con 0x7ff2e40d0d30 2023-05-17T12:25:42.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2ec5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40b3400 con 0x7ff2e40cf190 2023-05-17T12:25:42.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2ea39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e406c760 0x7ff2e40c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2ea39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e406c760 0x7ff2e40c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47516/0 (socket says 172.21.15.88:47516) 2023-05-17T12:25:42.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2ea39b700 1 -- 172.21.15.88:0/4052232743 learned_addr learned my addr 172.21.15.88:0/4052232743 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:42.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2e9b9a700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 0x7ff2e40b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.618+0000 7ff2eab9c700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e40d0d30 0x7ff2e41f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2ea39b700 1 -- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 msgr2=0x7ff2e40b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2ea39b700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 0x7ff2e40b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2ea39b700 1 -- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e40d0d30 msgr2=0x7ff2e41f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2ea39b700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e40d0d30 0x7ff2e41f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2ea39b700 1 -- 172.21.15.88:0/4052232743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40094a0 con 0x7ff2e406c760 2023-05-17T12:25:42.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2e9b9a700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 0x7ff2e40b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:42.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2ea39b700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e406c760 0x7ff2e40c8860 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000c550 tx=0x7ff2e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:42.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2daffd700 1 -- 172.21.15.88:0/4052232743 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0004c80 con 0x7ff2e406c760 2023-05-17T12:25:42.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2daffd700 1 -- 172.21.15.88:0/4052232743 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0004e00 con 0x7ff2e406c760 2023-05-17T12:25:42.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2daffd700 1 -- 172.21.15.88:0/4052232743 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0007310 con 0x7ff2e406c760 2023-05-17T12:25:42.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e406aa40 con 0x7ff2e406c760 2023-05-17T12:25:42.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.619+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e406a760 con 0x7ff2e406c760 2023-05-17T12:25:42.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.620+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e415cb40 con 0x7ff2e406c760 2023-05-17T12:25:42.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.621+0000 7ff2daffd700 1 -- 172.21.15.88:0/4052232743 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff2e0007470 con 0x7ff2e406c760 2023-05-17T12:25:42.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.622+0000 7ff2daffd700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff2c806ace0 0x7ff2c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:42.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.622+0000 7ff2daffd700 1 -- 172.21.15.88:0/4052232743 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff2e0089350 con 0x7ff2e406c760 2023-05-17T12:25:42.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.623+0000 7ff2e9b9a700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff2c806ace0 0x7ff2c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:42.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.623+0000 7ff2e9b9a700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff2c806ace0 0x7ff2c806d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40090b0 tx=0x7ff2d4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:42.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.626+0000 7ff2daffd700 1 -- 172.21.15.88:0/4052232743 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff2e00540c0 con 0x7ff2e406c760 2023-05-17T12:25:42.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.820+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2e406b4a0 con 0x7ff2e406c760 2023-05-17T12:25:42.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.821+0000 7ff2daffd700 1 -- 172.21.15.88:0/4052232743 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2e406b4a0 con 0x7ff2e406c760 2023-05-17T12:25:42.824 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:25:42.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff2c806ace0 msgr2=0x7ff2c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff2c806ace0 0x7ff2c806d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40090b0 tx=0x7ff2d4008030 comp rx=0 tx=0).stop 2023-05-17T12:25:42.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e406c760 msgr2=0x7ff2e40c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:42.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e406c760 0x7ff2e40c8860 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000c550 tx=0x7ff2e000c910 comp rx=0 tx=0).stop 2023-05-17T12:25:42.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 shutdown_connections 2023-05-17T12:25:42.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff2c806ace0 0x7ff2c806d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e40d0d30 0x7ff2e41f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2e406c760 0x7ff2e40c8860 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 --2- 172.21.15.88:0/4052232743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cf190 0x7ff2e40b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 >> 172.21.15.88:0/4052232743 conn(0x7ff2e40d06f0 msgr2=0x7ff2e40b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 shutdown_connections 2023-05-17T12:25:42.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:42.823+0000 7ff2ec5ff700 1 -- 172.21.15.88:0/4052232743 wait complete. 2023-05-17T12:25:42.843 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:25:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.026+0000 7fa8753ff700 1 Processor -- start 2023-05-17T12:25:43.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.027+0000 7fa8753ff700 1 -- start start 2023-05-17T12:25:43.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.028+0000 7fa8753ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa87006af60 0x7fa870160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.028+0000 7fa8753ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87006a510 con 0x7fa87006c760 2023-05-17T12:25:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.028+0000 7fa8753ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8700cf8a0 con 0x7fa8700b23a0 2023-05-17T12:25:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.028+0000 7fa8753ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8700cd840 con 0x7fa87006af60 2023-05-17T12:25:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.028+0000 7fa86effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa87006c760 0x7fa87006cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53672/0 (socket says 172.21.15.88:53672) 2023-05-17T12:25:43.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.028+0000 7fa86effd700 1 -- 172.21.15.88:0/622230087 learned_addr learned my addr 172.21.15.88:0/622230087 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.028+0000 7fa86f7fe700 1 --2- 172.21.15.88:0/622230087 >> v2:172.21.15.187:3300/0 conn(0x7fa87006af60 0x7fa870160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.028+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191870168 0 0) 0x7fa87006a510 con 0x7fa87006c760 2023-05-17T12:25:43.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa85c0035b0 con 0x7fa87006c760 2023-05-17T12:25:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548759839 0 0) 0x7fa85c0035b0 con 0x7fa87006c760 2023-05-17T12:25:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 >> v2:172.21.15.187:3300/0 conn(0x7fa87006af60 msgr2=0x7fa870160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 --2- 172.21.15.88:0/622230087 >> v2:172.21.15.187:3300/0 conn(0x7fa87006af60 0x7fa870160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 >> v1:172.21.15.187:6789/0 conn(0x7fa8700b23a0 legacy=0x7fa8700cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700cdb20 con 0x7fa87006c760 2023-05-17T12:25:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7fa860001670 con 0x7fa87006c760 2023-05-17T12:25:43.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 >> v1:172.21.15.88:6789/0 conn(0x7fa87006c760 legacy=0x7fa87006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa85c003a00 0x7fa85c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c004850 0x7fa85c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c005200 0x7fa85c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700cd840 con 0x7fa85c003a00 2023-05-17T12:25:43.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c00c080 con 0x7fa85c004850 2023-05-17T12:25:43.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c00c240 con 0x7fa85c005200 2023-05-17T12:25:43.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86f7fe700 1 --2- 172.21.15.88:0/622230087 >> v2:172.21.15.187:3300/0 conn(0x7fa87006af60 0x7fa870160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:43.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa86effd700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa85c003a00 0x7fa85c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.029+0000 7fa867fff700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c004850 0x7fa85c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86f7fe700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c005200 0x7fa85c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86effd700 1 -- 172.21.15.88:0/622230087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c005200 msgr2=0x7fa85c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86effd700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c005200 0x7fa85c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86effd700 1 -- 172.21.15.88:0/622230087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c004850 msgr2=0x7fa85c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86effd700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa85c004850 0x7fa85c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86effd700 1 -- 172.21.15.88:0/622230087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c0035b0 con 0x7fa85c003a00 2023-05-17T12:25:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86f7fe700 1 -- 172.21.15.88:0/622230087 reap_dead start 2023-05-17T12:25:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86effd700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa85c003a00 0x7fa85c003e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa86000c240 tx=0x7fa85c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebbe8e28a7fe8fc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860007c10 con 0x7fa85c003a00 2023-05-17T12:25:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86000cd80 con 0x7fa85c003a00 2023-05-17T12:25:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.030+0000 7fa86e7fc700 1 -- 172.21.15.88:0/622230087 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860005ba0 con 0x7fa85c003a00 2023-05-17T12:25:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.031+0000 7fa8753ff700 1 -- 172.21.15.88:0/622230087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa85c003a00 msgr2=0x7fa85c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.031+0000 7fa8753ff700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa85c003a00 0x7fa85c003e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa86000c240 tx=0x7fa85c005880 comp rx=0 tx=0).stop 2023-05-17T12:25:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.031+0000 7fa8753ff700 1 -- 172.21.15.88:0/622230087 shutdown_connections 2023-05-17T12:25:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.031+0000 7fa8753ff700 1 --2- 172.21.15.88:0/622230087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa85c003a00 0x7fa85c003e10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.031+0000 7fa8753ff700 1 -- 172.21.15.88:0/622230087 >> 172.21.15.88:0/622230087 conn(0x7fa8700d06f0 msgr2=0x7fa8700d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.031+0000 7fa8753ff700 1 -- 172.21.15.88:0/622230087 shutdown_connections 2023-05-17T12:25:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.031+0000 7fa8753ff700 1 -- 172.21.15.88:0/622230087 wait complete. 2023-05-17T12:25:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.033+0000 7fa8753ff700 1 Processor -- start 2023-05-17T12:25:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.033+0000 7fa8753ff700 1 -- start start 2023-05-17T12:25:43.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.034+0000 7fa8753ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c003a00 0x7fa8701535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.034+0000 7fa8753ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa870153df0 0x7fa87015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.034+0000 7fa8753ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8700c7cc0 0x7fa8700c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.034+0000 7fa8753ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700c7830 con 0x7fa8700c7cc0 2023-05-17T12:25:43.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.034+0000 7fa8753ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870153b30 con 0x7fa870153df0 2023-05-17T12:25:43.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa8753ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700c6c20 con 0x7fa85c003a00 2023-05-17T12:25:43.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8700c7cc0 0x7fa8700c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8700c7cc0 0x7fa8700c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47544/0 (socket says 172.21.15.88:47544) 2023-05-17T12:25:43.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86f7fe700 1 -- 172.21.15.88:0/1313128777 learned_addr learned my addr 172.21.15.88:0/1313128777 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:43.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86effd700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c003a00 0x7fa8701535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa867fff700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa870153df0 0x7fa87015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86f7fe700 1 -- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c003a00 msgr2=0x7fa8701535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86f7fe700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c003a00 0x7fa8701535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86f7fe700 1 -- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa870153df0 msgr2=0x7fa87015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86f7fe700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa870153df0 0x7fa87015aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86f7fe700 1 -- 172.21.15.88:0/1313128777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87006aa40 con 0x7fa8700c7cc0 2023-05-17T12:25:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa867fff700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa870153df0 0x7fa87015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.035+0000 7fa86f7fe700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8700c7cc0 0x7fa8700c8140 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa8700d1de0 tx=0x7fa868009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.036+0000 7fa8677fe700 1 -- 172.21.15.88:0/1313128777 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800e070 con 0x7fa8700c7cc0 2023-05-17T12:25:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.036+0000 7fa8677fe700 1 -- 172.21.15.88:0/1313128777 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa868011cd0 con 0x7fa8700c7cc0 2023-05-17T12:25:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.036+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87006a760 con 0x7fa8700c7cc0 2023-05-17T12:25:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.036+0000 7fa8677fe700 1 -- 172.21.15.88:0/1313128777 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868011e60 con 0x7fa8700c7cc0 2023-05-17T12:25:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.036+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87015cb40 con 0x7fa8700c7cc0 2023-05-17T12:25:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.037+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa870074530 con 0x7fa8700c7cc0 2023-05-17T12:25:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.038+0000 7fa8677fe700 1 -- 172.21.15.88:0/1313128777 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa868003a20 con 0x7fa8700c7cc0 2023-05-17T12:25:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.038+0000 7fa8677fe700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa85006ace0 0x7fa85006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.039+0000 7fa8677fe700 1 -- 172.21.15.88:0/1313128777 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa868089f20 con 0x7fa8700c7cc0 2023-05-17T12:25:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.039+0000 7fa86effd700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa85006ace0 0x7fa85006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.040+0000 7fa86effd700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa85006ace0 0x7fa85006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa860000c00 tx=0x7fa860007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.043+0000 7fa8677fe700 1 -- 172.21.15.88:0/1313128777 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa868054d30 con 0x7fa8700c7cc0 2023-05-17T12:25:43.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.233+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa87006b7c0 con 0x7fa8700c7cc0 2023-05-17T12:25:43.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.233+0000 7fa8677fe700 1 -- 172.21.15.88:0/1313128777 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa868058350 con 0x7fa8700c7cc0 2023-05-17T12:25:43.237 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:25:43.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa85006ace0 msgr2=0x7fa85006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa85006ace0 0x7fa85006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa860000c00 tx=0x7fa860007000 comp rx=0 tx=0).stop 2023-05-17T12:25:43.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8700c7cc0 msgr2=0x7fa8700c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8700c7cc0 0x7fa8700c8140 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa8700d1de0 tx=0x7fa868009f90 comp rx=0 tx=0).stop 2023-05-17T12:25:43.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 shutdown_connections 2023-05-17T12:25:43.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa85006ace0 0x7fa85006d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8700c7cc0 0x7fa8700c8140 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa85c003a00 0x7fa8701535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 --2- 172.21.15.88:0/1313128777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa870153df0 0x7fa87015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 >> 172.21.15.88:0/1313128777 conn(0x7fa8700d06f0 msgr2=0x7fa8700d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 shutdown_connections 2023-05-17T12:25:43.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.236+0000 7fa8753ff700 1 -- 172.21.15.88:0/1313128777 wait complete. 2023-05-17T12:25:43.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:25:43.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.444+0000 7f3540dff700 1 Processor -- start 2023-05-17T12:25:43.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.444+0000 7f3540dff700 1 -- start start 2023-05-17T12:25:43.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.445+0000 7f3540dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f353c06c760 0x7f353c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.445+0000 7f3540dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 0x7f353c160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.445+0000 7f3540dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353c06b4a0 con 0x7f353c0b23a0 2023-05-17T12:25:43.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.445+0000 7f3540dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c06a510 con 0x7f353c06c760 2023-05-17T12:25:43.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.445+0000 7f3540dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c0cd840 con 0x7f353c0cf190 2023-05-17T12:25:43.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.445+0000 7f3539d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f353c0b23a0 0x7f353c06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53684/0 (socket says 172.21.15.88:53684) 2023-05-17T12:25:43.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f3539d9b700 1 -- 172.21.15.88:0/4188850904 learned_addr learned my addr 172.21.15.88:0/4188850904 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:43.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f353a59c700 1 --2- 172.21.15.88:0/4188850904 >> v2:172.21.15.187:3300/0 conn(0x7f353c06c760 0x7f353c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f353ad9d700 1 --2- 172.21.15.88:0/4188850904 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 0x7f353c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f353959a700 1 -- 172.21.15.88:0/4188850904 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105165419 0 0) 0x7f3530001110 con 0x7f353c0b23a0 2023-05-17T12:25:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f353959a700 1 -- 172.21.15.88:0/4188850904 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35240035b0 con 0x7f353c0b23a0 2023-05-17T12:25:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f353a59c700 1 -- 172.21.15.88:0/4188850904 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 msgr2=0x7f353c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f353a59c700 1 --2- 172.21.15.88:0/4188850904 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 0x7f353c160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f353a59c700 1 -- 172.21.15.88:0/4188850904 >> v1:172.21.15.88:6789/0 conn(0x7f353c0b23a0 legacy=0x7f353c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f353a59c700 1 -- 172.21.15.88:0/4188850904 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0cdb20 con 0x7f353c06c760 2023-05-17T12:25:43.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.446+0000 7f353a59c700 1 --2- 172.21.15.88:0/4188850904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f353c06c760 0x7f353c06af60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f352c009840 tx=0x7f352c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=727f4c043cb4047e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:43.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f353959a700 1 -- 172.21.15.88:0/4188850904 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c011830 con 0x7f353c06c760 2023-05-17T12:25:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f353959a700 1 -- 172.21.15.88:0/4188850904 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c011990 con 0x7f353c06c760 2023-05-17T12:25:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f353959a700 1 -- 172.21.15.88:0/4188850904 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c011d20 con 0x7f353c06c760 2023-05-17T12:25:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f3540dff700 1 -- 172.21.15.88:0/4188850904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f353c06c760 msgr2=0x7f353c06af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f3540dff700 1 --2- 172.21.15.88:0/4188850904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f353c06c760 0x7f353c06af60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f352c009840 tx=0x7f352c009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:43.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f3540dff700 1 -- 172.21.15.88:0/4188850904 shutdown_connections 2023-05-17T12:25:43.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f3540dff700 1 --2- 172.21.15.88:0/4188850904 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 0x7f353c160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f3540dff700 1 --2- 172.21.15.88:0/4188850904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f353c06c760 0x7f353c06af60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f3540dff700 1 -- 172.21.15.88:0/4188850904 >> 172.21.15.88:0/4188850904 conn(0x7f353c0d06f0 msgr2=0x7f353c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:43.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f3540dff700 1 -- 172.21.15.88:0/4188850904 shutdown_connections 2023-05-17T12:25:43.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.447+0000 7f3540dff700 1 -- 172.21.15.88:0/4188850904 wait complete. 2023-05-17T12:25:43.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.449+0000 7f3540dff700 1 Processor -- start 2023-05-17T12:25:43.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.449+0000 7f3540dff700 1 -- start start 2023-05-17T12:25:43.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.450+0000 7f3540dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353c06c760 0x7f353c145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.450+0000 7f3540dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 0x7f353c1f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.450+0000 7f3540dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f353c1557b0 0x7f353c0b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.450+0000 7f3540dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c148560 con 0x7f353c06c760 2023-05-17T12:25:43.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.450+0000 7f3540dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c146210 con 0x7f353c1557b0 2023-05-17T12:25:43.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.450+0000 7f3540dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c1464f0 con 0x7f353c0cf190 2023-05-17T12:25:43.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.450+0000 7f353a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353c06c760 0x7f353c145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.450+0000 7f353a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353c06c760 0x7f353c145c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47550/0 (socket says 172.21.15.88:47550) 2023-05-17T12:25:43.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.450+0000 7f353a59c700 1 -- 172.21.15.88:0/2566475002 learned_addr learned my addr 172.21.15.88:0/2566475002 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:43.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f3539d9b700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 0x7f353c1f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f353ad9d700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f353c1557b0 0x7f353c0b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f353a59c700 1 -- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 msgr2=0x7f353c1f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f353a59c700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 0x7f353c1f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f353a59c700 1 -- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f353c1557b0 msgr2=0x7f353c0b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f353a59c700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f353c1557b0 0x7f353c0b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f353a59c700 1 -- 172.21.15.88:0/2566475002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c0094a0 con 0x7f353c06c760 2023-05-17T12:25:43.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f353a59c700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353c06c760 0x7f353c145c30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f352c0090b0 tx=0x7f352c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:43.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f352affd700 1 -- 172.21.15.88:0/2566475002 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c004590 con 0x7f353c06c760 2023-05-17T12:25:43.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f352affd700 1 -- 172.21.15.88:0/2566475002 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c01f070 con 0x7f353c06c760 2023-05-17T12:25:43.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f352affd700 1 -- 172.21.15.88:0/2566475002 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c0038e0 con 0x7f353c06c760 2023-05-17T12:25:43.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.451+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353c06aa40 con 0x7f353c06c760 2023-05-17T12:25:43.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.452+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353c06a760 con 0x7f353c06c760 2023-05-17T12:25:43.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.453+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353c15cb40 con 0x7f353c06c760 2023-05-17T12:25:43.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.453+0000 7f352affd700 1 -- 172.21.15.88:0/2566475002 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f352c003a40 con 0x7f353c06c760 2023-05-17T12:25:43.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.455+0000 7f352affd700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f351c06ace0 0x7f351c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.455+0000 7f352affd700 1 -- 172.21.15.88:0/2566475002 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f352c021070 con 0x7f353c06c760 2023-05-17T12:25:43.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.456+0000 7f3539d9b700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f351c06ace0 0x7f351c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.456+0000 7f3539d9b700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f351c06ace0 0x7f351c06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3530007fd0 tx=0x7f3530007c40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:43.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.459+0000 7f352affd700 1 -- 172.21.15.88:0/2566475002 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f352c055cb0 con 0x7f353c06c760 2023-05-17T12:25:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.654+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f353c074530 con 0x7f353c06c760 2023-05-17T12:25:43.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.655+0000 7f352affd700 1 -- 172.21.15.88:0/2566475002 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f352c0592d0 con 0x7f353c06c760 2023-05-17T12:25:43.658 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:25:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f351c06ace0 msgr2=0x7f351c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f351c06ace0 0x7f351c06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3530007fd0 tx=0x7f3530007c40 comp rx=0 tx=0).stop 2023-05-17T12:25:43.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353c06c760 msgr2=0x7f353c145c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353c06c760 0x7f353c145c30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f352c0090b0 tx=0x7f352c004750 comp rx=0 tx=0).stop 2023-05-17T12:25:43.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 shutdown_connections 2023-05-17T12:25:43.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f351c06ace0 0x7f351c06d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f353c1557b0 0x7f353c0b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f353c06c760 0x7f353c145c30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 --2- 172.21.15.88:0/2566475002 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353c0cf190 0x7f353c1f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 >> 172.21.15.88:0/2566475002 conn(0x7f353c0d06f0 msgr2=0x7f353c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:43.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 shutdown_connections 2023-05-17T12:25:43.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.657+0000 7f3540dff700 1 -- 172.21.15.88:0/2566475002 wait complete. 2023-05-17T12:25:43.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:25:43.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.859+0000 7fa0653ff700 1 Processor -- start 2023-05-17T12:25:43.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.859+0000 7fa0653ff700 1 -- start start 2023-05-17T12:25:43.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa0653ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 0x7fa06006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa0653ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa06006c330 0x7fa06006c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa0653ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600cd6b0 con 0x7fa06015c840 2023-05-17T12:25:43.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa0653ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600cdf50 con 0x7fa06006c330 2023-05-17T12:25:43.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa0653ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06006ccf0 con 0x7fa06006b0b0 2023-05-17T12:25:43.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa05effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa06015c840 0x7fa0600cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53698/0 (socket says 172.21.15.88:53698) 2023-05-17T12:25:43.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa05effd700 1 -- 172.21.15.88:0/2328154271 learned_addr learned my addr 172.21.15.88:0/2328154271 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:43.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa05f7fe700 1 --2- 172.21.15.88:0/2328154271 >> v2:172.21.15.88:3300/0 conn(0x7fa06006c330 0x7fa06006c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa05e7fc700 1 -- 172.21.15.88:0/2328154271 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283507618 0 0) 0x7fa0600cd6b0 con 0x7fa06015c840 2023-05-17T12:25:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa05e7fc700 1 -- 172.21.15.88:0/2328154271 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa04c0035b0 con 0x7fa06015c840 2023-05-17T12:25:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2328154271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 msgr2=0x7fa06006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa057fff700 1 --2- 172.21.15.88:0/2328154271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 0x7fa06006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa05f7fe700 1 --2- 172.21.15.88:0/2328154271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 0x7fa06006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2328154271 >> v1:172.21.15.88:6789/0 conn(0x7fa06015c840 legacy=0x7fa0600cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa05f7fe700 1 -- 172.21.15.88:0/2328154271 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600b2460 con 0x7fa06006c330 2023-05-17T12:25:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.861+0000 7fa057fff700 1 --2- 172.21.15.88:0/2328154271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 0x7fa06006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.862+0000 7fa05f7fe700 1 --2- 172.21.15.88:0/2328154271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06006c330 0x7fa06006c7b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa058009d90 tx=0x7fa05800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb3bd226fc0b6f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.862+0000 7fa05e7fc700 1 -- 172.21.15.88:0/2328154271 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05800e070 con 0x7fa06006c330 2023-05-17T12:25:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.862+0000 7fa05e7fc700 1 -- 172.21.15.88:0/2328154271 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05800bb20 con 0x7fa06006c330 2023-05-17T12:25:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.862+0000 7fa05e7fc700 1 -- 172.21.15.88:0/2328154271 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058012430 con 0x7fa06006c330 2023-05-17T12:25:43.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.862+0000 7fa0653ff700 1 -- 172.21.15.88:0/2328154271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06006c330 msgr2=0x7fa06006c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.862+0000 7fa0653ff700 1 --2- 172.21.15.88:0/2328154271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06006c330 0x7fa06006c7b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa058009d90 tx=0x7fa05800b330 comp rx=0 tx=0).stop 2023-05-17T12:25:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.863+0000 7fa0653ff700 1 -- 172.21.15.88:0/2328154271 shutdown_connections 2023-05-17T12:25:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.863+0000 7fa0653ff700 1 --2- 172.21.15.88:0/2328154271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06006c330 0x7fa06006c7b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.863+0000 7fa0653ff700 1 --2- 172.21.15.88:0/2328154271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 0x7fa06006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.863+0000 7fa0653ff700 1 -- 172.21.15.88:0/2328154271 >> 172.21.15.88:0/2328154271 conn(0x7fa0600d3060 msgr2=0x7fa0600d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.863+0000 7fa0653ff700 1 -- 172.21.15.88:0/2328154271 shutdown_connections 2023-05-17T12:25:43.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.863+0000 7fa0653ff700 1 -- 172.21.15.88:0/2328154271 wait complete. 2023-05-17T12:25:43.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.864+0000 7fa0653ff700 1 Processor -- start 2023-05-17T12:25:43.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.864+0000 7fa0653ff700 1 -- start start 2023-05-17T12:25:43.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.865+0000 7fa0653ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 0x7fa0600c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.865+0000 7fa0653ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06006c330 0x7fa0601e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.865+0000 7fa0653ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06015c840 0x7fa0601e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.865+0000 7fa0653ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601e6650 con 0x7fa06015c840 2023-05-17T12:25:43.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.865+0000 7fa0653ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa060148d70 con 0x7fa06006c330 2023-05-17T12:25:43.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.865+0000 7fa0653ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601e5f90 con 0x7fa06006b0b0 2023-05-17T12:25:43.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.865+0000 7fa05f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06015c840 0x7fa0601e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa05f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06015c840 0x7fa0601e2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47556/0 (socket says 172.21.15.88:47556) 2023-05-17T12:25:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa05f7fe700 1 -- 172.21.15.88:0/4276571602 learned_addr learned my addr 172.21.15.88:0/4276571602 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa05effd700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 0x7fa0600c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa057fff700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06006c330 0x7fa0601e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa05f7fe700 1 -- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 msgr2=0x7fa0600c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa05f7fe700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 0x7fa0600c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa05f7fe700 1 -- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06006c330 msgr2=0x7fa0601e6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa05f7fe700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06006c330 0x7fa0601e6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa05f7fe700 1 -- 172.21.15.88:0/4276571602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa058009a70 con 0x7fa06015c840 2023-05-17T12:25:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa057fff700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06006c330 0x7fa0601e6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:43.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa05f7fe700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06015c840 0x7fa0601e2f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa058014040 tx=0x7fa058004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa0577fe700 1 -- 172.21.15.88:0/4276571602 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058012430 con 0x7fa06015c840 2023-05-17T12:25:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa0577fe700 1 -- 172.21.15.88:0/4276571602 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa058020070 con 0x7fa06015c840 2023-05-17T12:25:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.866+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0600cd900 con 0x7fa06015c840 2023-05-17T12:25:43.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.867+0000 7fa0577fe700 1 -- 172.21.15.88:0/4276571602 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058003ea0 con 0x7fa06015c840 2023-05-17T12:25:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.867+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0600b2740 con 0x7fa06015c840 2023-05-17T12:25:43.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.868+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600cdbe0 con 0x7fa06015c840 2023-05-17T12:25:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.868+0000 7fa0577fe700 1 -- 172.21.15.88:0/4276571602 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa058004280 con 0x7fa06015c840 2023-05-17T12:25:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.869+0000 7fa0577fe700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa04006ace0 0x7fa04006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.869+0000 7fa0577fe700 1 -- 172.21.15.88:0/4276571602 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa058022070 con 0x7fa06015c840 2023-05-17T12:25:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.870+0000 7fa05effd700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa04006ace0 0x7fa04006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:43.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.870+0000 7fa05effd700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa04006ace0 0x7fa04006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa050007fd0 tx=0x7fa050007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:43.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:43.874+0000 7fa0577fe700 1 -- 172.21.15.88:0/4276571602 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa058056660 con 0x7fa06015c840 2023-05-17T12:25:44.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.110+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0601e6790 con 0x7fa06015c840 2023-05-17T12:25:44.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.111+0000 7fa0577fe700 1 -- 172.21.15.88:0/4276571602 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fa058059c80 con 0x7fa06015c840 2023-05-17T12:25:44.114 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:44.114 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:30.331217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T12:25:44.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa04006ace0 msgr2=0x7fa04006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa04006ace0 0x7fa04006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa050007fd0 tx=0x7fa050007dc0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06015c840 msgr2=0x7fa0601e2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06015c840 0x7fa0601e2f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa058014040 tx=0x7fa058004ad0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 shutdown_connections 2023-05-17T12:25:44.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa04006ace0 0x7fa04006d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa06015c840 0x7fa0601e2f20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa06006b0b0 0x7fa0600c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 --2- 172.21.15.88:0/4276571602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06006c330 0x7fa0601e6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 >> 172.21.15.88:0/4276571602 conn(0x7fa0600d3060 msgr2=0x7fa06015ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:44.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 shutdown_connections 2023-05-17T12:25:44.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.113+0000 7fa0653ff700 1 -- 172.21.15.88:0/4276571602 wait complete. 2023-05-17T12:25:44.118 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-05-17T12:25:44.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:25:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.315+0000 7f7ae4fff700 1 Processor -- start 2023-05-17T12:25:44.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.315+0000 7f7ae4fff700 1 -- start start 2023-05-17T12:25:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.316+0000 7f7ae4fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 0x7f7ae006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.316+0000 7f7ae4fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ae006b0b0 0x7f7ae00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7ae4fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae00cd6b0 con 0x7f7ae006c330 2023-05-17T12:25:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7ae4fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00cdf50 con 0x7f7ae006b0b0 2023-05-17T12:25:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7ae4fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00cf860 con 0x7f7ae015c840 2023-05-17T12:25:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7aded9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7ae006c330 0x7f7ae0160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53706/0 (socket says 172.21.15.88:53706) 2023-05-17T12:25:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7aded9d700 1 -- 172.21.15.88:0/3971390921 learned_addr learned my addr 172.21.15.88:0/3971390921 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:44.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7ad7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ae006b0b0 0x7f7ae00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7ade59c700 1 --2- 172.21.15.88:0/3971390921 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 0x7f7ae006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7addd9b700 1 -- 172.21.15.88:0/3971390921 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847889452 0 0) 0x7f7ae00cd6b0 con 0x7f7ae006c330 2023-05-17T12:25:44.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7addd9b700 1 -- 172.21.15.88:0/3971390921 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7acc0035b0 con 0x7f7ae006c330 2023-05-17T12:25:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7ad7fff700 1 -- 172.21.15.88:0/3971390921 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 msgr2=0x7f7ae006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7ad7fff700 1 --2- 172.21.15.88:0/3971390921 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 0x7f7ae006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7ad7fff700 1 -- 172.21.15.88:0/3971390921 >> v1:172.21.15.88:6789/0 conn(0x7f7ae006c330 legacy=0x7f7ae0160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.317+0000 7f7ad7fff700 1 -- 172.21.15.88:0/3971390921 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00b2460 con 0x7f7ae006b0b0 2023-05-17T12:25:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7ad7fff700 1 --2- 172.21.15.88:0/3971390921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006b0b0 0x7f7ae00cf320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009840 tx=0x7f7ac8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980d7a5fd986e743 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7addd9b700 1 -- 172.21.15.88:0/3971390921 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8011830 con 0x7f7ae006b0b0 2023-05-17T12:25:44.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7addd9b700 1 -- 172.21.15.88:0/3971390921 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac8011990 con 0x7f7ae006b0b0 2023-05-17T12:25:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7addd9b700 1 -- 172.21.15.88:0/3971390921 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8011d20 con 0x7f7ae006b0b0 2023-05-17T12:25:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7ae4fff700 1 -- 172.21.15.88:0/3971390921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006b0b0 msgr2=0x7f7ae00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7ae4fff700 1 --2- 172.21.15.88:0/3971390921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006b0b0 0x7f7ae00cf320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009840 tx=0x7f7ac8009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7ae4fff700 1 -- 172.21.15.88:0/3971390921 shutdown_connections 2023-05-17T12:25:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7ae4fff700 1 --2- 172.21.15.88:0/3971390921 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 0x7f7ae006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7ae4fff700 1 --2- 172.21.15.88:0/3971390921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006b0b0 0x7f7ae00cf320 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.318+0000 7f7ae4fff700 1 -- 172.21.15.88:0/3971390921 >> 172.21.15.88:0/3971390921 conn(0x7f7ae00d3060 msgr2=0x7f7ae00d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.319+0000 7f7ae4fff700 1 -- 172.21.15.88:0/3971390921 shutdown_connections 2023-05-17T12:25:44.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.319+0000 7f7ae4fff700 1 -- 172.21.15.88:0/3971390921 wait complete. 2023-05-17T12:25:44.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.320+0000 7f7ae4fff700 1 Processor -- start 2023-05-17T12:25:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.320+0000 7f7ae4fff700 1 -- start start 2023-05-17T12:25:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.321+0000 7f7ae4fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae006b0b0 0x7f7ae01577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.321+0000 7f7ae4fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006c330 0x7f7ae00b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.321+0000 7f7ae4fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 0x7f7ae015f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.321+0000 7f7ae4fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae015def0 con 0x7f7ae006c330 2023-05-17T12:25:44.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.321+0000 7f7ae4fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae0157d10 con 0x7f7ae006b0b0 2023-05-17T12:25:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.321+0000 7f7ae4fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00b66a0 con 0x7f7ae015c840 2023-05-17T12:25:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006c330 0x7f7ae00b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006c330 0x7f7ae00b7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47574/0 (socket says 172.21.15.88:47574) 2023-05-17T12:25:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad7fff700 1 -- 172.21.15.88:0/4216424663 learned_addr learned my addr 172.21.15.88:0/4216424663 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ade59c700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae006b0b0 0x7f7ae01577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7aded9d700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 0x7f7ae015f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad7fff700 1 -- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 msgr2=0x7f7ae015f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad7fff700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 0x7f7ae015f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad7fff700 1 -- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae006b0b0 msgr2=0x7f7ae01577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad7fff700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae006b0b0 0x7f7ae01577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad7fff700 1 -- 172.21.15.88:0/4216424663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80094a0 con 0x7f7ae006c330 2023-05-17T12:25:44.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad7fff700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006c330 0x7f7ae00b7740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80090b0 tx=0x7f7ac8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.322+0000 7f7ad6ffd700 1 -- 172.21.15.88:0/4216424663 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8004400 con 0x7f7ae006c330 2023-05-17T12:25:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.323+0000 7f7ad6ffd700 1 -- 172.21.15.88:0/4216424663 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac801f070 con 0x7f7ae006c330 2023-05-17T12:25:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.323+0000 7f7ad6ffd700 1 -- 172.21.15.88:0/4216424663 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80038c0 con 0x7f7ae006c330 2023-05-17T12:25:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.323+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae00cd900 con 0x7f7ae006c330 2023-05-17T12:25:44.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.323+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae00b2740 con 0x7f7ae006c330 2023-05-17T12:25:44.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.324+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae00cdbe0 con 0x7f7ae006c330 2023-05-17T12:25:44.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.324+0000 7f7ad6ffd700 1 -- 172.21.15.88:0/4216424663 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ac8021030 con 0x7f7ae006c330 2023-05-17T12:25:44.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.325+0000 7f7ad6ffd700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7ac006ace0 0x7f7ac006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.325+0000 7f7ad6ffd700 1 -- 172.21.15.88:0/4216424663 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7ac808a990 con 0x7f7ae006c330 2023-05-17T12:25:44.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.326+0000 7f7ade59c700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7ac006ace0 0x7f7ac006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.326+0000 7f7ade59c700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7ac006ace0 0x7f7ac006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00c9df0 tx=0x7f7ad0009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:44.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.330+0000 7f7ad6ffd700 1 -- 172.21.15.88:0/4216424663 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7ac80557d0 con 0x7f7ae006c330 2023-05-17T12:25:44.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.526+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ae0074530 con 0x7f7ae006c330 2023-05-17T12:25:44.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.527+0000 7f7ad6ffd700 1 -- 172.21.15.88:0/4216424663 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f7ac8058df0 con 0x7f7ae006c330 2023-05-17T12:25:44.530 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:44.531 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:25:44.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7ac006ace0 msgr2=0x7f7ac006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7ac006ace0 0x7f7ac006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00c9df0 tx=0x7f7ad0009210 comp rx=0 tx=0).stop 2023-05-17T12:25:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006c330 msgr2=0x7f7ae00b7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006c330 0x7f7ae00b7740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80090b0 tx=0x7f7ac8004750 comp rx=0 tx=0).stop 2023-05-17T12:25:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 shutdown_connections 2023-05-17T12:25:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7ac006ace0 0x7f7ac006d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ae015c840 0x7f7ae015f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ae006b0b0 0x7f7ae01577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 --2- 172.21.15.88:0/4216424663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ae006c330 0x7f7ae00b7740 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 >> 172.21.15.88:0/4216424663 conn(0x7f7ae00d3060 msgr2=0x7f7ae015b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:44.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 shutdown_connections 2023-05-17T12:25:44.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.529+0000 7f7ae4fff700 1 -- 172.21.15.88:0/4216424663 wait complete. 2023-05-17T12:25:44.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:25:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.731+0000 7f2b097ff700 1 Processor -- start 2023-05-17T12:25:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.731+0000 7f2b097ff700 1 -- start start 2023-05-17T12:25:44.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.732+0000 7f2b097ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2b0406b0b0 0x7f2b0406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.732+0000 7f2b097ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b0406c330 0x7f2b0406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b097ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b040cd6b0 con 0x7f2b0415c840 2023-05-17T12:25:44.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b097ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b040cdf50 con 0x7f2b0406b0b0 2023-05-17T12:25:44.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b097ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0406ccf0 con 0x7f2b0406c330 2023-05-17T12:25:44.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b02ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2b0415c840 0x7f2b040cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53718/0 (socket says 172.21.15.88:53718) 2023-05-17T12:25:44.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b02ffd700 1 -- 172.21.15.88:0/1804414077 learned_addr learned my addr 172.21.15.88:0/1804414077 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:44.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b037fe700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b0406c330 0x7f2b0406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2afbfff700 1 --2- 172.21.15.88:0/1804414077 >> v2:172.21.15.187:3300/0 conn(0x7f2b0406b0b0 0x7f2b0406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892726975 0 0) 0x7f2b040cd6b0 con 0x7f2b0415c840 2023-05-17T12:25:44.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af00035b0 con 0x7f2b0415c840 2023-05-17T12:25:44.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1502890562 0 0) 0x7f2af00035b0 con 0x7f2b0415c840 2023-05-17T12:25:44.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b0406c330 msgr2=0x7f2b0406c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b027fc700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b0406c330 0x7f2b0406c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 >> v2:172.21.15.187:3300/0 conn(0x7f2b0406b0b0 msgr2=0x7f2b0406b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.733+0000 7f2b027fc700 1 --2- 172.21.15.88:0/1804414077 >> v2:172.21.15.187:3300/0 conn(0x7f2b0406b0b0 0x7f2b0406b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b040b2460 con 0x7f2b0415c840 2023-05-17T12:25:44.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f2af4001670 con 0x7f2b0415c840 2023-05-17T12:25:44.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 >> v1:172.21.15.88:6789/0 conn(0x7f2b0415c840 legacy=0x7f2b040cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b027fc700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b0406c330 0x7f2af0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b027fc700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af0003fd0 0x7f2af0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b027fc700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0004d90 0x7f2af0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0406ccf0 con 0x7f2af0004d90 2023-05-17T12:25:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af000ba10 con 0x7f2af0003fd0 2023-05-17T12:25:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af000bbd0 con 0x7f2b0406c330 2023-05-17T12:25:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b02ffd700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b0406c330 0x7f2af0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2afbfff700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af0003fd0 0x7f2af0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b037fe700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0004d90 0x7f2af0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b02ffd700 1 -- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af0003fd0 msgr2=0x7f2af0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:44.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b02ffd700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af0003fd0 0x7f2af0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b02ffd700 1 -- 172.21.15.88:0/1804414077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0004d90 msgr2=0x7f2af0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:44.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b02ffd700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0004d90 0x7f2af0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b02ffd700 1 -- 172.21.15.88:0/1804414077 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af00035b0 con 0x7f2b0406c330 2023-05-17T12:25:44.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.734+0000 7f2b037fe700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2af0004d90 0x7f2af0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:44.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.735+0000 7f2b02ffd700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b0406c330 0x7f2af0003a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c240 tx=0x7f2af0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd333c8a68ff71f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.735+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400cd40 con 0x7f2b0406c330 2023-05-17T12:25:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.735+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4005960 con 0x7f2b0406c330 2023-05-17T12:25:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.735+0000 7f2b027fc700 1 -- 172.21.15.88:0/1804414077 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400cea0 con 0x7f2b0406c330 2023-05-17T12:25:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.735+0000 7f2b097ff700 1 -- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b0406c330 msgr2=0x7f2af0003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.735+0000 7f2b097ff700 1 --2- 172.21.15.88:0/1804414077 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b0406c330 0x7f2af0003a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c240 tx=0x7f2af0005880 comp rx=0 tx=0).stop 2023-05-17T12:25:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.735+0000 7f2b037fe700 1 -- 172.21.15.88:0/1804414077 reap_dead start 2023-05-17T12:25:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.736+0000 7f2b097ff700 1 -- 172.21.15.88:0/1804414077 shutdown_connections 2023-05-17T12:25:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.736+0000 7f2b097ff700 1 -- 172.21.15.88:0/1804414077 >> 172.21.15.88:0/1804414077 conn(0x7f2b040d3060 msgr2=0x7f2b040d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.736+0000 7f2b097ff700 1 -- 172.21.15.88:0/1804414077 shutdown_connections 2023-05-17T12:25:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.736+0000 7f2b097ff700 1 -- 172.21.15.88:0/1804414077 wait complete. 2023-05-17T12:25:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.737+0000 7f2b097ff700 1 Processor -- start 2023-05-17T12:25:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.737+0000 7f2b097ff700 1 -- start start 2023-05-17T12:25:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.738+0000 7f2b097ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b0406c330 0x7f2b04154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.738+0000 7f2b097ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b04154a50 0x7f2b040b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.738+0000 7f2b097ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b040b8330 0x7f2b040b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.738+0000 7f2b097ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040b8cf0 con 0x7f2b0406c330 2023-05-17T12:25:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.738+0000 7f2b097ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040b7760 con 0x7f2b040b8330 2023-05-17T12:25:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.738+0000 7f2b097ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04154790 con 0x7f2b04154a50 2023-05-17T12:25:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b0406c330 0x7f2b04154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b0406c330 0x7f2b04154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47592/0 (socket says 172.21.15.88:47592) 2023-05-17T12:25:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b02ffd700 1 -- 172.21.15.88:0/1483392945 learned_addr learned my addr 172.21.15.88:0/1483392945 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2afbfff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b04154a50 0x7f2b040b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b037fe700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b040b8330 0x7f2b040b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b02ffd700 1 -- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b04154a50 msgr2=0x7f2b040b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b02ffd700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b04154a50 0x7f2b040b68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b02ffd700 1 -- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b040b8330 msgr2=0x7f2b040b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b02ffd700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b040b8330 0x7f2b040b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b02ffd700 1 -- 172.21.15.88:0/1483392945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b040cd900 con 0x7f2b0406c330 2023-05-17T12:25:44.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2afbfff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b04154a50 0x7f2b040b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:25:44.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b02ffd700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b0406c330 0x7f2b04154250 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2af000bd60 tx=0x7f2af4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:44.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2afb7fe700 1 -- 172.21.15.88:0/1483392945 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4004870 con 0x7f2b0406c330 2023-05-17T12:25:44.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2afb7fe700 1 -- 172.21.15.88:0/1483392945 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af40049f0 con 0x7f2b0406c330 2023-05-17T12:25:44.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b040b2740 con 0x7f2b0406c330 2023-05-17T12:25:44.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.739+0000 7f2afb7fe700 1 -- 172.21.15.88:0/1483392945 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4004da0 con 0x7f2b0406c330 2023-05-17T12:25:44.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.740+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b040cdbe0 con 0x7f2b0406c330 2023-05-17T12:25:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.741+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b04074530 con 0x7f2b0406c330 2023-05-17T12:25:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.741+0000 7f2afb7fe700 1 -- 172.21.15.88:0/1483392945 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2af40070d0 con 0x7f2b0406c330 2023-05-17T12:25:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.743+0000 7f2afb7fe700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2ae406ace0 0x7f2ae406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.743+0000 7f2afb7fe700 1 -- 172.21.15.88:0/1483392945 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2af408ab00 con 0x7f2b0406c330 2023-05-17T12:25:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.743+0000 7f2afbfff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2ae406ace0 0x7f2ae406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.744+0000 7f2afbfff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2ae406ace0 0x7f2ae406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b040c9800 tx=0x7f2aec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.747+0000 7f2afb7fe700 1 -- 172.21.15.88:0/1483392945 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2af4055910 con 0x7f2b0406c330 2023-05-17T12:25:44.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.983+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b04066350 con 0x7f2b0406c330 2023-05-17T12:25:44.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.984+0000 7f2afb7fe700 1 -- 172.21.15.88:0/1483392945 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f2af4058f30 con 0x7f2b0406c330 2023-05-17T12:25:44.987 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:25:44.987 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:30.331217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T12:25:44.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2ae406ace0 msgr2=0x7f2ae406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2ae406ace0 0x7f2ae406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b040c9800 tx=0x7f2aec008040 comp rx=0 tx=0).stop 2023-05-17T12:25:44.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b0406c330 msgr2=0x7f2b04154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b0406c330 0x7f2b04154250 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2af000bd60 tx=0x7f2af4000fe0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 shutdown_connections 2023-05-17T12:25:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2ae406ace0 0x7f2ae406d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b040b8330 0x7f2b040b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2b0406c330 0x7f2b04154250 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 --2- 172.21.15.88:0/1483392945 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b04154a50 0x7f2b040b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:44.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 >> 172.21.15.88:0/1483392945 conn(0x7f2b040d3060 msgr2=0x7f2b0406a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:44.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 shutdown_connections 2023-05-17T12:25:44.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:44.986+0000 7f2b097ff700 1 -- 172.21.15.88:0/1483392945 wait complete. 2023-05-17T12:25:44.991 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-05-17T12:25:45.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T12:25:01.775684+0000', 'modified': '2023-05-17T12:25:30.331217+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4314}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4314': {'gid': 4314, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6837/1857408255', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6835', 'nonce': 1857408255}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 1857408255}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-17T12:25:45.409 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T12:25:45.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-17T12:25:45.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.594+0000 7f32ffbff700 1 Processor -- start 2023-05-17T12:25:45.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.594+0000 7f32ffbff700 1 -- start start 2023-05-17T12:25:45.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.595+0000 7f32ffbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32f80d1bb0 0x7f32f80d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.595+0000 7f32ffbff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f32f815d990 0x7f32f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.595+0000 7f32ffbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f81574f0 con 0x7f32f80cf650 2023-05-17T12:25:45.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.595+0000 7f32ffbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f80cd800 con 0x7f32f80d1bb0 2023-05-17T12:25:45.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.595+0000 7f32ffbff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f80cd9e0 con 0x7f32f815d990 2023-05-17T12:25:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.595+0000 7f32fd99b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32f80d1bb0 0x7f32f80d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.595+0000 7f32fd99b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32f80d1bb0 0x7f32f80d1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47604/0 (socket says 172.21.15.88:47604) 2023-05-17T12:25:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.595+0000 7f32fd99b700 1 -- 172.21.15.88:0/3115770993 learned_addr learned my addr 172.21.15.88:0/3115770993 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.595+0000 7f32fe19c700 1 --2- 172.21.15.88:0/3115770993 >> v2:172.21.15.187:3300/0 conn(0x7f32f815d990 0x7f32f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.596+0000 7f32fd99b700 1 -- 172.21.15.88:0/3115770993 >> v2:172.21.15.187:3300/0 conn(0x7f32f815d990 msgr2=0x7f32f806c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:45.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.596+0000 7f32fd99b700 1 --2- 172.21.15.88:0/3115770993 >> v2:172.21.15.187:3300/0 conn(0x7f32f815d990 0x7f32f806c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.596+0000 7f32fd99b700 1 -- 172.21.15.88:0/3115770993 >> v1:172.21.15.187:6789/0 conn(0x7f32f80cf650 legacy=0x7f32f8160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.596+0000 7f32fd99b700 1 -- 172.21.15.88:0/3115770993 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80cdcc0 con 0x7f32f80d1bb0 2023-05-17T12:25:45.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.596+0000 7f32fd99b700 1 --2- 172.21.15.88:0/3115770993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d1bb0 0x7f32f80d1f80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f32f80cea20 tx=0x7f32f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bd8b70e525df2a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:45.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.596+0000 7f32fc999700 1 -- 172.21.15.88:0/3115770993 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4011830 con 0x7f32f80d1bb0 2023-05-17T12:25:45.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.596+0000 7f32fc999700 1 -- 172.21.15.88:0/3115770993 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f4011990 con 0x7f32f80d1bb0 2023-05-17T12:25:45.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.596+0000 7f32fc999700 1 -- 172.21.15.88:0/3115770993 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4011d20 con 0x7f32f80d1bb0 2023-05-17T12:25:45.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.597+0000 7f32ffbff700 1 -- 172.21.15.88:0/3115770993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d1bb0 msgr2=0x7f32f80d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.597+0000 7f32ffbff700 1 --2- 172.21.15.88:0/3115770993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d1bb0 0x7f32f80d1f80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f32f80cea20 tx=0x7f32f4009bd0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.597+0000 7f32ffbff700 1 -- 172.21.15.88:0/3115770993 shutdown_connections 2023-05-17T12:25:45.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.597+0000 7f32ffbff700 1 --2- 172.21.15.88:0/3115770993 >> v2:172.21.15.187:3300/0 conn(0x7f32f815d990 0x7f32f806c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.597+0000 7f32ffbff700 1 --2- 172.21.15.88:0/3115770993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d1bb0 0x7f32f80d1f80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.597+0000 7f32ffbff700 1 -- 172.21.15.88:0/3115770993 >> 172.21.15.88:0/3115770993 conn(0x7f32f80d3ed0 msgr2=0x7f32f80cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:45.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.597+0000 7f32ffbff700 1 -- 172.21.15.88:0/3115770993 shutdown_connections 2023-05-17T12:25:45.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.597+0000 7f32ffbff700 1 -- 172.21.15.88:0/3115770993 wait complete. 2023-05-17T12:25:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.598+0000 7f32ffbff700 1 Processor -- start 2023-05-17T12:25:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.599+0000 7f32ffbff700 1 -- start start 2023-05-17T12:25:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.599+0000 7f32ffbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80cf650 0x7f32f80c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32ffbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f80d1bb0 0x7f32f815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32ffbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32f815d990 0x7f32f814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32ffbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f814d410 con 0x7f32f80cf650 2023-05-17T12:25:45.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32ffbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f814d6f0 con 0x7f32f815d990 2023-05-17T12:25:45.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32ffbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f814d9d0 con 0x7f32f80d1bb0 2023-05-17T12:25:45.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32fd99b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80cf650 0x7f32f80c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32fd99b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80cf650 0x7f32f80c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47620/0 (socket says 172.21.15.88:47620) 2023-05-17T12:25:45.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32fd99b700 1 -- 172.21.15.88:0/4261551926 learned_addr learned my addr 172.21.15.88:0/4261551926 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:45.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32fd99b700 1 -- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f80d1bb0 msgr2=0x7f32f815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32fd99b700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f80d1bb0 0x7f32f815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32fd99b700 1 -- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32f815d990 msgr2=0x7f32f814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32fd99b700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32f815d990 0x7f32f814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32fd99b700 1 -- 172.21.15.88:0/4261551926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4009550 con 0x7f32f80cf650 2023-05-17T12:25:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.600+0000 7f32fd99b700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80cf650 0x7f32f80c69e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f32f4000c00 tx=0x7f32f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.601+0000 7f32ee7fc700 1 -- 172.21.15.88:0/4261551926 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40044f0 con 0x7f32f80cf650 2023-05-17T12:25:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.601+0000 7f32ee7fc700 1 -- 172.21.15.88:0/4261551926 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f401f070 con 0x7f32f80cf650 2023-05-17T12:25:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.601+0000 7f32ffbff700 1 -- 172.21.15.88:0/4261551926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f815d470 con 0x7f32f80cf650 2023-05-17T12:25:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.601+0000 7f32ee7fc700 1 -- 172.21.15.88:0/4261551926 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40038e0 con 0x7f32f80cf650 2023-05-17T12:25:45.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.601+0000 7f32ffbff700 1 -- 172.21.15.88:0/4261551926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f815d190 con 0x7f32f80cf650 2023-05-17T12:25:45.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.603+0000 7f32ee7fc700 1 -- 172.21.15.88:0/4261551926 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32f4021030 con 0x7f32f80cf650 2023-05-17T12:25:45.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.605+0000 7f32ee7fc700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32dc06ace0 0x7f32dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.605+0000 7f32ee7fc700 1 -- 172.21.15.88:0/4261551926 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32f408ac50 con 0x7f32f80cf650 2023-05-17T12:25:45.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.605+0000 7f32fd19a700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32dc06ace0 0x7f32dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.606+0000 7f32fd19a700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32dc06ace0 0x7f32dc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f32e8000f60 tx=0x7f32e8007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:45.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.607+0000 7f33134b3b80 1 Processor -- start 2023-05-17T12:25:45.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.607+0000 7f33134b3b80 1 -- start start 2023-05-17T12:25:45.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.608+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 0x5620247a9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.608+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.608+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 0x56202475cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.608+0000 7f33134b3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620246d5a50 con 0x562024778960 2023-05-17T12:25:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.608+0000 7f33134b3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56202464b600 con 0x56202475fe80 2023-05-17T12:25:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.608+0000 7f33134b3b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620246ba790 con 0x5620247a8f70 2023-05-17T12:25:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47636/0 (socket says 172.21.15.88:47636) 2023-05-17T12:25:45.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd19a700 1 -- 172.21.15.88:0/309027735 learned_addr learned my addr 172.21.15.88:0/309027735 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd99b700 1 --2- 172.21.15.88:0/309027735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 0x5620247a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fe19c700 1 --2- 172.21.15.88:0/309027735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 0x56202475cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd19a700 1 -- 172.21.15.88:0/309027735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 msgr2=0x5620247a9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:45.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd19a700 1 --2- 172.21.15.88:0/309027735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 0x5620247a9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd19a700 1 -- 172.21.15.88:0/309027735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 msgr2=0x56202475cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd19a700 1 --2- 172.21.15.88:0/309027735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 0x56202475cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd19a700 1 -- 172.21.15.88:0/309027735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620244a7790 con 0x562024778960 2023-05-17T12:25:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32fd19a700 1 --2- 172.21.15.88:0/309027735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a57b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f32e8016720 tx=0x7f32e800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df59dab18b01f86 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32db7fe700 1 -- 172.21.15.88:0/309027735 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e801b070 con 0x562024778960 2023-05-17T12:25:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32db7fe700 1 -- 172.21.15.88:0/309027735 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8016280 con 0x562024778960 2023-05-17T12:25:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.609+0000 7f32db7fe700 1 -- 172.21.15.88:0/309027735 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8005310 con 0x562024778960 2023-05-17T12:25:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.610+0000 7f33134b3b80 1 -- 172.21.15.88:0/309027735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 msgr2=0x5620247a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.610+0000 7f33134b3b80 1 --2- 172.21.15.88:0/309027735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a57b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f32e8016720 tx=0x7f32e800f000 comp rx=0 tx=0).stop 2023-05-17T12:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.610+0000 7f33134b3b80 1 -- 172.21.15.88:0/309027735 shutdown_connections 2023-05-17T12:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.610+0000 7f33134b3b80 1 --2- 172.21.15.88:0/309027735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 0x56202475cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.610+0000 7f33134b3b80 1 --2- 172.21.15.88:0/309027735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 0x5620247a9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.610+0000 7f33134b3b80 1 --2- 172.21.15.88:0/309027735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a57b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.610+0000 7f33134b3b80 1 -- 172.21.15.88:0/309027735 >> 172.21.15.88:0/309027735 conn(0x562024757480 msgr2=0x5620247a7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.610+0000 7f33134b3b80 1 -- 172.21.15.88:0/309027735 shutdown_connections 2023-05-17T12:25:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.610+0000 7f33134b3b80 1 -- 172.21.15.88:0/309027735 wait complete. 2023-05-17T12:25:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.611+0000 7f33134b3b80 1 -- start start 2023-05-17T12:25:45.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.611+0000 7f33134b3b80 1 Processor -- start 2023-05-17T12:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56202475fe80 0x5620247b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x562024778960 0x5620247780d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620247a8f70 0x5620247a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f33134b3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620246b3a60 con 0x56202475fe80 2023-05-17T12:25:45.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f33134b3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56202464fad0 con 0x5620247a8f70 2023-05-17T12:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f33134b3b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x56202464f770 con 0x562024778960 2023-05-17T12:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f33134b3b80 10 client.0 _ll_register_callbacks cb 0x5620246aba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T12:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f32fd99b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56202475fe80 0x5620247b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f32fd99b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56202475fe80 0x5620247b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47640/0 (socket says 172.21.15.88:47640) 2023-05-17T12:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.612+0000 7f32fd99b700 1 -- 172.21.15.88:0/3256167240 learned_addr learned my addr 172.21.15.88:0/3256167240 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32fe19c700 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620247a8f70 0x5620247a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32fd19a700 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x562024778960 0x5620247780d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32fd99b700 1 -- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x562024778960 msgr2=0x5620247780d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:45.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32fd99b700 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x562024778960 0x5620247780d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32fd99b700 1 -- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620247a8f70 msgr2=0x5620247a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:45.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32fd99b700 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620247a8f70 0x5620247a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32fd99b700 1 -- 172.21.15.88:0/3256167240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f81574f0 con 0x56202475fe80 2023-05-17T12:25:45.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32fd99b700 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56202475fe80 0x5620247b7750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009130 tx=0x7f32f40104f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904ed31a0cd1b315 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:45.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-05-17T12:25:45.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32d8ff9700 1 -- 172.21.15.88:0/3256167240 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4058e90 con 0x56202475fe80 2023-05-17T12:25:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32d8ff9700 1 -- 172.21.15.88:0/3256167240 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32f4061660 con 0x56202475fe80 2023-05-17T12:25:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f33134b3b80 1 -- 172.21.15.88:0/3256167240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562024754a90 con 0x56202475fe80 2023-05-17T12:25:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f32d8ff9700 1 -- 172.21.15.88:0/3256167240 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32f4061820 con 0x56202475fe80 2023-05-17T12:25:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f33134b3b80 10 client.4914 fetch_fsmap learned FSMap version 9 2023-05-17T12:25:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.613+0000 7f33134b3b80 1 -- 172.21.15.88:0/3256167240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56202467a2e0 con 0x56202475fe80 2023-05-17T12:25:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.614+0000 7f32d8ff9700 1 -- 172.21.15.88:0/3256167240 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562024754a90 con 0x56202475fe80 2023-05-17T12:25:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.614+0000 7f32d8ff9700 1 -- 172.21.15.88:0/3256167240 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f32f405ab90 con 0x56202475fe80 2023-05-17T12:25:45.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.614+0000 7f33134b3b80 10 client.4914 fetch_fsmap finished waiting for FSMap version 9 2023-05-17T12:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.614+0000 7f33134b3b80 10 client.4914 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T12:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.614+0000 7f33134b3b80 20 client.4914 populate_metadata read hostname 'smithi088' 2023-05-17T12:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.614+0000 7f33134b3b80 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x56202478b8d0 0x56202478bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.614+0000 7f33134b3b80 4 client.4914 mds_command: new command op to 4314 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T12:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.614+0000 7f33134b3b80 1 -- 172.21.15.88:0/3256167240 --> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620247314b0 con 0x56202478b8d0 2023-05-17T12:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.614+0000 7f32fd19a700 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x56202478b8d0 0x56202478bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.615+0000 7f32d8ff9700 10 client.4914 ms_handle_connect on v2:172.21.15.187:6835/1857408255 2023-05-17T12:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.615+0000 7f32fd19a700 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x56202478b8d0 0x56202478bca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73dadcb8fc38378f server_cookie=179205d48931c6c1 in_seq=0 out_seq=0 2023-05-17T12:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f32d8ff9700 1 -- 172.21.15.88:0/3256167240 <== mds.0 v2:172.21.15.187:6835/1857408255 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5620247314b0 con 0x56202478b8d0 2023-05-17T12:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f32d8ff9700 10 client.4914 handle_command_reply: tid=0 2023-05-17T12:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 client.4914 shutdown 2023-05-17T12:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 -- 172.21.15.88:0/3256167240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56202475fe80 msgr2=0x5620247b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56202475fe80 0x5620247b7750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009130 tx=0x7f32f40104f0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 -- 172.21.15.88:0/3256167240 shutdown_connections 2023-05-17T12:25:45.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x56202478b8d0 0x56202478bca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620247a8f70 0x5620247a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x56202475fe80 0x5620247b7750 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f32d8ff9700 0 client.4914 ms_handle_reset on v2:172.21.15.187:6835/1857408255 2023-05-17T12:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 --2- 172.21.15.88:0/3256167240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x562024778960 0x5620247780d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 -- 172.21.15.88:0/3256167240 >> 172.21.15.88:0/3256167240 conn(0x562024757480 msgr2=0x5620247a9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 -- 172.21.15.88:0/3256167240 shutdown_connections 2023-05-17T12:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.616+0000 7f33134b3b80 1 -- 172.21.15.88:0/3256167240 wait complete. 2023-05-17T12:25:45.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.617+0000 7f33134b3b80 20 client.4914 trim_cache size 0 max 16384 2023-05-17T12:25:45.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.634+0000 7f33134b3b80 1 Processor -- start 2023-05-17T12:25:45.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.634+0000 7f33134b3b80 1 -- start start 2023-05-17T12:25:45.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.635+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 0x56202475ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.635+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.635+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 0x562024762830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.635+0000 7f33134b3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620244a8390 con 0x562024778960 2023-05-17T12:25:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.635+0000 7f33134b3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620247a5400 con 0x56202475fe80 2023-05-17T12:25:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.635+0000 7f33134b3b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x56202475f180 con 0x5620247a8f70 2023-05-17T12:25:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.635+0000 7f32fd19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47656/0 (socket says 172.21.15.88:47656) 2023-05-17T12:25:45.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd19a700 1 -- 172.21.15.88:0/406848387 learned_addr learned my addr 172.21.15.88:0/406848387 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:45.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd99b700 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 0x56202475ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fe19c700 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 0x562024762830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd19a700 1 -- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 msgr2=0x562024762830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd19a700 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 0x562024762830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd19a700 1 -- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 msgr2=0x56202475ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd19a700 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 0x56202475ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd19a700 1 -- 172.21.15.88:0/406848387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56202467a030 con 0x562024778960 2023-05-17T12:25:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd99b700 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 0x56202475ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fe19c700 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 0x562024762830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:25:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32fd19a700 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a9d50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f32e8018040 tx=0x7f32e8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab7320a17914a99 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32dbfff700 1 -- 172.21.15.88:0/406848387 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8027070 con 0x562024778960 2023-05-17T12:25:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32dbfff700 1 -- 172.21.15.88:0/406848387 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8007ed0 con 0x562024778960 2023-05-17T12:25:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.636+0000 7f32dbfff700 1 -- 172.21.15.88:0/406848387 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e802b780 con 0x562024778960 2023-05-17T12:25:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.637+0000 7f33134b3b80 1 -- 172.21.15.88:0/406848387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 msgr2=0x5620247a9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.637+0000 7f33134b3b80 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a9d50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f32e8018040 tx=0x7f32e8011000 comp rx=0 tx=0).stop 2023-05-17T12:25:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.637+0000 7f33134b3b80 1 -- 172.21.15.88:0/406848387 shutdown_connections 2023-05-17T12:25:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.637+0000 7f33134b3b80 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5620247a8f70 0x562024762830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.637+0000 7f33134b3b80 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56202475fe80 0x56202475ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.637+0000 7f33134b3b80 1 --2- 172.21.15.88:0/406848387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562024778960 0x5620247a9d50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.637+0000 7f33134b3b80 1 -- 172.21.15.88:0/406848387 >> 172.21.15.88:0/406848387 conn(0x562024757480 msgr2=0x562024777ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.637+0000 7f33134b3b80 1 -- 172.21.15.88:0/406848387 shutdown_connections 2023-05-17T12:25:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.637+0000 7f33134b3b80 1 -- 172.21.15.88:0/406848387 wait complete. 2023-05-17T12:25:45.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.638+0000 7f33134b3b80 1 -- start start 2023-05-17T12:25:45.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.638+0000 7f33134b3b80 1 Processor -- start 2023-05-17T12:25:45.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56202475fe80 0x56202478e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562024778960 0x56202478c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f33134b3b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5620247a8f70 0x562024804d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f33134b3b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562024789a10 con 0x5620247a8f70 2023-05-17T12:25:45.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f33134b3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562024789e30 con 0x562024778960 2023-05-17T12:25:45.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f33134b3b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620247a5f10 con 0x56202475fe80 2023-05-17T12:25:45.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f33134b3b80 10 client.0 _ll_register_callbacks cb 0x5620246aba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T12:25:45.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f32fe19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5620247a8f70 0x562024804d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f32fe19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5620247a8f70 0x562024804d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47668/0 (socket says 172.21.15.88:47668) 2023-05-17T12:25:45.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f32fe19c700 1 -- 172.21.15.88:0/2169028573 learned_addr learned my addr 172.21.15.88:0/2169028573 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:45.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f32fd19a700 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562024778960 0x56202478c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.639+0000 7f32fd99b700 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56202475fe80 0x56202478e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32fe19c700 1 -- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56202475fe80 msgr2=0x56202478e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:45.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32fe19c700 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56202475fe80 0x56202478e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32fe19c700 1 -- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562024778960 msgr2=0x56202478c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:45.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32fe19c700 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562024778960 0x56202478c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32fe19c700 1 -- 172.21.15.88:0/2169028573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620244a7790 con 0x5620247a8f70 2023-05-17T12:25:45.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32fe19c700 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5620247a8f70 0x562024804d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f32f0004660 tx=0x7f32f0004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e95f42bf34c6fed server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:45.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-05-17T12:25:45.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32d8ff9700 1 -- 172.21.15.88:0/2169028573 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f000e040 con 0x5620247a8f70 2023-05-17T12:25:45.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32d8ff9700 1 -- 172.21.15.88:0/2169028573 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32f0007720 con 0x5620247a8f70 2023-05-17T12:25:45.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f33134b3b80 1 -- 172.21.15.88:0/2169028573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32e8016280 con 0x5620247a8f70 2023-05-17T12:25:45.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f32d8ff9700 1 -- 172.21.15.88:0/2169028573 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32f0007900 con 0x5620247a8f70 2023-05-17T12:25:45.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f33134b3b80 10 client.4920 fetch_fsmap learned FSMap version 9 2023-05-17T12:25:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.640+0000 7f33134b3b80 1 -- 172.21.15.88:0/2169028573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x562024660b10 con 0x5620247a8f70 2023-05-17T12:25:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.641+0000 7f32d8ff9700 1 -- 172.21.15.88:0/2169028573 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8016280 con 0x5620247a8f70 2023-05-17T12:25:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.641+0000 7f32d8ff9700 1 -- 172.21.15.88:0/2169028573 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f32f0007a60 con 0x5620247a8f70 2023-05-17T12:25:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.641+0000 7f33134b3b80 10 client.4920 fetch_fsmap finished waiting for FSMap version 9 2023-05-17T12:25:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.641+0000 7f33134b3b80 10 client.4920 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-17T12:25:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.641+0000 7f33134b3b80 20 client.4920 populate_metadata read hostname 'smithi088' 2023-05-17T12:25:45.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.641+0000 7f33134b3b80 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x5620247a5730 0x5620248052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:45.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.641+0000 7f33134b3b80 4 client.4920 mds_command: new command op to 4314 tid=0[{"prefix": "status"}] 2023-05-17T12:25:45.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.641+0000 7f33134b3b80 1 -- 172.21.15.88:0/2169028573 --> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5620246acba0 con 0x5620247a5730 2023-05-17T12:25:45.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.641+0000 7f32fd99b700 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x5620247a5730 0x5620248052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:45.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f32fd99b700 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x5620247a5730 0x5620248052c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9a6068cff5bcd8f server_cookie=98a5f3ef8bce79da in_seq=0 out_seq=0 2023-05-17T12:25:45.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f32d8ff9700 10 client.4920 ms_handle_connect on v2:172.21.15.187:6835/1857408255 2023-05-17T12:25:45.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f32d8ff9700 1 -- 172.21.15.88:0/2169028573 <== mds.0 v2:172.21.15.187:6835/1857408255 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5620246acba0 con 0x5620247a5730 2023-05-17T12:25:45.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f32d8ff9700 10 client.4920 handle_command_reply: tid=0 2023-05-17T12:25:45.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 client.4920 shutdown 2023-05-17T12:25:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 -- 172.21.15.88:0/2169028573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5620247a8f70 msgr2=0x562024804d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5620247a8f70 0x562024804d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f32f0004660 tx=0x7f32f0004970 comp rx=0 tx=0).stop 2023-05-17T12:25:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 -- 172.21.15.88:0/2169028573 shutdown_connections 2023-05-17T12:25:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5620247a8f70 0x562024804d80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x56202475fe80 0x56202478e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:6835/1857408255,v1:172.21.15.187:6837/1857408255] conn(0x5620247a5730 0x5620248052c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 --2- 172.21.15.88:0/2169028573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562024778960 0x56202478c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f32d8ff9700 0 client.4920 ms_handle_reset on v2:172.21.15.187:6835/1857408255 2023-05-17T12:25:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 -- 172.21.15.88:0/2169028573 >> 172.21.15.88:0/2169028573 conn(0x562024757480 msgr2=0x5620247a9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 -- 172.21.15.88:0/2169028573 shutdown_connections 2023-05-17T12:25:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 1 -- 172.21.15.88:0/2169028573 wait complete. 2023-05-17T12:25:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.642+0000 7f33134b3b80 20 client.4920 trim_cache size 0 max 16384 2023-05-17T12:25:45.653 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-05-17T12:25:45.654 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "5fe2c233-5aa8-47bb-8675-a47cef3664c7", 2023-05-17T12:25:45.654 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-05-17T12:25:45.654 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4314, 2023-05-17T12:25:45.654 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-05-17T12:25:45.654 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-05-17T12:25:45.654 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-05-17T12:25:45.654 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 43.864048078000003, 2023-05-17T12:25:45.655 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 9, 2023-05-17T12:25:45.655 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 29, 2023-05-17T12:25:45.655 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 27, 2023-05-17T12:25:45.655 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 49.708763099000002 2023-05-17T12:25:45.655 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-05-17T12:25:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 -- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32dc06ace0 msgr2=0x7f32dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32dc06ace0 0x7f32dc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f32e8000f60 tx=0x7f32e8007a40 comp rx=0 tx=0).stop 2023-05-17T12:25:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 -- 172.21.15.88:0/4261551926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80cf650 msgr2=0x7f32f80c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80cf650 0x7f32f80c69e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f32f4000c00 tx=0x7f32f4004750 comp rx=0 tx=0).stop 2023-05-17T12:25:45.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 -- 172.21.15.88:0/4261551926 shutdown_connections 2023-05-17T12:25:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32dc06ace0 0x7f32dc06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32f815d990 0x7f32f814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80cf650 0x7f32f80c69e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 --2- 172.21.15.88:0/4261551926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f80d1bb0 0x7f32f815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 -- 172.21.15.88:0/4261551926 >> 172.21.15.88:0/4261551926 conn(0x7f32f80d3ed0 msgr2=0x7f32f814f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 -- 172.21.15.88:0/4261551926 shutdown_connections 2023-05-17T12:25:45.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:45.643+0000 7f32ffbff700 1 -- 172.21.15.88:0/4261551926 wait complete. 2023-05-17T12:25:45.662 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-05-17T12:25:45.679 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-05-17T12:25:45.679 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-17T12:25:45.680 INFO:tasks.ceph_fuse:client.0 config is {} 2023-05-17T12:25:45.680 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-17T12:25:45.680 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T12:25:45.680 INFO:tasks.ceph_fuse:client.2 config is {} 2023-05-17T12:25:45.681 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-17T12:25:45.681 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-17T12:25:45.681 INFO:tasks.ceph_fuse:client.1 config is {} 2023-05-17T12:25:45.681 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-17T12:25:45.681 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-17T12:25:45.682 INFO:tasks.ceph_fuse:client.3 config is {} 2023-05-17T12:25:45.682 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-17T12:25:45.682 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-17T12:25:45.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:45.683 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-05-17T12:25:45.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:45.730 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-05-17T12:25:45.799 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-05-17T12:25:45.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T12:25:45.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:45.802 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-05-17T12:25:45.846 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-05-17T12:25:45.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:45.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-17T12:25:45.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:46.017 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-05-17T12:25:46.110 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-05-17T12:25:46.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T12:25:46.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.294+0000 7f7492bff700 1 Processor -- start 2023-05-17T12:25:46.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.294+0000 7f7492bff700 1 -- start start 2023-05-17T12:25:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.295+0000 7f7492bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f748c15cd70 0x7f748c167a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.295+0000 7f7492bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0ab8f0 con 0x7f748c15c9a0 2023-05-17T12:25:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.295+0000 7f7492bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c160870 con 0x7f748c071540 2023-05-17T12:25:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.295+0000 7f7492bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c1614f0 con 0x7f748c15cd70 2023-05-17T12:25:46.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.295+0000 7f749099b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f748c15c9a0 0x7f748c070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53720/0 (socket says 172.21.15.88:53720) 2023-05-17T12:25:46.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.295+0000 7f749099b700 1 -- 172.21.15.88:0/3129292282 learned_addr learned my addr 172.21.15.88:0/3129292282 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:46.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f749119c700 1 --2- 172.21.15.88:0/3129292282 >> v2:172.21.15.187:3300/0 conn(0x7f748c15cd70 0x7f748c167a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:46.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485134070 0 0) 0x7f748c0ab8f0 con 0x7f748c15c9a0 2023-05-17T12:25:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f747c0035b0 con 0x7f748c15c9a0 2023-05-17T12:25:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963368677 0 0) 0x7f748c160870 con 0x7f748c071540 2023-05-17T12:25:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f748c0ab8f0 con 0x7f748c071540 2023-05-17T12:25:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1345450418 0 0) 0x7f747c0035b0 con 0x7f748c15c9a0 2023-05-17T12:25:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 >> v2:172.21.15.187:3300/0 conn(0x7f748c15cd70 msgr2=0x7f748c167a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 --2- 172.21.15.88:0/3129292282 >> v2:172.21.15.187:3300/0 conn(0x7f748c15cd70 0x7f748c167a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 >> v1:172.21.15.187:6789/0 conn(0x7f748c071540 legacy=0x7f748c0adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c160b50 con 0x7f748c15c9a0 2023-05-17T12:25:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f7480001670 con 0x7f748c15c9a0 2023-05-17T12:25:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 >> v1:172.21.15.88:6789/0 conn(0x7f748c15c9a0 legacy=0x7f748c070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f747c003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f747c004850 0x7f747c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c0052c0 0x7f747c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:46.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c1614f0 con 0x7f747c003be0 2023-05-17T12:25:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c00c200 con 0x7f747c0052c0 2023-05-17T12:25:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c00c3c0 con 0x7f747c004850 2023-05-17T12:25:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.296+0000 7f749099b700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f747c003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f749119c700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c0052c0 0x7f747c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f748bfff700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f747c004850 0x7f747c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f749099b700 1 -- 172.21.15.88:0/3129292282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f747c004850 msgr2=0x7f747c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f749099b700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f747c004850 0x7f747c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f749099b700 1 -- 172.21.15.88:0/3129292282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c0052c0 msgr2=0x7f747c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:46.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f749099b700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f747c0052c0 0x7f747c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f749099b700 1 -- 172.21.15.88:0/3129292282 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0035b0 con 0x7f747c003be0 2023-05-17T12:25:46.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f749119c700 1 -- 172.21.15.88:0/3129292282 reap_dead start 2023-05-17T12:25:46.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f749099b700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f747c003fd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f748000c110 tx=0x7f747c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442d5abeea8cc18 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:46.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000ccb0 con 0x7f747c003be0 2023-05-17T12:25:46.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748000ce10 con 0x7f747c003be0 2023-05-17T12:25:46.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.297+0000 7f748b7fe700 1 -- 172.21.15.88:0/3129292282 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480005ba0 con 0x7f747c003be0 2023-05-17T12:25:46.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.298+0000 7f7492bff700 1 -- 172.21.15.88:0/3129292282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 msgr2=0x7f747c003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:46.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.298+0000 7f7492bff700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f747c003fd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f748000c110 tx=0x7f747c005880 comp rx=0 tx=0).stop 2023-05-17T12:25:46.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.298+0000 7f7492bff700 1 -- 172.21.15.88:0/3129292282 shutdown_connections 2023-05-17T12:25:46.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.298+0000 7f7492bff700 1 --2- 172.21.15.88:0/3129292282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f747c003fd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.298+0000 7f7492bff700 1 -- 172.21.15.88:0/3129292282 >> 172.21.15.88:0/3129292282 conn(0x7f748c0ced10 msgr2=0x7f748c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:46.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.298+0000 7f7492bff700 1 -- 172.21.15.88:0/3129292282 shutdown_connections 2023-05-17T12:25:46.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.298+0000 7f7492bff700 1 -- 172.21.15.88:0/3129292282 wait complete. 2023-05-17T12:25:46.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.300+0000 7f7492bff700 1 Processor -- start 2023-05-17T12:25:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.300+0000 7f7492bff700 1 -- start start 2023-05-17T12:25:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f7492bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f748c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f7492bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f748c0b25b0 0x7f748c15e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f7492bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748c0b2a20 0x7f748c15f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f7492bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0b3c40 con 0x7f747c003be0 2023-05-17T12:25:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f7492bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c15e0e0 con 0x7f748c0b25b0 2023-05-17T12:25:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f7492bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c15d1f0 con 0x7f748c0b2a20 2023-05-17T12:25:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f749099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f748c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f749099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f748c150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47686/0 (socket says 172.21.15.88:47686) 2023-05-17T12:25:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f749099b700 1 -- 172.21.15.88:0/3461930473 learned_addr learned my addr 172.21.15.88:0/3461930473 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f748bfff700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f748c0b25b0 0x7f748c15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.301+0000 7f749119c700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748c0b2a20 0x7f748c15f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f749099b700 1 -- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748c0b2a20 msgr2=0x7f748c15f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f749099b700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748c0b2a20 0x7f748c15f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f749099b700 1 -- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f748c0b25b0 msgr2=0x7f748c15e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f749099b700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f748c0b25b0 0x7f748c15e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f749099b700 1 -- 172.21.15.88:0/3461930473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c161110 con 0x7f747c003be0 2023-05-17T12:25:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f749099b700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f748c150b50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c1d0 tx=0x7f7480001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f74897fa700 1 -- 172.21.15.88:0/3461930473 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480004c80 con 0x7f747c003be0 2023-05-17T12:25:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f74897fa700 1 -- 172.21.15.88:0/3461930473 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7480004de0 con 0x7f747c003be0 2023-05-17T12:25:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c160e30 con 0x7f747c003be0 2023-05-17T12:25:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f74897fa700 1 -- 172.21.15.88:0/3461930473 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480007310 con 0x7f747c003be0 2023-05-17T12:25:46.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.302+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c070e30 con 0x7f747c003be0 2023-05-17T12:25:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.303+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c074530 con 0x7f747c003be0 2023-05-17T12:25:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.304+0000 7f74897fa700 1 -- 172.21.15.88:0/3461930473 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7480007470 con 0x7f747c003be0 2023-05-17T12:25:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.305+0000 7f74897fa700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f747006ace0 0x7f747006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:46.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.305+0000 7f74897fa700 1 -- 172.21.15.88:0/3461930473 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7480089f40 con 0x7f747c003be0 2023-05-17T12:25:46.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.306+0000 7f748bfff700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f747006ace0 0x7f747006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:46.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.306+0000 7f748bfff700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f747006ace0 0x7f747006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f748c1548d0 tx=0x7f7478009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:46.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.309+0000 7f74897fa700 1 -- 172.21.15.88:0/3461930473 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7480054cd0 con 0x7f747c003be0 2023-05-17T12:25:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.548+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f748c06bce0 con 0x7f747c003be0 2023-05-17T12:25:46.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.549+0000 7f74897fa700 1 -- 172.21.15.88:0/3461930473 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f74800582f0 con 0x7f747c003be0 2023-05-17T12:25:46.552 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-17T12:25:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f747006ace0 msgr2=0x7f747006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:46.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f747006ace0 0x7f747006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f748c1548d0 tx=0x7f7478009040 comp rx=0 tx=0).stop 2023-05-17T12:25:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 msgr2=0x7f748c150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f748c150b50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c1d0 tx=0x7f7480001930 comp rx=0 tx=0).stop 2023-05-17T12:25:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 shutdown_connections 2023-05-17T12:25:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f747006ace0 0x7f747006d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748c0b2a20 0x7f748c15f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f747c003be0 0x7f748c150b50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 --2- 172.21.15.88:0/3461930473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f748c0b25b0 0x7f748c15e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:46.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 >> 172.21.15.88:0/3461930473 conn(0x7f748c0ced10 msgr2=0x7f748c0cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:46.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.551+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 shutdown_connections 2023-05-17T12:25:46.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:46.552+0000 7f7492bff700 1 -- 172.21.15.88:0/3461930473 wait complete. 2023-05-17T12:25:46.571 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T12:25:46.572 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T12:25:46.572 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-05-17T12:25:46.573 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T12:25:46.573 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T12:25:46.573 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T12:25:46.573 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T12:25:46.574 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T12:25:46.574 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T12:25:46.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:46.575 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-05-17T12:25:46.617 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:25:46.618 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:25:46.618 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:25:46.618 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:46.618 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-05-17T12:25:46.618 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:46.618 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:46.619 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:46.619 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-05-17T12:25:46.619 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:46.619 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:46.619 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-05-17T12:25:46.619 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:46.619 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:46.619 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T12:25:46.620 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:46.620 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-17T12:25:46.620 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42144sec preferred_lft 42144sec 2023-05-17T12:25:46.620 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-05-17T12:25:46.620 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:46.621 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-17T12:25:46.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:46.622 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:46.622 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:46.622 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-05-17T12:25:46.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-05-17T12:25:46.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-05-17T12:25:46.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-17T12:25:46.623 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:46.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:46.839 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T12:25:46.900 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-05-17T12:25:46.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:46.903 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-05-17T12:25:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-05-17T12:25:46.947 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T12:25:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-17T12:25:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-17T12:25:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T12:25:46.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:46.949 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:46.949 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:46.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-17T12:25:46.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-17T12:25:46.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-17T12:25:46.950 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:47.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:47.138 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-05-17T12:25:47.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:47.181 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-05-17T12:25:47.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:47.263 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:47.263 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:47.263 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T12:25:47.263 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-17T12:25:47.263 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:47.428 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-17T12:25:47.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:47.429 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:47.429 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:47.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-17T12:25:47.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-17T12:25:47.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-17T12:25:47.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-17T12:25:47.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-17T12:25:47.431 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:47.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:47.654 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:47.654 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:47.654 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-05-17T12:25:47.654 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-05-17T12:25:47.654 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:47.819 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-17T12:25:47.820 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:47.820 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-17T12:25:47.861 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-17T12:25:47.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:47.862 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-17T12:25:47.942 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-05-17T12:25:48.045 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:48.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:48.107 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:48.109 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:48.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:48.110 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-05-17T12:25:48.151 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-17T12:25:48.151 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-17T12:25:48.194 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-05-17T12:25:48.257 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:48.258 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:48.321 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:48.322 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:48.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:48.323 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-05-17T12:25:48.349 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2023-05-17T12:25:48.346+0000 7f4794f6a5c0 -1 init, newargv = 0x5564607500c0 newargc=15 2023-05-17T12:25:48.349 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[145257]: starting ceph client 2023-05-17T12:25:48.357 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[145257]: starting fuse 2023-05-17T12:25:48.367 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-05-17T12:25:48.367 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-05-17T12:25:48.368 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T12:25:48.368 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-05-17T12:25:48.368 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-05-17T12:25:48.368 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-05-17T12:25:48.369 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-05-17T12:25:48.369 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:48.369 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-05-17T12:25:48.369 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-17T12:25:48.370 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-05-17T12:25:48.370 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-17T12:25:48.370 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:48.370 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-05-17T12:25:48.370 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-05-17T12:25:48.371 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-05-17T12:25:48.371 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-05-17T12:25:48.371 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:48.371 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-05-17T12:25:48.372 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T12:25:48.372 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T12:25:48.372 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T12:25:48.372 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-05-17T12:25:48.373 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-05-17T12:25:48.373 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-05-17T12:25:48.373 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T12:25:48.373 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:48.373 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.0")) 2023-05-17T12:25:48.374 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-05-17T12:25:48.543 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.145257.asok 2023-05-17T12:25:48.721 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.145257.asok 2023-05-17T12:25:48.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:48.721 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.145257.asok status 2023-05-17T12:25:48.935 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-05-17T12:25:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-05-17T12:25:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb", 2023-05-17T12:25:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev)", 2023-05-17T12:25:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2023-05-17T12:25:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-05-17T12:25:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-17T12:25:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "145257", 2023-05-17T12:25:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-05-17T12:25:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-05-17T12:25:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-05-17T12:25:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4935, 2023-05-17T12:25:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-05-17T12:25:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-05-17T12:25:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-05-17T12:25:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4935 2023-05-17T12:25:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-05-17T12:25:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-05-17T12:25:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-05-17T12:25:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 3057539141 2023-05-17T12:25:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:25:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-05-17T12:25:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-05-17T12:25:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-05-17T12:25:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 3057539141 2023-05-17T12:25:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4935 192.168.0.1:0/3057539141", 2023-05-17T12:25:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/3057539141", 2023-05-17T12:25:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-05-17T12:25:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 9, 2023-05-17T12:25:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 29, 2023-05-17T12:25:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-05-17T12:25:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-05-17T12:25:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-05-17T12:25:48.941 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-05-17T12:25:48.948 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T12:25:49.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.130+0000 7f56d55ff700 1 Processor -- start 2023-05-17T12:25:49.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.131+0000 7f56d55ff700 1 -- start start 2023-05-17T12:25:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56d55ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f56d006b0b0 0x7f56d006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56d55ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d00cd6b0 con 0x7f56d006c330 2023-05-17T12:25:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56d55ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d00b2460 con 0x7f56d015c840 2023-05-17T12:25:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56d55ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d00cdf50 con 0x7f56d006b0b0 2023-05-17T12:25:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56c7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f56d006b0b0 0x7f56d006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56cf7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f56d006c330 0x7f56d0160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53732/0 (socket says 172.21.15.88:53732) 2023-05-17T12:25:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56cf7fe700 1 -- 172.21.15.88:0/1752758893 learned_addr learned my addr 172.21.15.88:0/1752758893 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56c7fff700 1 -- 172.21.15.88:0/1752758893 >> v1:172.21.15.187:6789/0 conn(0x7f56d015c840 legacy=0x7f56d00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56c7fff700 1 -- 172.21.15.88:0/1752758893 >> v1:172.21.15.88:6789/0 conn(0x7f56d006c330 legacy=0x7f56d0160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.132+0000 7f56c7fff700 1 -- 172.21.15.88:0/1752758893 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d00b2740 con 0x7f56d006b0b0 2023-05-17T12:25:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.133+0000 7f56c7fff700 1 --2- 172.21.15.88:0/1752758893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d006b0b0 0x7f56d006b940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f56b8009840 tx=0x7f56b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe859c7ff1b9dc8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.133+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1752758893 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8004230 con 0x7f56d006b0b0 2023-05-17T12:25:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.133+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1752758893 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b8004390 con 0x7f56d006b0b0 2023-05-17T12:25:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.133+0000 7f56ce7fc700 1 -- 172.21.15.88:0/1752758893 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b80036a0 con 0x7f56d006b0b0 2023-05-17T12:25:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.133+0000 7f56d55ff700 1 -- 172.21.15.88:0/1752758893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d006b0b0 msgr2=0x7f56d006b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.133+0000 7f56d55ff700 1 --2- 172.21.15.88:0/1752758893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d006b0b0 0x7f56d006b940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f56b8009840 tx=0x7f56b8009b50 comp rx=0 tx=0).stop 2023-05-17T12:25:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.133+0000 7f56d55ff700 1 -- 172.21.15.88:0/1752758893 shutdown_connections 2023-05-17T12:25:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.133+0000 7f56d55ff700 1 --2- 172.21.15.88:0/1752758893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d006b0b0 0x7f56d006b940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.133+0000 7f56d55ff700 1 -- 172.21.15.88:0/1752758893 >> 172.21.15.88:0/1752758893 conn(0x7f56d00d3060 msgr2=0x7f56d00d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.134+0000 7f56d55ff700 1 -- 172.21.15.88:0/1752758893 shutdown_connections 2023-05-17T12:25:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.134+0000 7f56d55ff700 1 -- 172.21.15.88:0/1752758893 wait complete. 2023-05-17T12:25:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.135+0000 7f56d55ff700 1 Processor -- start 2023-05-17T12:25:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.135+0000 7f56d55ff700 1 -- start start 2023-05-17T12:25:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.136+0000 7f56d55ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56d006b0b0 0x7f56d015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.136+0000 7f56d55ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56d006c330 0x7f56d014c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.136+0000 7f56d55ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d015c840 0x7f56d00b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.136+0000 7f56d55ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d015d3a0 con 0x7f56d015c840 2023-05-17T12:25:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.136+0000 7f56d55ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d014ca40 con 0x7f56d006b0b0 2023-05-17T12:25:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.136+0000 7f56d55ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d015a300 con 0x7f56d006c330 2023-05-17T12:25:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.136+0000 7f56cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d015c840 0x7f56d00b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56cf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d015c840 0x7f56d00b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47698/0 (socket says 172.21.15.88:47698) 2023-05-17T12:25:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56cf7fe700 1 -- 172.21.15.88:0/3359231632 learned_addr learned my addr 172.21.15.88:0/3359231632 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56ceffd700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56d006b0b0 0x7f56d015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56c7fff700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56d006c330 0x7f56d014c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:49.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56cf7fe700 1 -- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56d006c330 msgr2=0x7f56d014c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56cf7fe700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56d006c330 0x7f56d014c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56cf7fe700 1 -- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56d006b0b0 msgr2=0x7f56d015ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56cf7fe700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56d006b0b0 0x7f56d015ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56cf7fe700 1 -- 172.21.15.88:0/3359231632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b80094a0 con 0x7f56d015c840 2023-05-17T12:25:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56cf7fe700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d015c840 0x7f56d00b4c10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f56c800cbc0 tx=0x7f56c800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56c77fe700 1 -- 172.21.15.88:0/3359231632 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c800a9e0 con 0x7f56d015c840 2023-05-17T12:25:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56c77fe700 1 -- 172.21.15.88:0/3359231632 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c800ab40 con 0x7f56d015c840 2023-05-17T12:25:49.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d00cdbe0 con 0x7f56d015c840 2023-05-17T12:25:49.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.137+0000 7f56c77fe700 1 -- 172.21.15.88:0/3359231632 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8012400 con 0x7f56d015c840 2023-05-17T12:25:49.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.138+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d00cd900 con 0x7f56d015c840 2023-05-17T12:25:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.139+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d015cc10 con 0x7f56d015c840 2023-05-17T12:25:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.140+0000 7f56c77fe700 1 -- 172.21.15.88:0/3359231632 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56c801b3b0 con 0x7f56d015c840 2023-05-17T12:25:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.141+0000 7f56c77fe700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56b006ace0 0x7f56b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.141+0000 7f56c77fe700 1 -- 172.21.15.88:0/3359231632 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f56c8089360 con 0x7f56d015c840 2023-05-17T12:25:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.141+0000 7f56ceffd700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56b006ace0 0x7f56b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:49.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.142+0000 7f56ceffd700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56b006ace0 0x7f56b006d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56c0007fd0 tx=0x7f56c0007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:49.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.145+0000 7f56c77fe700 1 -- 172.21.15.88:0/3359231632 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f56c80540f0 con 0x7f56d015c840 2023-05-17T12:25:49.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.383+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56d0074530 con 0x7f56d015c840 2023-05-17T12:25:49.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.383+0000 7f56c77fe700 1 -- 172.21.15.88:0/3359231632 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f56c8057710 con 0x7f56d015c840 2023-05-17T12:25:49.387 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-17T12:25:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56b006ace0 msgr2=0x7f56b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56b006ace0 0x7f56b006d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f56c0007fd0 tx=0x7f56c0007ec0 comp rx=0 tx=0).stop 2023-05-17T12:25:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d015c840 msgr2=0x7f56d00b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d015c840 0x7f56d00b4c10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f56c800cbc0 tx=0x7f56c800ced0 comp rx=0 tx=0).stop 2023-05-17T12:25:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 shutdown_connections 2023-05-17T12:25:49.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56b006ace0 0x7f56b006d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d015c840 0x7f56d00b4c10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56d006b0b0 0x7f56d015ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 --2- 172.21.15.88:0/3359231632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56d006c330 0x7f56d014c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 >> 172.21.15.88:0/3359231632 conn(0x7f56d00d3060 msgr2=0x7f56d006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 shutdown_connections 2023-05-17T12:25:49.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:49.386+0000 7f56d55ff700 1 -- 172.21.15.88:0/3359231632 wait complete. 2023-05-17T12:25:49.405 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T12:25:49.406 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T12:25:49.406 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-05-17T12:25:49.406 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-17T12:25:49.406 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-17T12:25:49.406 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T12:25:49.407 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T12:25:49.407 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T12:25:49.407 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-17T12:25:49.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:49.408 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-05-17T12:25:49.450 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:25:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:25:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:25:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-05-17T12:25:49.450 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:49.451 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-05-17T12:25:49.451 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:49.451 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-05-17T12:25:49.451 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:49.452 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T12:25:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-17T12:25:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42141sec preferred_lft 42141sec 2023-05-17T12:25:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-05-17T12:25:49.452 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:49.452 INFO:teuthology.orchestra.run.smithi088.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T12:25:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 2e:41:a6:3f:56:eb brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T12:25:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::cc3f:4cff:fe8d:24eb/64 scope link 2023-05-17T12:25:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:49.453 INFO:teuthology.orchestra.run.smithi088.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T12:25:49.453 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 2e:41:a6:3f:56:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T12:25:49.454 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::2c41:a6ff:fe3f:56eb/64 scope link tentative 2023-05-17T12:25:49.454 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:49.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:49.455 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T12:25:49.557 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-05-17T12:25:49.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:49.560 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-05-17T12:25:49.604 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-05-17T12:25:49.605 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T12:25:49.605 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-17T12:25:49.605 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-17T12:25:49.605 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T12:25:49.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:49.606 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:49.607 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:49.608 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-17T12:25:49.608 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-17T12:25:49.608 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-17T12:25:49.608 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:49.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:49.795 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-05-17T12:25:49.838 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T12:25:49.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:49.839 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-05-17T12:25:49.920 INFO:teuthology.orchestra.run.smithi088.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-17T12:25:49.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:49.923 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:49.923 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:49.924 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T12:25:49.925 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-17T12:25:49.925 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:50.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:50.090 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-17T12:25:50.154 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:25:50.154 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:25:50.154 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:25:50.155 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:50.155 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-05-17T12:25:50.155 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:50.156 INFO:teuthology.orchestra.run.smithi088.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T12:25:50.156 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0a:67:58:c4:9a:33 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T12:25:50.156 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T12:25:50.157 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:50.157 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::867:58ff:fec4:9a33/64 scope link 2023-05-17T12:25:50.157 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:50.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:50.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-17T12:25:50.224 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:25:50.224 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:25:50.225 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:25:50.225 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:50.225 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-05-17T12:25:50.225 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:50.226 INFO:teuthology.orchestra.run.smithi088.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T12:25:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0a:67:58:c4:9a:33 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T12:25:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T12:25:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:50.226 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::867:58ff:fec4:9a33/64 scope link 2023-05-17T12:25:50.227 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:50.227 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-17T12:25:50.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:50.228 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:50.229 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:50.229 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-17T12:25:50.229 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-17T12:25:50.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-17T12:25:50.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-17T12:25:50.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-17T12:25:50.230 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:50.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:50.456 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:25:50.456 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:25:50.456 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.1 up 2023-05-17T12:25:50.457 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.1 master ceph-brx 2023-05-17T12:25:50.457 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:25:50.623 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-05-17T12:25:50.624 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:50.624 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-17T12:25:50.665 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-17T12:25:50.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:50.666 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-17T12:25:50.746 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-05-17T12:25:50.850 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:50.851 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:50.912 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:50.914 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:50.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:50.915 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-05-17T12:25:50.957 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-05-17T12:25:50.957 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-05-17T12:25:50.957 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-05-17T12:25:51.000 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-05-17T12:25:51.064 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:51.064 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:51.126 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:51.128 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:51.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:51.129 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-05-17T12:25:51.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi088.stderr:2023-05-17T12:25:51.154+0000 7fbe089df5c0 -1 init, newargv = 0x562a3dcf9370 newargc=15 2023-05-17T12:25:51.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi088.stderr:ceph-fuse[145981]: starting ceph client 2023-05-17T12:25:51.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi088.stderr:ceph-fuse[145981]: starting fuse 2023-05-17T12:25:51.173 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-05-17T12:25:51.173 INFO:teuthology.orchestra.run.smithi088.stdout:44 2023-05-17T12:25:51.174 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-05-17T12:25:51.174 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T12:25:51.174 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-05-17T12:25:51.175 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-05-17T12:25:51.175 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-05-17T12:25:51.175 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-05-17T12:25:51.175 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:51.176 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-05-17T12:25:51.176 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-05-17T12:25:51.176 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-05-17T12:25:51.176 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-05-17T12:25:51.177 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:51.177 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-05-17T12:25:51.177 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-05-17T12:25:51.177 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-05-17T12:25:51.178 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-05-17T12:25:51.178 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:51.178 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-05-17T12:25:51.178 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T12:25:51.179 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T12:25:51.179 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T12:25:51.179 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-05-17T12:25:51.179 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-05-17T12:25:51.180 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-05-17T12:25:51.180 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T12:25:51.180 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:25:51.180 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.2")) 2023-05-17T12:25:51.180 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-05-17T12:25:51.348 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.2.145981.asok 2023-05-17T12:25:51.526 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.145981.asok 2023-05-17T12:25:51.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:51.527 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.145981.asok status 2023-05-17T12:25:51.739 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-05-17T12:25:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-05-17T12:25:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb", 2023-05-17T12:25:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev)", 2023-05-17T12:25:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "2", 2023-05-17T12:25:51.740 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-05-17T12:25:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-05-17T12:25:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "145981", 2023-05-17T12:25:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-05-17T12:25:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-05-17T12:25:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-05-17T12:25:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4950, 2023-05-17T12:25:51.741 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-05-17T12:25:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-05-17T12:25:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-05-17T12:25:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4950 2023-05-17T12:25:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-05-17T12:25:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-05-17T12:25:51.742 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.2:0", 2023-05-17T12:25:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1417739044 2023-05-17T12:25:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:25:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-05-17T12:25:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-05-17T12:25:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.2:0", 2023-05-17T12:25:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1417739044 2023-05-17T12:25:51.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:25:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4950 192.168.0.2:0/1417739044", 2023-05-17T12:25:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.2:0/1417739044", 2023-05-17T12:25:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-05-17T12:25:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 9, 2023-05-17T12:25:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 29, 2023-05-17T12:25:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-05-17T12:25:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-05-17T12:25:51.744 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-05-17T12:25:51.745 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-05-17T12:25:51.753 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T12:25:51.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.933+0000 7f8814fff700 1 Processor -- start 2023-05-17T12:25:51.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.933+0000 7f8814fff700 1 -- start start 2023-05-17T12:25:51.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.934+0000 7f8814fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f881006b0b0 0x7f881006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:51.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.935+0000 7f8814fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88100cd6b0 con 0x7f881015c840 2023-05-17T12:25:51.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.935+0000 7f8814fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88100b2460 con 0x7f881006c330 2023-05-17T12:25:51.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.935+0000 7f8814fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88100cdf50 con 0x7f881006b0b0 2023-05-17T12:25:51.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.935+0000 7f880e59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f881015c840 0x7f88100cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57486/0 (socket says 172.21.15.88:57486) 2023-05-17T12:25:51.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.935+0000 7f880e59c700 1 -- 172.21.15.88:0/28674200 learned_addr learned my addr 172.21.15.88:0/28674200 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:51.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.935+0000 7f8807fff700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f881006b0b0 0x7f881006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:51.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.935+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24520931 0 0) 0x7f88100cd6b0 con 0x7f881015c840 2023-05-17T12:25:51.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.935+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87fc0035b0 con 0x7f881015c840 2023-05-17T12:25:51.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.935+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1316461188 0 0) 0x7f87fc0035b0 con 0x7f881015c840 2023-05-17T12:25:51.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f881006b0b0 msgr2=0x7f881006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:51.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f881006b0b0 0x7f881006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:51.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 >> v1:172.21.15.187:6789/0 conn(0x7f881006c330 legacy=0x7f8810160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:51.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100b2740 con 0x7f881015c840 2023-05-17T12:25:51.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f8800001670 con 0x7f881015c840 2023-05-17T12:25:51.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 >> v1:172.21.15.88:6789/0 conn(0x7f881015c840 legacy=0x7f88100cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:51.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f881006b0b0 0x7f87fc003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:51.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004000 0x7f87fc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:51.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87fc004d90 0x7f87fc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:51.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc00bba0 con 0x7f87fc004d90 2023-05-17T12:25:51.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc00bd10 con 0x7f87fc004000 2023-05-17T12:25:51.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc00bed0 con 0x7f881006b0b0 2023-05-17T12:25:51.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880ed9d700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87fc004d90 0x7f87fc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:51.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f8807fff700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004000 0x7f87fc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:51.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880e59c700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f881006b0b0 0x7f87fc003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:51.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880ed9d700 1 -- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f881006b0b0 msgr2=0x7f87fc003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:51.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880ed9d700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f881006b0b0 0x7f87fc003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:51.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880ed9d700 1 -- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004000 msgr2=0x7f87fc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:25:51.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880ed9d700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004000 0x7f87fc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:51.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.936+0000 7f880ed9d700 1 -- 172.21.15.88:0/28674200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0035b0 con 0x7f87fc004d90 2023-05-17T12:25:51.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.937+0000 7f880ed9d700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87fc004d90 0x7f87fc005200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f880800c190 tx=0x7f87fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4572a3ef3d07fdeb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:51.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.937+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808001db0 con 0x7f87fc004d90 2023-05-17T12:25:51.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.937+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880800ccd0 con 0x7f87fc004d90 2023-05-17T12:25:51.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.937+0000 7f880dd9b700 1 -- 172.21.15.88:0/28674200 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808003c40 con 0x7f87fc004d90 2023-05-17T12:25:51.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.937+0000 7f8814fff700 1 -- 172.21.15.88:0/28674200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87fc004d90 msgr2=0x7f87fc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:51.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.937+0000 7f8814fff700 1 --2- 172.21.15.88:0/28674200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87fc004d90 0x7f87fc005200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f880800c190 tx=0x7f87fc005880 comp rx=0 tx=0).stop 2023-05-17T12:25:51.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.937+0000 7f880ed9d700 1 -- 172.21.15.88:0/28674200 reap_dead start 2023-05-17T12:25:51.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.937+0000 7f8814fff700 1 -- 172.21.15.88:0/28674200 shutdown_connections 2023-05-17T12:25:51.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.938+0000 7f8814fff700 1 -- 172.21.15.88:0/28674200 >> 172.21.15.88:0/28674200 conn(0x7f88100d3060 msgr2=0x7f88100d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:51.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.938+0000 7f8814fff700 1 -- 172.21.15.88:0/28674200 shutdown_connections 2023-05-17T12:25:51.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.938+0000 7f8814fff700 1 -- 172.21.15.88:0/28674200 wait complete. 2023-05-17T12:25:51.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.939+0000 7f8814fff700 1 Processor -- start 2023-05-17T12:25:51.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.939+0000 7f8814fff700 1 -- start start 2023-05-17T12:25:51.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.940+0000 7f8814fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004d90 0x7f88101f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:51.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.940+0000 7f8814fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88100b2a20 0x7f88100c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:51.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.940+0000 7f8814fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88100b4030 0x7f88100c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:51.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.940+0000 7f8814fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881014e010 con 0x7f88100b4030 2023-05-17T12:25:51.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.940+0000 7f8814fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88100c7ff0 con 0x7f87fc004d90 2023-05-17T12:25:51.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.940+0000 7f8814fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88100b3ba0 con 0x7f88100b2a20 2023-05-17T12:25:51.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88100b4030 0x7f88100c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:51.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004d90 0x7f88101f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:51.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004d90 0x7f88101f1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:58412/0 (socket says 172.21.15.88:58412) 2023-05-17T12:25:51.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880e59c700 1 -- 172.21.15.88:0/803329621 learned_addr learned my addr 172.21.15.88:0/803329621 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:51.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f8807fff700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88100b2a20 0x7f88100c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:51.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880ed9d700 1 -- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88100b2a20 msgr2=0x7f88100c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:51.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880ed9d700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88100b2a20 0x7f88100c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:51.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880ed9d700 1 -- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004d90 msgr2=0x7f88101f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:51.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880ed9d700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004d90 0x7f88101f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:51.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880ed9d700 1 -- 172.21.15.88:0/803329621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100cdbe0 con 0x7f88100b4030 2023-05-17T12:25:51.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880e59c700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004d90 0x7f88101f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:25:51.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.941+0000 7f880ed9d700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88100b4030 0x7f88100c82f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f880800c160 tx=0x7f88080014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:51.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.942+0000 7f8806ffd700 1 -- 172.21.15.88:0/803329621 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88080050d0 con 0x7f88100b4030 2023-05-17T12:25:51.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.942+0000 7f8806ffd700 1 -- 172.21.15.88:0/803329621 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808005250 con 0x7f88100b4030 2023-05-17T12:25:51.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.942+0000 7f8806ffd700 1 -- 172.21.15.88:0/803329621 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808005400 con 0x7f88100b4030 2023-05-17T12:25:51.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.942+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88100cd900 con 0x7f88100b4030 2023-05-17T12:25:51.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.942+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881015cc10 con 0x7f88100b4030 2023-05-17T12:25:51.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.943+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8810074530 con 0x7f88100b4030 2023-05-17T12:25:51.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.944+0000 7f8806ffd700 1 -- 172.21.15.88:0/803329621 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8808019070 con 0x7f88100b4030 2023-05-17T12:25:51.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.945+0000 7f8806ffd700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f87f006ace0 0x7f87f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:51.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.945+0000 7f8806ffd700 1 -- 172.21.15.88:0/803329621 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f880808a490 con 0x7f88100b4030 2023-05-17T12:25:51.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.945+0000 7f880e59c700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f87f006ace0 0x7f87f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:51.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.946+0000 7f880e59c700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f87f006ace0 0x7f87f006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f88000017a0 tx=0x7f8800000ff0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:51.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:51.948+0000 7f8806ffd700 1 -- 172.21.15.88:0/803329621 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f88080553a0 con 0x7f88100b4030 2023-05-17T12:25:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.188+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88100b3ce0 con 0x7f88100b4030 2023-05-17T12:25:52.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.188+0000 7f8806ffd700 1 -- 172.21.15.88:0/803329621 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8808017070 con 0x7f88100b4030 2023-05-17T12:25:52.193 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-17T12:25:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.190+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f87f006ace0 msgr2=0x7f87f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.190+0000 7f8814fff700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f87f006ace0 0x7f87f006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f88000017a0 tx=0x7f8800000ff0 comp rx=0 tx=0).stop 2023-05-17T12:25:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.190+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88100b4030 msgr2=0x7f88100c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.190+0000 7f8814fff700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88100b4030 0x7f88100c82f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f880800c160 tx=0x7f88080014a0 comp rx=0 tx=0).stop 2023-05-17T12:25:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.191+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 shutdown_connections 2023-05-17T12:25:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.191+0000 7f8814fff700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f87f006ace0 0x7f87f006d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.191+0000 7f8814fff700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88100b4030 0x7f88100c82f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.191+0000 7f8814fff700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87fc004d90 0x7f88101f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.191+0000 7f8814fff700 1 --2- 172.21.15.88:0/803329621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88100b2a20 0x7f88100c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.191+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 >> 172.21.15.88:0/803329621 conn(0x7f88100d3060 msgr2=0x7f881006c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.191+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 shutdown_connections 2023-05-17T12:25:52.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:52.191+0000 7f8814fff700 1 -- 172.21.15.88:0/803329621 wait complete. 2023-05-17T12:25:52.212 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T12:25:52.212 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T12:25:52.212 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-05-17T12:25:52.213 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-17T12:25:52.213 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-17T12:25:52.213 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T12:25:52.213 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T12:25:52.213 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T12:25:52.213 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-17T12:25:52.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:52.214 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-05-17T12:25:52.261 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:25:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:25:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:25:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:52.262 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-05-17T12:25:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:52.263 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:52.263 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-05-17T12:25:52.263 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-05-17T12:25:52.264 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:52.264 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:52.265 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T12:25:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-17T12:25:52.265 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42130sec preferred_lft 42130sec 2023-05-17T12:25:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-05-17T12:25:52.266 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:52.267 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-17T12:25:52.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:52.268 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-05-17T12:25:52.268 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-05-17T12:25:52.268 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add name ceph-brx type bridge 2023-05-17T12:25:52.269 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr flush dev ceph-brx 2023-05-17T12:25:52.269 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set ceph-brx up 2023-05-17T12:25:52.269 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-17T12:25:52.269 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-05-17T12:25:52.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:52.788 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T12:25:52.893 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-05-17T12:25:52.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:52.896 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-05-17T12:25:52.961 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-05-17T12:25:52.962 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T12:25:52.962 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-17T12:25:52.962 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-17T12:25:52.962 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T12:25:52.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:52.963 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-05-17T12:25:52.963 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-05-17T12:25:52.963 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-17T12:25:52.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-17T12:25:52.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-17T12:25:52.964 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-05-17T12:25:53.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:53.617 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-05-17T12:25:53.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:53.659 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-05-17T12:25:53.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:53.741 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-05-17T12:25:53.742 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-05-17T12:25:53.742 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-17T12:25:53.742 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-17T12:25:53.742 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-05-17T12:25:53.913 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-17T12:25:53.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:53.914 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-05-17T12:25:53.914 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-05-17T12:25:53.914 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-17T12:25:53.914 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-17T12:25:53.915 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-17T12:25:53.915 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-17T12:25:53.915 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-17T12:25:53.915 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-05-17T12:25:54.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:54.152 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-05-17T12:25:54.152 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-05-17T12:25:54.153 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-05-17T12:25:54.153 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.0 master ceph-brx 2023-05-17T12:25:54.153 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-05-17T12:25:54.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:25:54.270 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:25:54.319 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-05-17T12:25:54.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:54.320 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-17T12:25:54.361 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-17T12:25:54.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:54.362 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-17T12:25:54.452 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-05-17T12:25:54.556 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:54.556 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:54.617 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:54.619 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:54.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:54.620 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-05-17T12:25:54.661 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-17T12:25:54.661 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-05-17T12:25:54.705 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-05-17T12:25:54.768 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:54.768 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:54.834 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:54.836 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:54.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:54.837 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-05-17T12:25:54.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-05-17T12:25:54.870+0000 7f00990155c0 -1 init, newargv = 0x55c923807b90 newargc=15 2023-05-17T12:25:54.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[111026]: starting ceph client 2023-05-17T12:25:54.882 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[111026]: starting fuse 2023-05-17T12:25:55.982 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-05-17T12:25:56.053 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:56.054 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:56.117 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:56.119 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:56.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:56.120 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-05-17T12:25:56.162 INFO:teuthology.orchestra.run.smithi187.stdout:42 2023-05-17T12:25:56.163 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-17T12:25:56.163 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T12:25:56.163 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-05-17T12:25:56.164 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-05-17T12:25:56.164 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-05-17T12:25:56.164 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-05-17T12:25:56.165 DEBUG:teuthology.orchestra.run.smithi187:> 2023-05-17T12:25:56.165 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-05-17T12:25:56.166 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-05-17T12:25:56.166 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-05-17T12:25:56.166 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-05-17T12:25:56.167 DEBUG:teuthology.orchestra.run.smithi187:> 2023-05-17T12:25:56.167 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-05-17T12:25:56.167 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-05-17T12:25:56.168 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-05-17T12:25:56.168 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-05-17T12:25:56.168 DEBUG:teuthology.orchestra.run.smithi187:> 2023-05-17T12:25:56.169 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-05-17T12:25:56.169 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T12:25:56.170 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T12:25:56.170 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T12:25:56.171 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-05-17T12:25:56.171 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-05-17T12:25:56.171 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-05-17T12:25:56.172 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T12:25:56.172 DEBUG:teuthology.orchestra.run.smithi187:> 2023-05-17T12:25:56.172 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-05-17T12:25:56.172 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-05-17T12:25:56.337 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.111026.asok 2023-05-17T12:25:56.515 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.111026.asok 2023-05-17T12:25:56.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:56.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.111026.asok status 2023-05-17T12:25:56.729 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-05-17T12:25:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-05-17T12:25:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb", 2023-05-17T12:25:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev)", 2023-05-17T12:25:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-05-17T12:25:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-05-17T12:25:56.730 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-05-17T12:25:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "111026", 2023-05-17T12:25:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-05-17T12:25:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-05-17T12:25:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-05-17T12:25:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-05-17T12:25:56.731 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 4822, 2023-05-17T12:25:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-05-17T12:25:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-05-17T12:25:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-05-17T12:25:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 4822 2023-05-17T12:25:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-05-17T12:25:56.732 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-05-17T12:25:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-05-17T12:25:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-05-17T12:25:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 2025306188 2023-05-17T12:25:56.733 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-05-17T12:25:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-05-17T12:25:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-05-17T12:25:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-05-17T12:25:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-05-17T12:25:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 2025306188 2023-05-17T12:25:56.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-05-17T12:25:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.4822 192.168.0.1:0/2025306188", 2023-05-17T12:25:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/2025306188", 2023-05-17T12:25:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-05-17T12:25:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 9, 2023-05-17T12:25:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 29, 2023-05-17T12:25:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-05-17T12:25:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-05-17T12:25:56.735 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-05-17T12:25:56.736 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-05-17T12:25:56.743 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T12:25:56.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.935+0000 7f648e1ff700 1 Processor -- start 2023-05-17T12:25:56.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.936+0000 7f648e1ff700 1 -- start start 2023-05-17T12:25:56.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.937+0000 7f648e1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64880ce2a0 0x7f6488164480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:56.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.937+0000 7f648e1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64881599b0 con 0x7f6488071540 2023-05-17T12:25:56.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.937+0000 7f648e1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648815e000 con 0x7f64881595e0 2023-05-17T12:25:56.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.937+0000 7f648e1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64880cca80 con 0x7f64880ce2a0 2023-05-17T12:25:56.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.937+0000 7f6486ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6488071540 0x7f64880cdb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57502/0 (socket says 172.21.15.88:57502) 2023-05-17T12:25:56.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.937+0000 7f6486ffd700 1 -- 172.21.15.88:0/327483301 learned_addr learned my addr 172.21.15.88:0/327483301 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:25:56.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.937+0000 7f6487fff700 1 --2- 172.21.15.88:0/327483301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64880ce2a0 0x7f6488164480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:56.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f64867fc700 1 -- 172.21.15.88:0/327483301 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039922359 0 0) 0x7f64881599b0 con 0x7f6488071540 2023-05-17T12:25:56.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f64867fc700 1 -- 172.21.15.88:0/327483301 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64700035b0 con 0x7f6488071540 2023-05-17T12:25:56.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f64867fc700 1 -- 172.21.15.88:0/327483301 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848628311 0 0) 0x7f648815e000 con 0x7f64881595e0 2023-05-17T12:25:56.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f64867fc700 1 -- 172.21.15.88:0/327483301 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64881599b0 con 0x7f64881595e0 2023-05-17T12:25:56.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f64867fc700 1 -- 172.21.15.88:0/327483301 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2056902498 0 0) 0x7f64700035b0 con 0x7f6488071540 2023-05-17T12:25:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f6487fff700 1 -- 172.21.15.88:0/327483301 >> v1:172.21.15.187:6789/0 conn(0x7f64881595e0 legacy=0x7f6488070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f6487fff700 1 -- 172.21.15.88:0/327483301 >> v1:172.21.15.88:6789/0 conn(0x7f6488071540 legacy=0x7f64880cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f6487fff700 1 -- 172.21.15.88:0/327483301 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880ccd60 con 0x7f64880ce2a0 2023-05-17T12:25:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f6487fff700 1 --2- 172.21.15.88:0/327483301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64880ce2a0 0x7f6488164480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6480009dc0 tx=0x7f648000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76b65c39a1e9d722 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.938+0000 7f64867fc700 1 -- 172.21.15.88:0/327483301 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000e070 con 0x7f64880ce2a0 2023-05-17T12:25:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.939+0000 7f64867fc700 1 -- 172.21.15.88:0/327483301 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480003a20 con 0x7f64880ce2a0 2023-05-17T12:25:56.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.939+0000 7f64867fc700 1 -- 172.21.15.88:0/327483301 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c001670 con 0x7f64880ce2a0 2023-05-17T12:25:56.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.939+0000 7f648e1ff700 1 -- 172.21.15.88:0/327483301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64880ce2a0 msgr2=0x7f6488164480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:56.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.939+0000 7f648e1ff700 1 --2- 172.21.15.88:0/327483301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64880ce2a0 0x7f6488164480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6480009dc0 tx=0x7f648000b330 comp rx=0 tx=0).stop 2023-05-17T12:25:56.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.939+0000 7f648e1ff700 1 -- 172.21.15.88:0/327483301 shutdown_connections 2023-05-17T12:25:56.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.939+0000 7f648e1ff700 1 --2- 172.21.15.88:0/327483301 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64880ce2a0 0x7f6488164480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:56.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.939+0000 7f648e1ff700 1 -- 172.21.15.88:0/327483301 >> 172.21.15.88:0/327483301 conn(0x7f64880ced10 msgr2=0x7f64880cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:56.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.939+0000 7f648e1ff700 1 -- 172.21.15.88:0/327483301 shutdown_connections 2023-05-17T12:25:56.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.939+0000 7f648e1ff700 1 -- 172.21.15.88:0/327483301 wait complete. 2023-05-17T12:25:56.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.941+0000 7f648e1ff700 1 Processor -- start 2023-05-17T12:25:56.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.941+0000 7f648e1ff700 1 -- start start 2023-05-17T12:25:56.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f648e1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6488071540 0x7f648815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:56.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f648e1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64880ce2a0 0x7f648815b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:56.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f648e1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64881595e0 0x7f64880c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:56.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f648e1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648815b960 con 0x7f64880ce2a0 2023-05-17T12:25:56.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f648e1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648815bc40 con 0x7f6488071540 2023-05-17T12:25:56.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f648e1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648815bf20 con 0x7f64881595e0 2023-05-17T12:25:56.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f6486ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64880ce2a0 0x7f648815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:56.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f6486ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64880ce2a0 0x7f648815b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33318/0 (socket says 172.21.15.88:33318) 2023-05-17T12:25:56.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f6486ffd700 1 -- 172.21.15.88:0/832303326 learned_addr learned my addr 172.21.15.88:0/832303326 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:25:56.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.942+0000 7f6487fff700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64881595e0 0x7f64880c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:56.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f64877fe700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6488071540 0x7f648815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:56.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f6486ffd700 1 -- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64881595e0 msgr2=0x7f64880c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:56.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f6486ffd700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64881595e0 0x7f64880c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:56.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f6486ffd700 1 -- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6488071540 msgr2=0x7f648815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:56.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f6486ffd700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6488071540 0x7f648815abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:56.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f6486ffd700 1 -- 172.21.15.88:0/832303326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480009a70 con 0x7f64880ce2a0 2023-05-17T12:25:56.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f6486ffd700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64880ce2a0 0x7f648815b130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c700 tx=0x7f647c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:56.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f646ffff700 1 -- 172.21.15.88:0/832303326 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c004c80 con 0x7f64880ce2a0 2023-05-17T12:25:56.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f646ffff700 1 -- 172.21.15.88:0/832303326 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c004de0 con 0x7f64880ce2a0 2023-05-17T12:25:56.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64880cd320 con 0x7f64880ce2a0 2023-05-17T12:25:56.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.943+0000 7f646ffff700 1 -- 172.21.15.88:0/832303326 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c0072f0 con 0x7f64880ce2a0 2023-05-17T12:25:56.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.944+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64880cd040 con 0x7f64880ce2a0 2023-05-17T12:25:56.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.945+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64880cd840 con 0x7f64880ce2a0 2023-05-17T12:25:56.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.946+0000 7f646ffff700 1 -- 172.21.15.88:0/832303326 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f647c007450 con 0x7f64880ce2a0 2023-05-17T12:25:56.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.946+0000 7f646ffff700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f647406ace0 0x7f647406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:25:56.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.947+0000 7f646ffff700 1 -- 172.21.15.88:0/832303326 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f647c0894a0 con 0x7f64880ce2a0 2023-05-17T12:25:56.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.947+0000 7f64877fe700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f647406ace0 0x7f647406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:25:56.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.948+0000 7f64877fe700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f647406ace0 0x7f647406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6478001220 tx=0x7f6478009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:25:56.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:56.951+0000 7f646ffff700 1 -- 172.21.15.88:0/832303326 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f647c054220 con 0x7f64880ce2a0 2023-05-17T12:25:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.186+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f648815c6f0 con 0x7f64880ce2a0 2023-05-17T12:25:57.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.187+0000 7f646ffff700 1 -- 172.21.15.88:0/832303326 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f647c007700 con 0x7f64880ce2a0 2023-05-17T12:25:57.191 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-17T12:25:57.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f647406ace0 msgr2=0x7f647406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:57.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f647406ace0 0x7f647406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6478001220 tx=0x7f6478009040 comp rx=0 tx=0).stop 2023-05-17T12:25:57.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64880ce2a0 msgr2=0x7f648815b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:25:57.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64880ce2a0 0x7f648815b130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c700 tx=0x7f647c00ca10 comp rx=0 tx=0).stop 2023-05-17T12:25:57.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 shutdown_connections 2023-05-17T12:25:57.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f647406ace0 0x7f647406d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:57.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64881595e0 0x7f64880c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:57.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6488071540 0x7f648815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:57.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 --2- 172.21.15.88:0/832303326 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64880ce2a0 0x7f648815b130 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:25:57.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.189+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 >> 172.21.15.88:0/832303326 conn(0x7f64880ced10 msgr2=0x7f64881562f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:25:57.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.190+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 shutdown_connections 2023-05-17T12:25:57.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:25:57.190+0000 7f648e1ff700 1 -- 172.21.15.88:0/832303326 wait complete. 2023-05-17T12:25:57.210 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T12:25:57.210 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T12:25:57.210 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-05-17T12:25:57.211 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-17T12:25:57.211 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-17T12:25:57.211 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T12:25:57.211 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T12:25:57.211 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T12:25:57.212 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-17T12:25:57.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:57.212 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-05-17T12:25:57.254 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:25:57.255 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:25:57.255 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:25:57.255 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.255 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-05-17T12:25:57.255 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.255 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:57.255 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:57.255 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-05-17T12:25:57.256 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:57.256 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:57.256 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-05-17T12:25:57.256 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:25:57.256 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:57.256 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T12:25:57.256 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:57.257 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-17T12:25:57.257 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42125sec preferred_lft 42125sec 2023-05-17T12:25:57.257 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-05-17T12:25:57.257 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.257 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T12:25:57.257 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 92:c7:6c:18:2c:83 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:25:57.257 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T12:25:57.258 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.258 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::cc6e:bfff:fe8c:a72c/64 scope link 2023-05-17T12:25:57.258 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.258 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T12:25:57.258 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 92:c7:6c:18:2c:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-17T12:25:57.258 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::90c7:6cff:fe18:2c83/64 scope link 2023-05-17T12:25:57.258 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:57.260 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T12:25:57.360 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-05-17T12:25:57.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:57.363 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-05-17T12:25:57.407 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-05-17T12:25:57.407 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T12:25:57.408 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-17T12:25:57.408 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-17T12:25:57.408 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T12:25:57.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:57.409 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-05-17T12:25:57.409 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-05-17T12:25:57.409 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-17T12:25:57.409 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-17T12:25:57.409 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-17T12:25:57.410 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-05-17T12:25:57.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:57.601 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-05-17T12:25:57.643 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-17T12:25:57.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:57.645 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-05-17T12:25:57.725 INFO:teuthology.orchestra.run.smithi187.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-17T12:25:57.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:57.727 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-05-17T12:25:57.728 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-05-17T12:25:57.728 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-17T12:25:57.729 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-17T12:25:57.729 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-05-17T12:25:57.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:57.896 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-17T12:25:57.960 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:25:57.961 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:25:57.961 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:25:57.961 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.961 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-05-17T12:25:57.961 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.961 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T12:25:57.962 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether c6:ea:c4:25:e1:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T12:25:57.962 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T12:25:57.962 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.962 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::c4ea:c4ff:fe25:e182/64 scope link 2023-05-17T12:25:57.962 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:57.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:57.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-17T12:25:58.027 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:25:58.028 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:25:58.028 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:25:58.028 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:58.028 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-05-17T12:25:58.028 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:58.028 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T12:25:58.028 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether c6:ea:c4:25:e1:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-17T12:25:58.029 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-17T12:25:58.029 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:58.029 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::c4ea:c4ff:fe25:e182/64 scope link 2023-05-17T12:25:58.029 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:25:58.030 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-17T12:25:58.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:58.031 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-05-17T12:25:58.031 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-05-17T12:25:58.031 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-17T12:25:58.031 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-17T12:25:58.031 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-17T12:25:58.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-17T12:25:58.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-17T12:25:58.032 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-05-17T12:25:58.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:58.255 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-05-17T12:25:58.255 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-05-17T12:25:58.255 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.1 up 2023-05-17T12:25:58.256 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.1 master ceph-brx 2023-05-17T12:25:58.256 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-05-17T12:25:58.421 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-05-17T12:25:58.422 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:58.422 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-05-17T12:25:58.463 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-05-17T12:25:58.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:25:58.464 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-05-17T12:25:58.544 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-05-17T12:25:58.647 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:58.647 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:58.708 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:58.709 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:58.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:58.710 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-05-17T12:25:58.751 INFO:teuthology.orchestra.run.smithi187.stdout:42 2023-05-17T12:25:58.751 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-05-17T12:25:58.752 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-05-17T12:25:58.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-05-17T12:25:58.857 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:25:58.857 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:25:58.919 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:25:58.921 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:25:58.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:58.922 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-05-17T12:25:58.952 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi187.stderr:2023-05-17T12:25:58.949+0000 7f92fe0ab5c0 -1 init, newargv = 0x55ea7c1ec690 newargc=15 2023-05-17T12:25:58.952 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi187.stderr:ceph-fuse[111770]: starting ceph client 2023-05-17T12:25:58.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi187.stderr:ceph-fuse[111770]: starting fuse 2023-05-17T12:25:58.967 INFO:teuthology.orchestra.run.smithi187.stdout:42 2023-05-17T12:25:58.967 INFO:teuthology.orchestra.run.smithi187.stdout:44 2023-05-17T12:25:58.968 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2023-05-17T12:25:58.968 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T12:25:58.969 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-05-17T12:25:58.969 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-05-17T12:25:58.969 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-05-17T12:25:58.969 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-05-17T12:25:58.970 DEBUG:teuthology.orchestra.run.smithi187:> 2023-05-17T12:25:58.970 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-05-17T12:25:58.970 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-05-17T12:25:58.970 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-05-17T12:25:58.971 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-05-17T12:25:58.971 DEBUG:teuthology.orchestra.run.smithi187:> 2023-05-17T12:25:58.971 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-05-17T12:25:58.971 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-05-17T12:25:58.971 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-05-17T12:25:58.972 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-05-17T12:25:58.972 DEBUG:teuthology.orchestra.run.smithi187:> 2023-05-17T12:25:58.972 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-05-17T12:25:58.972 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T12:25:58.973 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T12:25:58.973 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T12:25:58.973 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-05-17T12:25:58.973 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-05-17T12:25:58.973 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-05-17T12:25:58.974 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T12:25:58.974 DEBUG:teuthology.orchestra.run.smithi187:> 2023-05-17T12:25:58.974 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.3")) 2023-05-17T12:25:58.974 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-05-17T12:25:59.143 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.3.111770.asok 2023-05-17T12:25:59.321 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.111770.asok 2023-05-17T12:25:59.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:59.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.111770.asok status 2023-05-17T12:25:59.537 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-05-17T12:25:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-05-17T12:25:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb", 2023-05-17T12:25:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev)", 2023-05-17T12:25:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "3", 2023-05-17T12:25:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-05-17T12:25:59.538 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-05-17T12:25:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "111770", 2023-05-17T12:25:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-05-17T12:25:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-05-17T12:25:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-05-17T12:25:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-05-17T12:25:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 4980, 2023-05-17T12:25:59.539 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-05-17T12:25:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-05-17T12:25:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-05-17T12:25:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 4980 2023-05-17T12:25:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-05-17T12:25:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-05-17T12:25:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-05-17T12:25:59.540 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.2:0", 2023-05-17T12:25:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1302397362 2023-05-17T12:25:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-05-17T12:25:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-05-17T12:25:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-05-17T12:25:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-05-17T12:25:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.2:0", 2023-05-17T12:25:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1302397362 2023-05-17T12:25:59.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-05-17T12:25:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.4980 192.168.0.2:0/1302397362", 2023-05-17T12:25:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.2:0/1302397362", 2023-05-17T12:25:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-05-17T12:25:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 9, 2023-05-17T12:25:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 29, 2023-05-17T12:25:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-05-17T12:25:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-05-17T12:25:59.542 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-05-17T12:25:59.543 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-05-17T12:25:59.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:59.551 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-05-17T12:25:59.552 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-17T12:25:59.599 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-05-17T12:25:59.600 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-17T12:25:59.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:59.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T12:25:59.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:59.667 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-05-17T12:25:59.667 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.2 2023-05-17T12:25:59.710 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-05-17T12:25:59.710 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-05-17T12:25:59.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:59.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-17T12:25:59.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:59.813 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-05-17T12:25:59.814 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-05-17T12:25:59.856 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-05-17T12:25:59.856 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-05-17T12:25:59.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:59.857 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-17T12:25:59.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:25:59.960 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-05-17T12:25:59.960 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.3 2023-05-17T12:26:00.002 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-05-17T12:26:00.002 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-05-17T12:26:00.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:26:00.003 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-17T12:26:00.104 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-17T12:26:00.122 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:00.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.304+0000 7f92681ff700 1 Processor -- start 2023-05-17T12:26:00.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.304+0000 7f92681ff700 1 -- start start 2023-05-17T12:26:00.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.305+0000 7f92681ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92601595e0 0x7f9260070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.305+0000 7f92681ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9260071370 0x7f92600cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.305+0000 7f92681ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92601599b0 con 0x7f92600ce0d0 2023-05-17T12:26:00.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.305+0000 7f92681ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92600717e0 con 0x7f92601595e0 2023-05-17T12:26:00.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.305+0000 7f92681ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600ce550 con 0x7f9260071370 2023-05-17T12:26:00.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.305+0000 7f9265f9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f92601595e0 0x7f9260070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.305+0000 7f926679c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f92600ce0d0 0x7f926006d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57506/0 (socket says 172.21.15.88:57506) 2023-05-17T12:26:00.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.305+0000 7f926679c700 1 -- 172.21.15.88:0/3389308125 learned_addr learned my addr 172.21.15.88:0/3389308125 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:00.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.305+0000 7f926579a700 1 --2- 172.21.15.88:0/3389308125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9260071370 0x7f92600cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9264f99700 1 -- 172.21.15.88:0/3389308125 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520008328 0 0) 0x7f92601599b0 con 0x7f92600ce0d0 2023-05-17T12:26:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9264f99700 1 -- 172.21.15.88:0/3389308125 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f924c0035b0 con 0x7f92600ce0d0 2023-05-17T12:26:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9265f9b700 1 -- 172.21.15.88:0/3389308125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9260071370 msgr2=0x7f92600cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9265f9b700 1 --2- 172.21.15.88:0/3389308125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9260071370 0x7f92600cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9265f9b700 1 -- 172.21.15.88:0/3389308125 >> v1:172.21.15.88:6789/0 conn(0x7f92600ce0d0 legacy=0x7f926006d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9265f9b700 1 -- 172.21.15.88:0/3389308125 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926015e000 con 0x7f92601595e0 2023-05-17T12:26:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9265f9b700 1 --2- 172.21.15.88:0/3389308125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92601595e0 0x7f9260070e30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f925c009840 tx=0x7f925c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baecd12e37820fdf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9264f99700 1 -- 172.21.15.88:0/3389308125 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c011830 con 0x7f92601595e0 2023-05-17T12:26:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9264f99700 1 -- 172.21.15.88:0/3389308125 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c011990 con 0x7f92601595e0 2023-05-17T12:26:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.306+0000 7f9264f99700 1 -- 172.21.15.88:0/3389308125 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c011d20 con 0x7f92601595e0 2023-05-17T12:26:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.307+0000 7f92681ff700 1 -- 172.21.15.88:0/3389308125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92601595e0 msgr2=0x7f9260070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.307+0000 7f92681ff700 1 --2- 172.21.15.88:0/3389308125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92601595e0 0x7f9260070e30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f925c009840 tx=0x7f925c009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.307+0000 7f92681ff700 1 -- 172.21.15.88:0/3389308125 shutdown_connections 2023-05-17T12:26:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.307+0000 7f92681ff700 1 --2- 172.21.15.88:0/3389308125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92601595e0 0x7f9260070e30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.307+0000 7f92681ff700 1 --2- 172.21.15.88:0/3389308125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9260071370 0x7f92600cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.307+0000 7f92681ff700 1 -- 172.21.15.88:0/3389308125 >> 172.21.15.88:0/3389308125 conn(0x7f92600ced10 msgr2=0x7f92600cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.307+0000 7f92681ff700 1 -- 172.21.15.88:0/3389308125 shutdown_connections 2023-05-17T12:26:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.307+0000 7f92681ff700 1 -- 172.21.15.88:0/3389308125 wait complete. 2023-05-17T12:26:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.309+0000 7f92681ff700 1 Processor -- start 2023-05-17T12:26:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.310+0000 7f92681ff700 1 -- start start 2023-05-17T12:26:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f92681ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9260071370 0x7f92600b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f92681ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92600ce0d0 0x7f92600b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f92681ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92601595e0 0x7f92600b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f92681ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9260159b80 con 0x7f9260071370 2023-05-17T12:26:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f92681ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92601f6330 con 0x7f92601595e0 2023-05-17T12:26:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f92681ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92601f6610 con 0x7f92600ce0d0 2023-05-17T12:26:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f9265f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9260071370 0x7f92600b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f9265f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9260071370 0x7f92600b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33344/0 (socket says 172.21.15.88:33344) 2023-05-17T12:26:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f9265f9b700 1 -- 172.21.15.88:0/3836367146 learned_addr learned my addr 172.21.15.88:0/3836367146 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f926579a700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92600ce0d0 0x7f92600b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f926679c700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92601595e0 0x7f92600b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f9265f9b700 1 -- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92600ce0d0 msgr2=0x7f92600b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f9265f9b700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92600ce0d0 0x7f92600b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f9265f9b700 1 -- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92601595e0 msgr2=0x7f92600b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f9265f9b700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92601595e0 0x7f92600b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.311+0000 7f9265f9b700 1 -- 172.21.15.88:0/3836367146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0094a0 con 0x7f9260071370 2023-05-17T12:26:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.312+0000 7f926679c700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92601595e0 0x7f92600b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.312+0000 7f9265f9b700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9260071370 0x7f92600b0120 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f925c0090b0 tx=0x7f925c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.312+0000 7f92567fc700 1 -- 172.21.15.88:0/3836367146 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c0036a0 con 0x7f9260071370 2023-05-17T12:26:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.312+0000 7f92567fc700 1 -- 172.21.15.88:0/3836367146 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c01f070 con 0x7f9260071370 2023-05-17T12:26:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.312+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92600ccd60 con 0x7f9260071370 2023-05-17T12:26:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.312+0000 7f92567fc700 1 -- 172.21.15.88:0/3836367146 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c003a60 con 0x7f9260071370 2023-05-17T12:26:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.312+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92600cca80 con 0x7f9260071370 2023-05-17T12:26:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.313+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92600cd040 con 0x7f9260071370 2023-05-17T12:26:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.314+0000 7f92567fc700 1 -- 172.21.15.88:0/3836367146 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f925c003bc0 con 0x7f9260071370 2023-05-17T12:26:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.315+0000 7f92567fc700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f924406ace0 0x7f924406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.315+0000 7f92567fc700 1 -- 172.21.15.88:0/3836367146 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f925c021070 con 0x7f9260071370 2023-05-17T12:26:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.315+0000 7f926579a700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f924406ace0 0x7f924406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.316+0000 7f926579a700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f924406ace0 0x7f924406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9260159b10 tx=0x7f9250009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.319+0000 7f92567fc700 1 -- 172.21.15.88:0/3836367146 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f925c055d20 con 0x7f9260071370 2023-05-17T12:26:00.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.518+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9260159cc0 con 0x7f9260071370 2023-05-17T12:26:00.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.519+0000 7f92567fc700 1 -- 172.21.15.88:0/3836367146 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f925c015090 con 0x7f9260071370 2023-05-17T12:26:00.523 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:00.524 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:00.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.521+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f924406ace0 msgr2=0x7f924406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.521+0000 7f92681ff700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f924406ace0 0x7f924406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9260159b10 tx=0x7f9250009210 comp rx=0 tx=0).stop 2023-05-17T12:26:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.521+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9260071370 msgr2=0x7f92600b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.521+0000 7f92681ff700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9260071370 0x7f92600b0120 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f925c0090b0 tx=0x7f925c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.521+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 shutdown_connections 2023-05-17T12:26:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.522+0000 7f92681ff700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f924406ace0 0x7f924406d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.522+0000 7f92681ff700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92601595e0 0x7f92600b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.522+0000 7f92681ff700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9260071370 0x7f92600b0120 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.522+0000 7f92681ff700 1 --2- 172.21.15.88:0/3836367146 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92600ce0d0 0x7f92600b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.522+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 >> 172.21.15.88:0/3836367146 conn(0x7f92600ced10 msgr2=0x7f926006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:00.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.522+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 shutdown_connections 2023-05-17T12:26:00.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.522+0000 7f92681ff700 1 -- 172.21.15.88:0/3836367146 wait complete. 2023-05-17T12:26:00.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:00.544 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:00.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.727+0000 7f83eb3ff700 1 Processor -- start 2023-05-17T12:26:00.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.728+0000 7f83eb3ff700 1 -- start start 2023-05-17T12:26:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.729+0000 7f83eb3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f83e406a510 0x7f83e40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.729+0000 7f83eb3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83e40b4750 0x7f83e40cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.729+0000 7f83eb3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e406b430 con 0x7f83e40c9370 2023-05-17T12:26:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.729+0000 7f83eb3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e406b680 con 0x7f83e40b4750 2023-05-17T12:26:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.729+0000 7f83eb3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e406b960 con 0x7f83e406a510 2023-05-17T12:26:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.729+0000 7f83e999c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83e40b4750 0x7f83e40cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.729+0000 7f83e999c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83e40b4750 0x7f83e40cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33352/0 (socket says 172.21.15.88:33352) 2023-05-17T12:26:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.729+0000 7f83e999c700 1 -- 172.21.15.88:0/2683923145 learned_addr learned my addr 172.21.15.88:0/2683923145 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.729+0000 7f83e899a700 1 --2- 172.21.15.88:0/2683923145 >> v2:172.21.15.187:3300/0 conn(0x7f83e406a510 0x7f83e40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.730+0000 7f83e999c700 1 -- 172.21.15.88:0/2683923145 >> v2:172.21.15.187:3300/0 conn(0x7f83e406a510 msgr2=0x7f83e40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.730+0000 7f83e999c700 1 --2- 172.21.15.88:0/2683923145 >> v2:172.21.15.187:3300/0 conn(0x7f83e406a510 0x7f83e40cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.730+0000 7f83e999c700 1 -- 172.21.15.88:0/2683923145 >> v1:172.21.15.187:6789/0 conn(0x7f83e40c9370 legacy=0x7f83e40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.730+0000 7f83e999c700 1 -- 172.21.15.88:0/2683923145 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e406bc40 con 0x7f83e40b4750 2023-05-17T12:26:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.730+0000 7f83e999c700 1 --2- 172.21.15.88:0/2683923145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e40b4750 0x7f83e40cd6e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83e40cecd0 tx=0x7f83dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44af8cd7b00e09f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.730+0000 7f83dbfff700 1 -- 172.21.15.88:0/2683923145 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00e070 con 0x7f83e40b4750 2023-05-17T12:26:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.730+0000 7f83dbfff700 1 -- 172.21.15.88:0/2683923145 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00b910 con 0x7f83e40b4750 2023-05-17T12:26:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.730+0000 7f83dbfff700 1 -- 172.21.15.88:0/2683923145 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00bcc0 con 0x7f83e40b4750 2023-05-17T12:26:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.731+0000 7f83eb3ff700 1 -- 172.21.15.88:0/2683923145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e40b4750 msgr2=0x7f83e40cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.731+0000 7f83eb3ff700 1 --2- 172.21.15.88:0/2683923145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e40b4750 0x7f83e40cd6e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83e40cecd0 tx=0x7f83dc00b330 comp rx=0 tx=0).stop 2023-05-17T12:26:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.731+0000 7f83eb3ff700 1 -- 172.21.15.88:0/2683923145 shutdown_connections 2023-05-17T12:26:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.731+0000 7f83eb3ff700 1 --2- 172.21.15.88:0/2683923145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e40b4750 0x7f83e40cd6e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.731+0000 7f83eb3ff700 1 --2- 172.21.15.88:0/2683923145 >> v2:172.21.15.187:3300/0 conn(0x7f83e406a510 0x7f83e40cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.731+0000 7f83eb3ff700 1 -- 172.21.15.88:0/2683923145 >> 172.21.15.88:0/2683923145 conn(0x7f83e40cf970 msgr2=0x7f83e40cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:00.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.731+0000 7f83eb3ff700 1 -- 172.21.15.88:0/2683923145 shutdown_connections 2023-05-17T12:26:00.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.731+0000 7f83eb3ff700 1 -- 172.21.15.88:0/2683923145 wait complete. 2023-05-17T12:26:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.732+0000 7f83eb3ff700 1 Processor -- start 2023-05-17T12:26:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.733+0000 7f83eb3ff700 1 -- start start 2023-05-17T12:26:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.733+0000 7f83eb3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e406a510 0x7f83e4152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.733+0000 7f83eb3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83e40b4750 0x7f83e4152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.733+0000 7f83eb3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83e40c9370 0x7f83e41e5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.733+0000 7f83eb3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e41e5c90 con 0x7f83e406a510 2023-05-17T12:26:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.733+0000 7f83eb3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e41e5f70 con 0x7f83e40b4750 2023-05-17T12:26:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.733+0000 7f83eb3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e41e6250 con 0x7f83e40c9370 2023-05-17T12:26:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e406a510 0x7f83e4152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e919b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e406a510 0x7f83e4152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33362/0 (socket says 172.21.15.88:33362) 2023-05-17T12:26:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e919b700 1 -- 172.21.15.88:0/3280906759 learned_addr learned my addr 172.21.15.88:0/3280906759 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e999c700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83e40c9370 0x7f83e41e5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e899a700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83e40b4750 0x7f83e4152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e919b700 1 -- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83e40c9370 msgr2=0x7f83e41e5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e919b700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83e40c9370 0x7f83e41e5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e919b700 1 -- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83e40b4750 msgr2=0x7f83e4152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e919b700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83e40b4750 0x7f83e4152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e919b700 1 -- 172.21.15.88:0/3280906759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc009b30 con 0x7f83e406a510 2023-05-17T12:26:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.734+0000 7f83e919b700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e406a510 0x7f83e4152aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c450 tx=0x7f83e000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.735+0000 7f83d9ffb700 1 -- 172.21.15.88:0/3280906759 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00052d0 con 0x7f83e406a510 2023-05-17T12:26:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.735+0000 7f83d9ffb700 1 -- 172.21.15.88:0/3280906759 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0005430 con 0x7f83e406a510 2023-05-17T12:26:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.735+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e4071f30 con 0x7f83e406a510 2023-05-17T12:26:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.735+0000 7f83d9ffb700 1 -- 172.21.15.88:0/3280906759 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00038c0 con 0x7f83e406a510 2023-05-17T12:26:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.735+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e415a8e0 con 0x7f83e406a510 2023-05-17T12:26:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.736+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e40720c0 con 0x7f83e406a510 2023-05-17T12:26:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.737+0000 7f83d9ffb700 1 -- 172.21.15.88:0/3280906759 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83e0003a20 con 0x7f83e406a510 2023-05-17T12:26:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.737+0000 7f83d9ffb700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f83c806ace0 0x7f83c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.738+0000 7f83d9ffb700 1 -- 172.21.15.88:0/3280906759 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f83e0088b70 con 0x7f83e406a510 2023-05-17T12:26:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.738+0000 7f83e899a700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f83c806ace0 0x7f83c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.739+0000 7f83e899a700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f83c806ace0 0x7f83c806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83e41e6c10 tx=0x7f83d4009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:00.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.742+0000 7f83d9ffb700 1 -- 172.21.15.88:0/3280906759 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f83e0053850 con 0x7f83e406a510 2023-05-17T12:26:00.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.935+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83e4074530 con 0x7f83e406a510 2023-05-17T12:26:00.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.935+0000 7f83d9ffb700 1 -- 172.21.15.88:0/3280906759 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83e000ce60 con 0x7f83e406a510 2023-05-17T12:26:00.939 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f83c806ace0 msgr2=0x7f83c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f83c806ace0 0x7f83c806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83e41e6c10 tx=0x7f83d4009210 comp rx=0 tx=0).stop 2023-05-17T12:26:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e406a510 msgr2=0x7f83e4152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e406a510 0x7f83e4152aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c450 tx=0x7f83e000c760 comp rx=0 tx=0).stop 2023-05-17T12:26:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 shutdown_connections 2023-05-17T12:26:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f83c806ace0 0x7f83c806d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83e40c9370 0x7f83e41e5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83e406a510 0x7f83e4152aa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 --2- 172.21.15.88:0/3280906759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83e40b4750 0x7f83e4152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:00.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 >> 172.21.15.88:0/3280906759 conn(0x7f83e40cf970 msgr2=0x7f83e40b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:00.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 shutdown_connections 2023-05-17T12:26:00.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:00.938+0000 7f83eb3ff700 1 -- 172.21.15.88:0/3280906759 wait complete. 2023-05-17T12:26:00.959 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:01.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.143+0000 7f95ff3ff700 1 Processor -- start 2023-05-17T12:26:01.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.143+0000 7f95ff3ff700 1 -- start start 2023-05-17T12:26:01.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.145+0000 7f95ff3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f95f806c760 0x7f95f806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.145+0000 7f95ff3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f806b4a0 con 0x7f95f80b23a0 2023-05-17T12:26:01.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.145+0000 7f95ff3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f806a510 con 0x7f95f80cf190 2023-05-17T12:26:01.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.145+0000 7f95ff3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f80cd840 con 0x7f95f806c760 2023-05-17T12:26:01.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.145+0000 7f95fc99a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f95f80b23a0 0x7f95f806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59838/0 (socket says 172.21.15.88:59838) 2023-05-17T12:26:01.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.145+0000 7f95fc99a700 1 -- 172.21.15.88:0/1973938214 learned_addr learned my addr 172.21.15.88:0/1973938214 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:01.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.145+0000 7f95fd19b700 1 --2- 172.21.15.88:0/1973938214 >> v2:172.21.15.187:3300/0 conn(0x7f95f806c760 0x7f95f806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:01.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.145+0000 7f95effff700 1 -- 172.21.15.88:0/1973938214 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809881182 0 0) 0x7f95e8001110 con 0x7f95f80b23a0 2023-05-17T12:26:01.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.146+0000 7f95effff700 1 -- 172.21.15.88:0/1973938214 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e40035b0 con 0x7f95f80b23a0 2023-05-17T12:26:01.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.146+0000 7f95fd19b700 1 -- 172.21.15.88:0/1973938214 >> v1:172.21.15.187:6789/0 conn(0x7f95f80cf190 legacy=0x7f95f8160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.146+0000 7f95fd19b700 1 -- 172.21.15.88:0/1973938214 >> v1:172.21.15.88:6789/0 conn(0x7f95f80b23a0 legacy=0x7f95f806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.146+0000 7f95fd19b700 1 -- 172.21.15.88:0/1973938214 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80cdb20 con 0x7f95f806c760 2023-05-17T12:26:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.146+0000 7f95fd19b700 1 --2- 172.21.15.88:0/1973938214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f806c760 0x7f95f806af60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009840 tx=0x7f95f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb50ac07cd5d542d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.146+0000 7f95effff700 1 -- 172.21.15.88:0/1973938214 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4011830 con 0x7f95f806c760 2023-05-17T12:26:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.146+0000 7f95effff700 1 -- 172.21.15.88:0/1973938214 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4011990 con 0x7f95f806c760 2023-05-17T12:26:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.146+0000 7f95effff700 1 -- 172.21.15.88:0/1973938214 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4011d00 con 0x7f95f806c760 2023-05-17T12:26:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.147+0000 7f95ff3ff700 1 -- 172.21.15.88:0/1973938214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f806c760 msgr2=0x7f95f806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.147+0000 7f95ff3ff700 1 --2- 172.21.15.88:0/1973938214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f806c760 0x7f95f806af60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009840 tx=0x7f95f4009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.147+0000 7f95ff3ff700 1 -- 172.21.15.88:0/1973938214 shutdown_connections 2023-05-17T12:26:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.147+0000 7f95ff3ff700 1 --2- 172.21.15.88:0/1973938214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f806c760 0x7f95f806af60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.147+0000 7f95ff3ff700 1 -- 172.21.15.88:0/1973938214 >> 172.21.15.88:0/1973938214 conn(0x7f95f80d06f0 msgr2=0x7f95f80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.147+0000 7f95ff3ff700 1 -- 172.21.15.88:0/1973938214 shutdown_connections 2023-05-17T12:26:01.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.147+0000 7f95ff3ff700 1 -- 172.21.15.88:0/1973938214 wait complete. 2023-05-17T12:26:01.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.149+0000 7f95ff3ff700 1 Processor -- start 2023-05-17T12:26:01.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.149+0000 7f95ff3ff700 1 -- start start 2023-05-17T12:26:01.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95ff3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95f806c760 0x7f95f80c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95ff3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f80cf190 0x7f95f80c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95ff3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95f80c70c0 0x7f95f8156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95ff3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80c7530 con 0x7f95f806c760 2023-05-17T12:26:01.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95ff3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8157ac0 con 0x7f95f80cf190 2023-05-17T12:26:01.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95ff3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8156eb0 con 0x7f95f80c70c0 2023-05-17T12:26:01.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95fd19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95f806c760 0x7f95f80c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:01.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95fd19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95f806c760 0x7f95f80c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54702/0 (socket says 172.21.15.88:54702) 2023-05-17T12:26:01.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95fd19b700 1 -- 172.21.15.88:0/3514034815 learned_addr learned my addr 172.21.15.88:0/3514034815 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:01.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95fd19b700 1 -- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95f80c70c0 msgr2=0x7f95f8156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95fd19b700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95f80c70c0 0x7f95f8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95fd19b700 1 -- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f80cf190 msgr2=0x7f95f80c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95fd19b700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f80cf190 0x7f95f80c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95fd19b700 1 -- 172.21.15.88:0/3514034815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40094a0 con 0x7f95f806c760 2023-05-17T12:26:01.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.150+0000 7f95fd19b700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95f806c760 0x7f95f80c60d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009fd0 tx=0x7f95f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:01.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.151+0000 7f95edffb700 1 -- 172.21.15.88:0/3514034815 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40036a0 con 0x7f95f806c760 2023-05-17T12:26:01.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.151+0000 7f95edffb700 1 -- 172.21.15.88:0/3514034815 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f401f070 con 0x7f95f806c760 2023-05-17T12:26:01.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.151+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f806aa40 con 0x7f95f806c760 2023-05-17T12:26:01.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.151+0000 7f95edffb700 1 -- 172.21.15.88:0/3514034815 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4003a20 con 0x7f95f806c760 2023-05-17T12:26:01.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.151+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f806a760 con 0x7f95f806c760 2023-05-17T12:26:01.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.152+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f815cb40 con 0x7f95f806c760 2023-05-17T12:26:01.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.153+0000 7f95edffb700 1 -- 172.21.15.88:0/3514034815 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95f4003b80 con 0x7f95f806c760 2023-05-17T12:26:01.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.154+0000 7f95edffb700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95dc06ace0 0x7f95dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.154+0000 7f95edffb700 1 -- 172.21.15.88:0/3514034815 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f95f4021070 con 0x7f95f806c760 2023-05-17T12:26:01.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.154+0000 7f95fc99a700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95dc06ace0 0x7f95dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:01.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.155+0000 7f95fc99a700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95dc06ace0 0x7f95dc06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95e8005910 tx=0x7f95e8001150 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:01.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.158+0000 7f95edffb700 1 -- 172.21.15.88:0/3514034815 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f95f4055ef0 con 0x7f95f806c760 2023-05-17T12:26:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.354+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f95f8074530 con 0x7f95f806c760 2023-05-17T12:26:01.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.355+0000 7f95edffb700 1 -- 172.21.15.88:0/3514034815 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f95f4059510 con 0x7f95f806c760 2023-05-17T12:26:01.359 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:01.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95dc06ace0 msgr2=0x7f95dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95dc06ace0 0x7f95dc06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95e8005910 tx=0x7f95e8001150 comp rx=0 tx=0).stop 2023-05-17T12:26:01.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95f806c760 msgr2=0x7f95f80c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95f806c760 0x7f95f80c60d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009fd0 tx=0x7f95f4004750 comp rx=0 tx=0).stop 2023-05-17T12:26:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 shutdown_connections 2023-05-17T12:26:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95dc06ace0 0x7f95dc06d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95f80c70c0 0x7f95f8156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95f806c760 0x7f95f80c60d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 --2- 172.21.15.88:0/3514034815 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95f80cf190 0x7f95f80c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 >> 172.21.15.88:0/3514034815 conn(0x7f95f80d06f0 msgr2=0x7f95f80b61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:01.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 shutdown_connections 2023-05-17T12:26:01.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.357+0000 7f95ff3ff700 1 -- 172.21.15.88:0/3514034815 wait complete. 2023-05-17T12:26:01.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.565+0000 7f954b1ff700 1 Processor -- start 2023-05-17T12:26:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.565+0000 7f954b1ff700 1 -- start start 2023-05-17T12:26:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.566+0000 7f954b1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f95440b23a0 0x7f954406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.566+0000 7f954b1ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f95440cf190 0x7f9544160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.566+0000 7f954b1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954406b4a0 con 0x7f954406c760 2023-05-17T12:26:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.566+0000 7f954b1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954406a510 con 0x7f95440b23a0 2023-05-17T12:26:01.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.566+0000 7f954b1ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95440cd840 con 0x7f95440cf190 2023-05-17T12:26:01.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.566+0000 7f9543fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f95440b23a0 0x7f954406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:01.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.566+0000 7f9543fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f95440b23a0 0x7f954406af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54706/0 (socket says 172.21.15.88:54706) 2023-05-17T12:26:01.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.566+0000 7f9543fff700 1 -- 172.21.15.88:0/3006434155 learned_addr learned my addr 172.21.15.88:0/3006434155 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:01.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.567+0000 7f954979c700 1 --2- 172.21.15.88:0/3006434155 >> v2:172.21.15.187:3300/0 conn(0x7f95440cf190 0x7f9544160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:01.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.567+0000 7f9543fff700 1 -- 172.21.15.88:0/3006434155 >> v2:172.21.15.187:3300/0 conn(0x7f95440cf190 msgr2=0x7f9544160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.567+0000 7f9543fff700 1 --2- 172.21.15.88:0/3006434155 >> v2:172.21.15.187:3300/0 conn(0x7f95440cf190 0x7f9544160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.567+0000 7f9543fff700 1 -- 172.21.15.88:0/3006434155 >> v1:172.21.15.187:6789/0 conn(0x7f954406c760 legacy=0x7f954406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.567+0000 7f9543fff700 1 -- 172.21.15.88:0/3006434155 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440cdb20 con 0x7f95440b23a0 2023-05-17T12:26:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.567+0000 7f9543fff700 1 --2- 172.21.15.88:0/3006434155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440b23a0 0x7f954406af60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f954408c360 tx=0x7f9530009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf4dad000c3744b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.567+0000 7f95437fe700 1 -- 172.21.15.88:0/3006434155 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530011830 con 0x7f95440b23a0 2023-05-17T12:26:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.567+0000 7f95437fe700 1 -- 172.21.15.88:0/3006434155 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9530011990 con 0x7f95440b23a0 2023-05-17T12:26:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.567+0000 7f95437fe700 1 -- 172.21.15.88:0/3006434155 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530011d20 con 0x7f95440b23a0 2023-05-17T12:26:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.568+0000 7f954b1ff700 1 -- 172.21.15.88:0/3006434155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440b23a0 msgr2=0x7f954406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.568+0000 7f954b1ff700 1 --2- 172.21.15.88:0/3006434155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440b23a0 0x7f954406af60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f954408c360 tx=0x7f9530009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.568+0000 7f954b1ff700 1 -- 172.21.15.88:0/3006434155 shutdown_connections 2023-05-17T12:26:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.568+0000 7f954b1ff700 1 --2- 172.21.15.88:0/3006434155 >> v2:172.21.15.187:3300/0 conn(0x7f95440cf190 0x7f9544160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.568+0000 7f954b1ff700 1 --2- 172.21.15.88:0/3006434155 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440b23a0 0x7f954406af60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.568+0000 7f954b1ff700 1 -- 172.21.15.88:0/3006434155 >> 172.21.15.88:0/3006434155 conn(0x7f95440d06f0 msgr2=0x7f95440d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.568+0000 7f954b1ff700 1 -- 172.21.15.88:0/3006434155 shutdown_connections 2023-05-17T12:26:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.568+0000 7f954b1ff700 1 -- 172.21.15.88:0/3006434155 wait complete. 2023-05-17T12:26:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.570+0000 7f954b1ff700 1 Processor -- start 2023-05-17T12:26:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.571+0000 7f954b1ff700 1 -- start start 2023-05-17T12:26:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f954b1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f954406c760 0x7f95441522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f954b1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440cf190 0x7f9544152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f954b1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9544151e60 0x7f95440ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f954b1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95440c7640 con 0x7f95440cf190 2023-05-17T12:26:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f954b1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95440c9ae0 con 0x7f9544151e60 2023-05-17T12:26:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f954b1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95440cc6f0 con 0x7f954406c760 2023-05-17T12:26:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f9543fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440cf190 0x7f9544152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f9543fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440cf190 0x7f9544152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54722/0 (socket says 172.21.15.88:54722) 2023-05-17T12:26:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f9543fff700 1 -- 172.21.15.88:0/1918276246 learned_addr learned my addr 172.21.15.88:0/1918276246 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f9543fff700 1 -- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f954406c760 msgr2=0x7f95441522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f9543fff700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f954406c760 0x7f95441522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f9543fff700 1 -- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9544151e60 msgr2=0x7f95440ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f9543fff700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9544151e60 0x7f95440ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.572+0000 7f9543fff700 1 -- 172.21.15.88:0/1918276246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530009550 con 0x7f95440cf190 2023-05-17T12:26:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.573+0000 7f9543fff700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440cf190 0x7f9544152800 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9530000c00 tx=0x7f9530004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.573+0000 7f95417fa700 1 -- 172.21.15.88:0/1918276246 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95300044f0 con 0x7f95440cf190 2023-05-17T12:26:01.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.573+0000 7f95417fa700 1 -- 172.21.15.88:0/1918276246 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953001f070 con 0x7f95440cf190 2023-05-17T12:26:01.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.573+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954406aa40 con 0x7f95440cf190 2023-05-17T12:26:01.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.573+0000 7f95417fa700 1 -- 172.21.15.88:0/1918276246 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95300038e0 con 0x7f95440cf190 2023-05-17T12:26:01.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.573+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954406a760 con 0x7f95440cf190 2023-05-17T12:26:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.574+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954415cb40 con 0x7f95440cf190 2023-05-17T12:26:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.575+0000 7f95417fa700 1 -- 172.21.15.88:0/1918276246 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9530021030 con 0x7f95440cf190 2023-05-17T12:26:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.576+0000 7f95417fa700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f952806ace0 0x7f952806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.576+0000 7f95417fa700 1 -- 172.21.15.88:0/1918276246 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f953008abb0 con 0x7f95440cf190 2023-05-17T12:26:01.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.576+0000 7f9548f9b700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f952806ace0 0x7f952806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:01.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.577+0000 7f9548f9b700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f952806ace0 0x7f952806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9538000f60 tx=0x7f9538007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:01.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.580+0000 7f95417fa700 1 -- 172.21.15.88:0/1918276246 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9530055920 con 0x7f95440cf190 2023-05-17T12:26:01.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.776+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9544074530 con 0x7f95440cf190 2023-05-17T12:26:01.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.777+0000 7f95417fa700 1 -- 172.21.15.88:0/1918276246 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9530058f40 con 0x7f95440cf190 2023-05-17T12:26:01.781 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:01.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f952806ace0 msgr2=0x7f952806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f952806ace0 0x7f952806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9538000f60 tx=0x7f9538007a40 comp rx=0 tx=0).stop 2023-05-17T12:26:01.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440cf190 msgr2=0x7f9544152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440cf190 0x7f9544152800 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9530000c00 tx=0x7f9530004750 comp rx=0 tx=0).stop 2023-05-17T12:26:01.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 shutdown_connections 2023-05-17T12:26:01.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f952806ace0 0x7f952806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9544151e60 0x7f95440ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f954406c760 0x7f95441522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 --2- 172.21.15.88:0/1918276246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95440cf190 0x7f9544152800 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 >> 172.21.15.88:0/1918276246 conn(0x7f95440d06f0 msgr2=0x7f95440d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:01.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 shutdown_connections 2023-05-17T12:26:01.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.779+0000 7f954b1ff700 1 -- 172.21.15.88:0/1918276246 wait complete. 2023-05-17T12:26:01.800 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:01.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.988+0000 7ff4d49ff700 1 Processor -- start 2023-05-17T12:26:01.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.988+0000 7ff4d49ff700 1 -- start start 2023-05-17T12:26:01.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.989+0000 7ff4d49ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff4d00c99e0 0x7ff4d00c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.989+0000 7ff4d49ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d006a720 con 0x7ff4d00cd270 2023-05-17T12:26:01.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.989+0000 7ff4d49ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d006aa00 con 0x7ff4d01421a0 2023-05-17T12:26:01.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.989+0000 7ff4d49ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d006a510 con 0x7ff4d00c99e0 2023-05-17T12:26:01.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.989+0000 7ff4ced9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff4d00cd270 0x7ff4d00cd670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59852/0 (socket says 172.21.15.88:59852) 2023-05-17T12:26:01.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.989+0000 7ff4ced9d700 1 -- 172.21.15.88:0/1626439757 learned_addr learned my addr 172.21.15.88:0/1626439757 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:01.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.989+0000 7ff4cdd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff4d00c99e0 0x7ff4d00c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:01.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.990+0000 7ff4cdd9b700 1 -- 172.21.15.88:0/1626439757 >> v1:172.21.15.187:6789/0 conn(0x7ff4d01421a0 legacy=0x7ff4d006e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.990+0000 7ff4cdd9b700 1 -- 172.21.15.88:0/1626439757 >> v1:172.21.15.88:6789/0 conn(0x7ff4d00cd270 legacy=0x7ff4d00cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.990+0000 7ff4cdd9b700 1 -- 172.21.15.88:0/1626439757 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d006ace0 con 0x7ff4d00c99e0 2023-05-17T12:26:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.990+0000 7ff4cdd9b700 1 --2- 172.21.15.88:0/1626439757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00c99e0 0x7ff4d00c9e80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009840 tx=0x7ff4c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b77c7e99c0010c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.990+0000 7ff4cd59a700 1 -- 172.21.15.88:0/1626439757 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400f8a0 con 0x7ff4d00c99e0 2023-05-17T12:26:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.990+0000 7ff4cd59a700 1 -- 172.21.15.88:0/1626439757 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c400fa00 con 0x7ff4d00c99e0 2023-05-17T12:26:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.990+0000 7ff4cd59a700 1 -- 172.21.15.88:0/1626439757 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400fd90 con 0x7ff4d00c99e0 2023-05-17T12:26:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.991+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1626439757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00c99e0 msgr2=0x7ff4d00c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.991+0000 7ff4d49ff700 1 --2- 172.21.15.88:0/1626439757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00c99e0 0x7ff4d00c9e80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009840 tx=0x7ff4c4009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.991+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1626439757 shutdown_connections 2023-05-17T12:26:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.991+0000 7ff4d49ff700 1 --2- 172.21.15.88:0/1626439757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d00c99e0 0x7ff4d00c9e80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.991+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1626439757 >> 172.21.15.88:0/1626439757 conn(0x7ff4d00cf970 msgr2=0x7ff4d00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.991+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1626439757 shutdown_connections 2023-05-17T12:26:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.991+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1626439757 wait complete. 2023-05-17T12:26:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.993+0000 7ff4d49ff700 1 Processor -- start 2023-05-17T12:26:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.993+0000 7ff4d49ff700 1 -- start start 2023-05-17T12:26:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4d49ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4d00c99e0 0x7ff4d013b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:01.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4d49ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d00cd270 0x7ff4d0140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4d49ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d01421a0 0x7ff4d0140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4d49ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d013ed20 con 0x7ff4d01421a0 2023-05-17T12:26:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4d49ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d01f6a60 con 0x7ff4d00c99e0 2023-05-17T12:26:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4d49ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d013e3f0 con 0x7ff4d00cd270 2023-05-17T12:26:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4ced9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d01421a0 0x7ff4d0140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4ced9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d01421a0 0x7ff4d0140f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54730/0 (socket says 172.21.15.88:54730) 2023-05-17T12:26:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4ced9d700 1 -- 172.21.15.88:0/1805539695 learned_addr learned my addr 172.21.15.88:0/1805539695 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4ce59c700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4d00c99e0 0x7ff4d013b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4cdd9b700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d00cd270 0x7ff4d0140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4ced9d700 1 -- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d00cd270 msgr2=0x7ff4d0140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4ced9d700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d00cd270 0x7ff4d0140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4ced9d700 1 -- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4d00c99e0 msgr2=0x7ff4d013b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4ced9d700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4d00c99e0 0x7ff4d013b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4ced9d700 1 -- 172.21.15.88:0/1805539695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40094a0 con 0x7ff4d01421a0 2023-05-17T12:26:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.994+0000 7ff4cdd9b700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d00cd270 0x7ff4d0140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.995+0000 7ff4ced9d700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d01421a0 0x7ff4d0140f80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800ca80 tx=0x7ff4c800ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.995+0000 7ff4beffd700 1 -- 172.21.15.88:0/1805539695 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c800aaa0 con 0x7ff4d01421a0 2023-05-17T12:26:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.995+0000 7ff4beffd700 1 -- 172.21.15.88:0/1805539695 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c800ac00 con 0x7ff4d01421a0 2023-05-17T12:26:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.995+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d0142570 con 0x7ff4d01421a0 2023-05-17T12:26:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.995+0000 7ff4beffd700 1 -- 172.21.15.88:0/1805539695 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8012400 con 0x7ff4d01421a0 2023-05-17T12:26:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.995+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d006afc0 con 0x7ff4d01421a0 2023-05-17T12:26:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.996+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d0142a50 con 0x7ff4d01421a0 2023-05-17T12:26:02.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.997+0000 7ff4beffd700 1 -- 172.21.15.88:0/1805539695 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4c801b3b0 con 0x7ff4d01421a0 2023-05-17T12:26:02.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.998+0000 7ff4beffd700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff4b006ace0 0x7ff4b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.998+0000 7ff4beffd700 1 -- 172.21.15.88:0/1805539695 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4c8089450 con 0x7ff4d01421a0 2023-05-17T12:26:02.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.998+0000 7ff4ce59c700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff4b006ace0 0x7ff4b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:01.999+0000 7ff4ce59c700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff4b006ace0 0x7ff4b006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0154fe0 tx=0x7ff4c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:02.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.002+0000 7ff4beffd700 1 -- 172.21.15.88:0/1805539695 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff4c80541e0 con 0x7ff4d01421a0 2023-05-17T12:26:02.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.196+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4d0074530 con 0x7ff4d01421a0 2023-05-17T12:26:02.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.197+0000 7ff4beffd700 1 -- 172.21.15.88:0/1805539695 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4c8057800 con 0x7ff4d01421a0 2023-05-17T12:26:02.201 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:02.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff4b006ace0 msgr2=0x7ff4b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff4b006ace0 0x7ff4b006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0154fe0 tx=0x7ff4c0009040 comp rx=0 tx=0).stop 2023-05-17T12:26:02.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d01421a0 msgr2=0x7ff4d0140f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d01421a0 0x7ff4d0140f80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800ca80 tx=0x7ff4c800ce40 comp rx=0 tx=0).stop 2023-05-17T12:26:02.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 shutdown_connections 2023-05-17T12:26:02.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff4b006ace0 0x7ff4b006d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4d01421a0 0x7ff4d0140f80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4d00c99e0 0x7ff4d013b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 --2- 172.21.15.88:0/1805539695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d00cd270 0x7ff4d0140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 >> 172.21.15.88:0/1805539695 conn(0x7ff4d00cf970 msgr2=0x7ff4d00c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:02.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 shutdown_connections 2023-05-17T12:26:02.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.199+0000 7ff4d49ff700 1 -- 172.21.15.88:0/1805539695 wait complete. 2023-05-17T12:26:02.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:02.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.405+0000 7f39ac9ff700 1 Processor -- start 2023-05-17T12:26:02.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.405+0000 7f39ac9ff700 1 -- start start 2023-05-17T12:26:02.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.406+0000 7f39ac9ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f39a80b23a0 0x7f39a806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.406+0000 7f39ac9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80cf190 0x7f39a8160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.406+0000 7f39ac9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a806b4a0 con 0x7f39a806c760 2023-05-17T12:26:02.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.406+0000 7f39ac9ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a806a510 con 0x7f39a80b23a0 2023-05-17T12:26:02.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.406+0000 7f39ac9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80cd840 con 0x7f39a80cf190 2023-05-17T12:26:02.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.406+0000 7f39a659c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f39a806c760 0x7f39a806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59854/0 (socket says 172.21.15.88:59854) 2023-05-17T12:26:02.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.406+0000 7f39a659c700 1 -- 172.21.15.88:0/3395217071 learned_addr learned my addr 172.21.15.88:0/3395217071 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:02.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.406+0000 7f39a5d9b700 1 --2- 172.21.15.88:0/3395217071 >> v2:172.21.15.187:3300/0 conn(0x7f39a80b23a0 0x7f39a806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.406+0000 7f39a6d9d700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80cf190 0x7f39a8160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461268894 0 0) 0x7f3998001110 con 0x7f39a806c760 2023-05-17T12:26:02.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39900035b0 con 0x7f39a806c760 2023-05-17T12:26:02.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 251692600 0 0) 0x7f39900035b0 con 0x7f39a806c760 2023-05-17T12:26:02.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80cf190 msgr2=0x7f39a8160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:02.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80cf190 0x7f39a8160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 >> v2:172.21.15.187:3300/0 conn(0x7f39a80b23a0 msgr2=0x7f39a806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:02.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 --2- 172.21.15.88:0/3395217071 >> v2:172.21.15.187:3300/0 conn(0x7f39a80b23a0 0x7f39a806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80cdb20 con 0x7f39a806c760 2023-05-17T12:26:02.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f3998001800 con 0x7f39a806c760 2023-05-17T12:26:02.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 >> v1:172.21.15.88:6789/0 conn(0x7f39a806c760 legacy=0x7f39a806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f3990003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80cf190 0x7f3990004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3990004d90 0x7f3990005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a806a510 con 0x7f3990003a00 2023-05-17T12:26:02.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80cd840 con 0x7f3990004d90 2023-05-17T12:26:02.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399000ba10 con 0x7f39a80cf190 2023-05-17T12:26:02.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a659c700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f3990003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a6d9d700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3990004d90 0x7f3990005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.407+0000 7f39a5d9b700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80cf190 0x7f3990004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.408+0000 7f39a659c700 1 -- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80cf190 msgr2=0x7f3990004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:02.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.408+0000 7f39a659c700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80cf190 0x7f3990004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.408+0000 7f39a659c700 1 -- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3990004d90 msgr2=0x7f3990005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:02.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.408+0000 7f39a659c700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3990004d90 0x7f3990005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.408+0000 7f39a659c700 1 -- 172.21.15.88:0/3395217071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900035b0 con 0x7f3990003a00 2023-05-17T12:26:02.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.408+0000 7f39a659c700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f3990003e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f399800c2f0 tx=0x7f3990005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d133a3b665b71d55 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:02.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.408+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800cdd0 con 0x7f3990003a00 2023-05-17T12:26:02.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.408+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3998005960 con 0x7f3990003a00 2023-05-17T12:26:02.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.408+0000 7f39a559a700 1 -- 172.21.15.88:0/3395217071 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998005d10 con 0x7f3990003a00 2023-05-17T12:26:02.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.409+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3395217071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 msgr2=0x7f3990003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.409+0000 7f39ac9ff700 1 --2- 172.21.15.88:0/3395217071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f3990003e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f399800c2f0 tx=0x7f3990005880 comp rx=0 tx=0).stop 2023-05-17T12:26:02.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.409+0000 7f39a6d9d700 1 -- 172.21.15.88:0/3395217071 reap_dead start 2023-05-17T12:26:02.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.409+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3395217071 shutdown_connections 2023-05-17T12:26:02.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.409+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3395217071 >> 172.21.15.88:0/3395217071 conn(0x7f39a80d06f0 msgr2=0x7f39a80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:02.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.409+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3395217071 shutdown_connections 2023-05-17T12:26:02.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.409+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3395217071 wait complete. 2023-05-17T12:26:02.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.411+0000 7f39ac9ff700 1 Processor -- start 2023-05-17T12:26:02.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.411+0000 7f39ac9ff700 1 -- start start 2023-05-17T12:26:02.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39ac9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f39a81540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39ac9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39a80cc5f0 0x7f39a80ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39ac9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80b7000 0x7f39a80b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39ac9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a81e6880 con 0x7f3990003a00 2023-05-17T12:26:02.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39ac9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80b79e0 con 0x7f39a80cc5f0 2023-05-17T12:26:02.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39ac9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a8154af0 con 0x7f39a80b7000 2023-05-17T12:26:02.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39a659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f39a81540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39a659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f39a81540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54736/0 (socket says 172.21.15.88:54736) 2023-05-17T12:26:02.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39a659c700 1 -- 172.21.15.88:0/3935501551 learned_addr learned my addr 172.21.15.88:0/3935501551 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:02.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39a659c700 1 -- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80b7000 msgr2=0x7f39a80b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39a659c700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80b7000 0x7f39a80b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39a659c700 1 -- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39a80cc5f0 msgr2=0x7f39a80ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39a659c700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39a80cc5f0 0x7f39a80ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.412+0000 7f39a659c700 1 -- 172.21.15.88:0/3935501551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a806aa40 con 0x7f3990003a00 2023-05-17T12:26:02.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.413+0000 7f39a659c700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f39a81540f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f39900046d0 tx=0x7f3998000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:02.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.413+0000 7f3996ffd700 1 -- 172.21.15.88:0/3935501551 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998001110 con 0x7f3990003a00 2023-05-17T12:26:02.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.413+0000 7f3996ffd700 1 -- 172.21.15.88:0/3935501551 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3998004a80 con 0x7f3990003a00 2023-05-17T12:26:02.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.413+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a806a760 con 0x7f3990003a00 2023-05-17T12:26:02.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.413+0000 7f3996ffd700 1 -- 172.21.15.88:0/3935501551 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998004c30 con 0x7f3990003a00 2023-05-17T12:26:02.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.413+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a815cb40 con 0x7f3990003a00 2023-05-17T12:26:02.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.414+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a81e6af0 con 0x7f3990003a00 2023-05-17T12:26:02.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.415+0000 7f3996ffd700 1 -- 172.21.15.88:0/3935501551 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3998005040 con 0x7f3990003a00 2023-05-17T12:26:02.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.416+0000 7f3996ffd700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f398806ace0 0x7f398806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.416+0000 7f3996ffd700 1 -- 172.21.15.88:0/3935501551 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f399808ab10 con 0x7f3990003a00 2023-05-17T12:26:02.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.417+0000 7f39a5d9b700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f398806ace0 0x7f398806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.417+0000 7f39a5d9b700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f398806ace0 0x7f398806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f399c006dd0 tx=0x7f399c006cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:02.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.421+0000 7f3996ffd700 1 -- 172.21.15.88:0/3935501551 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3998055930 con 0x7f3990003a00 2023-05-17T12:26:02.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.616+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f39a806b4a0 con 0x7f3990003a00 2023-05-17T12:26:02.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.617+0000 7f3996ffd700 1 -- 172.21.15.88:0/3935501551 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f39a806b4a0 con 0x7f3990003a00 2023-05-17T12:26:02.621 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f398806ace0 msgr2=0x7f398806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f398806ace0 0x7f398806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f399c006dd0 tx=0x7f399c006cc0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 msgr2=0x7f39a81540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f39a81540f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f39900046d0 tx=0x7f3998000fe0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 shutdown_connections 2023-05-17T12:26:02.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f398806ace0 0x7f398806d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39a80b7000 0x7f39a80b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3990003a00 0x7f39a81540f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 --2- 172.21.15.88:0/3935501551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39a80cc5f0 0x7f39a80ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 >> 172.21.15.88:0/3935501551 conn(0x7f39a80d06f0 msgr2=0x7f39a80b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:02.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 shutdown_connections 2023-05-17T12:26:02.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.619+0000 7f39ac9ff700 1 -- 172.21.15.88:0/3935501551 wait complete. 2023-05-17T12:26:02.640 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:02.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.821+0000 7f6b791ff700 1 Processor -- start 2023-05-17T12:26:02.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.821+0000 7f6b791ff700 1 -- start start 2023-05-17T12:26:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.822+0000 7f6b791ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6b7406b0b0 0x7f6b7406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.822+0000 7f6b791ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740cd6b0 con 0x7f6b7406c330 2023-05-17T12:26:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.822+0000 7f6b791ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740b2460 con 0x7f6b7415c840 2023-05-17T12:26:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.822+0000 7f6b791ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740cdf50 con 0x7f6b7406b0b0 2023-05-17T12:26:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.822+0000 7f6b7359e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6b7406c330 0x7f6b74160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59858/0 (socket says 172.21.15.88:59858) 2023-05-17T12:26:02.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.822+0000 7f6b7359e700 1 -- 172.21.15.88:0/2635378942 learned_addr learned my addr 172.21.15.88:0/2635378942 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:02.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.823+0000 7f6b7259c700 1 --2- 172.21.15.88:0/2635378942 >> v2:172.21.15.187:3300/0 conn(0x7f6b7406b0b0 0x7f6b7406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.823+0000 7f6b71d9b700 1 -- 172.21.15.88:0/2635378942 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562516893 0 0) 0x7f6b740cd6b0 con 0x7f6b7406c330 2023-05-17T12:26:02.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.823+0000 7f6b71d9b700 1 -- 172.21.15.88:0/2635378942 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b5c0035b0 con 0x7f6b7406c330 2023-05-17T12:26:02.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.823+0000 7f6b7259c700 1 -- 172.21.15.88:0/2635378942 >> v1:172.21.15.187:6789/0 conn(0x7f6b7415c840 legacy=0x7f6b740cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.823+0000 7f6b7259c700 1 -- 172.21.15.88:0/2635378942 >> v1:172.21.15.88:6789/0 conn(0x7f6b7406c330 legacy=0x7f6b74160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.823+0000 7f6b7259c700 1 -- 172.21.15.88:0/2635378942 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740b2740 con 0x7f6b7406b0b0 2023-05-17T12:26:02.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.823+0000 7f6b7259c700 1 --2- 172.21.15.88:0/2635378942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7406b0b0 0x7f6b7406b940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009840 tx=0x7f6b68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cc230680eebe0e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:02.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b71d9b700 1 -- 172.21.15.88:0/2635378942 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68011830 con 0x7f6b7406b0b0 2023-05-17T12:26:02.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b71d9b700 1 -- 172.21.15.88:0/2635378942 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68011990 con 0x7f6b7406b0b0 2023-05-17T12:26:02.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b71d9b700 1 -- 172.21.15.88:0/2635378942 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68011d20 con 0x7f6b7406b0b0 2023-05-17T12:26:02.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b791ff700 1 -- 172.21.15.88:0/2635378942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7406b0b0 msgr2=0x7f6b7406b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b791ff700 1 --2- 172.21.15.88:0/2635378942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7406b0b0 0x7f6b7406b940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009840 tx=0x7f6b68009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:02.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b791ff700 1 -- 172.21.15.88:0/2635378942 shutdown_connections 2023-05-17T12:26:02.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b791ff700 1 --2- 172.21.15.88:0/2635378942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7406b0b0 0x7f6b7406b940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b791ff700 1 -- 172.21.15.88:0/2635378942 >> 172.21.15.88:0/2635378942 conn(0x7f6b740d3060 msgr2=0x7f6b740d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:02.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b791ff700 1 -- 172.21.15.88:0/2635378942 shutdown_connections 2023-05-17T12:26:02.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.824+0000 7f6b791ff700 1 -- 172.21.15.88:0/2635378942 wait complete. 2023-05-17T12:26:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.826+0000 7f6b791ff700 1 Processor -- start 2023-05-17T12:26:02.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.826+0000 7f6b791ff700 1 -- start start 2023-05-17T12:26:02.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b791ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b7406b0b0 0x7f6b740b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b791ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b7406c330 0x7f6b74160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b791ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7415c840 0x7f6b74153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b791ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74159030 con 0x7f6b7406c330 2023-05-17T12:26:02.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b791ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74160bc0 con 0x7f6b7415c840 2023-05-17T12:26:02.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b791ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74158460 con 0x7f6b7406b0b0 2023-05-17T12:26:02.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b7259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b7406c330 0x7f6b74160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b7259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b7406c330 0x7f6b74160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54740/0 (socket says 172.21.15.88:54740) 2023-05-17T12:26:02.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b7259c700 1 -- 172.21.15.88:0/1576628114 learned_addr learned my addr 172.21.15.88:0/1576628114 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:02.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b7359e700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7415c840 0x7f6b74153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b72d9d700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b7406b0b0 0x7f6b740b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b7259c700 1 -- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b7406b0b0 msgr2=0x7f6b740b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b7259c700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b7406b0b0 0x7f6b740b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b7259c700 1 -- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7415c840 msgr2=0x7f6b74153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:02.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b7259c700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7415c840 0x7f6b74153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:02.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.827+0000 7f6b7259c700 1 -- 172.21.15.88:0/1576628114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680094a0 con 0x7f6b7406c330 2023-05-17T12:26:02.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.828+0000 7f6b72d9d700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b7406b0b0 0x7f6b740b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:02.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.828+0000 7f6b7259c700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b7406c330 0x7f6b74160680 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009b90 tx=0x7f6b68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.828+0000 7f6b5b7fe700 1 -- 172.21.15.88:0/1576628114 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680038a0 con 0x7f6b7406c330 2023-05-17T12:26:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.828+0000 7f6b5b7fe700 1 -- 172.21.15.88:0/1576628114 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6801e070 con 0x7f6b7406c330 2023-05-17T12:26:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.828+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b740cdbe0 con 0x7f6b7406c330 2023-05-17T12:26:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.828+0000 7f6b5b7fe700 1 -- 172.21.15.88:0/1576628114 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68003c40 con 0x7f6b7406c330 2023-05-17T12:26:02.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.828+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b740cd900 con 0x7f6b7406c330 2023-05-17T12:26:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.829+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7415cc10 con 0x7f6b7406c330 2023-05-17T12:26:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.830+0000 7f6b5b7fe700 1 -- 172.21.15.88:0/1576628114 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b6802d450 con 0x7f6b7406c330 2023-05-17T12:26:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.831+0000 7f6b5b7fe700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6b6006ace0 0x7f6b6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.831+0000 7f6b5b7fe700 1 -- 172.21.15.88:0/1576628114 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6b6808a8c0 con 0x7f6b7406c330 2023-05-17T12:26:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.831+0000 7f6b72d9d700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6b6006ace0 0x7f6b6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:02.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.832+0000 7f6b72d9d700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6b6006ace0 0x7f6b6006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b64000f60 tx=0x7f6b64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:02.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:02.835+0000 7f6b5b7fe700 1 -- 172.21.15.88:0/1576628114 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6b680555b0 con 0x7f6b7406c330 2023-05-17T12:26:03.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.029+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b74074530 con 0x7f6b7406c330 2023-05-17T12:26:03.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.031+0000 7f6b5b7fe700 1 -- 172.21.15.88:0/1576628114 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f6b68058bd0 con 0x7f6b7406c330 2023-05-17T12:26:03.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:03.035 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:03.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6b6006ace0 msgr2=0x7f6b6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6b6006ace0 0x7f6b6006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b64000f60 tx=0x7f6b64009040 comp rx=0 tx=0).stop 2023-05-17T12:26:03.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b7406c330 msgr2=0x7f6b74160680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b7406c330 0x7f6b74160680 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009b90 tx=0x7f6b68004750 comp rx=0 tx=0).stop 2023-05-17T12:26:03.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 shutdown_connections 2023-05-17T12:26:03.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6b6006ace0 0x7f6b6006d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7415c840 0x7f6b74153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b7406b0b0 0x7f6b740b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 --2- 172.21.15.88:0/1576628114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b7406c330 0x7f6b74160680 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 >> 172.21.15.88:0/1576628114 conn(0x7f6b740d3060 msgr2=0x7f6b7406a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:03.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 shutdown_connections 2023-05-17T12:26:03.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.033+0000 7f6b791ff700 1 -- 172.21.15.88:0/1576628114 wait complete. 2023-05-17T12:26:03.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:03.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:03.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.239+0000 7f4fd07ff700 1 Processor -- start 2023-05-17T12:26:03.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.239+0000 7f4fd07ff700 1 -- start start 2023-05-17T12:26:03.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.240+0000 7f4fd07ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fc80b03d0 0x7f4fc8160a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.240+0000 7f4fd07ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4fc80d0070 0x7f4fc80b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.240+0000 7f4fd07ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc806c710 con 0x7f4fc815c700 2023-05-17T12:26:03.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.240+0000 7f4fd07ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc806beb0 con 0x7f4fc80b03d0 2023-05-17T12:26:03.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.240+0000 7f4fd07ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc80d0f80 con 0x7f4fc80d0070 2023-05-17T12:26:03.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.240+0000 7f4fcdd9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fc80b03d0 0x7f4fc8160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcdd9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fc80b03d0 0x7f4fc8160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54748/0 (socket says 172.21.15.88:54748) 2023-05-17T12:26:03.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcdd9a700 1 -- 172.21.15.88:0/1545309310 learned_addr learned my addr 172.21.15.88:0/1545309310 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:03.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcdd9a700 1 -- 172.21.15.88:0/1545309310 >> v2:172.21.15.187:3300/0 conn(0x7f4fc80d0070 msgr2=0x7f4fc80b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:03.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fced9c700 1 --2- 172.21.15.88:0/1545309310 >> v2:172.21.15.187:3300/0 conn(0x7f4fc80d0070 0x7f4fc80b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcdd9a700 1 --2- 172.21.15.88:0/1545309310 >> v2:172.21.15.187:3300/0 conn(0x7f4fc80d0070 0x7f4fc80b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcdd9a700 1 -- 172.21.15.88:0/1545309310 >> v1:172.21.15.187:6789/0 conn(0x7f4fc815c700 legacy=0x7f4fc8160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcdd9a700 1 -- 172.21.15.88:0/1545309310 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8161180 con 0x7f4fc80b03d0 2023-05-17T12:26:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fced9c700 1 --2- 172.21.15.88:0/1545309310 >> v2:172.21.15.187:3300/0 conn(0x7f4fc80d0070 0x7f4fc80b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcdd9a700 1 --2- 172.21.15.88:0/1545309310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 0x7f4fc8160a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80c4670 tx=0x7f4fb8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d033670e7cbebda server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcd599700 1 -- 172.21.15.88:0/1545309310 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8004230 con 0x7f4fc80b03d0 2023-05-17T12:26:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcd599700 1 -- 172.21.15.88:0/1545309310 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb8004390 con 0x7f4fc80b03d0 2023-05-17T12:26:03.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.241+0000 7f4fcd599700 1 -- 172.21.15.88:0/1545309310 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80036a0 con 0x7f4fc80b03d0 2023-05-17T12:26:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.242+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1545309310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 msgr2=0x7f4fc8160a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.242+0000 7f4fd07ff700 1 --2- 172.21.15.88:0/1545309310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 0x7f4fc8160a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80c4670 tx=0x7f4fb8009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.242+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1545309310 shutdown_connections 2023-05-17T12:26:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.242+0000 7f4fd07ff700 1 --2- 172.21.15.88:0/1545309310 >> v2:172.21.15.187:3300/0 conn(0x7f4fc80d0070 0x7f4fc80b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.242+0000 7f4fd07ff700 1 --2- 172.21.15.88:0/1545309310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 0x7f4fc8160a80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.242+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1545309310 >> 172.21.15.88:0/1545309310 conn(0x7f4fc8070bd0 msgr2=0x7f4fc8070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:03.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.242+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1545309310 shutdown_connections 2023-05-17T12:26:03.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.242+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1545309310 wait complete. 2023-05-17T12:26:03.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.244+0000 7f4fd07ff700 1 Processor -- start 2023-05-17T12:26:03.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.244+0000 7f4fd07ff700 1 -- start start 2023-05-17T12:26:03.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fd07ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 0x7f4fc80c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fd07ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fc80d0070 0x7f4fc8153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fd07ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fc815c700 0x7f4fc80c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fd07ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80c7a30 con 0x7f4fc80b03d0 2023-05-17T12:26:03.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fd07ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80ca1a0 con 0x7f4fc815c700 2023-05-17T12:26:03.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fd07ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc80c9620 con 0x7f4fc80d0070 2023-05-17T12:26:03.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fce59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 0x7f4fc80c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fce59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 0x7f4fc80c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54764/0 (socket says 172.21.15.88:54764) 2023-05-17T12:26:03.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fce59b700 1 -- 172.21.15.88:0/1802602039 learned_addr learned my addr 172.21.15.88:0/1802602039 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:03.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fcdd9a700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fc80d0070 0x7f4fc8153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fced9c700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fc815c700 0x7f4fc80c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fce59b700 1 -- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fc80d0070 msgr2=0x7f4fc8153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fce59b700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fc80d0070 0x7f4fc8153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fce59b700 1 -- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fc815c700 msgr2=0x7f4fc80c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fce59b700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fc815c700 0x7f4fc80c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.245+0000 7f4fce59b700 1 -- 172.21.15.88:0/1802602039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8009550 con 0x7f4fc80b03d0 2023-05-17T12:26:03.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.246+0000 7f4fce59b700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 0x7f4fc80c8f40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400b470 tx=0x7f4fc400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.246+0000 7f4fbeffd700 1 -- 172.21.15.88:0/1802602039 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4011830 con 0x7f4fc80b03d0 2023-05-17T12:26:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.246+0000 7f4fbeffd700 1 -- 172.21.15.88:0/1802602039 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc40119b0 con 0x7f4fc80b03d0 2023-05-17T12:26:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.246+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc806c430 con 0x7f4fc80b03d0 2023-05-17T12:26:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.246+0000 7f4fbeffd700 1 -- 172.21.15.88:0/1802602039 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4011d60 con 0x7f4fc80b03d0 2023-05-17T12:26:03.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.246+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc806c150 con 0x7f4fc80b03d0 2023-05-17T12:26:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.247+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc815cad0 con 0x7f4fc80b03d0 2023-05-17T12:26:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.248+0000 7f4fbeffd700 1 -- 172.21.15.88:0/1802602039 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fc401a400 con 0x7f4fc80b03d0 2023-05-17T12:26:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.249+0000 7f4fbeffd700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4fac06ace0 0x7f4fac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.250+0000 7f4fbeffd700 1 -- 172.21.15.88:0/1802602039 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4fc40897d0 con 0x7f4fc80b03d0 2023-05-17T12:26:03.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.250+0000 7f4fcdd9a700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4fac06ace0 0x7f4fac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.251+0000 7f4fcdd9a700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4fac06ace0 0x7f4fac06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b0810 tx=0x7f4fb8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:03.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.254+0000 7f4fbeffd700 1 -- 172.21.15.88:0/1802602039 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4fc4054550 con 0x7f4fc80b03d0 2023-05-17T12:26:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.444+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fc8074530 con 0x7f4fc80b03d0 2023-05-17T12:26:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.445+0000 7f4fbeffd700 1 -- 172.21.15.88:0/1802602039 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4fc4057b70 con 0x7f4fc80b03d0 2023-05-17T12:26:03.449 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:03.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4fac06ace0 msgr2=0x7f4fac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4fac06ace0 0x7f4fac06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b0810 tx=0x7f4fb8008030 comp rx=0 tx=0).stop 2023-05-17T12:26:03.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 msgr2=0x7f4fc80c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 0x7f4fc80c8f40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400b470 tx=0x7f4fc400b830 comp rx=0 tx=0).stop 2023-05-17T12:26:03.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 shutdown_connections 2023-05-17T12:26:03.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4fac06ace0 0x7f4fac06d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fc815c700 0x7f4fc80c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fc80b03d0 0x7f4fc80c8f40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 --2- 172.21.15.88:0/1802602039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fc80d0070 0x7f4fc8153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 >> 172.21.15.88:0/1802602039 conn(0x7f4fc8070bd0 msgr2=0x7f4fc815b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:03.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 shutdown_connections 2023-05-17T12:26:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.447+0000 7f4fd07ff700 1 -- 172.21.15.88:0/1802602039 wait complete. 2023-05-17T12:26:03.468 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:03.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.654+0000 7f3fa7bff700 1 Processor -- start 2023-05-17T12:26:03.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.654+0000 7f3fa7bff700 1 -- start start 2023-05-17T12:26:03.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa7bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa006c760 0x7f3fa006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa7bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3fa00cf190 0x7f3fa0160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa7bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa006b4a0 con 0x7f3fa00b23a0 2023-05-17T12:26:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa7bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa006a510 con 0x7f3fa00cf190 2023-05-17T12:26:03.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa7bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00cd840 con 0x7f3fa006c760 2023-05-17T12:26:03.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa619c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3fa00cf190 0x7f3fa0160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa599b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa006c760 0x7f3fa006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa599b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa006c760 0x7f3fa006af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:41108/0 (socket says 172.21.15.88:41108) 2023-05-17T12:26:03.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa619c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3fa00cf190 0x7f3fa0160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39770/0 (socket says 172.21.15.88:39770) 2023-05-17T12:26:03.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.656+0000 7f3fa599b700 1 -- 172.21.15.88:0/3774281869 learned_addr learned my addr 172.21.15.88:0/3774281869 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:03.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.657+0000 7f3fa599b700 1 -- 172.21.15.88:0/3774281869 >> v2:172.21.15.187:3300/0 conn(0x7f3fa00cf190 msgr2=0x7f3fa0160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:03.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.657+0000 7f3fa599b700 1 --2- 172.21.15.88:0/3774281869 >> v2:172.21.15.187:3300/0 conn(0x7f3fa00cf190 0x7f3fa0160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.657+0000 7f3fa599b700 1 -- 172.21.15.88:0/3774281869 >> v1:172.21.15.187:6789/0 conn(0x7f3fa00b23a0 legacy=0x7f3fa006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.657+0000 7f3fa599b700 1 -- 172.21.15.88:0/3774281869 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00cdb20 con 0x7f3fa006c760 2023-05-17T12:26:03.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.657+0000 7f3fa619c700 1 --2- 172.21.15.88:0/3774281869 >> v2:172.21.15.187:3300/0 conn(0x7f3fa00cf190 0x7f3fa0160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:03.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.657+0000 7f3fa599b700 1 --2- 172.21.15.88:0/3774281869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa006c760 0x7f3fa006af60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c0098f0 tx=0x7f3f9c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31b68acf47cd04c6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:03.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.657+0000 7f3fa4999700 1 -- 172.21.15.88:0/3774281869 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c011830 con 0x7f3fa006c760 2023-05-17T12:26:03.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.657+0000 7f3fa4999700 1 -- 172.21.15.88:0/3774281869 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c011990 con 0x7f3fa006c760 2023-05-17T12:26:03.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.657+0000 7f3fa4999700 1 -- 172.21.15.88:0/3774281869 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c011d20 con 0x7f3fa006c760 2023-05-17T12:26:03.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.658+0000 7f3fa7bff700 1 -- 172.21.15.88:0/3774281869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa006c760 msgr2=0x7f3fa006af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.658+0000 7f3fa7bff700 1 --2- 172.21.15.88:0/3774281869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa006c760 0x7f3fa006af60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c0098f0 tx=0x7f3f9c009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.658+0000 7f3fa7bff700 1 -- 172.21.15.88:0/3774281869 shutdown_connections 2023-05-17T12:26:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.658+0000 7f3fa7bff700 1 --2- 172.21.15.88:0/3774281869 >> v2:172.21.15.187:3300/0 conn(0x7f3fa00cf190 0x7f3fa0160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.658+0000 7f3fa7bff700 1 --2- 172.21.15.88:0/3774281869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa006c760 0x7f3fa006af60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.658+0000 7f3fa7bff700 1 -- 172.21.15.88:0/3774281869 >> 172.21.15.88:0/3774281869 conn(0x7f3fa00d06f0 msgr2=0x7f3fa00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:03.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.658+0000 7f3fa7bff700 1 -- 172.21.15.88:0/3774281869 shutdown_connections 2023-05-17T12:26:03.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.658+0000 7f3fa7bff700 1 -- 172.21.15.88:0/3774281869 wait complete. 2023-05-17T12:26:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.660+0000 7f3fa7bff700 1 Processor -- start 2023-05-17T12:26:03.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.660+0000 7f3fa7bff700 1 -- start start 2023-05-17T12:26:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa7bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fa006c760 0x7f3fa00c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa7bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fa00cf190 0x7f3fa014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa7bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa0150dc0 0x7f3fa0151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa7bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0151330 con 0x7f3fa006c760 2023-05-17T12:26:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa7bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0151610 con 0x7f3fa00cf190 2023-05-17T12:26:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa7bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0153de0 con 0x7f3fa0150dc0 2023-05-17T12:26:03.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa599b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fa006c760 0x7f3fa00c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa599b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fa006c760 0x7f3fa00c6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54772/0 (socket says 172.21.15.88:54772) 2023-05-17T12:26:03.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa599b700 1 -- 172.21.15.88:0/219349745 learned_addr learned my addr 172.21.15.88:0/219349745 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:03.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa619c700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa0150dc0 0x7f3fa0151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa519a700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fa00cf190 0x7f3fa014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa599b700 1 -- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa0150dc0 msgr2=0x7f3fa0151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa599b700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa0150dc0 0x7f3fa0151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa599b700 1 -- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fa00cf190 msgr2=0x7f3fa014fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa599b700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fa00cf190 0x7f3fa014fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.661+0000 7f3fa599b700 1 -- 172.21.15.88:0/219349745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98009a70 con 0x7f3fa006c760 2023-05-17T12:26:03.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.662+0000 7f3fa599b700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fa006c760 0x7f3fa00c6e20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009c40 tx=0x7f3f9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:03.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.662+0000 7f3f967fc700 1 -- 172.21.15.88:0/219349745 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0044d0 con 0x7f3fa006c760 2023-05-17T12:26:03.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.662+0000 7f3f967fc700 1 -- 172.21.15.88:0/219349745 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c01e070 con 0x7f3fa006c760 2023-05-17T12:26:03.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.662+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c009550 con 0x7f3fa006c760 2023-05-17T12:26:03.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.662+0000 7f3f967fc700 1 -- 172.21.15.88:0/219349745 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0038e0 con 0x7f3fa006c760 2023-05-17T12:26:03.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.662+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa006aa40 con 0x7f3fa006c760 2023-05-17T12:26:03.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.663+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa006a760 con 0x7f3fa006c760 2023-05-17T12:26:03.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.664+0000 7f3f967fc700 1 -- 172.21.15.88:0/219349745 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f9c003a40 con 0x7f3fa006c760 2023-05-17T12:26:03.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.665+0000 7f3f967fc700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f8406ace0 0x7f3f8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:03.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.665+0000 7f3f967fc700 1 -- 172.21.15.88:0/219349745 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3f9c08a610 con 0x7f3fa006c760 2023-05-17T12:26:03.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.665+0000 7f3fa519a700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f8406ace0 0x7f3f8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:03.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.666+0000 7f3fa519a700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f8406ace0 0x7f3f8406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0153510 tx=0x7f3f90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:03.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.669+0000 7f3f967fc700 1 -- 172.21.15.88:0/219349745 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3f9c055380 con 0x7f3fa006c760 2023-05-17T12:26:03.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.861+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fa015cb40 con 0x7f3fa006c760 2023-05-17T12:26:03.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.862+0000 7f3f967fc700 1 -- 172.21.15.88:0/219349745 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3f9c0589a0 con 0x7f3fa006c760 2023-05-17T12:26:03.866 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:03.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f8406ace0 msgr2=0x7f3f8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f8406ace0 0x7f3f8406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0153510 tx=0x7f3f90009040 comp rx=0 tx=0).stop 2023-05-17T12:26:03.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fa006c760 msgr2=0x7f3fa00c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:03.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fa006c760 0x7f3fa00c6e20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009c40 tx=0x7f3f9c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:03.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 shutdown_connections 2023-05-17T12:26:03.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f8406ace0 0x7f3f8406d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3fa0150dc0 0x7f3fa0151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fa006c760 0x7f3fa00c6e20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 --2- 172.21.15.88:0/219349745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fa00cf190 0x7f3fa014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:03.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 >> 172.21.15.88:0/219349745 conn(0x7f3fa00d06f0 msgr2=0x7f3fa01559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 shutdown_connections 2023-05-17T12:26:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:03.864+0000 7f3fa7bff700 1 -- 172.21.15.88:0/219349745 wait complete. 2023-05-17T12:26:03.885 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:04.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.068+0000 7f2c103ff700 1 Processor -- start 2023-05-17T12:26:04.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.068+0000 7f2c103ff700 1 -- start start 2023-05-17T12:26:04.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.070+0000 7f2c103ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2c080b23a0 0x7f2c0806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.070+0000 7f2c103ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0806b4a0 con 0x7f2c0806c760 2023-05-17T12:26:04.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.070+0000 7f2c103ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0806a510 con 0x7f2c080cf190 2023-05-17T12:26:04.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.070+0000 7f2c103ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c080cd840 con 0x7f2c080b23a0 2023-05-17T12:26:04.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.070+0000 7f2c0e19b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2c0806c760 0x7f2c0806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59860/0 (socket says 172.21.15.88:59860) 2023-05-17T12:26:04.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.070+0000 7f2c0e19b700 1 -- 172.21.15.88:0/2059957243 learned_addr learned my addr 172.21.15.88:0/2059957243 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:04.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d99a700 1 --2- 172.21.15.88:0/2059957243 >> v2:172.21.15.187:3300/0 conn(0x7f2c080b23a0 0x7f2c0806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739462158 0 0) 0x7f2c04001110 con 0x7f2c0806c760 2023-05-17T12:26:04.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf40035b0 con 0x7f2c0806c760 2023-05-17T12:26:04.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1012607718 0 0) 0x7f2bf40035b0 con 0x7f2c0806c760 2023-05-17T12:26:04.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 >> v2:172.21.15.187:3300/0 conn(0x7f2c080b23a0 msgr2=0x7f2c0806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:04.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 --2- 172.21.15.88:0/2059957243 >> v2:172.21.15.187:3300/0 conn(0x7f2c080b23a0 0x7f2c0806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 >> v1:172.21.15.187:6789/0 conn(0x7f2c080cf190 legacy=0x7f2c08160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c080cdb20 con 0x7f2c0806c760 2023-05-17T12:26:04.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f2c04001800 con 0x7f2c0806c760 2023-05-17T12:26:04.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 >> v1:172.21.15.88:6789/0 conn(0x7f2c0806c760 legacy=0x7f2c0806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bf4003a00 0x7f2bf4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4004850 0x7f2bf4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4005200 0x7f2bf400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080cd840 con 0x7f2bf4004850 2023-05-17T12:26:04.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf400c080 con 0x7f2bf4005200 2023-05-17T12:26:04.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.071+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf400c240 con 0x7f2bf4003a00 2023-05-17T12:26:04.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d99a700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4004850 0x7f2bf4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0e99c700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4005200 0x7f2bf400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0e19b700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bf4003a00 0x7f2bf4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d99a700 1 -- 172.21.15.88:0/2059957243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bf4003a00 msgr2=0x7f2bf4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:04.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d99a700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bf4003a00 0x7f2bf4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d99a700 1 -- 172.21.15.88:0/2059957243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4005200 msgr2=0x7f2bf400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:04.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d99a700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4005200 0x7f2bf400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d99a700 1 -- 172.21.15.88:0/2059957243 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40035b0 con 0x7f2bf4004850 2023-05-17T12:26:04.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0e99c700 1 -- 172.21.15.88:0/2059957243 reap_dead start 2023-05-17T12:26:04.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d99a700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4004850 0x7f2bf4004cc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009b60 tx=0x7f2bf4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9dc1a681b268bab server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:04.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf800e6c0 con 0x7f2bf4004850 2023-05-17T12:26:04.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf800e820 con 0x7f2bf4004850 2023-05-17T12:26:04.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.072+0000 7f2c0d199700 1 -- 172.21.15.88:0/2059957243 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf800eb90 con 0x7f2bf4004850 2023-05-17T12:26:04.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.073+0000 7f2c103ff700 1 -- 172.21.15.88:0/2059957243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4004850 msgr2=0x7f2bf4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.073+0000 7f2c103ff700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4004850 0x7f2bf4004cc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009b60 tx=0x7f2bf4005880 comp rx=0 tx=0).stop 2023-05-17T12:26:04.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.073+0000 7f2c103ff700 1 -- 172.21.15.88:0/2059957243 shutdown_connections 2023-05-17T12:26:04.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.073+0000 7f2c103ff700 1 --2- 172.21.15.88:0/2059957243 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf4004850 0x7f2bf4004cc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.073+0000 7f2c103ff700 1 -- 172.21.15.88:0/2059957243 >> 172.21.15.88:0/2059957243 conn(0x7f2c080d06f0 msgr2=0x7f2c080d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:04.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.073+0000 7f2c103ff700 1 -- 172.21.15.88:0/2059957243 shutdown_connections 2023-05-17T12:26:04.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.073+0000 7f2c103ff700 1 -- 172.21.15.88:0/2059957243 wait complete. 2023-05-17T12:26:04.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.075+0000 7f2c103ff700 1 Processor -- start 2023-05-17T12:26:04.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.075+0000 7f2c103ff700 1 -- start start 2023-05-17T12:26:04.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c103ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bf4004850 0x7f2c081f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c103ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c0815ba00 0x7f2c080c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c103ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c080c98b0 0x7f2c080b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c103ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080cc4d0 con 0x7f2c0815ba00 2023-05-17T12:26:04.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c103ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0815be70 con 0x7f2c080c98b0 2023-05-17T12:26:04.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c103ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080cb8c0 con 0x7f2bf4004850 2023-05-17T12:26:04.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0d99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c0815ba00 0x7f2c080c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0d99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c0815ba00 0x7f2c080c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54804/0 (socket says 172.21.15.88:54804) 2023-05-17T12:26:04.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0d99a700 1 -- 172.21.15.88:0/1178517562 learned_addr learned my addr 172.21.15.88:0/1178517562 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:04.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0e19b700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bf4004850 0x7f2c081f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0e99c700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c080c98b0 0x7f2c080b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0d99a700 1 -- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bf4004850 msgr2=0x7f2c081f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0d99a700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bf4004850 0x7f2c081f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0d99a700 1 -- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c080c98b0 msgr2=0x7f2c080b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0d99a700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c080c98b0 0x7f2c080b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.076+0000 7f2c0d99a700 1 -- 172.21.15.88:0/1178517562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0806aa40 con 0x7f2c0815ba00 2023-05-17T12:26:04.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.077+0000 7f2c0d99a700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c0815ba00 0x7f2c080c9370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400c050 tx=0x7f2bf80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.077+0000 7f2bfeffd700 1 -- 172.21.15.88:0/1178517562 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf800e6c0 con 0x7f2c0815ba00 2023-05-17T12:26:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.077+0000 7f2bfeffd700 1 -- 172.21.15.88:0/1178517562 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf8003ad0 con 0x7f2c0815ba00 2023-05-17T12:26:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.077+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0806a760 con 0x7f2c0815ba00 2023-05-17T12:26:04.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.077+0000 7f2bfeffd700 1 -- 172.21.15.88:0/1178517562 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8003e80 con 0x7f2c0815ba00 2023-05-17T12:26:04.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.077+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0815cb40 con 0x7f2c0815ba00 2023-05-17T12:26:04.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.078+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c08074530 con 0x7f2c0815ba00 2023-05-17T12:26:04.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.079+0000 7f2bfeffd700 1 -- 172.21.15.88:0/1178517562 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bf8013470 con 0x7f2c0815ba00 2023-05-17T12:26:04.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.080+0000 7f2bfeffd700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2bec06ace0 0x7f2bec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.080+0000 7f2bfeffd700 1 -- 172.21.15.88:0/1178517562 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2bf808b170 con 0x7f2c0815ba00 2023-05-17T12:26:04.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.080+0000 7f2c0e19b700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2bec06ace0 0x7f2bec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.081+0000 7f2c0e19b700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2bec06ace0 0x7f2bec06d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c04001e20 tx=0x7f2c04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:04.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.084+0000 7f2bfeffd700 1 -- 172.21.15.88:0/1178517562 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2bf8056000 con 0x7f2c0815ba00 2023-05-17T12:26:04.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.276+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c0806b7c0 con 0x7f2c0815ba00 2023-05-17T12:26:04.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.277+0000 7f2bfeffd700 1 -- 172.21.15.88:0/1178517562 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bf8059620 con 0x7f2c0815ba00 2023-05-17T12:26:04.281 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:04.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2bec06ace0 msgr2=0x7f2bec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2bec06ace0 0x7f2bec06d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c04001e20 tx=0x7f2c04009040 comp rx=0 tx=0).stop 2023-05-17T12:26:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c0815ba00 msgr2=0x7f2c080c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c0815ba00 0x7f2c080c9370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400c050 tx=0x7f2bf80047c0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 shutdown_connections 2023-05-17T12:26:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2bec06ace0 0x7f2bec06d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c080c98b0 0x7f2c080b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bf4004850 0x7f2c081f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 --2- 172.21.15.88:0/1178517562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c0815ba00 0x7f2c080c9370 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 >> 172.21.15.88:0/1178517562 conn(0x7f2c080d06f0 msgr2=0x7f2c08154740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:04.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.279+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 shutdown_connections 2023-05-17T12:26:04.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.280+0000 7f2c103ff700 1 -- 172.21.15.88:0/1178517562 wait complete. 2023-05-17T12:26:04.301 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:04.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.485+0000 7f39675ff700 1 Processor -- start 2023-05-17T12:26:04.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.485+0000 7f39675ff700 1 -- start start 2023-05-17T12:26:04.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.486+0000 7f39675ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f39600b23a0 0x7f396006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.486+0000 7f39675ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600cf190 0x7f3960160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.486+0000 7f39675ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396006b4a0 con 0x7f396006c760 2023-05-17T12:26:04.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.486+0000 7f39675ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396006a510 con 0x7f39600b23a0 2023-05-17T12:26:04.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.486+0000 7f39675ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600cd840 con 0x7f39600cf190 2023-05-17T12:26:04.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.486+0000 7f396539b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f396006c760 0x7f396006cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59872/0 (socket says 172.21.15.88:59872) 2023-05-17T12:26:04.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.486+0000 7f396539b700 1 -- 172.21.15.88:0/3698137186 learned_addr learned my addr 172.21.15.88:0/3698137186 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:04.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3964b9a700 1 --2- 172.21.15.88:0/3698137186 >> v2:172.21.15.187:3300/0 conn(0x7f39600b23a0 0x7f396006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3965b9c700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600cf190 0x7f3960160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219955491 0 0) 0x7f395c001110 con 0x7f396006c760 2023-05-17T12:26:04.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c0035b0 con 0x7f396006c760 2023-05-17T12:26:04.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 521660004 0 0) 0x7f394c0035b0 con 0x7f396006c760 2023-05-17T12:26:04.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600cf190 msgr2=0x7f3960160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600cf190 0x7f3960160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 >> v2:172.21.15.187:3300/0 conn(0x7f39600b23a0 msgr2=0x7f396006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 --2- 172.21.15.88:0/3698137186 >> v2:172.21.15.187:3300/0 conn(0x7f39600b23a0 0x7f396006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600cdb20 con 0x7f396006c760 2023-05-17T12:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f395c001800 con 0x7f396006c760 2023-05-17T12:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3964b9a700 1 --2- 172.21.15.88:0/3698137186 >> v2:172.21.15.187:3300/0 conn(0x7f39600b23a0 0x7f396006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 >> v1:172.21.15.88:6789/0 conn(0x7f396006c760 legacy=0x7f396006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f394c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f394c004850 0x7f394c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600cf190 0x7f394c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396006a510 con 0x7f394c003a00 2023-05-17T12:26:04.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600cd840 con 0x7f394c004850 2023-05-17T12:26:04.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.487+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c00ba10 con 0x7f39600cf190 2023-05-17T12:26:04.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f396539b700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f394c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f3964b9a700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f394c004850 0x7f394c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f3965b9c700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600cf190 0x7f394c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f396539b700 1 -- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600cf190 msgr2=0x7f394c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f396539b700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600cf190 0x7f394c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f396539b700 1 -- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f394c004850 msgr2=0x7f394c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f396539b700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f394c004850 0x7f394c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f396539b700 1 -- 172.21.15.88:0/3698137186 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0035b0 con 0x7f394c003a00 2023-05-17T12:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f3965b9c700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600cf190 0x7f394c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:04.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f396539b700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f394c003e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c1c0 tx=0x7f394c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348e976fa8b68df0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c007d00 con 0x7f394c003a00 2023-05-17T12:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c00cc80 con 0x7f394c003a00 2023-05-17T12:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.488+0000 7f3957fff700 1 -- 172.21.15.88:0/3698137186 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c005960 con 0x7f394c003a00 2023-05-17T12:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.489+0000 7f39675ff700 1 -- 172.21.15.88:0/3698137186 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 msgr2=0x7f394c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.489+0000 7f39675ff700 1 --2- 172.21.15.88:0/3698137186 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f394c003e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c1c0 tx=0x7f394c005880 comp rx=0 tx=0).stop 2023-05-17T12:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.489+0000 7f3965b9c700 1 -- 172.21.15.88:0/3698137186 reap_dead start 2023-05-17T12:26:04.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.489+0000 7f39675ff700 1 -- 172.21.15.88:0/3698137186 shutdown_connections 2023-05-17T12:26:04.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.489+0000 7f39675ff700 1 -- 172.21.15.88:0/3698137186 >> 172.21.15.88:0/3698137186 conn(0x7f39600d06f0 msgr2=0x7f39600d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:04.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.489+0000 7f39675ff700 1 -- 172.21.15.88:0/3698137186 shutdown_connections 2023-05-17T12:26:04.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.489+0000 7f39675ff700 1 -- 172.21.15.88:0/3698137186 wait complete. 2023-05-17T12:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.491+0000 7f39675ff700 1 Processor -- start 2023-05-17T12:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.491+0000 7f39675ff700 1 -- start start 2023-05-17T12:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f39675ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f39601540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f39675ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39600cc5f0 0x7f39600ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f39675ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600b7000 0x7f39600b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f39675ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39601e6880 con 0x7f394c003a00 2023-05-17T12:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f39675ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600b79e0 con 0x7f39600cc5f0 2023-05-17T12:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f39675ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3960154af0 con 0x7f39600b7000 2023-05-17T12:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f396539b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f39601540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f396539b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f39601540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54808/0 (socket says 172.21.15.88:54808) 2023-05-17T12:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f396539b700 1 -- 172.21.15.88:0/1320452681 learned_addr learned my addr 172.21.15.88:0/1320452681 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f3964b9a700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39600cc5f0 0x7f39600ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f3965b9c700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600b7000 0x7f39600b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f396539b700 1 -- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600b7000 msgr2=0x7f39600b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f396539b700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600b7000 0x7f39600b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f396539b700 1 -- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39600cc5f0 msgr2=0x7f39600ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f396539b700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39600cc5f0 0x7f39600ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f396539b700 1 -- 172.21.15.88:0/1320452681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396006aa40 con 0x7f394c003a00 2023-05-17T12:26:04.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.492+0000 7f3964b9a700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39600cc5f0 0x7f39600ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:04.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.493+0000 7f396539b700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f39601540f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c7b0 tx=0x7f395c001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:04.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.493+0000 7f3955ffb700 1 -- 172.21.15.88:0/1320452681 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c005d10 con 0x7f394c003a00 2023-05-17T12:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.493+0000 7f3955ffb700 1 -- 172.21.15.88:0/1320452681 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c005e70 con 0x7f394c003a00 2023-05-17T12:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.493+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396006a760 con 0x7f394c003a00 2023-05-17T12:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.493+0000 7f3955ffb700 1 -- 172.21.15.88:0/1320452681 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c0072f0 con 0x7f394c003a00 2023-05-17T12:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.493+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396015cb40 con 0x7f394c003a00 2023-05-17T12:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.494+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39601e6af0 con 0x7f394c003a00 2023-05-17T12:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.495+0000 7f3955ffb700 1 -- 172.21.15.88:0/1320452681 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f395c019030 con 0x7f394c003a00 2023-05-17T12:26:04.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.496+0000 7f3955ffb700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f394406ace0 0x7f394406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.496+0000 7f3955ffb700 1 -- 172.21.15.88:0/1320452681 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f395c08a9e0 con 0x7f394c003a00 2023-05-17T12:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.496+0000 7f3964b9a700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f394406ace0 0x7f394406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.497+0000 7f3964b9a700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f394406ace0 0x7f394406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3960161230 tx=0x7f3950008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:04.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.500+0000 7f3955ffb700 1 -- 172.21.15.88:0/1320452681 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f395c055750 con 0x7f394c003a00 2023-05-17T12:26:04.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.696+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f396006b4a0 con 0x7f394c003a00 2023-05-17T12:26:04.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.696+0000 7f3955ffb700 1 -- 172.21.15.88:0/1320452681 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f396006b4a0 con 0x7f394c003a00 2023-05-17T12:26:04.701 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f394406ace0 msgr2=0x7f394406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f394406ace0 0x7f394406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3960161230 tx=0x7f3950008040 comp rx=0 tx=0).stop 2023-05-17T12:26:04.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 msgr2=0x7f39601540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f39601540f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c7b0 tx=0x7f395c001ac0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 shutdown_connections 2023-05-17T12:26:04.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f394406ace0 0x7f394406d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39600b7000 0x7f39600b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f394c003a00 0x7f39601540f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 --2- 172.21.15.88:0/1320452681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39600cc5f0 0x7f39600ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 >> 172.21.15.88:0/1320452681 conn(0x7f39600d06f0 msgr2=0x7f39600b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:04.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 shutdown_connections 2023-05-17T12:26:04.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.699+0000 7f39675ff700 1 -- 172.21.15.88:0/1320452681 wait complete. 2023-05-17T12:26:04.720 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:04.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.903+0000 7faaf5bff700 1 Processor -- start 2023-05-17T12:26:04.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.904+0000 7faaf5bff700 1 -- start start 2023-05-17T12:26:04.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.905+0000 7faaf5bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf0153d60 0x7faaf015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.905+0000 7faaf5bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faaf00cdf80 0x7faaf00cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.905+0000 7faaf5bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf015e030 con 0x7faaf00cdb10 2023-05-17T12:26:04.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.905+0000 7faaf5bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf0159ed0 con 0x7faaf00cdf80 2023-05-17T12:26:04.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.905+0000 7faaf5bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf015a1b0 con 0x7faaf0153d60 2023-05-17T12:26:04.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.905+0000 7faae7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faaf00cdb10 0x7faaf00cc8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59878/0 (socket says 172.21.15.88:59878) 2023-05-17T12:26:04.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.905+0000 7faae7fff700 1 -- 172.21.15.88:0/2107565533 learned_addr learned my addr 172.21.15.88:0/2107565533 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:04.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.905+0000 7faaeffff700 1 --2- 172.21.15.88:0/2107565533 >> v2:172.21.15.88:3300/0 conn(0x7faaf00cdf80 0x7faaf00cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaef7fe700 1 --2- 172.21.15.88:0/2107565533 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf0153d60 0x7faaf015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeeffd700 1 -- 172.21.15.88:0/2107565533 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479065194 0 0) 0x7faaf015e030 con 0x7faaf00cdb10 2023-05-17T12:26:04.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeeffd700 1 -- 172.21.15.88:0/2107565533 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faadc0035b0 con 0x7faaf00cdb10 2023-05-17T12:26:04.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeffff700 1 -- 172.21.15.88:0/2107565533 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf0153d60 msgr2=0x7faaf015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:04.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeffff700 1 --2- 172.21.15.88:0/2107565533 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf0153d60 0x7faaf015daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeffff700 1 -- 172.21.15.88:0/2107565533 >> v1:172.21.15.88:6789/0 conn(0x7faaf00cdb10 legacy=0x7faaf00cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeffff700 1 -- 172.21.15.88:0/2107565533 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf015a490 con 0x7faaf00cdf80 2023-05-17T12:26:04.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaef7fe700 1 --2- 172.21.15.88:0/2107565533 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf0153d60 0x7faaf015daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:04.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeffff700 1 --2- 172.21.15.88:0/2107565533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf00cdf80 0x7faaf00cd000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faae8009d90 tx=0x7faae800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885a4d211f9485f2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:04.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeeffd700 1 -- 172.21.15.88:0/2107565533 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800e070 con 0x7faaf00cdf80 2023-05-17T12:26:04.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeeffd700 1 -- 172.21.15.88:0/2107565533 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae800bb20 con 0x7faaf00cdf80 2023-05-17T12:26:04.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.906+0000 7faaeeffd700 1 -- 172.21.15.88:0/2107565533 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8012430 con 0x7faaf00cdf80 2023-05-17T12:26:04.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.907+0000 7faaf5bff700 1 -- 172.21.15.88:0/2107565533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf00cdf80 msgr2=0x7faaf00cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.907+0000 7faaf5bff700 1 --2- 172.21.15.88:0/2107565533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf00cdf80 0x7faaf00cd000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faae8009d90 tx=0x7faae800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:04.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.907+0000 7faaf5bff700 1 -- 172.21.15.88:0/2107565533 shutdown_connections 2023-05-17T12:26:04.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.907+0000 7faaf5bff700 1 --2- 172.21.15.88:0/2107565533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf00cdf80 0x7faaf00cd000 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.907+0000 7faaf5bff700 1 --2- 172.21.15.88:0/2107565533 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf0153d60 0x7faaf015daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.907+0000 7faaf5bff700 1 -- 172.21.15.88:0/2107565533 >> 172.21.15.88:0/2107565533 conn(0x7faaf00cf970 msgr2=0x7faaf00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:04.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.907+0000 7faaf5bff700 1 -- 172.21.15.88:0/2107565533 shutdown_connections 2023-05-17T12:26:04.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.907+0000 7faaf5bff700 1 -- 172.21.15.88:0/2107565533 wait complete. 2023-05-17T12:26:04.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.909+0000 7faaf5bff700 1 Processor -- start 2023-05-17T12:26:04.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.909+0000 7faaf5bff700 1 -- start start 2023-05-17T12:26:04.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaf5bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf00cdb10 0x7faaf013ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaf5bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaf00cdf80 0x7faaf015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaf5bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf0153d60 0x7faaf015c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaf5bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf00b1cb0 con 0x7faaf0153d60 2023-05-17T12:26:04.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaf5bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf015b1b0 con 0x7faaf00cdf80 2023-05-17T12:26:04.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaf5bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf015b450 con 0x7faaf00cdb10 2023-05-17T12:26:04.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaeffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf0153d60 0x7faaf015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaeffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf0153d60 0x7faaf015c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54816/0 (socket says 172.21.15.88:54816) 2023-05-17T12:26:04.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaeffff700 1 -- 172.21.15.88:0/211315173 learned_addr learned my addr 172.21.15.88:0/211315173 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:04.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaef7fe700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf00cdb10 0x7faaf013ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faae7fff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaf00cdf80 0x7faaf015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaeffff700 1 -- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf00cdb10 msgr2=0x7faaf013ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaeffff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf00cdb10 0x7faaf013ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaeffff700 1 -- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaf00cdf80 msgr2=0x7faaf015ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:04.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaeffff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaf00cdf80 0x7faaf015ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:04.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.911+0000 7faaeffff700 1 -- 172.21.15.88:0/211315173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8009a70 con 0x7faaf0153d60 2023-05-17T12:26:04.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.912+0000 7faaeffff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf0153d60 0x7faaf015c230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faae8014040 tx=0x7faae8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:04.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.912+0000 7faaecff9700 1 -- 172.21.15.88:0/211315173 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8012430 con 0x7faaf0153d60 2023-05-17T12:26:04.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.912+0000 7faaecff9700 1 -- 172.21.15.88:0/211315173 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae8020070 con 0x7faaf0153d60 2023-05-17T12:26:04.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.912+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf015aa50 con 0x7faaf0153d60 2023-05-17T12:26:04.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.912+0000 7faaecff9700 1 -- 172.21.15.88:0/211315173 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8003ea0 con 0x7faaf0153d60 2023-05-17T12:26:04.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.912+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf015a770 con 0x7faaf0153d60 2023-05-17T12:26:04.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.913+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf00ce400 con 0x7faaf0153d60 2023-05-17T12:26:04.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.914+0000 7faaecff9700 1 -- 172.21.15.88:0/211315173 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faae8004280 con 0x7faaf0153d60 2023-05-17T12:26:04.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.915+0000 7faaecff9700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faad006ace0 0x7faad006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:04.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.915+0000 7faaecff9700 1 -- 172.21.15.88:0/211315173 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faae8022070 con 0x7faaf0153d60 2023-05-17T12:26:04.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.916+0000 7faaef7fe700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faad006ace0 0x7faad006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:04.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.916+0000 7faaef7fe700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faad006ace0 0x7faad006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faaf015c1c0 tx=0x7faae0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:04.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:04.920+0000 7faaecff9700 1 -- 172.21.15.88:0/211315173 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faae80566e0 con 0x7faaf0153d60 2023-05-17T12:26:05.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.113+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faaf0074530 con 0x7faaf0153d60 2023-05-17T12:26:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.114+0000 7faaecff9700 1 -- 172.21.15.88:0/211315173 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7faae8059d00 con 0x7faaf0153d60 2023-05-17T12:26:05.118 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faad006ace0 msgr2=0x7faad006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faad006ace0 0x7faad006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faaf015c1c0 tx=0x7faae0008040 comp rx=0 tx=0).stop 2023-05-17T12:26:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf0153d60 msgr2=0x7faaf015c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf0153d60 0x7faaf015c230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faae8014040 tx=0x7faae8004ad0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 shutdown_connections 2023-05-17T12:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faad006ace0 0x7faad006d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faaf0153d60 0x7faaf015c230 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaf00cdb10 0x7faaf013ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 --2- 172.21.15.88:0/211315173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaf00cdf80 0x7faaf015ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 >> 172.21.15.88:0/211315173 conn(0x7faaf00cf970 msgr2=0x7faaf0142600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:05.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 shutdown_connections 2023-05-17T12:26:05.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.116+0000 7faaf5bff700 1 -- 172.21.15.88:0/211315173 wait complete. 2023-05-17T12:26:05.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:05.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.319+0000 7fb06e9ff700 1 Processor -- start 2023-05-17T12:26:05.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.320+0000 7fb06e9ff700 1 -- start start 2023-05-17T12:26:05.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06e9ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb06815c840 0x7fb06806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06e9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb06806c330 0x7fb06806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06e9ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680cd6b0 con 0x7fb06806b0b0 2023-05-17T12:26:05.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06e9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680cdf50 con 0x7fb06806c330 2023-05-17T12:26:05.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06e9ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06806ccb0 con 0x7fb06815c840 2023-05-17T12:26:05.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06cf9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb06806c330 0x7fb06806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06cf9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb06806c330 0x7fb06806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54822/0 (socket says 172.21.15.88:54822) 2023-05-17T12:26:05.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06cf9c700 1 -- 172.21.15.88:0/874020170 learned_addr learned my addr 172.21.15.88:0/874020170 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:05.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06cf9c700 1 -- 172.21.15.88:0/874020170 >> v2:172.21.15.187:3300/0 conn(0x7fb06815c840 msgr2=0x7fb06806b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:05.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06cf9c700 1 --2- 172.21.15.88:0/874020170 >> v2:172.21.15.187:3300/0 conn(0x7fb06815c840 0x7fb06806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06cf9c700 1 -- 172.21.15.88:0/874020170 >> v1:172.21.15.187:6789/0 conn(0x7fb06806b0b0 legacy=0x7fb0680cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:05.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.321+0000 7fb06cf9c700 1 -- 172.21.15.88:0/874020170 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680b2460 con 0x7fb06806c330 2023-05-17T12:26:05.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb06cf9c700 1 --2- 172.21.15.88:0/874020170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806c330 0x7fb06806c770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0680cfa40 tx=0x7fb06000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd120d880427e427 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:05.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb066ffd700 1 -- 172.21.15.88:0/874020170 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06000e070 con 0x7fb06806c330 2023-05-17T12:26:05.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb066ffd700 1 -- 172.21.15.88:0/874020170 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb060003a20 con 0x7fb06806c330 2023-05-17T12:26:05.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb066ffd700 1 -- 172.21.15.88:0/874020170 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060003dd0 con 0x7fb06806c330 2023-05-17T12:26:05.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb06e9ff700 1 -- 172.21.15.88:0/874020170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806c330 msgr2=0x7fb06806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb06e9ff700 1 --2- 172.21.15.88:0/874020170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806c330 0x7fb06806c770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0680cfa40 tx=0x7fb06000b330 comp rx=0 tx=0).stop 2023-05-17T12:26:05.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb06e9ff700 1 -- 172.21.15.88:0/874020170 shutdown_connections 2023-05-17T12:26:05.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb06e9ff700 1 --2- 172.21.15.88:0/874020170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806c330 0x7fb06806c770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb06e9ff700 1 --2- 172.21.15.88:0/874020170 >> v2:172.21.15.187:3300/0 conn(0x7fb06815c840 0x7fb06806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb06e9ff700 1 -- 172.21.15.88:0/874020170 >> 172.21.15.88:0/874020170 conn(0x7fb0680d3060 msgr2=0x7fb0680d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:05.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.322+0000 7fb06e9ff700 1 -- 172.21.15.88:0/874020170 shutdown_connections 2023-05-17T12:26:05.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.323+0000 7fb06e9ff700 1 -- 172.21.15.88:0/874020170 wait complete. 2023-05-17T12:26:05.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.325+0000 7fb06e9ff700 1 Processor -- start 2023-05-17T12:26:05.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.325+0000 7fb06e9ff700 1 -- start start 2023-05-17T12:26:05.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.326+0000 7fb06e9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806b0b0 0x7fb0680b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.326+0000 7fb06e9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb06806c330 0x7fb06814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.326+0000 7fb06e9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb06815c840 0x7fb06814c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.326+0000 7fb06e9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068158780 con 0x7fb06806b0b0 2023-05-17T12:26:05.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.326+0000 7fb06e9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068160720 con 0x7fb06806c330 2023-05-17T12:26:05.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.326+0000 7fb06e9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb068160a00 con 0x7fb06815c840 2023-05-17T12:26:05.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb067fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806b0b0 0x7fb0680b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb067fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806b0b0 0x7fb0680b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54830/0 (socket says 172.21.15.88:54830) 2023-05-17T12:26:05.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb067fff700 1 -- 172.21.15.88:0/3011206714 learned_addr learned my addr 172.21.15.88:0/3011206714 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:05.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb0677fe700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb06806c330 0x7fb06814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb06cf9c700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb06815c840 0x7fb06814c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb067fff700 1 -- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb06815c840 msgr2=0x7fb06814c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb067fff700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb06815c840 0x7fb06814c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb067fff700 1 -- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb06806c330 msgr2=0x7fb06814c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb067fff700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb06806c330 0x7fb06814c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb067fff700 1 -- 172.21.15.88:0/3011206714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb060009b30 con 0x7fb06806b0b0 2023-05-17T12:26:05.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb067fff700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806b0b0 0x7fb0680b4510 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb05800b4a0 tx=0x7fb05800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:05.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.327+0000 7fb064ff9700 1 -- 172.21.15.88:0/3011206714 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058011830 con 0x7fb06806b0b0 2023-05-17T12:26:05.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.328+0000 7fb064ff9700 1 -- 172.21.15.88:0/3011206714 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058011990 con 0x7fb06806b0b0 2023-05-17T12:26:05.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.328+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0680cd900 con 0x7fb06806b0b0 2023-05-17T12:26:05.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.328+0000 7fb064ff9700 1 -- 172.21.15.88:0/3011206714 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058011d40 con 0x7fb06806b0b0 2023-05-17T12:26:05.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.328+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0680b2740 con 0x7fb06806b0b0 2023-05-17T12:26:05.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.329+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0680cdbe0 con 0x7fb06806b0b0 2023-05-17T12:26:05.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.330+0000 7fb064ff9700 1 -- 172.21.15.88:0/3011206714 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb05801a400 con 0x7fb06806b0b0 2023-05-17T12:26:05.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.330+0000 7fb064ff9700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb05406ace0 0x7fb05406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.330+0000 7fb064ff9700 1 -- 172.21.15.88:0/3011206714 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb058089630 con 0x7fb06806b0b0 2023-05-17T12:26:05.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.331+0000 7fb0677fe700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb05406ace0 0x7fb05406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.331+0000 7fb0677fe700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb05406ace0 0x7fb05406d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb0680b1b50 tx=0x7fb05c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:05.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.335+0000 7fb064ff9700 1 -- 172.21.15.88:0/3011206714 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb0580543c0 con 0x7fb06806b0b0 2023-05-17T12:26:05.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.530+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb068074530 con 0x7fb06806b0b0 2023-05-17T12:26:05.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.531+0000 7fb064ff9700 1 -- 172.21.15.88:0/3011206714 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fb0580579e0 con 0x7fb06806b0b0 2023-05-17T12:26:05.536 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:05.536 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:05.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb05406ace0 msgr2=0x7fb05406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb05406ace0 0x7fb05406d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb0680b1b50 tx=0x7fb05c009040 comp rx=0 tx=0).stop 2023-05-17T12:26:05.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806b0b0 msgr2=0x7fb0680b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806b0b0 0x7fb0680b4510 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb05800b4a0 tx=0x7fb05800b7b0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 shutdown_connections 2023-05-17T12:26:05.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb05406ace0 0x7fb05406d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb06815c840 0x7fb06814c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb06806b0b0 0x7fb0680b4510 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 --2- 172.21.15.88:0/3011206714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb06806c330 0x7fb06814c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 >> 172.21.15.88:0/3011206714 conn(0x7fb0680d3060 msgr2=0x7fb0680cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:05.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 shutdown_connections 2023-05-17T12:26:05.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.534+0000 7fb06e9ff700 1 -- 172.21.15.88:0/3011206714 wait complete. 2023-05-17T12:26:05.555 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:05.556 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:05.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.738+0000 7f9821bff700 1 Processor -- start 2023-05-17T12:26:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.738+0000 7f9821bff700 1 -- start start 2023-05-17T12:26:05.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.739+0000 7f9821bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f981c0b0a10 0x7f981c167b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.739+0000 7f9821bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c06b770 con 0x7f981c15cd80 2023-05-17T12:26:05.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.739+0000 7f9821bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c06d810 con 0x7f981c0b2510 2023-05-17T12:26:05.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.739+0000 7f9821bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c15d150 con 0x7f981c0b0a10 2023-05-17T12:26:05.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.739+0000 7f981b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f981c15cd80 0x7f981c06cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59890/0 (socket says 172.21.15.88:59890) 2023-05-17T12:26:05.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.739+0000 7f981b7fe700 1 -- 172.21.15.88:0/3017162583 learned_addr learned my addr 172.21.15.88:0/3017162583 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123848016 0 0) 0x7f981c06b770 con 0x7f981c15cd80 2023-05-17T12:26:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98040035b0 con 0x7f981c15cd80 2023-05-17T12:26:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981bfff700 1 --2- 172.21.15.88:0/3017162583 >> v2:172.21.15.187:3300/0 conn(0x7f981c0b0a10 0x7f981c167b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358415571 0 0) 0x7f98040035b0 con 0x7f981c15cd80 2023-05-17T12:26:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 >> v2:172.21.15.187:3300/0 conn(0x7f981c0b0a10 msgr2=0x7f981c167b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 --2- 172.21.15.88:0/3017162583 >> v2:172.21.15.187:3300/0 conn(0x7f981c0b0a10 0x7f981c167b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 >> v1:172.21.15.187:6789/0 conn(0x7f981c0b2510 legacy=0x7f981c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c06ae40 con 0x7f981c15cd80 2023-05-17T12:26:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f980c001670 con 0x7f981c15cd80 2023-05-17T12:26:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 >> v1:172.21.15.88:6789/0 conn(0x7f981c15cd80 legacy=0x7f981c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9804003a00 0x7f9804003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9804004850 0x7f9804004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9804005200 0x7f980400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c15d150 con 0x7f9804005200 2023-05-17T12:26:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980400c080 con 0x7f9804004850 2023-05-17T12:26:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.740+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980400c240 con 0x7f9804003a00 2023-05-17T12:26:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981bfff700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9804005200 0x7f980400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981affd700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9804004850 0x7f9804004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981b7fe700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9804003a00 0x7f9804003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981bfff700 1 -- 172.21.15.88:0/3017162583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9804003a00 msgr2=0x7f9804003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981bfff700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9804003a00 0x7f9804003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981bfff700 1 -- 172.21.15.88:0/3017162583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9804004850 msgr2=0x7f9804004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981bfff700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9804004850 0x7f9804004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981bfff700 1 -- 172.21.15.88:0/3017162583 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040035b0 con 0x7f9804005200 2023-05-17T12:26:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981bfff700 1 -- 172.21.15.88:0/3017162583 reap_dead start 2023-05-17T12:26:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981bfff700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9804005200 0x7f980400ba10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9814009f90 tx=0x7f9804005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b1bc77d0d4a626 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814003a20 con 0x7f9804005200 2023-05-17T12:26:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981400f040 con 0x7f9804005200 2023-05-17T12:26:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.741+0000 7f981a7fc700 1 -- 172.21.15.88:0/3017162583 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814003de0 con 0x7f9804005200 2023-05-17T12:26:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.742+0000 7f9821bff700 1 -- 172.21.15.88:0/3017162583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9804005200 msgr2=0x7f980400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.742+0000 7f9821bff700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9804005200 0x7f980400ba10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9814009f90 tx=0x7f9804005880 comp rx=0 tx=0).stop 2023-05-17T12:26:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.742+0000 7f9821bff700 1 -- 172.21.15.88:0/3017162583 shutdown_connections 2023-05-17T12:26:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.742+0000 7f9821bff700 1 --2- 172.21.15.88:0/3017162583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9804005200 0x7f980400ba10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.742+0000 7f9821bff700 1 -- 172.21.15.88:0/3017162583 >> 172.21.15.88:0/3017162583 conn(0x7f981c0b2de0 msgr2=0x7f981c0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.742+0000 7f9821bff700 1 -- 172.21.15.88:0/3017162583 shutdown_connections 2023-05-17T12:26:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.742+0000 7f9821bff700 1 -- 172.21.15.88:0/3017162583 wait complete. 2023-05-17T12:26:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.744+0000 7f9821bff700 1 Processor -- start 2023-05-17T12:26:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.744+0000 7f9821bff700 1 -- start start 2023-05-17T12:26:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f9821bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9804005200 0x7f981c1f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f9821bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15fbd0 0x7f981c06e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f9821bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f981c1f2cd0 0x7f981c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f9821bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1f62e0 con 0x7f981c1f2cd0 2023-05-17T12:26:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f9821bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1f65c0 con 0x7f9804005200 2023-05-17T12:26:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f9821bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1f68a0 con 0x7f981c15fbd0 2023-05-17T12:26:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f981bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f981c1f2cd0 0x7f981c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f981bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f981c1f2cd0 0x7f981c15db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54846/0 (socket says 172.21.15.88:54846) 2023-05-17T12:26:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f981bfff700 1 -- 172.21.15.88:0/3382823233 learned_addr learned my addr 172.21.15.88:0/3382823233 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f981b7fe700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9804005200 0x7f981c1f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.745+0000 7f981affd700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15fbd0 0x7f981c06e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f981bfff700 1 -- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15fbd0 msgr2=0x7f981c06e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f981bfff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15fbd0 0x7f981c06e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f981bfff700 1 -- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9804005200 msgr2=0x7f981c1f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f981bfff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9804005200 0x7f981c1f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f981bfff700 1 -- 172.21.15.88:0/3382823233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c06b400 con 0x7f981c1f2cd0 2023-05-17T12:26:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f981bfff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f981c1f2cd0 0x7f981c15db90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f981c0b2d70 tx=0x7f9814004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f9803fff700 1 -- 172.21.15.88:0/3382823233 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814003e10 con 0x7f981c1f2cd0 2023-05-17T12:26:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f9803fff700 1 -- 172.21.15.88:0/3382823233 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814004230 con 0x7f981c1f2cd0 2023-05-17T12:26:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f9803fff700 1 -- 172.21.15.88:0/3382823233 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140045e0 con 0x7f981c1f2cd0 2023-05-17T12:26:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.746+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c06b120 con 0x7f981c1f2cd0 2023-05-17T12:26:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.747+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c0ce3b0 con 0x7f981c1f2cd0 2023-05-17T12:26:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.747+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c074530 con 0x7f981c1f2cd0 2023-05-17T12:26:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.748+0000 7f9803fff700 1 -- 172.21.15.88:0/3382823233 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9814004740 con 0x7f981c1f2cd0 2023-05-17T12:26:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.749+0000 7f9803fff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f980806ace0 0x7f980806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.749+0000 7f9803fff700 1 -- 172.21.15.88:0/3382823233 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f981408aed0 con 0x7f981c1f2cd0 2023-05-17T12:26:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.750+0000 7f981b7fe700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f980806ace0 0x7f980806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.750+0000 7f981b7fe700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f980806ace0 0x7f980806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f980c000c00 tx=0x7f980c000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.753+0000 7f9803fff700 1 -- 172.21.15.88:0/3382823233 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9814055ce0 con 0x7f981c1f2cd0 2023-05-17T12:26:05.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.951+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f981c072210 con 0x7f981c1f2cd0 2023-05-17T12:26:05.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.951+0000 7f9803fff700 1 -- 172.21.15.88:0/3382823233 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98140180a0 con 0x7f981c1f2cd0 2023-05-17T12:26:05.956 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:05.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f980806ace0 msgr2=0x7f980806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f980806ace0 0x7f980806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f980c000c00 tx=0x7f980c000ed0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f981c1f2cd0 msgr2=0x7f981c15db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:05.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f981c1f2cd0 0x7f981c15db90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f981c0b2d70 tx=0x7f9814004b40 comp rx=0 tx=0).stop 2023-05-17T12:26:05.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 shutdown_connections 2023-05-17T12:26:05.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f980806ace0 0x7f980806d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f981c1f2cd0 0x7f981c15db90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9804005200 0x7f981c1f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 --2- 172.21.15.88:0/3382823233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f981c15fbd0 0x7f981c06e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:05.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 >> 172.21.15.88:0/3382823233 conn(0x7f981c0b2de0 msgr2=0x7f981c15c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:05.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 shutdown_connections 2023-05-17T12:26:05.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:05.953+0000 7f9821bff700 1 -- 172.21.15.88:0/3382823233 wait complete. 2023-05-17T12:26:05.974 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:06.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.158+0000 7f6d0ebff700 1 Processor -- start 2023-05-17T12:26:06.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.158+0000 7f6d0ebff700 1 -- start start 2023-05-17T12:26:06.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d0ebff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6d080b23a0 0x7f6d0806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d0ebff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d080cf190 0x7f6d08160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d0ebff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0806b4a0 con 0x7f6d0806c760 2023-05-17T12:26:06.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d0ebff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0806a510 con 0x7f6d080b23a0 2023-05-17T12:26:06.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d0ebff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080cd840 con 0x7f6d080cf190 2023-05-17T12:26:06.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d0c99b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6d0806c760 0x7f6d0806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59900/0 (socket says 172.21.15.88:59900) 2023-05-17T12:26:06.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d0c99b700 1 -- 172.21.15.88:0/3923056200 learned_addr learned my addr 172.21.15.88:0/3923056200 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:06.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d07fff700 1 --2- 172.21.15.88:0/3923056200 >> v2:172.21.15.187:3300/0 conn(0x7f6d080b23a0 0x7f6d0806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d0d19c700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d080cf190 0x7f6d08160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464247398 0 0) 0x7f6cfc001110 con 0x7f6d0806c760 2023-05-17T12:26:06.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.160+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cf80035b0 con 0x7f6d0806c760 2023-05-17T12:26:06.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2381223369 0 0) 0x7f6cf80035b0 con 0x7f6d0806c760 2023-05-17T12:26:06.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d080cf190 msgr2=0x7f6d08160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:06.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d080cf190 0x7f6d08160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 >> v2:172.21.15.187:3300/0 conn(0x7f6d080b23a0 msgr2=0x7f6d0806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:06.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 --2- 172.21.15.88:0/3923056200 >> v2:172.21.15.187:3300/0 conn(0x7f6d080b23a0 0x7f6d0806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080cdb20 con 0x7f6d0806c760 2023-05-17T12:26:06.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f6cfc001800 con 0x7f6d0806c760 2023-05-17T12:26:06.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 >> v1:172.21.15.88:6789/0 conn(0x7f6d0806c760 legacy=0x7f6d0806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d080cf190 0x7f6cf8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8003f80 0x7f6cf8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf8004d90 0x7f6cf8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0806a510 con 0x7f6cf8003f80 2023-05-17T12:26:06.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080cd840 con 0x7f6cf8004d90 2023-05-17T12:26:06.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf800ba10 con 0x7f6d080cf190 2023-05-17T12:26:06.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d07fff700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8003f80 0x7f6cf8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d0c99b700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d080cf190 0x7f6cf8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d0d19c700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf8004d90 0x7f6cf8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d07fff700 1 -- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d080cf190 msgr2=0x7f6cf8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:06.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d07fff700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d080cf190 0x7f6cf8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d07fff700 1 -- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf8004d90 msgr2=0x7f6cf8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d07fff700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf8004d90 0x7f6cf8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d07fff700 1 -- 172.21.15.88:0/3923056200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf80035b0 con 0x7f6cf8003f80 2023-05-17T12:26:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d0c99b700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d080cf190 0x7f6cf8003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.161+0000 7f6d0d19c700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cf8004d90 0x7f6cf8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.162+0000 7f6d07fff700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8003f80 0x7f6cf8004850 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009b60 tx=0x7f6cf8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ee864407ab0482 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.162+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400e6c0 con 0x7f6cf8003f80 2023-05-17T12:26:06.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.162+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf400e820 con 0x7f6cf8003f80 2023-05-17T12:26:06.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.162+0000 7f6d077fe700 1 -- 172.21.15.88:0/3923056200 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400eb90 con 0x7f6cf8003f80 2023-05-17T12:26:06.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.162+0000 7f6d0ebff700 1 -- 172.21.15.88:0/3923056200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8003f80 msgr2=0x7f6cf8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.162+0000 7f6d0ebff700 1 --2- 172.21.15.88:0/3923056200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8003f80 0x7f6cf8004850 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009b60 tx=0x7f6cf8005880 comp rx=0 tx=0).stop 2023-05-17T12:26:06.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.162+0000 7f6d0d19c700 1 -- 172.21.15.88:0/3923056200 reap_dead start 2023-05-17T12:26:06.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.162+0000 7f6d0ebff700 1 -- 172.21.15.88:0/3923056200 shutdown_connections 2023-05-17T12:26:06.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.163+0000 7f6d0ebff700 1 -- 172.21.15.88:0/3923056200 >> 172.21.15.88:0/3923056200 conn(0x7f6d080d06f0 msgr2=0x7f6d080d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:06.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.163+0000 7f6d0ebff700 1 -- 172.21.15.88:0/3923056200 shutdown_connections 2023-05-17T12:26:06.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.163+0000 7f6d0ebff700 1 -- 172.21.15.88:0/3923056200 wait complete. 2023-05-17T12:26:06.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.164+0000 7f6d0ebff700 1 Processor -- start 2023-05-17T12:26:06.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.164+0000 7f6d0ebff700 1 -- start start 2023-05-17T12:26:06.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.165+0000 7f6d0ebff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf8003f80 0x7f6d080c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.165+0000 7f6d0ebff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080c8240 0x7f6d081f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.165+0000 7f6d0ebff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d08153ff0 0x7f6d081f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.165+0000 7f6d0ebff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d081f3180 con 0x7f6d080c8240 2023-05-17T12:26:06.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.165+0000 7f6d0ebff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c7590 con 0x7f6d08153ff0 2023-05-17T12:26:06.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.165+0000 7f6d0ebff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d080c9490 con 0x7f6cf8003f80 2023-05-17T12:26:06.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d07fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080c8240 0x7f6d081f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d07fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080c8240 0x7f6d081f2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54868/0 (socket says 172.21.15.88:54868) 2023-05-17T12:26:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d07fff700 1 -- 172.21.15.88:0/1505354810 learned_addr learned my addr 172.21.15.88:0/1505354810 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d0c99b700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf8003f80 0x7f6d080c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d0d19c700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d08153ff0 0x7f6d081f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d07fff700 1 -- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf8003f80 msgr2=0x7f6d080c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d07fff700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf8003f80 0x7f6d080c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d07fff700 1 -- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d08153ff0 msgr2=0x7f6d081f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d07fff700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d08153ff0 0x7f6d081f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d07fff700 1 -- 172.21.15.88:0/1505354810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0806aa40 con 0x7f6d080c8240 2023-05-17T12:26:06.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d0c99b700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf8003f80 0x7f6d080c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:06.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d07fff700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080c8240 0x7f6d081f2700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80046d0 tx=0x7f6cf40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:06.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d057fa700 1 -- 172.21.15.88:0/1505354810 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400e6c0 con 0x7f6d080c8240 2023-05-17T12:26:06.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d057fa700 1 -- 172.21.15.88:0/1505354810 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf4003ab0 con 0x7f6d080c8240 2023-05-17T12:26:06.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.166+0000 7f6d057fa700 1 -- 172.21.15.88:0/1505354810 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4003e60 con 0x7f6d080c8240 2023-05-17T12:26:06.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.167+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0806a760 con 0x7f6d080c8240 2023-05-17T12:26:06.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.167+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0815cb40 con 0x7f6d080c8240 2023-05-17T12:26:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.168+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d08074530 con 0x7f6d080c8240 2023-05-17T12:26:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.169+0000 7f6d057fa700 1 -- 172.21.15.88:0/1505354810 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6cf4013470 con 0x7f6d080c8240 2023-05-17T12:26:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.170+0000 7f6d057fa700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6cec06ace0 0x7f6cec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.170+0000 7f6d057fa700 1 -- 172.21.15.88:0/1505354810 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6cf408b210 con 0x7f6d080c8240 2023-05-17T12:26:06.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.170+0000 7f6d0c99b700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6cec06ace0 0x7f6cec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.171+0000 7f6d0c99b700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6cec06ace0 0x7f6cec06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0012b0 tx=0x7f6cfc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:06.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.174+0000 7f6d057fa700 1 -- 172.21.15.88:0/1505354810 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6cf40560a0 con 0x7f6d080c8240 2023-05-17T12:26:06.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.366+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d0806b7c0 con 0x7f6d080c8240 2023-05-17T12:26:06.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.366+0000 7f6d057fa700 1 -- 172.21.15.88:0/1505354810 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6cf40596c0 con 0x7f6d080c8240 2023-05-17T12:26:06.370 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:06.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6cec06ace0 msgr2=0x7f6cec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6cec06ace0 0x7f6cec06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0012b0 tx=0x7f6cfc009040 comp rx=0 tx=0).stop 2023-05-17T12:26:06.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080c8240 msgr2=0x7f6d081f2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080c8240 0x7f6d081f2700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80046d0 tx=0x7f6cf40047c0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 shutdown_connections 2023-05-17T12:26:06.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6cec06ace0 0x7f6cec06d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d08153ff0 0x7f6d081f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6cf8003f80 0x7f6d080c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 --2- 172.21.15.88:0/1505354810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080c8240 0x7f6d081f2700 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 >> 172.21.15.88:0/1505354810 conn(0x7f6d080d06f0 msgr2=0x7f6d080b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:06.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 shutdown_connections 2023-05-17T12:26:06.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.369+0000 7f6d0ebff700 1 -- 172.21.15.88:0/1505354810 wait complete. 2023-05-17T12:26:06.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:06.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.574+0000 7f9b799ff700 1 Processor -- start 2023-05-17T12:26:06.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.574+0000 7f9b799ff700 1 -- start start 2023-05-17T12:26:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.575+0000 7f9b799ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b740b23a0 0x7f9b7406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.575+0000 7f9b799ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7406b4a0 con 0x7f9b7406c760 2023-05-17T12:26:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.575+0000 7f9b799ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7406a510 con 0x7f9b740cf190 2023-05-17T12:26:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.575+0000 7f9b799ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740cd840 con 0x7f9b740b23a0 2023-05-17T12:26:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.575+0000 7f9b72ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9b7406c760 0x7f9b7406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59908/0 (socket says 172.21.15.88:59908) 2023-05-17T12:26:06.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.575+0000 7f9b72ffd700 1 -- 172.21.15.88:0/4187058754 learned_addr learned my addr 172.21.15.88:0/4187058754 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b727fc700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b740b23a0 0x7f9b7406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73298318 0 0) 0x7f9b64001110 con 0x7f9b7406c760 2023-05-17T12:26:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b5c0035b0 con 0x7f9b7406c760 2023-05-17T12:26:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 794702519 0 0) 0x7f9b5c0035b0 con 0x7f9b7406c760 2023-05-17T12:26:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b740b23a0 msgr2=0x7f9b7406af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b740b23a0 0x7f9b7406af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 >> v1:172.21.15.187:6789/0 conn(0x7f9b740cf190 legacy=0x7f9b74160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740cdb20 con 0x7f9b7406c760 2023-05-17T12:26:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f9b64001800 con 0x7f9b7406c760 2023-05-17T12:26:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 >> v1:172.21.15.88:6789/0 conn(0x7f9b7406c760 legacy=0x7f9b7406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c003a30 0x7f9b5c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b5c0043d0 0x7f9b5c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b5c005090 0x7f9b5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740cd840 con 0x7f9b5c0043d0 2023-05-17T12:26:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0056c0 con 0x7f9b5c003a30 2023-05-17T12:26:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.576+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c00bf80 con 0x7f9b5c005090 2023-05-17T12:26:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b727fc700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b5c0043d0 0x7f9b5c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c003a30 0x7f9b5c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b737fe700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b5c005090 0x7f9b5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b727fc700 1 -- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b5c005090 msgr2=0x7f9b5c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b727fc700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b5c005090 0x7f9b5c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b727fc700 1 -- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c003a30 msgr2=0x7f9b5c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b727fc700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c003a30 0x7f9b5c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b727fc700 1 -- 172.21.15.88:0/4187058754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0035b0 con 0x7f9b5c0043d0 2023-05-17T12:26:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b727fc700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b5c0043d0 0x7f9b5c004890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009b60 tx=0x7f9b5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ac36c317cf4ff4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800e660 con 0x7f9b5c0043d0 2023-05-17T12:26:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6800e7c0 con 0x7f9b5c0043d0 2023-05-17T12:26:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.577+0000 7f9b71ffb700 1 -- 172.21.15.88:0/4187058754 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800eb30 con 0x7f9b5c0043d0 2023-05-17T12:26:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.578+0000 7f9b799ff700 1 -- 172.21.15.88:0/4187058754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b5c0043d0 msgr2=0x7f9b5c004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.578+0000 7f9b799ff700 1 --2- 172.21.15.88:0/4187058754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b5c0043d0 0x7f9b5c004890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009b60 tx=0x7f9b5c005880 comp rx=0 tx=0).stop 2023-05-17T12:26:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.578+0000 7f9b737fe700 1 -- 172.21.15.88:0/4187058754 reap_dead start 2023-05-17T12:26:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.578+0000 7f9b799ff700 1 -- 172.21.15.88:0/4187058754 shutdown_connections 2023-05-17T12:26:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.578+0000 7f9b799ff700 1 -- 172.21.15.88:0/4187058754 >> 172.21.15.88:0/4187058754 conn(0x7f9b740d06f0 msgr2=0x7f9b740d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.578+0000 7f9b799ff700 1 -- 172.21.15.88:0/4187058754 shutdown_connections 2023-05-17T12:26:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.578+0000 7f9b799ff700 1 -- 172.21.15.88:0/4187058754 wait complete. 2023-05-17T12:26:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.580+0000 7f9b799ff700 1 Processor -- start 2023-05-17T12:26:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.580+0000 7f9b799ff700 1 -- start start 2023-05-17T12:26:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b799ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0043d0 0x7f9b74145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b799ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b741568a0 0x7f9b74145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b799ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b74145f50 0x7f9b741e6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b799ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b741463f0 con 0x7f9b741568a0 2023-05-17T12:26:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b799ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740c6c20 con 0x7f9b5c0043d0 2023-05-17T12:26:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b799ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740c6e90 con 0x7f9b74145f50 2023-05-17T12:26:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b727fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b741568a0 0x7f9b74145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b727fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b741568a0 0x7f9b74145a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54890/0 (socket says 172.21.15.88:54890) 2023-05-17T12:26:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b727fc700 1 -- 172.21.15.88:0/3813972222 learned_addr learned my addr 172.21.15.88:0/3813972222 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0043d0 0x7f9b74145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b737fe700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b74145f50 0x7f9b741e6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b727fc700 1 -- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b74145f50 msgr2=0x7f9b741e6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b727fc700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b74145f50 0x7f9b741e6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b727fc700 1 -- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0043d0 msgr2=0x7f9b74145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b727fc700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0043d0 0x7f9b74145130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.581+0000 7f9b727fc700 1 -- 172.21.15.88:0/3813972222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7406aa40 con 0x7f9b741568a0 2023-05-17T12:26:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.582+0000 7f9b727fc700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b741568a0 0x7f9b74145a10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c005690 tx=0x7f9b680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.582+0000 7f9b5bfff700 1 -- 172.21.15.88:0/3813972222 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800e660 con 0x7f9b741568a0 2023-05-17T12:26:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.582+0000 7f9b5bfff700 1 -- 172.21.15.88:0/3813972222 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b68003ab0 con 0x7f9b741568a0 2023-05-17T12:26:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.582+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7406a760 con 0x7f9b741568a0 2023-05-17T12:26:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.582+0000 7f9b5bfff700 1 -- 172.21.15.88:0/3813972222 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68003e60 con 0x7f9b741568a0 2023-05-17T12:26:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.582+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7415cb40 con 0x7f9b741568a0 2023-05-17T12:26:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.583+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b74074530 con 0x7f9b741568a0 2023-05-17T12:26:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.584+0000 7f9b5bfff700 1 -- 172.21.15.88:0/3813972222 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b68013470 con 0x7f9b741568a0 2023-05-17T12:26:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.585+0000 7f9b5bfff700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9b6006ace0 0x7f9b6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.585+0000 7f9b5bfff700 1 -- 172.21.15.88:0/3813972222 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b6808afb0 con 0x7f9b741568a0 2023-05-17T12:26:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.585+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9b6006ace0 0x7f9b6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.586+0000 7f9b72ffd700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9b6006ace0 0x7f9b6006d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b640017a0 tx=0x7f9b64001110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.589+0000 7f9b5bfff700 1 -- 172.21.15.88:0/3813972222 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9b68055e40 con 0x7f9b741568a0 2023-05-17T12:26:06.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.782+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b740b5e80 con 0x7f9b741568a0 2023-05-17T12:26:06.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.783+0000 7f9b5bfff700 1 -- 172.21.15.88:0/3813972222 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b68059460 con 0x7f9b741568a0 2023-05-17T12:26:06.787 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:06.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9b6006ace0 msgr2=0x7f9b6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9b6006ace0 0x7f9b6006d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b640017a0 tx=0x7f9b64001110 comp rx=0 tx=0).stop 2023-05-17T12:26:06.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b741568a0 msgr2=0x7f9b74145a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b741568a0 0x7f9b74145a10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c005690 tx=0x7f9b680047c0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 shutdown_connections 2023-05-17T12:26:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9b6006ace0 0x7f9b6006d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b74145f50 0x7f9b741e6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0043d0 0x7f9b74145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 --2- 172.21.15.88:0/3813972222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b741568a0 0x7f9b74145a10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 >> 172.21.15.88:0/3813972222 conn(0x7f9b740d06f0 msgr2=0x7f9b740b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:06.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 shutdown_connections 2023-05-17T12:26:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.785+0000 7f9b799ff700 1 -- 172.21.15.88:0/3813972222 wait complete. 2023-05-17T12:26:06.806 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:06.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.990+0000 7faffb5ff700 1 Processor -- start 2023-05-17T12:26:06.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.990+0000 7faffb5ff700 1 -- start start 2023-05-17T12:26:06.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.991+0000 7faffb5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faff406c760 0x7faff406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.991+0000 7faffb5ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faff40b23a0 0x7faff406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:06.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.991+0000 7faffb5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff406b4a0 con 0x7faff40cf190 2023-05-17T12:26:06.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.991+0000 7faffb5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff406a510 con 0x7faff406c760 2023-05-17T12:26:06.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.991+0000 7faffb5ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff406d070 con 0x7faff40b23a0 2023-05-17T12:26:06.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff939b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faff406c760 0x7faff406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff9b9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faff40cf190 0x7faff4160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59914/0 (socket says 172.21.15.88:59914) 2023-05-17T12:26:06.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff9b9c700 1 -- 172.21.15.88:0/1480247455 learned_addr learned my addr 172.21.15.88:0/1480247455 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:06.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff8b9a700 1 --2- 172.21.15.88:0/1480247455 >> v2:172.21.15.187:3300/0 conn(0x7faff40b23a0 0x7faff406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:06.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff939b700 1 -- 172.21.15.88:0/1480247455 >> v2:172.21.15.187:3300/0 conn(0x7faff40b23a0 msgr2=0x7faff406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:06.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff939b700 1 --2- 172.21.15.88:0/1480247455 >> v2:172.21.15.187:3300/0 conn(0x7faff40b23a0 0x7faff406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff939b700 1 -- 172.21.15.88:0/1480247455 >> v1:172.21.15.88:6789/0 conn(0x7faff40cf190 legacy=0x7faff4160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff939b700 1 -- 172.21.15.88:0/1480247455 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40cd840 con 0x7faff406c760 2023-05-17T12:26:06.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff8b9a700 1 --2- 172.21.15.88:0/1480247455 >> v2:172.21.15.187:3300/0 conn(0x7faff40b23a0 0x7faff406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:06.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7fafebfff700 1 -- 172.21.15.88:0/1480247455 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103958729 0 0) 0x7fafec001490 con 0x7faff40cf190 2023-05-17T12:26:06.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7faff939b700 1 --2- 172.21.15.88:0/1480247455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff406c760 0x7faff406af60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faff406c540 tx=0x7faff0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdb0ff0ee7eb6d5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:06.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7fafebfff700 1 -- 172.21.15.88:0/1480247455 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0011830 con 0x7faff406c760 2023-05-17T12:26:06.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7fafebfff700 1 -- 172.21.15.88:0/1480247455 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff0011990 con 0x7faff406c760 2023-05-17T12:26:06.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.992+0000 7fafebfff700 1 -- 172.21.15.88:0/1480247455 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0011d20 con 0x7faff406c760 2023-05-17T12:26:06.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.993+0000 7faffb5ff700 1 -- 172.21.15.88:0/1480247455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff406c760 msgr2=0x7faff406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:06.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.993+0000 7faffb5ff700 1 --2- 172.21.15.88:0/1480247455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff406c760 0x7faff406af60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faff406c540 tx=0x7faff0009b20 comp rx=0 tx=0).stop 2023-05-17T12:26:06.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.993+0000 7faffb5ff700 1 -- 172.21.15.88:0/1480247455 shutdown_connections 2023-05-17T12:26:06.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.993+0000 7faffb5ff700 1 --2- 172.21.15.88:0/1480247455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff406c760 0x7faff406af60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.993+0000 7faffb5ff700 1 --2- 172.21.15.88:0/1480247455 >> v2:172.21.15.187:3300/0 conn(0x7faff40b23a0 0x7faff406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:06.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.993+0000 7faffb5ff700 1 -- 172.21.15.88:0/1480247455 >> 172.21.15.88:0/1480247455 conn(0x7faff40d06f0 msgr2=0x7faff40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:06.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.993+0000 7faffb5ff700 1 -- 172.21.15.88:0/1480247455 shutdown_connections 2023-05-17T12:26:07.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.993+0000 7faffb5ff700 1 -- 172.21.15.88:0/1480247455 wait complete. 2023-05-17T12:26:07.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.995+0000 7faffb5ff700 1 Processor -- start 2023-05-17T12:26:07.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.996+0000 7faffb5ff700 1 -- start start 2023-05-17T12:26:07.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faffb5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff406c760 0x7faff40b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faffb5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40cf190 0x7faff41ebdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faffb5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff41ec300 0x7faff41f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faffb5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff41f30e0 con 0x7faff41ec300 2023-05-17T12:26:07.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faffb5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff41f36c0 con 0x7faff40cf190 2023-05-17T12:26:07.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faffb5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff41f39a0 con 0x7faff406c760 2023-05-17T12:26:07.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faff9b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff41ec300 0x7faff41f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faff9b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff41ec300 0x7faff41f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54920/0 (socket says 172.21.15.88:54920) 2023-05-17T12:26:07.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faff9b9c700 1 -- 172.21.15.88:0/3500443482 learned_addr learned my addr 172.21.15.88:0/3500443482 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:07.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faff939b700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff406c760 0x7faff40b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.997+0000 7faff8b9a700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40cf190 0x7faff41ebdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7faff9b9c700 1 -- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff406c760 msgr2=0x7faff40b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7faff9b9c700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff406c760 0x7faff40b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7faff9b9c700 1 -- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40cf190 msgr2=0x7faff41ebdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7faff9b9c700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40cf190 0x7faff41ebdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7faff9b9c700 1 -- 172.21.15.88:0/3500443482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00094a0 con 0x7faff41ec300 2023-05-17T12:26:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7faff9b9c700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff41ec300 0x7faff41f2380 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fafec00cba0 tx=0x7fafec00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7fafe9ffb700 1 -- 172.21.15.88:0/3500443482 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00aad0 con 0x7faff41ec300 2023-05-17T12:26:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7fafe9ffb700 1 -- 172.21.15.88:0/3500443482 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec00ac50 con 0x7faff41ec300 2023-05-17T12:26:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff406a760 con 0x7faff41ec300 2023-05-17T12:26:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7fafe9ffb700 1 -- 172.21.15.88:0/3500443482 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0070d0 con 0x7faff41ec300 2023-05-17T12:26:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.998+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff40cdb20 con 0x7faff41ec300 2023-05-17T12:26:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:06.999+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff406aa40 con 0x7faff41ec300 2023-05-17T12:26:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.000+0000 7fafe9ffb700 1 -- 172.21.15.88:0/3500443482 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafec007230 con 0x7faff41ec300 2023-05-17T12:26:07.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.001+0000 7fafe9ffb700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fafd806ace0 0x7fafd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.001+0000 7fafe9ffb700 1 -- 172.21.15.88:0/3500443482 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafec089490 con 0x7faff41ec300 2023-05-17T12:26:07.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.001+0000 7faff939b700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fafd806ace0 0x7fafd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.002+0000 7faff939b700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fafd806ace0 0x7fafd806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faff00090b0 tx=0x7faff0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:07.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.005+0000 7fafe9ffb700 1 -- 172.21.15.88:0/3500443482 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fafec054170 con 0x7faff41ec300 2023-05-17T12:26:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.199+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faff406b4a0 con 0x7faff41ec300 2023-05-17T12:26:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.200+0000 7fafe9ffb700 1 -- 172.21.15.88:0/3500443482 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7faff406b4a0 con 0x7faff41ec300 2023-05-17T12:26:07.204 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:07.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fafd806ace0 msgr2=0x7fafd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fafd806ace0 0x7fafd806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faff00090b0 tx=0x7faff0008030 comp rx=0 tx=0).stop 2023-05-17T12:26:07.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff41ec300 msgr2=0x7faff41f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff41ec300 0x7faff41f2380 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fafec00cba0 tx=0x7fafec00ceb0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 shutdown_connections 2023-05-17T12:26:07.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fafd806ace0 0x7fafd806d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faff41ec300 0x7faff41f2380 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faff406c760 0x7faff40b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 --2- 172.21.15.88:0/3500443482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faff40cf190 0x7faff41ebdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 >> 172.21.15.88:0/3500443482 conn(0x7faff40d06f0 msgr2=0x7faff4158230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:07.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 shutdown_connections 2023-05-17T12:26:07.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.202+0000 7faffb5ff700 1 -- 172.21.15.88:0/3500443482 wait complete. 2023-05-17T12:26:07.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:07.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.408+0000 7f2ca5fff700 1 Processor -- start 2023-05-17T12:26:07.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.408+0000 7f2ca5fff700 1 -- start start 2023-05-17T12:26:07.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.409+0000 7f2ca5fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca006c8f0 0x7f2ca00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.409+0000 7f2ca5fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca00d0c30 con 0x7f2ca0160d10 2023-05-17T12:26:07.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.409+0000 7f2ca5fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca0161180 con 0x7f2ca00b89e0 2023-05-17T12:26:07.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.409+0000 7f2ca5fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00b28d0 con 0x7f2ca006c8f0 2023-05-17T12:26:07.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.409+0000 7f2c9ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2ca0160d10 0x7f2ca00d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59930/0 (socket says 172.21.15.88:59930) 2023-05-17T12:26:07.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.409+0000 7f2c9ffff700 1 -- 172.21.15.88:0/832619650 learned_addr learned my addr 172.21.15.88:0/832619650 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:07.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.409+0000 7f2c97fff700 1 --2- 172.21.15.88:0/832619650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca006c8f0 0x7f2ca00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.409+0000 7f2c9effd700 1 -- 172.21.15.88:0/832619650 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155313473 0 0) 0x7f2ca00d0c30 con 0x7f2ca0160d10 2023-05-17T12:26:07.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c9effd700 1 -- 172.21.15.88:0/832619650 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8c0035b0 con 0x7f2ca0160d10 2023-05-17T12:26:07.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c9effd700 1 -- 172.21.15.88:0/832619650 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854114488 0 0) 0x7f2ca0161180 con 0x7f2ca00b89e0 2023-05-17T12:26:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c9effd700 1 -- 172.21.15.88:0/832619650 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca00d0c30 con 0x7f2ca00b89e0 2023-05-17T12:26:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c97fff700 1 -- 172.21.15.88:0/832619650 >> v1:172.21.15.187:6789/0 conn(0x7f2ca00b89e0 legacy=0x7f2ca006c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c97fff700 1 -- 172.21.15.88:0/832619650 >> v1:172.21.15.88:6789/0 conn(0x7f2ca0160d10 legacy=0x7f2ca00d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c97fff700 1 -- 172.21.15.88:0/832619650 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00cd750 con 0x7f2ca006c8f0 2023-05-17T12:26:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c97fff700 1 --2- 172.21.15.88:0/832619650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca006c8f0 0x7f2ca00cf320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009870 tx=0x7f2c88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20b5fcee15098ba6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c9effd700 1 -- 172.21.15.88:0/832619650 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88011830 con 0x7f2ca006c8f0 2023-05-17T12:26:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c9effd700 1 -- 172.21.15.88:0/832619650 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88011990 con 0x7f2ca006c8f0 2023-05-17T12:26:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.410+0000 7f2c9effd700 1 -- 172.21.15.88:0/832619650 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88011d00 con 0x7f2ca006c8f0 2023-05-17T12:26:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.411+0000 7f2ca5fff700 1 -- 172.21.15.88:0/832619650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca006c8f0 msgr2=0x7f2ca00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.411+0000 7f2ca5fff700 1 --2- 172.21.15.88:0/832619650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca006c8f0 0x7f2ca00cf320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009870 tx=0x7f2c88009b80 comp rx=0 tx=0).stop 2023-05-17T12:26:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.411+0000 7f2ca5fff700 1 -- 172.21.15.88:0/832619650 shutdown_connections 2023-05-17T12:26:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.411+0000 7f2ca5fff700 1 --2- 172.21.15.88:0/832619650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca006c8f0 0x7f2ca00cf320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.411+0000 7f2ca5fff700 1 -- 172.21.15.88:0/832619650 >> 172.21.15.88:0/832619650 conn(0x7f2ca00d05c0 msgr2=0x7f2ca00d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.411+0000 7f2ca5fff700 1 -- 172.21.15.88:0/832619650 shutdown_connections 2023-05-17T12:26:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.411+0000 7f2ca5fff700 1 -- 172.21.15.88:0/832619650 wait complete. 2023-05-17T12:26:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.413+0000 7f2ca5fff700 1 Processor -- start 2023-05-17T12:26:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.413+0000 7f2ca5fff700 1 -- start start 2023-05-17T12:26:07.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2ca5fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ca006c8f0 0x7f2ca00cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2ca5fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca00b89e0 0x7f2ca00b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2ca5fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ca0160d10 0x7f2ca00b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2ca5fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00ccef0 con 0x7f2ca0160d10 2023-05-17T12:26:07.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2ca5fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca01f5700 con 0x7f2ca006c8f0 2023-05-17T12:26:07.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2ca5fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca01f59e0 con 0x7f2ca00b89e0 2023-05-17T12:26:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c9ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ca0160d10 0x7f2ca00b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c9ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ca0160d10 0x7f2ca00b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54932/0 (socket says 172.21.15.88:54932) 2023-05-17T12:26:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c9ffff700 1 -- 172.21.15.88:0/174583147 learned_addr learned my addr 172.21.15.88:0/174583147 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c9f7fe700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ca006c8f0 0x7f2ca00cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c97fff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca00b89e0 0x7f2ca00b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c9ffff700 1 -- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca00b89e0 msgr2=0x7f2ca00b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c9ffff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca00b89e0 0x7f2ca00b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c9ffff700 1 -- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ca006c8f0 msgr2=0x7f2ca00cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c9ffff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ca006c8f0 0x7f2ca00cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.414+0000 7f2c9ffff700 1 -- 172.21.15.88:0/174583147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c880094a0 con 0x7f2ca0160d10 2023-05-17T12:26:07.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.415+0000 7f2c9ffff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ca0160d10 0x7f2ca00b7420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800caa0 tx=0x7f2c9800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:07.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.415+0000 7f2c9cff9700 1 -- 172.21.15.88:0/174583147 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800a9e0 con 0x7f2ca0160d10 2023-05-17T12:26:07.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.415+0000 7f2c9cff9700 1 -- 172.21.15.88:0/174583147 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9800ab60 con 0x7f2ca0160d10 2023-05-17T12:26:07.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.415+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca00cdd10 con 0x7f2ca0160d10 2023-05-17T12:26:07.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.415+0000 7f2c9cff9700 1 -- 172.21.15.88:0/174583147 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98012400 con 0x7f2ca0160d10 2023-05-17T12:26:07.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.415+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca00cda30 con 0x7f2ca0160d10 2023-05-17T12:26:07.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.416+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca00d0e80 con 0x7f2ca0160d10 2023-05-17T12:26:07.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.417+0000 7f2c9cff9700 1 -- 172.21.15.88:0/174583147 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c9801b3b0 con 0x7f2ca0160d10 2023-05-17T12:26:07.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.418+0000 7f2c9cff9700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c8006ace0 0x7f2c8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.419+0000 7f2c9cff9700 1 -- 172.21.15.88:0/174583147 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2c980894c0 con 0x7f2ca0160d10 2023-05-17T12:26:07.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.419+0000 7f2c9f7fe700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c8006ace0 0x7f2c8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.419+0000 7f2c9f7fe700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c8006ace0 0x7f2c8006d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c90001830 tx=0x7f2c90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.423+0000 7f2c9cff9700 1 -- 172.21.15.88:0/174583147 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2c98054260 con 0x7f2ca0160d10 2023-05-17T12:26:07.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.619+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2ca00cd030 con 0x7f2ca0160d10 2023-05-17T12:26:07.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.620+0000 7f2c9cff9700 1 -- 172.21.15.88:0/174583147 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2ca00cd030 con 0x7f2ca0160d10 2023-05-17T12:26:07.624 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:07.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c8006ace0 msgr2=0x7f2c8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c8006ace0 0x7f2c8006d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c90001830 tx=0x7f2c90009040 comp rx=0 tx=0).stop 2023-05-17T12:26:07.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ca0160d10 msgr2=0x7f2ca00b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ca0160d10 0x7f2ca00b7420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800caa0 tx=0x7f2c9800cdb0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 shutdown_connections 2023-05-17T12:26:07.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c8006ace0 0x7f2c8006d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ca0160d10 0x7f2ca00b7420 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ca006c8f0 0x7f2ca00cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 --2- 172.21.15.88:0/174583147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ca00b89e0 0x7f2ca00b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 >> 172.21.15.88:0/174583147 conn(0x7f2ca00d05c0 msgr2=0x7f2ca00b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:07.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 shutdown_connections 2023-05-17T12:26:07.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.622+0000 7f2ca5fff700 1 -- 172.21.15.88:0/174583147 wait complete. 2023-05-17T12:26:07.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:07.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.825+0000 7f71b97ff700 1 Processor -- start 2023-05-17T12:26:07.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.825+0000 7f71b97ff700 1 -- start start 2023-05-17T12:26:07.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.826+0000 7f71b97ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 0x7f71b40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.826+0000 7f71b97ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71b415a950 0x7f71b4070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.826+0000 7f71b97ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f71b40c98a0 0x7f71b4071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.826+0000 7f71b97ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b415ec80 con 0x7f71b415a950 2023-05-17T12:26:07.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.826+0000 7f71b97ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b415f110 con 0x7f71b40c98a0 2023-05-17T12:26:07.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.826+0000 7f71b97ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b415e350 con 0x7f71b415a580 2023-05-17T12:26:07.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b27fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71b415a950 0x7f71b4070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b27fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71b415a950 0x7f71b4070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54942/0 (socket says 172.21.15.88:54942) 2023-05-17T12:26:07.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b27fc700 1 -- 172.21.15.88:0/2628178349 learned_addr learned my addr 172.21.15.88:0/2628178349 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:07.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b37fe700 1 --2- 172.21.15.88:0/2628178349 >> v2:172.21.15.187:3300/0 conn(0x7f71b40c98a0 0x7f71b4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b2ffd700 1 --2- 172.21.15.88:0/2628178349 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 0x7f71b40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b27fc700 1 -- 172.21.15.88:0/2628178349 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 msgr2=0x7f71b40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:07.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b27fc700 1 --2- 172.21.15.88:0/2628178349 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 0x7f71b40c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b27fc700 1 -- 172.21.15.88:0/2628178349 >> v2:172.21.15.187:3300/0 conn(0x7f71b40c98a0 msgr2=0x7f71b4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:07.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b27fc700 1 --2- 172.21.15.88:0/2628178349 >> v2:172.21.15.187:3300/0 conn(0x7f71b40c98a0 0x7f71b4071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b27fc700 1 -- 172.21.15.88:0/2628178349 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b415e630 con 0x7f71b415a950 2023-05-17T12:26:07.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b27fc700 1 --2- 172.21.15.88:0/2628178349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 0x7f71b4070e30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f71b415e1f0 tx=0x7f71a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e329c3b20bd45c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:07.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.827+0000 7f71b1ffb700 1 -- 172.21.15.88:0/2628178349 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800b870 con 0x7f71b415a950 2023-05-17T12:26:07.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b1ffb700 1 -- 172.21.15.88:0/2628178349 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a800b9d0 con 0x7f71b415a950 2023-05-17T12:26:07.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b1ffb700 1 -- 172.21.15.88:0/2628178349 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800bd60 con 0x7f71b415a950 2023-05-17T12:26:07.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b97ff700 1 -- 172.21.15.88:0/2628178349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 msgr2=0x7f71b4070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b97ff700 1 --2- 172.21.15.88:0/2628178349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 0x7f71b4070e30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f71b415e1f0 tx=0x7f71a8009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b97ff700 1 -- 172.21.15.88:0/2628178349 shutdown_connections 2023-05-17T12:26:07.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b97ff700 1 --2- 172.21.15.88:0/2628178349 >> v2:172.21.15.187:3300/0 conn(0x7f71b40c98a0 0x7f71b4071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b97ff700 1 --2- 172.21.15.88:0/2628178349 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 0x7f71b40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b97ff700 1 --2- 172.21.15.88:0/2628178349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 0x7f71b4070e30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b97ff700 1 -- 172.21.15.88:0/2628178349 >> 172.21.15.88:0/2628178349 conn(0x7f71b40ced10 msgr2=0x7f71b40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:07.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b97ff700 1 -- 172.21.15.88:0/2628178349 shutdown_connections 2023-05-17T12:26:07.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.828+0000 7f71b97ff700 1 -- 172.21.15.88:0/2628178349 wait complete. 2023-05-17T12:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.830+0000 7f71b97ff700 1 Processor -- start 2023-05-17T12:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.830+0000 7f71b97ff700 1 -- start start 2023-05-17T12:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.831+0000 7f71b97ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71b40c98a0 0x7f71b40ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.831+0000 7f71b97ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 0x7f71b415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.831+0000 7f71b97ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 0x7f71b40c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.831+0000 7f71b97ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b415cd20 con 0x7f71b415a950 2023-05-17T12:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.831+0000 7f71b97ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b415db90 con 0x7f71b40c98a0 2023-05-17T12:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.831+0000 7f71b97ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40ac700 con 0x7f71b415a580 2023-05-17T12:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.831+0000 7f71b37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 0x7f71b40c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.831+0000 7f71b37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 0x7f71b40c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54950/0 (socket says 172.21.15.88:54950) 2023-05-17T12:26:07.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.831+0000 7f71b37fe700 1 -- 172.21.15.88:0/3074546700 learned_addr learned my addr 172.21.15.88:0/3074546700 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b2ffd700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71b40c98a0 0x7f71b40ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b27fc700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 0x7f71b415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b37fe700 1 -- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 msgr2=0x7f71b415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b37fe700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 0x7f71b415d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b37fe700 1 -- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71b40c98a0 msgr2=0x7f71b40ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b37fe700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71b40c98a0 0x7f71b40ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b37fe700 1 -- 172.21.15.88:0/3074546700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009550 con 0x7f71b415a950 2023-05-17T12:26:07.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b37fe700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 0x7f71b40c5de0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f71ac007e60 tx=0x7f71ac00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f719b7fe700 1 -- 172.21.15.88:0/3074546700 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00ede0 con 0x7f71b415a950 2023-05-17T12:26:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f719b7fe700 1 -- 172.21.15.88:0/3074546700 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac014420 con 0x7f71b415a950 2023-05-17T12:26:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b40cea60 con 0x7f71b415a950 2023-05-17T12:26:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f719b7fe700 1 -- 172.21.15.88:0/3074546700 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0147d0 con 0x7f71b415a950 2023-05-17T12:26:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.832+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b415e910 con 0x7f71b415a950 2023-05-17T12:26:07.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.833+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b40c9e00 con 0x7f71b415a950 2023-05-17T12:26:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.834+0000 7f719b7fe700 1 -- 172.21.15.88:0/3074546700 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71ac014930 con 0x7f71b415a950 2023-05-17T12:26:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.835+0000 7f719b7fe700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f71a006ace0 0x7f71a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.835+0000 7f719b7fe700 1 -- 172.21.15.88:0/3074546700 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f71ac089f30 con 0x7f71b415a950 2023-05-17T12:26:07.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.836+0000 7f71b2ffd700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f71a006ace0 0x7f71a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:07.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.836+0000 7f71b2ffd700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f71a006ace0 0x7f71a006d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f71b40b4020 tx=0x7f71a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:07.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:07.839+0000 7f719b7fe700 1 -- 172.21.15.88:0/3074546700 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f71ac054ca0 con 0x7f71b415a950 2023-05-17T12:26:08.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.037+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71b4074530 con 0x7f71b415a950 2023-05-17T12:26:08.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.039+0000 7f719b7fe700 1 -- 172.21.15.88:0/3074546700 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f71ac0582c0 con 0x7f71b415a950 2023-05-17T12:26:08.043 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:08.043 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f71a006ace0 msgr2=0x7f71a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f71a006ace0 0x7f71a006d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f71b40b4020 tx=0x7f71a4008040 comp rx=0 tx=0).stop 2023-05-17T12:26:08.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 msgr2=0x7f71b40c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 0x7f71b40c5de0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f71ac007e60 tx=0x7f71ac00e3c0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 shutdown_connections 2023-05-17T12:26:08.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f71a006ace0 0x7f71a006d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b415a950 0x7f71b40c5de0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71b40c98a0 0x7f71b40ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 --2- 172.21.15.88:0/3074546700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b415a580 0x7f71b415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 >> 172.21.15.88:0/3074546700 conn(0x7f71b40ced10 msgr2=0x7f71b40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:08.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.041+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 shutdown_connections 2023-05-17T12:26:08.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.042+0000 7f71b97ff700 1 -- 172.21.15.88:0/3074546700 wait complete. 2023-05-17T12:26:08.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:08.063 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:08.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.246+0000 7fad493ff700 1 Processor -- start 2023-05-17T12:26:08.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.247+0000 7fad493ff700 1 -- start start 2023-05-17T12:26:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.248+0000 7fad493ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad4406c760 0x7fad4406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.248+0000 7fad493ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4406b4a0 con 0x7fad440b23a0 2023-05-17T12:26:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.248+0000 7fad493ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4406a510 con 0x7fad440cf190 2023-05-17T12:26:08.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.248+0000 7fad493ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad440cd840 con 0x7fad4406c760 2023-05-17T12:26:08.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad3bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fad440b23a0 0x7fad4406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59946/0 (socket says 172.21.15.88:59946) 2023-05-17T12:26:08.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad3bfff700 1 -- 172.21.15.88:0/1159884413 learned_addr learned my addr 172.21.15.88:0/1159884413 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:08.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad42ffd700 1 --2- 172.21.15.88:0/1159884413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad4406c760 0x7fad4406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad427fc700 1 -- 172.21.15.88:0/1159884413 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054074305 0 0) 0x7fad2c001110 con 0x7fad440b23a0 2023-05-17T12:26:08.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad427fc700 1 -- 172.21.15.88:0/1159884413 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad300035b0 con 0x7fad440b23a0 2023-05-17T12:26:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad427fc700 1 -- 172.21.15.88:0/1159884413 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489540608 0 0) 0x7fad4406a510 con 0x7fad440cf190 2023-05-17T12:26:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad427fc700 1 -- 172.21.15.88:0/1159884413 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2c001110 con 0x7fad440cf190 2023-05-17T12:26:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad42ffd700 1 -- 172.21.15.88:0/1159884413 >> v1:172.21.15.187:6789/0 conn(0x7fad440cf190 legacy=0x7fad44160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad42ffd700 1 -- 172.21.15.88:0/1159884413 >> v1:172.21.15.88:6789/0 conn(0x7fad440b23a0 legacy=0x7fad4406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad427fc700 1 -- 172.21.15.88:0/1159884413 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1369378659 0 0) 0x7fad300035b0 con 0x7fad440b23a0 2023-05-17T12:26:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.249+0000 7fad42ffd700 1 -- 172.21.15.88:0/1159884413 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440cdb20 con 0x7fad4406c760 2023-05-17T12:26:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad42ffd700 1 --2- 172.21.15.88:0/1159884413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad4406c760 0x7fad4406af60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad34009870 tx=0x7fad34009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e79a47f2e573cae server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:08.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad427fc700 1 -- 172.21.15.88:0/1159884413 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34011830 con 0x7fad4406c760 2023-05-17T12:26:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad427fc700 1 -- 172.21.15.88:0/1159884413 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad34011990 con 0x7fad4406c760 2023-05-17T12:26:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad427fc700 1 -- 172.21.15.88:0/1159884413 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34011d20 con 0x7fad4406c760 2023-05-17T12:26:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad493ff700 1 -- 172.21.15.88:0/1159884413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad4406c760 msgr2=0x7fad4406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad493ff700 1 --2- 172.21.15.88:0/1159884413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad4406c760 0x7fad4406af60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad34009870 tx=0x7fad34009b80 comp rx=0 tx=0).stop 2023-05-17T12:26:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad493ff700 1 -- 172.21.15.88:0/1159884413 shutdown_connections 2023-05-17T12:26:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad493ff700 1 --2- 172.21.15.88:0/1159884413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad4406c760 0x7fad4406af60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad493ff700 1 -- 172.21.15.88:0/1159884413 >> 172.21.15.88:0/1159884413 conn(0x7fad440d06f0 msgr2=0x7fad440d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.250+0000 7fad493ff700 1 -- 172.21.15.88:0/1159884413 shutdown_connections 2023-05-17T12:26:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.251+0000 7fad493ff700 1 -- 172.21.15.88:0/1159884413 wait complete. 2023-05-17T12:26:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.253+0000 7fad493ff700 1 Processor -- start 2023-05-17T12:26:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.253+0000 7fad493ff700 1 -- start start 2023-05-17T12:26:08.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.254+0000 7fad493ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4406c760 0x7fad440cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.254+0000 7fad493ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad440cf190 0x7fad441555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.254+0000 7fad493ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad44158390 0x7fad440b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.254+0000 7fad493ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440ccc80 con 0x7fad4406c760 2023-05-17T12:26:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.254+0000 7fad493ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad44158b90 con 0x7fad440cf190 2023-05-17T12:26:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.254+0000 7fad493ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad440cbdd0 con 0x7fad44158390 2023-05-17T12:26:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.254+0000 7fad42ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4406c760 0x7fad440cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.254+0000 7fad42ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4406c760 0x7fad440cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54960/0 (socket says 172.21.15.88:54960) 2023-05-17T12:26:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.254+0000 7fad42ffd700 1 -- 172.21.15.88:0/2180528006 learned_addr learned my addr 172.21.15.88:0/2180528006 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.255+0000 7fad42ffd700 1 -- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad44158390 msgr2=0x7fad440b8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.255+0000 7fad42ffd700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad44158390 0x7fad440b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.255+0000 7fad42ffd700 1 -- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad440cf190 msgr2=0x7fad441555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.255+0000 7fad3bfff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad440cf190 0x7fad441555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.255+0000 7fad42ffd700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad440cf190 0x7fad441555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.255+0000 7fad42ffd700 1 -- 172.21.15.88:0/2180528006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340094a0 con 0x7fad4406c760 2023-05-17T12:26:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.255+0000 7fad3bfff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad440cf190 0x7fad441555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.255+0000 7fad42ffd700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4406c760 0x7fad440cb890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad34014040 tx=0x7fad34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:08.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.256+0000 7fad3b7fe700 1 -- 172.21.15.88:0/2180528006 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3401a860 con 0x7fad4406c760 2023-05-17T12:26:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.256+0000 7fad3b7fe700 1 -- 172.21.15.88:0/2180528006 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3401a9c0 con 0x7fad4406c760 2023-05-17T12:26:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.256+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4406aa40 con 0x7fad4406c760 2023-05-17T12:26:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.256+0000 7fad3b7fe700 1 -- 172.21.15.88:0/2180528006 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3401ad30 con 0x7fad4406c760 2023-05-17T12:26:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.256+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4406a760 con 0x7fad4406c760 2023-05-17T12:26:08.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.257+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4415cb40 con 0x7fad4406c760 2023-05-17T12:26:08.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.258+0000 7fad3b7fe700 1 -- 172.21.15.88:0/2180528006 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad34022070 con 0x7fad4406c760 2023-05-17T12:26:08.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.258+0000 7fad3b7fe700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fad2406ace0 0x7fad2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.259+0000 7fad3b7fe700 1 -- 172.21.15.88:0/2180528006 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fad3408a4d0 con 0x7fad4406c760 2023-05-17T12:26:08.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.259+0000 7fad3bfff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fad2406ace0 0x7fad2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.260+0000 7fad3bfff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fad2406ace0 0x7fad2406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fad440c8900 tx=0x7fad2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:08.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.263+0000 7fad3b7fe700 1 -- 172.21.15.88:0/2180528006 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fad34055420 con 0x7fad4406c760 2023-05-17T12:26:08.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.459+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad44074530 con 0x7fad4406c760 2023-05-17T12:26:08.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.459+0000 7fad3b7fe700 1 -- 172.21.15.88:0/2180528006 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad340150a0 con 0x7fad4406c760 2023-05-17T12:26:08.464 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:08.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fad2406ace0 msgr2=0x7fad2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fad2406ace0 0x7fad2406d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fad440c8900 tx=0x7fad2c009040 comp rx=0 tx=0).stop 2023-05-17T12:26:08.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4406c760 msgr2=0x7fad440cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4406c760 0x7fad440cb890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad34014040 tx=0x7fad34004750 comp rx=0 tx=0).stop 2023-05-17T12:26:08.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 shutdown_connections 2023-05-17T12:26:08.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fad2406ace0 0x7fad2406d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad44158390 0x7fad440b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad4406c760 0x7fad440cb890 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 --2- 172.21.15.88:0/2180528006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad440cf190 0x7fad441555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 >> 172.21.15.88:0/2180528006 conn(0x7fad440d06f0 msgr2=0x7fad440b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:08.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 shutdown_connections 2023-05-17T12:26:08.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.462+0000 7fad493ff700 1 -- 172.21.15.88:0/2180528006 wait complete. 2023-05-17T12:26:08.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:08.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.666+0000 7fce077ff700 1 Processor -- start 2023-05-17T12:26:08.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.667+0000 7fce077ff700 1 -- start start 2023-05-17T12:26:08.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce077ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fce0006c760 0x7fce0006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce077ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce000b23a0 0x7fce0006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce077ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0006b4a0 con 0x7fce000cf190 2023-05-17T12:26:08.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce077ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0006a510 con 0x7fce000b23a0 2023-05-17T12:26:08.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce077ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0006d070 con 0x7fce0006c760 2023-05-17T12:26:08.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce04d9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce000b23a0 0x7fce0006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce05d9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fce000cf190 0x7fce00160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59952/0 (socket says 172.21.15.88:59952) 2023-05-17T12:26:08.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce05d9c700 1 -- 172.21.15.88:0/4199811960 learned_addr learned my addr 172.21.15.88:0/4199811960 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:08.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce0559b700 1 --2- 172.21.15.88:0/4199811960 >> v2:172.21.15.187:3300/0 conn(0x7fce0006c760 0x7fce0006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce04d9a700 1 -- 172.21.15.88:0/4199811960 >> v2:172.21.15.187:3300/0 conn(0x7fce0006c760 msgr2=0x7fce0006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:08.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce04d9a700 1 --2- 172.21.15.88:0/4199811960 >> v2:172.21.15.187:3300/0 conn(0x7fce0006c760 0x7fce0006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce04d9a700 1 -- 172.21.15.88:0/4199811960 >> v1:172.21.15.88:6789/0 conn(0x7fce000cf190 legacy=0x7fce00160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fce04d9a700 1 -- 172.21.15.88:0/4199811960 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce000cd840 con 0x7fce000b23a0 2023-05-17T12:26:08.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.668+0000 7fcdf7fff700 1 -- 172.21.15.88:0/4199811960 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603809519 0 0) 0x7fcdf8001490 con 0x7fce000cf190 2023-05-17T12:26:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.669+0000 7fce04d9a700 1 --2- 172.21.15.88:0/4199811960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce000b23a0 0x7fce0006cb30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fce000d3a80 tx=0x7fcdf0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acad0d7877ed4ca5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.669+0000 7fcdf7fff700 1 -- 172.21.15.88:0/4199811960 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0011830 con 0x7fce000b23a0 2023-05-17T12:26:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.669+0000 7fcdf7fff700 1 -- 172.21.15.88:0/4199811960 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf0011990 con 0x7fce000b23a0 2023-05-17T12:26:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.669+0000 7fcdf7fff700 1 -- 172.21.15.88:0/4199811960 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0011d20 con 0x7fce000b23a0 2023-05-17T12:26:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.669+0000 7fce077ff700 1 -- 172.21.15.88:0/4199811960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce000b23a0 msgr2=0x7fce0006cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.669+0000 7fce077ff700 1 --2- 172.21.15.88:0/4199811960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce000b23a0 0x7fce0006cb30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fce000d3a80 tx=0x7fcdf0009b20 comp rx=0 tx=0).stop 2023-05-17T12:26:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.670+0000 7fce077ff700 1 -- 172.21.15.88:0/4199811960 shutdown_connections 2023-05-17T12:26:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.670+0000 7fce077ff700 1 --2- 172.21.15.88:0/4199811960 >> v2:172.21.15.187:3300/0 conn(0x7fce0006c760 0x7fce0006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.670+0000 7fce077ff700 1 --2- 172.21.15.88:0/4199811960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce000b23a0 0x7fce0006cb30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.670+0000 7fce077ff700 1 -- 172.21.15.88:0/4199811960 >> 172.21.15.88:0/4199811960 conn(0x7fce000d06f0 msgr2=0x7fce000d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:08.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.670+0000 7fce077ff700 1 -- 172.21.15.88:0/4199811960 shutdown_connections 2023-05-17T12:26:08.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.670+0000 7fce077ff700 1 -- 172.21.15.88:0/4199811960 wait complete. 2023-05-17T12:26:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.671+0000 7fce077ff700 1 Processor -- start 2023-05-17T12:26:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.671+0000 7fce077ff700 1 -- start start 2023-05-17T12:26:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.672+0000 7fce077ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce0006c760 0x7fce00153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.672+0000 7fce077ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce000cf190 0x7fce000c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.672+0000 7fce077ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce000c9540 0x7fce000c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.672+0000 7fce077ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce001f5df0 con 0x7fce0006c760 2023-05-17T12:26:08.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.672+0000 7fce077ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce000c99c0 con 0x7fce000cf190 2023-05-17T12:26:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.672+0000 7fce077ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce000c7990 con 0x7fce000c9540 2023-05-17T12:26:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce0559b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce0006c760 0x7fce00153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce0559b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce0006c760 0x7fce00153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54988/0 (socket says 172.21.15.88:54988) 2023-05-17T12:26:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce0559b700 1 -- 172.21.15.88:0/272923993 learned_addr learned my addr 172.21.15.88:0/272923993 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce05d9c700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce000c9540 0x7fce000c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce04d9a700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce000cf190 0x7fce000c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce0559b700 1 -- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce000c9540 msgr2=0x7fce000c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce0559b700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce000c9540 0x7fce000c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce0559b700 1 -- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce000cf190 msgr2=0x7fce000c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce0559b700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce000cf190 0x7fce000c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce0559b700 1 -- 172.21.15.88:0/272923993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf00094a0 con 0x7fce0006c760 2023-05-17T12:26:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce04d9a700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce000cf190 0x7fce000c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce05d9c700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce000c9540 0x7fce000c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:08.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce0559b700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce0006c760 0x7fce00153e80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e810 tx=0x7fcdfc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fcdf5ffb700 1 -- 172.21.15.88:0/272923993 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc013610 con 0x7fce0006c760 2023-05-17T12:26:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fcdf5ffb700 1 -- 172.21.15.88:0/272923993 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc013770 con 0x7fce0006c760 2023-05-17T12:26:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0006a760 con 0x7fce0006c760 2023-05-17T12:26:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.673+0000 7fcdf5ffb700 1 -- 172.21.15.88:0/272923993 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc013b20 con 0x7fce0006c760 2023-05-17T12:26:08.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.674+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce000cdb20 con 0x7fce0006c760 2023-05-17T12:26:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.674+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0006aa40 con 0x7fce0006c760 2023-05-17T12:26:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.675+0000 7fcdf5ffb700 1 -- 172.21.15.88:0/272923993 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcdfc013c80 con 0x7fce0006c760 2023-05-17T12:26:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.676+0000 7fcdf5ffb700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcde406ace0 0x7fcde406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.676+0000 7fcdf5ffb700 1 -- 172.21.15.88:0/272923993 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcdfc089520 con 0x7fce0006c760 2023-05-17T12:26:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.677+0000 7fce04d9a700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcde406ace0 0x7fcde406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:08.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.677+0000 7fce04d9a700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcde406ace0 0x7fcde406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce000d2ea0 tx=0x7fcdf0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:08.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.680+0000 7fcdf5ffb700 1 -- 172.21.15.88:0/272923993 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fcdfc057ca0 con 0x7fce0006c760 2023-05-17T12:26:08.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.872+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce00074530 con 0x7fce0006c760 2023-05-17T12:26:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.872+0000 7fcdf5ffb700 1 -- 172.21.15.88:0/272923993 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcdfc057830 con 0x7fce0006c760 2023-05-17T12:26:08.876 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:08.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcde406ace0 msgr2=0x7fcde406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcde406ace0 0x7fcde406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce000d2ea0 tx=0x7fcdf0008030 comp rx=0 tx=0).stop 2023-05-17T12:26:08.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce0006c760 msgr2=0x7fce00153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce0006c760 0x7fce00153e80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e810 tx=0x7fcdfc00ebd0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 shutdown_connections 2023-05-17T12:26:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcde406ace0 0x7fcde406d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce000c9540 0x7fce000c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce0006c760 0x7fce00153e80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 --2- 172.21.15.88:0/272923993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce000cf190 0x7fce000c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 >> 172.21.15.88:0/272923993 conn(0x7fce000d06f0 msgr2=0x7fce000b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:08.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 shutdown_connections 2023-05-17T12:26:08.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:08.875+0000 7fce077ff700 1 -- 172.21.15.88:0/272923993 wait complete. 2023-05-17T12:26:08.896 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:09.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.080+0000 7f9cf03ff700 1 Processor -- start 2023-05-17T12:26:09.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.080+0000 7f9cf03ff700 1 -- start start 2023-05-17T12:26:09.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.081+0000 7f9cf03ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ce80b23a0 0x7f9ce806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.081+0000 7f9cf03ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce806b4a0 con 0x7f9ce806c760 2023-05-17T12:26:09.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.081+0000 7f9cf03ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce806a510 con 0x7f9ce80cf190 2023-05-17T12:26:09.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.081+0000 7f9cf03ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce80cd840 con 0x7f9ce80b23a0 2023-05-17T12:26:09.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.082+0000 7f9cee19b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9ce806c760 0x7f9ce806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59960/0 (socket says 172.21.15.88:59960) 2023-05-17T12:26:09.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.082+0000 7f9cee19b700 1 -- 172.21.15.88:0/4072421075 learned_addr learned my addr 172.21.15.88:0/4072421075 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:09.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.082+0000 7f9ced99a700 1 --2- 172.21.15.88:0/4072421075 >> v2:172.21.15.88:3300/0 conn(0x7f9ce80b23a0 0x7f9ce806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.082+0000 7f9ced199700 1 -- 172.21.15.88:0/4072421075 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446445468 0 0) 0x7f9ce4001110 con 0x7f9ce806c760 2023-05-17T12:26:09.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.082+0000 7f9ced199700 1 -- 172.21.15.88:0/4072421075 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd40035b0 con 0x7f9ce806c760 2023-05-17T12:26:09.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.082+0000 7f9ced99a700 1 -- 172.21.15.88:0/4072421075 >> v1:172.21.15.187:6789/0 conn(0x7f9ce80cf190 legacy=0x7f9ce8160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.082+0000 7f9ced99a700 1 -- 172.21.15.88:0/4072421075 >> v1:172.21.15.88:6789/0 conn(0x7f9ce806c760 legacy=0x7f9ce806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.082+0000 7f9ced99a700 1 -- 172.21.15.88:0/4072421075 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80cdb20 con 0x7f9ce80b23a0 2023-05-17T12:26:09.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.082+0000 7f9ced99a700 1 --2- 172.21.15.88:0/4072421075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce80b23a0 0x7f9ce806af60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009840 tx=0x7f9cd8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e751dafbc0e12f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:09.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9ced199700 1 -- 172.21.15.88:0/4072421075 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8011830 con 0x7f9ce80b23a0 2023-05-17T12:26:09.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9ced199700 1 -- 172.21.15.88:0/4072421075 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd8011990 con 0x7f9ce80b23a0 2023-05-17T12:26:09.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9ced199700 1 -- 172.21.15.88:0/4072421075 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8011d20 con 0x7f9ce80b23a0 2023-05-17T12:26:09.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9cf03ff700 1 -- 172.21.15.88:0/4072421075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce80b23a0 msgr2=0x7f9ce806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9cf03ff700 1 --2- 172.21.15.88:0/4072421075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce80b23a0 0x7f9ce806af60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009840 tx=0x7f9cd8009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:09.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9cf03ff700 1 -- 172.21.15.88:0/4072421075 shutdown_connections 2023-05-17T12:26:09.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9cf03ff700 1 --2- 172.21.15.88:0/4072421075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce80b23a0 0x7f9ce806af60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9cf03ff700 1 -- 172.21.15.88:0/4072421075 >> 172.21.15.88:0/4072421075 conn(0x7f9ce80d06f0 msgr2=0x7f9ce80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:09.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9cf03ff700 1 -- 172.21.15.88:0/4072421075 shutdown_connections 2023-05-17T12:26:09.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.083+0000 7f9cf03ff700 1 -- 172.21.15.88:0/4072421075 wait complete. 2023-05-17T12:26:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.085+0000 7f9cf03ff700 1 Processor -- start 2023-05-17T12:26:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.085+0000 7f9cf03ff700 1 -- start start 2023-05-17T12:26:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cf03ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce806c760 0x7f9ce80b8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cf03ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce80cf190 0x7f9ce80b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cf03ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce80b63c0 0x7f9ce8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cf03ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80b6840 con 0x7f9ce806c760 2023-05-17T12:26:09.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cf03ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80ccf00 con 0x7f9ce80cf190 2023-05-17T12:26:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cf03ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80b6a40 con 0x7f9ce80b63c0 2023-05-17T12:26:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cee19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce806c760 0x7f9ce80b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cee19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce806c760 0x7f9ce80b8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55004/0 (socket says 172.21.15.88:55004) 2023-05-17T12:26:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cee19b700 1 -- 172.21.15.88:0/1002439545 learned_addr learned my addr 172.21.15.88:0/1002439545 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.086+0000 7f9cee99c700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce80b63c0 0x7f9ce8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9ced99a700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce80cf190 0x7f9ce80b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cee19b700 1 -- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce80b63c0 msgr2=0x7f9ce8159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cee19b700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce80b63c0 0x7f9ce8159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cee19b700 1 -- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce80cf190 msgr2=0x7f9ce80b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cee19b700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce80cf190 0x7f9ce80b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cee19b700 1 -- 172.21.15.88:0/1002439545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80094a0 con 0x7f9ce806c760 2023-05-17T12:26:09.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cee99c700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce80b63c0 0x7f9ce8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:09.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9ced99a700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce80cf190 0x7f9ce80b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:09.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cee19b700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce806c760 0x7f9ce80b8710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4007fd0 tx=0x7f9ce400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:09.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cdeffd700 1 -- 172.21.15.88:0/1002439545 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4005d70 con 0x7f9ce806c760 2023-05-17T12:26:09.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cdeffd700 1 -- 172.21.15.88:0/1002439545 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce40070d0 con 0x7f9ce806c760 2023-05-17T12:26:09.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce806aa40 con 0x7f9ce806c760 2023-05-17T12:26:09.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cdeffd700 1 -- 172.21.15.88:0/1002439545 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4007460 con 0x7f9ce806c760 2023-05-17T12:26:09.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.087+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce806a760 con 0x7f9ce806c760 2023-05-17T12:26:09.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.088+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce815cb40 con 0x7f9ce806c760 2023-05-17T12:26:09.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.089+0000 7f9cdeffd700 1 -- 172.21.15.88:0/1002439545 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ce40075c0 con 0x7f9ce806c760 2023-05-17T12:26:09.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.091+0000 7f9cdeffd700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9ccc06ace0 0x7f9ccc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.091+0000 7f9cdeffd700 1 -- 172.21.15.88:0/1002439545 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9ce4088cb0 con 0x7f9ce806c760 2023-05-17T12:26:09.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.091+0000 7f9ced99a700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9ccc06ace0 0x7f9ccc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.092+0000 7f9ced99a700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9ccc06ace0 0x7f9ccc06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8159e90 tx=0x7f9cd8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:09.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.095+0000 7f9cdeffd700 1 -- 172.21.15.88:0/1002439545 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9ce4053990 con 0x7f9ce806c760 2023-05-17T12:26:09.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.288+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ce806b4a0 con 0x7f9ce806c760 2023-05-17T12:26:09.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.288+0000 7f9cdeffd700 1 -- 172.21.15.88:0/1002439545 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ce806b4a0 con 0x7f9ce806c760 2023-05-17T12:26:09.292 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9ccc06ace0 msgr2=0x7f9ccc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9ccc06ace0 0x7f9ccc06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8159e90 tx=0x7f9cd8008030 comp rx=0 tx=0).stop 2023-05-17T12:26:09.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce806c760 msgr2=0x7f9ce80b8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce806c760 0x7f9ce80b8710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4007fd0 tx=0x7f9ce400ca90 comp rx=0 tx=0).stop 2023-05-17T12:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 shutdown_connections 2023-05-17T12:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f9ccc06ace0 0x7f9ccc06d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce80b63c0 0x7f9ce8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ce806c760 0x7f9ce80b8710 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 --2- 172.21.15.88:0/1002439545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce80cf190 0x7f9ce80b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 >> 172.21.15.88:0/1002439545 conn(0x7f9ce80d06f0 msgr2=0x7f9ce80d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:09.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 shutdown_connections 2023-05-17T12:26:09.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.290+0000 7f9cf03ff700 1 -- 172.21.15.88:0/1002439545 wait complete. 2023-05-17T12:26:09.311 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:09.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.496+0000 7f691f9ff700 1 Processor -- start 2023-05-17T12:26:09.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.497+0000 7f691f9ff700 1 -- start start 2023-05-17T12:26:09.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f691f9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f691806c760 0x7f691806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f691f9ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f69180b23a0 0x7f691806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f691f9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691806b4a0 con 0x7f69180cf190 2023-05-17T12:26:09.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f691f9ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691806a510 con 0x7f69180b23a0 2023-05-17T12:26:09.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f691f9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691806d070 con 0x7f691806c760 2023-05-17T12:26:09.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f691df9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f69180cf190 0x7f6918160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59962/0 (socket says 172.21.15.88:59962) 2023-05-17T12:26:09.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f691df9c700 1 -- 172.21.15.88:0/152248893 learned_addr learned my addr 172.21.15.88:0/152248893 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f691d79b700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f691806c760 0x7f691806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f691cf9a700 1 --2- 172.21.15.88:0/152248893 >> v2:172.21.15.187:3300/0 conn(0x7f69180b23a0 0x7f691806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971451278 0 0) 0x7f6910001490 con 0x7f69180cf190 2023-05-17T12:26:09.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.498+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69040035b0 con 0x7f69180cf190 2023-05-17T12:26:09.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 855906807 0 0) 0x7f69040035b0 con 0x7f69180cf190 2023-05-17T12:26:09.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f691806c760 msgr2=0x7f691806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:09.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f691806c760 0x7f691806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 >> v2:172.21.15.187:3300/0 conn(0x7f69180b23a0 msgr2=0x7f691806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:09.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 --2- 172.21.15.88:0/152248893 >> v2:172.21.15.187:3300/0 conn(0x7f69180b23a0 0x7f691806cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69180cd840 con 0x7f69180cf190 2023-05-17T12:26:09.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f6910001b80 con 0x7f69180cf190 2023-05-17T12:26:09.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 >> v1:172.21.15.88:6789/0 conn(0x7f69180cf190 legacy=0x7f6918160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6904003a00 0x7f6904003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6904004430 0x7f69040048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f691806c760 0x7f6904004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691806a510 con 0x7f6904004430 2023-05-17T12:26:09.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691806d070 con 0x7f6904003a00 2023-05-17T12:26:09.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690400ba10 con 0x7f691806c760 2023-05-17T12:26:09.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f691cf9a700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6904004430 0x7f69040048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f691df9c700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f691806c760 0x7f6904004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f691d79b700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6904003a00 0x7f6904003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f691cf9a700 1 -- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f691806c760 msgr2=0x7f6904004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:09.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.499+0000 7f691cf9a700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f691806c760 0x7f6904004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f691cf9a700 1 -- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6904003a00 msgr2=0x7f6904003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:09.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f691cf9a700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6904003a00 0x7f6904003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f691cf9a700 1 -- 172.21.15.88:0/152248893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69040035b0 con 0x7f6904004430 2023-05-17T12:26:09.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f691df9c700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f691806c760 0x7f6904004fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:09.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f691cf9a700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6904004430 0x7f69040048f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6908009b60 tx=0x7f6904005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a002a40d9b0530 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:09.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800e6c0 con 0x7f6904004430 2023-05-17T12:26:09.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690800e820 con 0x7f6904004430 2023-05-17T12:26:09.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f690ffff700 1 -- 172.21.15.88:0/152248893 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800eb90 con 0x7f6904004430 2023-05-17T12:26:09.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f691f9ff700 1 -- 172.21.15.88:0/152248893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6904004430 msgr2=0x7f69040048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.500+0000 7f691f9ff700 1 --2- 172.21.15.88:0/152248893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6904004430 0x7f69040048f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6908009b60 tx=0x7f6904005880 comp rx=0 tx=0).stop 2023-05-17T12:26:09.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.501+0000 7f691df9c700 1 -- 172.21.15.88:0/152248893 reap_dead start 2023-05-17T12:26:09.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.501+0000 7f691f9ff700 1 -- 172.21.15.88:0/152248893 shutdown_connections 2023-05-17T12:26:09.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.501+0000 7f691f9ff700 1 -- 172.21.15.88:0/152248893 >> 172.21.15.88:0/152248893 conn(0x7f69180d06f0 msgr2=0x7f69180d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:09.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.501+0000 7f691f9ff700 1 -- 172.21.15.88:0/152248893 shutdown_connections 2023-05-17T12:26:09.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.501+0000 7f691f9ff700 1 -- 172.21.15.88:0/152248893 wait complete. 2023-05-17T12:26:09.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.503+0000 7f691f9ff700 1 Processor -- start 2023-05-17T12:26:09.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.503+0000 7f691f9ff700 1 -- start start 2023-05-17T12:26:09.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.504+0000 7f691f9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6904004430 0x7f69181484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.504+0000 7f691f9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69180cbd70 0x7f69180cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.504+0000 7f691f9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69180c8e20 0x7f69180c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.504+0000 7f691f9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69180cacd0 con 0x7f69180c8e20 2023-05-17T12:26:09.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.504+0000 7f691f9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918148a10 con 0x7f6904004430 2023-05-17T12:26:09.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.504+0000 7f691f9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69180ca120 con 0x7f69180cbd70 2023-05-17T12:26:09.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691df9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69180c8e20 0x7f69180c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691df9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69180c8e20 0x7f69180c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55030/0 (socket says 172.21.15.88:55030) 2023-05-17T12:26:09.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691df9c700 1 -- 172.21.15.88:0/2348266546 learned_addr learned my addr 172.21.15.88:0/2348266546 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:09.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691d79b700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6904004430 0x7f69181484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691cf9a700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69180cbd70 0x7f69180cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691df9c700 1 -- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69180cbd70 msgr2=0x7f69180cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691df9c700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69180cbd70 0x7f69180cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691df9c700 1 -- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6904004430 msgr2=0x7f69181484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691df9c700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6904004430 0x7f69181484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691df9c700 1 -- 172.21.15.88:0/2348266546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691806a760 con 0x7f69180c8e20 2023-05-17T12:26:09.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.505+0000 7f691df9c700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69180c8e20 0x7f69180c9290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6910000f80 tx=0x7f691000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:09.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.506+0000 7f690dffb700 1 -- 172.21.15.88:0/2348266546 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000ec80 con 0x7f69180c8e20 2023-05-17T12:26:09.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.506+0000 7f690dffb700 1 -- 172.21.15.88:0/2348266546 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691000ede0 con 0x7f69180c8e20 2023-05-17T12:26:09.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.506+0000 7f690dffb700 1 -- 172.21.15.88:0/2348266546 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910013620 con 0x7f69180c8e20 2023-05-17T12:26:09.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.506+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69180cdb20 con 0x7f69180c8e20 2023-05-17T12:26:09.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.506+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691806aa40 con 0x7f69180c8e20 2023-05-17T12:26:09.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.507+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69180cae10 con 0x7f69180c8e20 2023-05-17T12:26:09.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.508+0000 7f690dffb700 1 -- 172.21.15.88:0/2348266546 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6910013780 con 0x7f69180c8e20 2023-05-17T12:26:09.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.509+0000 7f690dffb700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f68fc06ace0 0x7f68fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.509+0000 7f690dffb700 1 -- 172.21.15.88:0/2348266546 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6910089ab0 con 0x7f69180c8e20 2023-05-17T12:26:09.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.509+0000 7f691d79b700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f68fc06ace0 0x7f68fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.510+0000 7f691d79b700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f68fc06ace0 0x7f68fc06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6914009a80 tx=0x7f6914008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:09.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.513+0000 7f690dffb700 1 -- 172.21.15.88:0/2348266546 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f69180cae10 con 0x7f69180c8e20 2023-05-17T12:26:09.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.707+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69180cae10 con 0x7f69180c8e20 2023-05-17T12:26:09.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.708+0000 7f690dffb700 1 -- 172.21.15.88:0/2348266546 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69180cae10 con 0x7f69180c8e20 2023-05-17T12:26:09.713 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:09.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f68fc06ace0 msgr2=0x7f68fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f68fc06ace0 0x7f68fc06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6914009a80 tx=0x7f6914008040 comp rx=0 tx=0).stop 2023-05-17T12:26:09.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69180c8e20 msgr2=0x7f69180c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69180c8e20 0x7f69180c9290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6910000f80 tx=0x7f691000e440 comp rx=0 tx=0).stop 2023-05-17T12:26:09.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 shutdown_connections 2023-05-17T12:26:09.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f68fc06ace0 0x7f68fc06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69180c8e20 0x7f69180c9290 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6904004430 0x7f69181484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 --2- 172.21.15.88:0/2348266546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69180cbd70 0x7f69180cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 >> 172.21.15.88:0/2348266546 conn(0x7f69180d06f0 msgr2=0x7f69180d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 shutdown_connections 2023-05-17T12:26:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.710+0000 7f691f9ff700 1 -- 172.21.15.88:0/2348266546 wait complete. 2023-05-17T12:26:09.731 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.918+0000 7f1f2edff700 1 Processor -- start 2023-05-17T12:26:09.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.918+0000 7f1f2edff700 1 -- start start 2023-05-17T12:26:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.919+0000 7f1f2edff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f2806c760 0x7f1f2806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.919+0000 7f1f2edff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1f280cf190 0x7f1f28160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.919+0000 7f1f2edff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2806b4a0 con 0x7f1f280b23a0 2023-05-17T12:26:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2edff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2806a510 con 0x7f1f2806c760 2023-05-17T12:26:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2edff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f280cd840 con 0x7f1f280cf190 2023-05-17T12:26:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2cb9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f2806c760 0x7f1f2806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2cb9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f2806c760 0x7f1f2806af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55042/0 (socket says 172.21.15.88:55042) 2023-05-17T12:26:09.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2cb9b700 1 -- 172.21.15.88:0/4216897135 learned_addr learned my addr 172.21.15.88:0/4216897135 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2d39c700 1 --2- 172.21.15.88:0/4216897135 >> v2:172.21.15.187:3300/0 conn(0x7f1f280cf190 0x7f1f28160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2cb9b700 1 -- 172.21.15.88:0/4216897135 >> v2:172.21.15.187:3300/0 conn(0x7f1f280cf190 msgr2=0x7f1f28160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2cb9b700 1 --2- 172.21.15.88:0/4216897135 >> v2:172.21.15.187:3300/0 conn(0x7f1f280cf190 0x7f1f28160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2cb9b700 1 -- 172.21.15.88:0/4216897135 >> v1:172.21.15.187:6789/0 conn(0x7f1f280b23a0 legacy=0x7f1f2806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2cb9b700 1 -- 172.21.15.88:0/4216897135 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f280cdb20 con 0x7f1f2806c760 2023-05-17T12:26:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.920+0000 7f1f2cb9b700 1 --2- 172.21.15.88:0/4216897135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 0x7f1f2806af60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f2808c360 tx=0x7f1f1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b4bbd4785d6669 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f277fe700 1 -- 172.21.15.88:0/4216897135 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c004230 con 0x7f1f2806c760 2023-05-17T12:26:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f277fe700 1 -- 172.21.15.88:0/4216897135 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c004390 con 0x7f1f2806c760 2023-05-17T12:26:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f277fe700 1 -- 172.21.15.88:0/4216897135 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c0036a0 con 0x7f1f2806c760 2023-05-17T12:26:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f2edff700 1 -- 172.21.15.88:0/4216897135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 msgr2=0x7f1f2806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f2edff700 1 --2- 172.21.15.88:0/4216897135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 0x7f1f2806af60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f2808c360 tx=0x7f1f1c009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f2edff700 1 -- 172.21.15.88:0/4216897135 shutdown_connections 2023-05-17T12:26:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f2edff700 1 --2- 172.21.15.88:0/4216897135 >> v2:172.21.15.187:3300/0 conn(0x7f1f280cf190 0x7f1f28160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f2edff700 1 --2- 172.21.15.88:0/4216897135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 0x7f1f2806af60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f2edff700 1 -- 172.21.15.88:0/4216897135 >> 172.21.15.88:0/4216897135 conn(0x7f1f280d06f0 msgr2=0x7f1f280d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f2edff700 1 -- 172.21.15.88:0/4216897135 shutdown_connections 2023-05-17T12:26:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.921+0000 7f1f2edff700 1 -- 172.21.15.88:0/4216897135 wait complete. 2023-05-17T12:26:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.923+0000 7f1f2edff700 1 Processor -- start 2023-05-17T12:26:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.923+0000 7f1f2edff700 1 -- start start 2023-05-17T12:26:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.924+0000 7f1f2edff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 0x7f1f28154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.924+0000 7f1f2edff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f280cf190 0x7f1f28158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.924+0000 7f1f2edff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f28144d60 0x7f1f28144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.924+0000 7f1f2edff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f280cc790 con 0x7f1f2806c760 2023-05-17T12:26:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.924+0000 7f1f2edff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f281f23f0 con 0x7f1f280cf190 2023-05-17T12:26:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.924+0000 7f1f2edff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f280cbb80 con 0x7f1f28144d60 2023-05-17T12:26:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.924+0000 7f1f2cb9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 0x7f1f28154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.924+0000 7f1f2cb9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 0x7f1f28154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55046/0 (socket says 172.21.15.88:55046) 2023-05-17T12:26:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.924+0000 7f1f2cb9b700 1 -- 172.21.15.88:0/2868760151 learned_addr learned my addr 172.21.15.88:0/2868760151 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f27fff700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f280cf190 0x7f1f28158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f2d39c700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f28144d60 0x7f1f28144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f2cb9b700 1 -- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f28144d60 msgr2=0x7f1f28144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f2cb9b700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f28144d60 0x7f1f28144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f2cb9b700 1 -- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f280cf190 msgr2=0x7f1f28158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f2cb9b700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f280cf190 0x7f1f28158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f2cb9b700 1 -- 172.21.15.88:0/2868760151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c009550 con 0x7f1f2806c760 2023-05-17T12:26:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f2cb9b700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 0x7f1f28154d50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009130 tx=0x7f1f1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f257fa700 1 -- 172.21.15.88:0/2868760151 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c003c10 con 0x7f1f2806c760 2023-05-17T12:26:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f257fa700 1 -- 172.21.15.88:0/2868760151 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c01f070 con 0x7f1f2806c760 2023-05-17T12:26:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2806aa40 con 0x7f1f2806c760 2023-05-17T12:26:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.925+0000 7f1f257fa700 1 -- 172.21.15.88:0/2868760151 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c011630 con 0x7f1f2806c760 2023-05-17T12:26:09.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.926+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2806a760 con 0x7f1f2806c760 2023-05-17T12:26:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.927+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2815cb40 con 0x7f1f2806c760 2023-05-17T12:26:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.927+0000 7f1f257fa700 1 -- 172.21.15.88:0/2868760151 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f1c021030 con 0x7f1f2806c760 2023-05-17T12:26:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.928+0000 7f1f257fa700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1f0c06ad10 0x7f1f0c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.928+0000 7f1f257fa700 1 -- 172.21.15.88:0/2868760151 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f1c08ab40 con 0x7f1f2806c760 2023-05-17T12:26:09.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.929+0000 7f1f27fff700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1f0c06ad10 0x7f1f0c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:09.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.930+0000 7f1f27fff700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1f0c06ad10 0x7f1f0c06d1c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f281f5a70 tx=0x7f1f14007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:09.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:09.932+0000 7f1f257fa700 1 -- 172.21.15.88:0/2868760151 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1f1c055830 con 0x7f1f2806c760 2023-05-17T12:26:10.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.125+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1f2806b4a0 con 0x7f1f2806c760 2023-05-17T12:26:10.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.125+0000 7f1f257fa700 1 -- 172.21.15.88:0/2868760151 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1f2806b4a0 con 0x7f1f2806c760 2023-05-17T12:26:10.129 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:10.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.127+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1f0c06ad10 msgr2=0x7f1f0c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:10.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.127+0000 7f1f2edff700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1f0c06ad10 0x7f1f0c06d1c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f281f5a70 tx=0x7f1f14007ec0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.127+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 msgr2=0x7f1f28154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:10.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.127+0000 7f1f2edff700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 0x7f1f28154d50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009130 tx=0x7f1f1c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:10.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.128+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 shutdown_connections 2023-05-17T12:26:10.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.128+0000 7f1f2edff700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1f0c06ad10 0x7f1f0c06d1c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.128+0000 7f1f2edff700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1f28144d60 0x7f1f28144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.128+0000 7f1f2edff700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2806c760 0x7f1f28154d50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.128+0000 7f1f2edff700 1 --2- 172.21.15.88:0/2868760151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f280cf190 0x7f1f28158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.128+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 >> 172.21.15.88:0/2868760151 conn(0x7f1f280d06f0 msgr2=0x7f1f280b7380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:10.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.128+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 shutdown_connections 2023-05-17T12:26:10.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.128+0000 7f1f2edff700 1 -- 172.21.15.88:0/2868760151 wait complete. 2023-05-17T12:26:10.167 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-17T12:26:10.168 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-05-17T12:26:10.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.350+0000 7f4dc53ff700 1 Processor -- start 2023-05-17T12:26:10.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.350+0000 7f4dc53ff700 1 -- start start 2023-05-17T12:26:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.351+0000 7f4dc53ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4dc015c840 0x7f4dc006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.351+0000 7f4dc53ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4dc006c330 0x7f4dc006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.351+0000 7f4dc53ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc00cd6b0 con 0x7f4dc006b0b0 2023-05-17T12:26:10.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.351+0000 7f4dc53ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc00cdf50 con 0x7f4dc006c330 2023-05-17T12:26:10.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.351+0000 7f4dc53ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc006ccb0 con 0x7f4dc015c840 2023-05-17T12:26:10.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.352+0000 7f4dbf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4dc006c330 0x7f4dc006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:10.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.352+0000 7f4dbf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4dc006c330 0x7f4dc006c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55054/0 (socket says 172.21.15.88:55054) 2023-05-17T12:26:10.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.352+0000 7f4dbf7fe700 1 -- 172.21.15.88:0/2882847931 learned_addr learned my addr 172.21.15.88:0/2882847931 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:10.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.352+0000 7f4dbeffd700 1 --2- 172.21.15.88:0/2882847931 >> v2:172.21.15.187:3300/0 conn(0x7f4dc015c840 0x7f4dc006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:10.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.352+0000 7f4dbf7fe700 1 -- 172.21.15.88:0/2882847931 >> v2:172.21.15.187:3300/0 conn(0x7f4dc015c840 msgr2=0x7f4dc006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.352+0000 7f4dbf7fe700 1 --2- 172.21.15.88:0/2882847931 >> v2:172.21.15.187:3300/0 conn(0x7f4dc015c840 0x7f4dc006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.352+0000 7f4dbf7fe700 1 -- 172.21.15.88:0/2882847931 >> v1:172.21.15.187:6789/0 conn(0x7f4dc006b0b0 legacy=0x7f4dc00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.352+0000 7f4dbf7fe700 1 -- 172.21.15.88:0/2882847931 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc00b2460 con 0x7f4dc006c330 2023-05-17T12:26:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.352+0000 7f4dbf7fe700 1 --2- 172.21.15.88:0/2882847931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006c330 0x7f4dc006c770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00cfa40 tx=0x7f4db800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cd5ea964cf781b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dbdffb700 1 -- 172.21.15.88:0/2882847931 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800e070 con 0x7f4dc006c330 2023-05-17T12:26:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dbdffb700 1 -- 172.21.15.88:0/2882847931 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800b9c0 con 0x7f4dc006c330 2023-05-17T12:26:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dbdffb700 1 -- 172.21.15.88:0/2882847931 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800bd70 con 0x7f4dc006c330 2023-05-17T12:26:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dc53ff700 1 -- 172.21.15.88:0/2882847931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006c330 msgr2=0x7f4dc006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dc53ff700 1 --2- 172.21.15.88:0/2882847931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006c330 0x7f4dc006c770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00cfa40 tx=0x7f4db800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dc53ff700 1 -- 172.21.15.88:0/2882847931 shutdown_connections 2023-05-17T12:26:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dc53ff700 1 --2- 172.21.15.88:0/2882847931 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006c330 0x7f4dc006c770 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dc53ff700 1 --2- 172.21.15.88:0/2882847931 >> v2:172.21.15.187:3300/0 conn(0x7f4dc015c840 0x7f4dc006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dc53ff700 1 -- 172.21.15.88:0/2882847931 >> 172.21.15.88:0/2882847931 conn(0x7f4dc00d3060 msgr2=0x7f4dc00d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dc53ff700 1 -- 172.21.15.88:0/2882847931 shutdown_connections 2023-05-17T12:26:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.353+0000 7f4dc53ff700 1 -- 172.21.15.88:0/2882847931 wait complete. 2023-05-17T12:26:10.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.356+0000 7f4dc53ff700 1 Processor -- start 2023-05-17T12:26:10.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.356+0000 7f4dc53ff700 1 -- start start 2023-05-17T12:26:10.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dc53ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006b0b0 0x7f4dc01f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:10.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dc53ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc006c330 0x7f4dc0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:10.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dc53ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc015c840 0x7f4dc0159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:10.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dc53ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0158d30 con 0x7f4dc006b0b0 2023-05-17T12:26:10.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dc53ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0159010 con 0x7f4dc006c330 2023-05-17T12:26:10.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dc53ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc01592f0 con 0x7f4dc015c840 2023-05-17T12:26:10.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dbeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006b0b0 0x7f4dc01f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:10.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dbeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006b0b0 0x7f4dc01f2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55064/0 (socket says 172.21.15.88:55064) 2023-05-17T12:26:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dbeffd700 1 -- 172.21.15.88:0/496775845 learned_addr learned my addr 172.21.15.88:0/496775845 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dbf7fe700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc015c840 0x7f4dc0159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.357+0000 7f4dbe7fc700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc006c330 0x7f4dc0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4dbeffd700 1 -- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc015c840 msgr2=0x7f4dc0159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4dbeffd700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc015c840 0x7f4dc0159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4dbeffd700 1 -- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc006c330 msgr2=0x7f4dc0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:10.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4dbeffd700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc006c330 0x7f4dc0156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4dbeffd700 1 -- 172.21.15.88:0/496775845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009b30 con 0x7f4dc006b0b0 2023-05-17T12:26:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4dbeffd700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006b0b0 0x7f4dc01f2270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4db000d800 tx=0x7f4db000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:10.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4da77fe700 1 -- 172.21.15.88:0/496775845 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db00125f0 con 0x7f4dc006b0b0 2023-05-17T12:26:10.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4da77fe700 1 -- 172.21.15.88:0/496775845 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db0012750 con 0x7f4dc006b0b0 2023-05-17T12:26:10.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc00cd900 con 0x7f4dc006b0b0 2023-05-17T12:26:10.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4da77fe700 1 -- 172.21.15.88:0/496775845 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0012b00 con 0x7f4dc006b0b0 2023-05-17T12:26:10.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.358+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc00b2740 con 0x7f4dc006b0b0 2023-05-17T12:26:10.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.359+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc00cdbe0 con 0x7f4dc006b0b0 2023-05-17T12:26:10.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.360+0000 7f4da77fe700 1 -- 172.21.15.88:0/496775845 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4db0012c60 con 0x7f4dc006b0b0 2023-05-17T12:26:10.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.361+0000 7f4da77fe700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4dac06ace0 0x7f4dac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:10.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.361+0000 7f4da77fe700 1 -- 172.21.15.88:0/496775845 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4db0089860 con 0x7f4dc006b0b0 2023-05-17T12:26:10.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.362+0000 7f4dbe7fc700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4dac06ace0 0x7f4dac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:10.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.362+0000 7f4dbe7fc700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4dac06ace0 0x7f4dac06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4dc015bdb0 tx=0x7f4db4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:10.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.365+0000 7f4da77fe700 1 -- 172.21.15.88:0/496775845 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4db00545f0 con 0x7f4dc006b0b0 2023-05-17T12:26:10.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:10.635+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f4dc0074530 con 0x7f4dc006b0b0 2023-05-17T12:26:11.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.551+0000 7f4da77fe700 1 -- 172.21.15.88:0/496775845 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v82) v1 ==== 147+0+0 (secure 0 0 0) 0x7f4db0057c10 con 0x7f4dc006b0b0 2023-05-17T12:26:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4dac06ace0 msgr2=0x7f4dac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4dac06ace0 0x7f4dac06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4dc015bdb0 tx=0x7f4db4009040 comp rx=0 tx=0).stop 2023-05-17T12:26:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006b0b0 msgr2=0x7f4dc01f2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006b0b0 0x7f4dc01f2270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4db000d800 tx=0x7f4db000db10 comp rx=0 tx=0).stop 2023-05-17T12:26:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 shutdown_connections 2023-05-17T12:26:11.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4dac06ace0 0x7f4dac06d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4dc015c840 0x7f4dc0159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4dc006b0b0 0x7f4dc01f2270 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 --2- 172.21.15.88:0/496775845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4dc006c330 0x7f4dc0156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 >> 172.21.15.88:0/496775845 conn(0x7f4dc00d3060 msgr2=0x7f4dc00b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:11.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 shutdown_connections 2023-05-17T12:26:11.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.555+0000 7f4dc53ff700 1 -- 172.21.15.88:0/496775845 wait complete. 2023-05-17T12:26:11.579 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-17T12:26:11.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.768+0000 7f445b9ff700 1 Processor -- start 2023-05-17T12:26:11.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.768+0000 7f445b9ff700 1 -- start start 2023-05-17T12:26:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.769+0000 7f445b9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f445406af60 0x7f4454160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.769+0000 7f445b9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445406a510 con 0x7f445406c760 2023-05-17T12:26:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.769+0000 7f445b9ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44540cf8a0 con 0x7f44540b23a0 2023-05-17T12:26:11.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.769+0000 7f445b9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44540cd840 con 0x7f445406af60 2023-05-17T12:26:11.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.769+0000 7f4459f9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f445406af60 0x7f4454160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:11.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.769+0000 7f445979b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f445406c760 0x7f445406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59508/0 (socket says 172.21.15.88:59508) 2023-05-17T12:26:11.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.769+0000 7f445979b700 1 -- 172.21.15.88:0/425670985 learned_addr learned my addr 172.21.15.88:0/425670985 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:11.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.770+0000 7f4459f9c700 1 -- 172.21.15.88:0/425670985 >> v1:172.21.15.187:6789/0 conn(0x7f44540b23a0 legacy=0x7f44540cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:11.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.770+0000 7f4459f9c700 1 -- 172.21.15.88:0/425670985 >> v1:172.21.15.88:6789/0 conn(0x7f445406c760 legacy=0x7f445406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.770+0000 7f4459f9c700 1 -- 172.21.15.88:0/425670985 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540cdb20 con 0x7f445406af60 2023-05-17T12:26:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.770+0000 7f444bfff700 1 -- 172.21.15.88:0/425670985 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632845263 0 0) 0x7f445406a510 con 0x7f445406c760 2023-05-17T12:26:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.770+0000 7f4459f9c700 1 --2- 172.21.15.88:0/425670985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 0x7f4454160380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f444c009d90 tx=0x7f444c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea81aa8623d55e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.770+0000 7f444bfff700 1 -- 172.21.15.88:0/425670985 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00e070 con 0x7f445406af60 2023-05-17T12:26:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.770+0000 7f444bfff700 1 -- 172.21.15.88:0/425670985 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c00bb90 con 0x7f445406af60 2023-05-17T12:26:11.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.770+0000 7f444bfff700 1 -- 172.21.15.88:0/425670985 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c003a20 con 0x7f445406af60 2023-05-17T12:26:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.771+0000 7f445b9ff700 1 -- 172.21.15.88:0/425670985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 msgr2=0x7f4454160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.771+0000 7f445b9ff700 1 --2- 172.21.15.88:0/425670985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 0x7f4454160380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f444c009d90 tx=0x7f444c00b330 comp rx=0 tx=0).stop 2023-05-17T12:26:11.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.771+0000 7f445b9ff700 1 -- 172.21.15.88:0/425670985 shutdown_connections 2023-05-17T12:26:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.771+0000 7f445b9ff700 1 --2- 172.21.15.88:0/425670985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 0x7f4454160380 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.771+0000 7f445b9ff700 1 -- 172.21.15.88:0/425670985 >> 172.21.15.88:0/425670985 conn(0x7f44540d06f0 msgr2=0x7f44540d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.771+0000 7f445b9ff700 1 -- 172.21.15.88:0/425670985 shutdown_connections 2023-05-17T12:26:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.771+0000 7f445b9ff700 1 -- 172.21.15.88:0/425670985 wait complete. 2023-05-17T12:26:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.773+0000 7f445b9ff700 1 Processor -- start 2023-05-17T12:26:11.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.773+0000 7f445b9ff700 1 -- start start 2023-05-17T12:26:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445b9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 0x7f44540b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445b9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445406c760 0x7f44541e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445b9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4454157470 0x7f445414de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445b9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540b61b0 con 0x7f445406af60 2023-05-17T12:26:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445b9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44541e7be0 con 0x7f4454157470 2023-05-17T12:26:11.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445b9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44541e7ec0 con 0x7f445406c760 2023-05-17T12:26:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445979b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 0x7f44540b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445979b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 0x7f44540b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55416/0 (socket says 172.21.15.88:55416) 2023-05-17T12:26:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445979b700 1 -- 172.21.15.88:0/2178400618 learned_addr learned my addr 172.21.15.88:0/2178400618 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f4459f9c700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4454157470 0x7f445414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f4458f9a700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445406c760 0x7f44541e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445979b700 1 -- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445406c760 msgr2=0x7f44541e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445979b700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445406c760 0x7f44541e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445979b700 1 -- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4454157470 msgr2=0x7f445414de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445979b700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4454157470 0x7f445414de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f445979b700 1 -- 172.21.15.88:0/2178400618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c009a70 con 0x7f445406af60 2023-05-17T12:26:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f4459f9c700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4454157470 0x7f445414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.774+0000 7f4458f9a700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445406c760 0x7f44541e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.775+0000 7f445979b700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 0x7f44540b6d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f44500011e0 tx=0x7f445000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.775+0000 7f4449ffb700 1 -- 172.21.15.88:0/2178400618 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450004c80 con 0x7f445406af60 2023-05-17T12:26:11.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.775+0000 7f4449ffb700 1 -- 172.21.15.88:0/2178400618 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4450004e00 con 0x7f445406af60 2023-05-17T12:26:11.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.775+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445406aa40 con 0x7f445406af60 2023-05-17T12:26:11.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.775+0000 7f4449ffb700 1 -- 172.21.15.88:0/2178400618 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450007310 con 0x7f445406af60 2023-05-17T12:26:11.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.775+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445406a760 con 0x7f445406af60 2023-05-17T12:26:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.776+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445415cb40 con 0x7f445406af60 2023-05-17T12:26:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.777+0000 7f4449ffb700 1 -- 172.21.15.88:0/2178400618 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4450007470 con 0x7f445406af60 2023-05-17T12:26:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.778+0000 7f4449ffb700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f443806ace0 0x7f443806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.778+0000 7f4449ffb700 1 -- 172.21.15.88:0/2178400618 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f44500895a0 con 0x7f445406af60 2023-05-17T12:26:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.778+0000 7f4458f9a700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f443806ace0 0x7f443806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:11.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.779+0000 7f4458f9a700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f443806ace0 0x7f443806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4444003f40 tx=0x7f4444009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:11.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.782+0000 7f4449ffb700 1 -- 172.21.15.88:0/2178400618 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4450054280 con 0x7f445406af60 2023-05-17T12:26:11.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.981+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4454074530 con 0x7f445406af60 2023-05-17T12:26:11.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.987+0000 7f4449ffb700 1 -- 172.21.15.88:0/2178400618 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f44500578a0 con 0x7f445406af60 2023-05-17T12:26:11.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f443806ace0 msgr2=0x7f443806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:11.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f443806ace0 0x7f443806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4444003f40 tx=0x7f4444009040 comp rx=0 tx=0).stop 2023-05-17T12:26:11.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 msgr2=0x7f44540b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:11.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 0x7f44540b6d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f44500011e0 tx=0x7f445000cae0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 shutdown_connections 2023-05-17T12:26:11.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f443806ace0 0x7f443806d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4454157470 0x7f445414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f445406af60 0x7f44540b6d70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 --2- 172.21.15.88:0/2178400618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f445406c760 0x7f44541e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:11.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 >> 172.21.15.88:0/2178400618 conn(0x7f44540d06f0 msgr2=0x7f4454158910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:11.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 shutdown_connections 2023-05-17T12:26:11.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:11.989+0000 7f445b9ff700 1 -- 172.21.15.88:0/2178400618 wait complete. 2023-05-17T12:26:12.010 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-17T12:26:12.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T12:26:12.112 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-17T12:26:12.214 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-17T12:26:12.215 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:26:12.215 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:12.256 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:26:12.257 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:12.338 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:12.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.562+0000 7f53b21ff700 1 Processor -- start 2023-05-17T12:26:12.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.562+0000 7f53b21ff700 1 -- start start 2023-05-17T12:26:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.563+0000 7f53b21ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac158bd0 0x7f53ac15c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.563+0000 7f53b21ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f53ac0cdbb0 0x7f53ac06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.563+0000 7f53b21ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac0c9c00 con 0x7f53ac0716c0 2023-05-17T12:26:12.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.563+0000 7f53b21ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac15d130 con 0x7f53ac0cdbb0 2023-05-17T12:26:12.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.563+0000 7f53b21ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac15d410 con 0x7f53ac158bd0 2023-05-17T12:26:12.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.563+0000 7f53abfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f53ac0716c0 0x7f53ac0ca390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59516/0 (socket says 172.21.15.88:59516) 2023-05-17T12:26:12.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.563+0000 7f53abfff700 1 -- 172.21.15.88:0/3484747983 learned_addr learned my addr 172.21.15.88:0/3484747983 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:12.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53ab7fe700 1 --2- 172.21.15.88:0/3484747983 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac158bd0 0x7f53ac15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53aaffd700 1 --2- 172.21.15.88:0/3484747983 >> v2:172.21.15.187:3300/0 conn(0x7f53ac0cdbb0 0x7f53ac06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53aa7fc700 1 -- 172.21.15.88:0/3484747983 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788793282 0 0) 0x7f53ac0c9c00 con 0x7f53ac0716c0 2023-05-17T12:26:12.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53aa7fc700 1 -- 172.21.15.88:0/3484747983 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53940035b0 con 0x7f53ac0716c0 2023-05-17T12:26:12.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53aaffd700 1 -- 172.21.15.88:0/3484747983 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac158bd0 msgr2=0x7f53ac15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:12.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53aa7fc700 1 -- 172.21.15.88:0/3484747983 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3662574785 0 0) 0x7f53940035b0 con 0x7f53ac0716c0 2023-05-17T12:26:12.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53aaffd700 1 --2- 172.21.15.88:0/3484747983 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac158bd0 0x7f53ac15c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53aaffd700 1 -- 172.21.15.88:0/3484747983 >> v1:172.21.15.88:6789/0 conn(0x7f53ac0716c0 legacy=0x7f53ac0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:12.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53aaffd700 1 -- 172.21.15.88:0/3484747983 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac0c9e70 con 0x7f53ac0cdbb0 2023-05-17T12:26:12.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53ab7fe700 1 --2- 172.21.15.88:0/3484747983 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac158bd0 0x7f53ac15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:12.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.564+0000 7f53aaffd700 1 --2- 172.21.15.88:0/3484747983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53ac0cdbb0 0x7f53ac06dd50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009840 tx=0x7f53a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e61821e9dc580826 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:12.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53aa7fc700 1 -- 172.21.15.88:0/3484747983 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40019f0 con 0x7f53ac0cdbb0 2023-05-17T12:26:12.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53aa7fc700 1 -- 172.21.15.88:0/3484747983 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a0004030 con 0x7f53ac0cdbb0 2023-05-17T12:26:12.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53aa7fc700 1 -- 172.21.15.88:0/3484747983 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a00043c0 con 0x7f53ac0cdbb0 2023-05-17T12:26:12.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53b21ff700 1 -- 172.21.15.88:0/3484747983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53ac0cdbb0 msgr2=0x7f53ac06dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:12.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53b21ff700 1 --2- 172.21.15.88:0/3484747983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53ac0cdbb0 0x7f53ac06dd50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009840 tx=0x7f53a0009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:12.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53b21ff700 1 -- 172.21.15.88:0/3484747983 shutdown_connections 2023-05-17T12:26:12.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53b21ff700 1 --2- 172.21.15.88:0/3484747983 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac158bd0 0x7f53ac15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53b21ff700 1 --2- 172.21.15.88:0/3484747983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53ac0cdbb0 0x7f53ac06dd50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53b21ff700 1 -- 172.21.15.88:0/3484747983 >> 172.21.15.88:0/3484747983 conn(0x7f53ac0ced10 msgr2=0x7f53ac0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:12.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53b21ff700 1 -- 172.21.15.88:0/3484747983 shutdown_connections 2023-05-17T12:26:12.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.565+0000 7f53b21ff700 1 -- 172.21.15.88:0/3484747983 wait complete. 2023-05-17T12:26:12.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.567+0000 7f53b21ff700 1 Processor -- start 2023-05-17T12:26:12.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.567+0000 7f53b21ff700 1 -- start start 2023-05-17T12:26:12.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53b21ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac0716c0 0x7f53ac150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53b21ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53ac0cdbb0 0x7f53ac15b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53b21ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53ac158bd0 0x7f53ac1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53b21ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0acee0 con 0x7f53ac158bd0 2023-05-17T12:26:12.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53b21ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0c5de0 con 0x7f53ac0cdbb0 2023-05-17T12:26:12.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53b21ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac150c50 con 0x7f53ac0716c0 2023-05-17T12:26:12.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53abfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53ac158bd0 0x7f53ac1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53abfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53ac158bd0 0x7f53ac1595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55418/0 (socket says 172.21.15.88:55418) 2023-05-17T12:26:12.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53ab7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac0716c0 0x7f53ac150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.568+0000 7f53abfff700 1 -- 172.21.15.88:0/373597550 learned_addr learned my addr 172.21.15.88:0/373597550 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:12.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f53aaffd700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53ac0cdbb0 0x7f53ac15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f53abfff700 1 -- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac0716c0 msgr2=0x7f53ac150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:12.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f53abfff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac0716c0 0x7f53ac150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f53abfff700 1 -- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53ac0cdbb0 msgr2=0x7f53ac15b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:12.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f53abfff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53ac0cdbb0 0x7f53ac15b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f53abfff700 1 -- 172.21.15.88:0/373597550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c0094a0 con 0x7f53ac158bd0 2023-05-17T12:26:12.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f53abfff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53ac158bd0 0x7f53ac1595a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f53a400cc90 tx=0x7f53a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:12.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f5393fff700 1 -- 172.21.15.88:0/373597550 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a400aad0 con 0x7f53ac158bd0 2023-05-17T12:26:12.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f5393fff700 1 -- 172.21.15.88:0/373597550 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a400ac30 con 0x7f53ac158bd0 2023-05-17T12:26:12.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a00094a0 con 0x7f53ac158bd0 2023-05-17T12:26:12.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.569+0000 7f5393fff700 1 -- 172.21.15.88:0/373597550 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40070d0 con 0x7f53ac158bd0 2023-05-17T12:26:12.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.570+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac15cd90 con 0x7f53ac158bd0 2023-05-17T12:26:12.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.570+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac15d6f0 con 0x7f53ac158bd0 2023-05-17T12:26:12.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.571+0000 7f5393fff700 1 -- 172.21.15.88:0/373597550 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53a4007230 con 0x7f53ac158bd0 2023-05-17T12:26:12.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.572+0000 7f5393fff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f539806ace0 0x7f539806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.572+0000 7f5393fff700 1 -- 172.21.15.88:0/373597550 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f53a40896b0 con 0x7f53ac158bd0 2023-05-17T12:26:12.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.573+0000 7f53ab7fe700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f539806ace0 0x7f539806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.573+0000 7f53ab7fe700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f539806ace0 0x7f539806d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f539c009cd0 tx=0x7f539c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:12.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.576+0000 7f5393fff700 1 -- 172.21.15.88:0/373597550 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f53a4054390 con 0x7f53ac158bd0 2023-05-17T12:26:12.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.772+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53ac158fa0 con 0x7f53ac158bd0 2023-05-17T12:26:12.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.774+0000 7f5393fff700 1 -- 172.21.15.88:0/373597550 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f53a40579b0 con 0x7f53ac158bd0 2023-05-17T12:26:12.778 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:12.778 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:12.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f539806ace0 msgr2=0x7f539806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:12.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f539806ace0 0x7f539806d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f539c009cd0 tx=0x7f539c009210 comp rx=0 tx=0).stop 2023-05-17T12:26:12.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53ac158bd0 msgr2=0x7f53ac1595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:12.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53ac158bd0 0x7f53ac1595a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f53a400cc90 tx=0x7f53a400a060 comp rx=0 tx=0).stop 2023-05-17T12:26:12.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 shutdown_connections 2023-05-17T12:26:12.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f539806ace0 0x7f539806d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53ac158bd0 0x7f53ac1595a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53ac0716c0 0x7f53ac150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 --2- 172.21.15.88:0/373597550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53ac0cdbb0 0x7f53ac15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 >> 172.21.15.88:0/373597550 conn(0x7f53ac0ced10 msgr2=0x7f53ac0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:12.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 shutdown_connections 2023-05-17T12:26:12.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.776+0000 7f53b21ff700 1 -- 172.21.15.88:0/373597550 wait complete. 2023-05-17T12:26:12.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:12.798 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:12.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.982+0000 7f42e8fff700 1 Processor -- start 2023-05-17T12:26:12.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.983+0000 7f42e8fff700 1 -- start start 2023-05-17T12:26:12.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e8fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42e40c9370 0x7f42e40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e8fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f42e406a510 0x7f42e415e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e8fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e406b430 con 0x7f42e40b4750 2023-05-17T12:26:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e8fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e40c9c80 con 0x7f42e406a510 2023-05-17T12:26:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e8fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e406b680 con 0x7f42e40c9370 2023-05-17T12:26:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e2d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f42e40b4750 0x7f42e415e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59532/0 (socket says 172.21.15.88:59532) 2023-05-17T12:26:12.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e2d9d700 1 -- 172.21.15.88:0/2136873248 learned_addr learned my addr 172.21.15.88:0/2136873248 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:12.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e259c700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42e40c9370 0x7f42e40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42dbfff700 1 --2- 172.21.15.88:0/2136873248 >> v2:172.21.15.187:3300/0 conn(0x7f42e406a510 0x7f42e415e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861458393 0 0) 0x7f42e406b430 con 0x7f42e40b4750 2023-05-17T12:26:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.984+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d00035b0 con 0x7f42e40b4750 2023-05-17T12:26:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2003279486 0 0) 0x7f42d00035b0 con 0x7f42e40b4750 2023-05-17T12:26:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42e40c9370 msgr2=0x7f42e40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42e40c9370 0x7f42e40c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 >> v2:172.21.15.187:3300/0 conn(0x7f42e406a510 msgr2=0x7f42e415e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:12.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 --2- 172.21.15.88:0/2136873248 >> v2:172.21.15.187:3300/0 conn(0x7f42e406a510 0x7f42e415e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e406b960 con 0x7f42e40b4750 2023-05-17T12:26:12.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f42dc0019f0 con 0x7f42e40b4750 2023-05-17T12:26:12.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 >> v1:172.21.15.88:6789/0 conn(0x7f42e40b4750 legacy=0x7f42e415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:12.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42e40c9370 0x7f42d0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42d0003f80 0x7f42d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d0004d90 0x7f42d0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40c9c80 con 0x7f42d0004d90 2023-05-17T12:26:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e406b680 con 0x7f42d0003f80 2023-05-17T12:26:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d000ba10 con 0x7f42e40c9370 2023-05-17T12:26:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e2d9d700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d0004d90 0x7f42d0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42e259c700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42e40c9370 0x7f42d0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.985+0000 7f42dbfff700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42d0003f80 0x7f42d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e2d9d700 1 -- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42e40c9370 msgr2=0x7f42d0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e2d9d700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42e40c9370 0x7f42d0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e2d9d700 1 -- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42d0003f80 msgr2=0x7f42d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e2d9d700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42d0003f80 0x7f42d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e2d9d700 1 -- 172.21.15.88:0/2136873248 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d00035b0 con 0x7f42d0004d90 2023-05-17T12:26:12.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e2d9d700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d0004d90 0x7f42d0005200 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00a860 tx=0x7f42d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b751d2335c39e69e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc012600 con 0x7f42d0004d90 2023-05-17T12:26:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc012780 con 0x7f42d0004d90 2023-05-17T12:26:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e1d9b700 1 -- 172.21.15.88:0/2136873248 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc012b30 con 0x7f42d0004d90 2023-05-17T12:26:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e8fff700 1 -- 172.21.15.88:0/2136873248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d0004d90 msgr2=0x7f42d0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.986+0000 7f42e8fff700 1 --2- 172.21.15.88:0/2136873248 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d0004d90 0x7f42d0005200 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00a860 tx=0x7f42d0005880 comp rx=0 tx=0).stop 2023-05-17T12:26:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.987+0000 7f42e2d9d700 1 -- 172.21.15.88:0/2136873248 reap_dead start 2023-05-17T12:26:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.987+0000 7f42e8fff700 1 -- 172.21.15.88:0/2136873248 shutdown_connections 2023-05-17T12:26:12.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.987+0000 7f42e8fff700 1 -- 172.21.15.88:0/2136873248 >> 172.21.15.88:0/2136873248 conn(0x7f42e40cf970 msgr2=0x7f42e40cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:12.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.987+0000 7f42e8fff700 1 -- 172.21.15.88:0/2136873248 shutdown_connections 2023-05-17T12:26:12.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.987+0000 7f42e8fff700 1 -- 172.21.15.88:0/2136873248 wait complete. 2023-05-17T12:26:12.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.988+0000 7f42e8fff700 1 Processor -- start 2023-05-17T12:26:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.989+0000 7f42e8fff700 1 -- start start 2023-05-17T12:26:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.989+0000 7f42e8fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d0004d90 0x7f42e415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.989+0000 7f42e8fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42e406edb0 0x7f42e406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.989+0000 7f42e8fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42e41e63d0 0x7f42e41433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.989+0000 7f42e8fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e414ec90 con 0x7f42e41e63d0 2023-05-17T12:26:12.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.989+0000 7f42e8fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e406dd10 con 0x7f42e406edb0 2023-05-17T12:26:12.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.989+0000 7f42e8fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e406dff0 con 0x7f42d0004d90 2023-05-17T12:26:12.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e2d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42e41e63d0 0x7f42e41433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e2d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42e41e63d0 0x7f42e41433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55430/0 (socket says 172.21.15.88:55430) 2023-05-17T12:26:12.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e2d9d700 1 -- 172.21.15.88:0/97539996 learned_addr learned my addr 172.21.15.88:0/97539996 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:12.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e259c700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d0004d90 0x7f42e415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:12.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42dbfff700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42e406edb0 0x7f42e406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e2d9d700 1 -- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d0004d90 msgr2=0x7f42e415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e2d9d700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d0004d90 0x7f42e415bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e2d9d700 1 -- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42e406edb0 msgr2=0x7f42e406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e2d9d700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42e406edb0 0x7f42e406d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e2d9d700 1 -- 172.21.15.88:0/97539996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e415a8e0 con 0x7f42e41e63d0 2023-05-17T12:26:13.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.990+0000 7f42e2d9d700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42e41e63d0 0x7f42e41433f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f42dc012000 tx=0x7f42dc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:13.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.991+0000 7f42daffd700 1 -- 172.21.15.88:0/97539996 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc01e600 con 0x7f42e41e63d0 2023-05-17T12:26:13.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.991+0000 7f42daffd700 1 -- 172.21.15.88:0/97539996 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc01e760 con 0x7f42e41e63d0 2023-05-17T12:26:13.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.991+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e406bc40 con 0x7f42e41e63d0 2023-05-17T12:26:13.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.991+0000 7f42daffd700 1 -- 172.21.15.88:0/97539996 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc01eb10 con 0x7f42e41e63d0 2023-05-17T12:26:13.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.991+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e4071f30 con 0x7f42e41e63d0 2023-05-17T12:26:13.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.992+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e4074530 con 0x7f42e41e63d0 2023-05-17T12:26:13.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.993+0000 7f42daffd700 1 -- 172.21.15.88:0/97539996 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42dc019030 con 0x7f42e41e63d0 2023-05-17T12:26:13.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.994+0000 7f42daffd700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f42c406ad10 0x7f42c406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.994+0000 7f42daffd700 1 -- 172.21.15.88:0/97539996 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f42dc08ab60 con 0x7f42e41e63d0 2023-05-17T12:26:13.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.995+0000 7f42e259c700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f42c406ad10 0x7f42c406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.995+0000 7f42e259c700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f42c406ad10 0x7f42c406d1c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009c60 tx=0x7f42d4009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:13.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:12.999+0000 7f42daffd700 1 -- 172.21.15.88:0/97539996 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f42dc055b50 con 0x7f42e41e63d0 2023-05-17T12:26:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.194+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42e40c9130 con 0x7f42e41e63d0 2023-05-17T12:26:13.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.194+0000 7f42daffd700 1 -- 172.21.15.88:0/97539996 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42dc0260a0 con 0x7f42e41e63d0 2023-05-17T12:26:13.199 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f42c406ad10 msgr2=0x7f42c406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f42c406ad10 0x7f42c406d1c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009c60 tx=0x7f42d4009210 comp rx=0 tx=0).stop 2023-05-17T12:26:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42e41e63d0 msgr2=0x7f42e41433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42e41e63d0 0x7f42e41433f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f42dc012000 tx=0x7f42dc001d80 comp rx=0 tx=0).stop 2023-05-17T12:26:13.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 shutdown_connections 2023-05-17T12:26:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f42c406ad10 0x7f42c406d1c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42e41e63d0 0x7f42e41433f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d0004d90 0x7f42e415bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 --2- 172.21.15.88:0/97539996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42e406edb0 0x7f42e406d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 >> 172.21.15.88:0/97539996 conn(0x7f42e40cf970 msgr2=0x7f42e415aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 shutdown_connections 2023-05-17T12:26:13.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.197+0000 7f42e8fff700 1 -- 172.21.15.88:0/97539996 wait complete. 2023-05-17T12:26:13.218 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:13.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.404+0000 7fe2d0dff700 1 Processor -- start 2023-05-17T12:26:13.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.405+0000 7fe2d0dff700 1 -- start start 2023-05-17T12:26:13.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.406+0000 7fe2d0dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe2cc06c760 0x7fe2cc06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.406+0000 7fe2d0dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc06b4a0 con 0x7fe2cc0cf190 2023-05-17T12:26:13.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.406+0000 7fe2d0dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc06a510 con 0x7fe2cc0b23a0 2023-05-17T12:26:13.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.406+0000 7fe2d0dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc0cd840 con 0x7fe2cc06c760 2023-05-17T12:26:13.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2cad9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe2cc0cf190 0x7fe2cc160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59542/0 (socket says 172.21.15.88:59542) 2023-05-17T12:26:13.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2cad9d700 1 -- 172.21.15.88:0/2171095201 learned_addr learned my addr 172.21.15.88:0/2171095201 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:13.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2ca59c700 1 --2- 172.21.15.88:0/2171095201 >> v2:172.21.15.187:3300/0 conn(0x7fe2cc06c760 0x7fe2cc06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2c959a700 1 -- 172.21.15.88:0/2171095201 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996701775 0 0) 0x7fe2c4001490 con 0x7fe2cc0cf190 2023-05-17T12:26:13.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2c959a700 1 -- 172.21.15.88:0/2171095201 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b40035b0 con 0x7fe2cc0cf190 2023-05-17T12:26:13.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2c959a700 1 -- 172.21.15.88:0/2171095201 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016378506 0 0) 0x7fe2cc06a510 con 0x7fe2cc0b23a0 2023-05-17T12:26:13.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2c959a700 1 -- 172.21.15.88:0/2171095201 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c4001490 con 0x7fe2cc0b23a0 2023-05-17T12:26:13.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2ca59c700 1 -- 172.21.15.88:0/2171095201 >> v1:172.21.15.187:6789/0 conn(0x7fe2cc0b23a0 legacy=0x7fe2cc06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2c959a700 1 -- 172.21.15.88:0/2171095201 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2334784830 0 0) 0x7fe2b40035b0 con 0x7fe2cc0cf190 2023-05-17T12:26:13.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2ca59c700 1 -- 172.21.15.88:0/2171095201 >> v1:172.21.15.88:6789/0 conn(0x7fe2cc0cf190 legacy=0x7fe2cc160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.407+0000 7fe2ca59c700 1 -- 172.21.15.88:0/2171095201 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0cdb20 con 0x7fe2cc06c760 2023-05-17T12:26:13.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.408+0000 7fe2ca59c700 1 --2- 172.21.15.88:0/2171095201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2cc06c760 0x7fe2cc06af60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009840 tx=0x7fe2bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=193834ee0d557251 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:13.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.408+0000 7fe2c959a700 1 -- 172.21.15.88:0/2171095201 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4001b80 con 0x7fe2cc06c760 2023-05-17T12:26:13.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.408+0000 7fe2c959a700 1 -- 172.21.15.88:0/2171095201 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc004030 con 0x7fe2cc06c760 2023-05-17T12:26:13.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.408+0000 7fe2c959a700 1 -- 172.21.15.88:0/2171095201 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0043c0 con 0x7fe2cc06c760 2023-05-17T12:26:13.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.408+0000 7fe2d0dff700 1 -- 172.21.15.88:0/2171095201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2cc06c760 msgr2=0x7fe2cc06af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.408+0000 7fe2d0dff700 1 --2- 172.21.15.88:0/2171095201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2cc06c760 0x7fe2cc06af60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009840 tx=0x7fe2bc009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:13.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.409+0000 7fe2d0dff700 1 -- 172.21.15.88:0/2171095201 shutdown_connections 2023-05-17T12:26:13.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.409+0000 7fe2d0dff700 1 --2- 172.21.15.88:0/2171095201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2cc06c760 0x7fe2cc06af60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.409+0000 7fe2d0dff700 1 -- 172.21.15.88:0/2171095201 >> 172.21.15.88:0/2171095201 conn(0x7fe2cc0d06f0 msgr2=0x7fe2cc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:13.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.409+0000 7fe2d0dff700 1 -- 172.21.15.88:0/2171095201 shutdown_connections 2023-05-17T12:26:13.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.409+0000 7fe2d0dff700 1 -- 172.21.15.88:0/2171095201 wait complete. 2023-05-17T12:26:13.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.410+0000 7fe2d0dff700 1 Processor -- start 2023-05-17T12:26:13.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.410+0000 7fe2d0dff700 1 -- start start 2023-05-17T12:26:13.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.411+0000 7fe2d0dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2cc06c760 0x7fe2cc157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.411+0000 7fe2d0dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2cc0cf190 0x7fe2cc0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.411+0000 7fe2d0dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2cc1e6ba0 0x7fe2cc0c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.411+0000 7fe2d0dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1e7be0 con 0x7fe2cc06c760 2023-05-17T12:26:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.411+0000 7fe2d0dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1584b0 con 0x7fe2cc1e6ba0 2023-05-17T12:26:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.411+0000 7fe2d0dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1e7060 con 0x7fe2cc0cf190 2023-05-17T12:26:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2ca59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2cc06c760 0x7fe2cc157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2ca59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2cc06c760 0x7fe2cc157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55436/0 (socket says 172.21.15.88:55436) 2023-05-17T12:26:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2ca59c700 1 -- 172.21.15.88:0/3341563760 learned_addr learned my addr 172.21.15.88:0/3341563760 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2ca59c700 1 -- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2cc0cf190 msgr2=0x7fe2cc0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2ca59c700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2cc0cf190 0x7fe2cc0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2ca59c700 1 -- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2cc1e6ba0 msgr2=0x7fe2cc0c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2ca59c700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2cc1e6ba0 0x7fe2cc0c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2ca59c700 1 -- 172.21.15.88:0/3341563760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc0094a0 con 0x7fe2cc06c760 2023-05-17T12:26:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2ca59c700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2cc06c760 0x7fe2cc157950 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0090b0 tx=0x7fe2bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2baffd700 1 -- 172.21.15.88:0/3341563760 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc011830 con 0x7fe2cc06c760 2023-05-17T12:26:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2baffd700 1 -- 172.21.15.88:0/3341563760 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc01f070 con 0x7fe2cc06c760 2023-05-17T12:26:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2baffd700 1 -- 172.21.15.88:0/3341563760 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc011bf0 con 0x7fe2cc06c760 2023-05-17T12:26:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.412+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc06aa40 con 0x7fe2cc06c760 2023-05-17T12:26:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.413+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc06a760 con 0x7fe2cc06c760 2023-05-17T12:26:13.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.414+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc15cb40 con 0x7fe2cc06c760 2023-05-17T12:26:13.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.414+0000 7fe2baffd700 1 -- 172.21.15.88:0/3341563760 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe2bc011d50 con 0x7fe2cc06c760 2023-05-17T12:26:13.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.415+0000 7fe2baffd700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe2ac06ace0 0x7fe2ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.415+0000 7fe2baffd700 1 -- 172.21.15.88:0/3341563760 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe2bc021070 con 0x7fe2cc06c760 2023-05-17T12:26:13.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.415+0000 7fe2c9d9b700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe2ac06ace0 0x7fe2ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.416+0000 7fe2c9d9b700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe2ac06ace0 0x7fe2ac06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00010e0 tx=0x7fe2c00079e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:13.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.419+0000 7fe2baffd700 1 -- 172.21.15.88:0/3341563760 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe2bc055ef0 con 0x7fe2cc06c760 2023-05-17T12:26:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.618+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe2cc074530 con 0x7fe2cc06c760 2023-05-17T12:26:13.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.618+0000 7fe2baffd700 1 -- 172.21.15.88:0/3341563760 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe2bc059510 con 0x7fe2cc06c760 2023-05-17T12:26:13.623 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe2ac06ace0 msgr2=0x7fe2ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe2ac06ace0 0x7fe2ac06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00010e0 tx=0x7fe2c00079e0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2cc06c760 msgr2=0x7fe2cc157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2cc06c760 0x7fe2cc157950 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0090b0 tx=0x7fe2bc004750 comp rx=0 tx=0).stop 2023-05-17T12:26:13.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 shutdown_connections 2023-05-17T12:26:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe2ac06ace0 0x7fe2ac06d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2cc1e6ba0 0x7fe2cc0c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2cc06c760 0x7fe2cc157950 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 --2- 172.21.15.88:0/3341563760 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2cc0cf190 0x7fe2cc0c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 >> 172.21.15.88:0/3341563760 conn(0x7fe2cc0d06f0 msgr2=0x7fe2cc0d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 shutdown_connections 2023-05-17T12:26:13.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.621+0000 7fe2d0dff700 1 -- 172.21.15.88:0/3341563760 wait complete. 2023-05-17T12:26:13.642 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.828+0000 7fb6c8fff700 1 Processor -- start 2023-05-17T12:26:13.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.828+0000 7fb6c8fff700 1 -- start start 2023-05-17T12:26:13.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.830+0000 7fb6c8fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb6c406c760 0x7fb6c406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.830+0000 7fb6c8fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb6c40cf190 0x7fb6c4160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.830+0000 7fb6c8fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c406b4a0 con 0x7fb6c40b23a0 2023-05-17T12:26:13.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.830+0000 7fb6c8fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c406a510 con 0x7fb6c40cf190 2023-05-17T12:26:13.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.830+0000 7fb6c8fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c40cd840 con 0x7fb6c406c760 2023-05-17T12:26:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.830+0000 7fb6bbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb6c40b23a0 0x7fb6c406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59544/0 (socket says 172.21.15.88:59544) 2023-05-17T12:26:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.830+0000 7fb6bbfff700 1 -- 172.21.15.88:0/1983473880 learned_addr learned my addr 172.21.15.88:0/1983473880 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.830+0000 7fb6c2d9d700 1 --2- 172.21.15.88:0/1983473880 >> v2:172.21.15.88:3300/0 conn(0x7fb6c40cf190 0x7fb6c4160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.831+0000 7fb6c259c700 1 --2- 172.21.15.88:0/1983473880 >> v2:172.21.15.187:3300/0 conn(0x7fb6c406c760 0x7fb6c406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.831+0000 7fb6c2d9d700 1 -- 172.21.15.88:0/1983473880 >> v2:172.21.15.187:3300/0 conn(0x7fb6c406c760 msgr2=0x7fb6c406af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.831+0000 7fb6c2d9d700 1 --2- 172.21.15.88:0/1983473880 >> v2:172.21.15.187:3300/0 conn(0x7fb6c406c760 0x7fb6c406af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.831+0000 7fb6c2d9d700 1 -- 172.21.15.88:0/1983473880 >> v1:172.21.15.88:6789/0 conn(0x7fb6c40b23a0 legacy=0x7fb6c406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.831+0000 7fb6c2d9d700 1 -- 172.21.15.88:0/1983473880 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c40cdb20 con 0x7fb6c40cf190 2023-05-17T12:26:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.831+0000 7fb6c2d9d700 1 --2- 172.21.15.88:0/1983473880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c40cf190 0x7fb6c4160380 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40d3a80 tx=0x7fb6bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66353e79ca5decb4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.831+0000 7fb6c1d9b700 1 -- 172.21.15.88:0/1983473880 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00e070 con 0x7fb6c40cf190 2023-05-17T12:26:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.831+0000 7fb6c1d9b700 1 -- 172.21.15.88:0/1983473880 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc00bbd0 con 0x7fb6c40cf190 2023-05-17T12:26:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.831+0000 7fb6c1d9b700 1 -- 172.21.15.88:0/1983473880 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc012430 con 0x7fb6c40cf190 2023-05-17T12:26:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.832+0000 7fb6c8fff700 1 -- 172.21.15.88:0/1983473880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c40cf190 msgr2=0x7fb6c4160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.832+0000 7fb6c8fff700 1 --2- 172.21.15.88:0/1983473880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c40cf190 0x7fb6c4160380 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40d3a80 tx=0x7fb6bc00b330 comp rx=0 tx=0).stop 2023-05-17T12:26:13.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.832+0000 7fb6c8fff700 1 -- 172.21.15.88:0/1983473880 shutdown_connections 2023-05-17T12:26:13.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.832+0000 7fb6c8fff700 1 --2- 172.21.15.88:0/1983473880 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c40cf190 0x7fb6c4160380 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.832+0000 7fb6c8fff700 1 --2- 172.21.15.88:0/1983473880 >> v2:172.21.15.187:3300/0 conn(0x7fb6c406c760 0x7fb6c406af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.832+0000 7fb6c8fff700 1 -- 172.21.15.88:0/1983473880 >> 172.21.15.88:0/1983473880 conn(0x7fb6c40d06f0 msgr2=0x7fb6c40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:13.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.832+0000 7fb6c8fff700 1 -- 172.21.15.88:0/1983473880 shutdown_connections 2023-05-17T12:26:13.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.832+0000 7fb6c8fff700 1 -- 172.21.15.88:0/1983473880 wait complete. 2023-05-17T12:26:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.834+0000 7fb6c8fff700 1 Processor -- start 2023-05-17T12:26:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.834+0000 7fb6c8fff700 1 -- start start 2023-05-17T12:26:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.835+0000 7fb6c8fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c406c760 0x7fb6c4148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.835+0000 7fb6c8fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6c40cf190 0x7fb6c4159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.835+0000 7fb6c8fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6c415b570 0x7fb6c4159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.835+0000 7fb6c8fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c415a2d0 con 0x7fb6c406c760 2023-05-17T12:26:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.835+0000 7fb6c8fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c415b0e0 con 0x7fb6c40cf190 2023-05-17T12:26:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.835+0000 7fb6c8fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4148ba0 con 0x7fb6c415b570 2023-05-17T12:26:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.835+0000 7fb6c259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c406c760 0x7fb6c4148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.835+0000 7fb6c259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c406c760 0x7fb6c4148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55446/0 (socket says 172.21.15.88:55446) 2023-05-17T12:26:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.835+0000 7fb6c259c700 1 -- 172.21.15.88:0/4071664881 learned_addr learned my addr 172.21.15.88:0/4071664881 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:13.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6bbfff700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6c40cf190 0x7fb6c4159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6c2d9d700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6c415b570 0x7fb6c4159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6c259c700 1 -- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6c415b570 msgr2=0x7fb6c4159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6c259c700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6c415b570 0x7fb6c4159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6c259c700 1 -- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6c40cf190 msgr2=0x7fb6c4159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6c259c700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6c40cf190 0x7fb6c4159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6c259c700 1 -- 172.21.15.88:0/4071664881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc009a70 con 0x7fb6c406c760 2023-05-17T12:26:13.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6c259c700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c406c760 0x7fb6c4148660 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400e810 tx=0x7fb6b400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6baffd700 1 -- 172.21.15.88:0/4071664881 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4013610 con 0x7fb6c406c760 2023-05-17T12:26:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6baffd700 1 -- 172.21.15.88:0/4071664881 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4013770 con 0x7fb6c406c760 2023-05-17T12:26:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c406aa40 con 0x7fb6c406c760 2023-05-17T12:26:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6baffd700 1 -- 172.21.15.88:0/4071664881 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4013b20 con 0x7fb6c406c760 2023-05-17T12:26:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.836+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c406a760 con 0x7fb6c406c760 2023-05-17T12:26:13.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.837+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c415cb40 con 0x7fb6c406c760 2023-05-17T12:26:13.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.838+0000 7fb6baffd700 1 -- 172.21.15.88:0/4071664881 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6b4013c80 con 0x7fb6c406c760 2023-05-17T12:26:13.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.839+0000 7fb6baffd700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6a406ace0 0x7fb6a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:13.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.839+0000 7fb6baffd700 1 -- 172.21.15.88:0/4071664881 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb6b4089520 con 0x7fb6c406c760 2023-05-17T12:26:13.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.839+0000 7fb6bbfff700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6a406ace0 0x7fb6a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:13.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.840+0000 7fb6bbfff700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6a406ace0 0x7fb6a406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40b41f0 tx=0x7fb6ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:13.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:13.843+0000 7fb6baffd700 1 -- 172.21.15.88:0/4071664881 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb6b4054210 con 0x7fb6c406c760 2023-05-17T12:26:14.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.033+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6c415b3c0 con 0x7fb6c406c760 2023-05-17T12:26:14.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.033+0000 7fb6baffd700 1 -- 172.21.15.88:0/4071664881 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6b4057830 con 0x7fb6c406c760 2023-05-17T12:26:14.038 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:14.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6a406ace0 msgr2=0x7fb6a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6a406ace0 0x7fb6a406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40b41f0 tx=0x7fb6ac009040 comp rx=0 tx=0).stop 2023-05-17T12:26:14.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c406c760 msgr2=0x7fb6c4148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c406c760 0x7fb6c4148660 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400e810 tx=0x7fb6b400ebd0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 shutdown_connections 2023-05-17T12:26:14.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb6a406ace0 0x7fb6a406d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6c415b570 0x7fb6c4159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6c406c760 0x7fb6c4148660 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 --2- 172.21.15.88:0/4071664881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6c40cf190 0x7fb6c4159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 >> 172.21.15.88:0/4071664881 conn(0x7fb6c40d06f0 msgr2=0x7fb6c40b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:14.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 shutdown_connections 2023-05-17T12:26:14.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.036+0000 7fb6c8fff700 1 -- 172.21.15.88:0/4071664881 wait complete. 2023-05-17T12:26:14.057 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:14.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.241+0000 7f3d4a5ff700 1 Processor -- start 2023-05-17T12:26:14.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.242+0000 7f3d4a5ff700 1 -- start start 2023-05-17T12:26:14.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d4a5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d440cdb10 0x7f3d440cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d4a5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 0x7f3d440caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d4a5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d440ce4a0 con 0x7f3d44153d60 2023-05-17T12:26:14.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d4a5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d44159ed0 con 0x7f3d440cdb10 2023-05-17T12:26:14.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d4a5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4415a1b0 con 0x7f3d440ca660 2023-05-17T12:26:14.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d3bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d440cdb10 0x7f3d440cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d3bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d440cdb10 0x7f3d440cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55448/0 (socket says 172.21.15.88:55448) 2023-05-17T12:26:14.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d3bfff700 1 -- 172.21.15.88:0/2015782289 learned_addr learned my addr 172.21.15.88:0/2015782289 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:14.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d48b9c700 1 --2- 172.21.15.88:0/2015782289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 0x7f3d440caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d3bfff700 1 -- 172.21.15.88:0/2015782289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 msgr2=0x7f3d440caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.243+0000 7f3d3bfff700 1 --2- 172.21.15.88:0/2015782289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 0x7f3d440caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.244+0000 7f3d3bfff700 1 -- 172.21.15.88:0/2015782289 >> v1:172.21.15.88:6789/0 conn(0x7f3d44153d60 legacy=0x7f3d4415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.244+0000 7f3d3bfff700 1 -- 172.21.15.88:0/2015782289 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4415a490 con 0x7f3d440cdb10 2023-05-17T12:26:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.244+0000 7f3d3bfff700 1 --2- 172.21.15.88:0/2015782289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 0x7f3d440cdf60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00bb90 tx=0x7f3d2c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a1f69d78079eaf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.244+0000 7f3d437fe700 1 -- 172.21.15.88:0/2015782289 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00dd30 con 0x7f3d440cdb10 2023-05-17T12:26:14.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.244+0000 7f3d437fe700 1 -- 172.21.15.88:0/2015782289 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c00de90 con 0x7f3d440cdb10 2023-05-17T12:26:14.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.244+0000 7f3d437fe700 1 -- 172.21.15.88:0/2015782289 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c010690 con 0x7f3d440cdb10 2023-05-17T12:26:14.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.245+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/2015782289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 msgr2=0x7f3d440cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.245+0000 7f3d4a5ff700 1 --2- 172.21.15.88:0/2015782289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 0x7f3d440cdf60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00bb90 tx=0x7f3d2c00bea0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.245+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/2015782289 shutdown_connections 2023-05-17T12:26:14.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.245+0000 7f3d4a5ff700 1 --2- 172.21.15.88:0/2015782289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 0x7f3d440caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.245+0000 7f3d4a5ff700 1 --2- 172.21.15.88:0/2015782289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 0x7f3d440cdf60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.245+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/2015782289 >> 172.21.15.88:0/2015782289 conn(0x7f3d440cf970 msgr2=0x7f3d440cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:14.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.245+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/2015782289 shutdown_connections 2023-05-17T12:26:14.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.245+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/2015782289 wait complete. 2023-05-17T12:26:14.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.247+0000 7f3d4a5ff700 1 Processor -- start 2023-05-17T12:26:14.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.247+0000 7f3d4a5ff700 1 -- start start 2023-05-17T12:26:14.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d4a5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 0x7f3d441f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d4a5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 0x7f3d441f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d4a5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d44153d60 0x7f3d441f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d4a5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d441f4100 con 0x7f3d440cdb10 2023-05-17T12:26:14.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d4a5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d441f43e0 con 0x7f3d44153d60 2023-05-17T12:26:14.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d4a5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d441f46c0 con 0x7f3d440ca660 2023-05-17T12:26:14.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 0x7f3d441f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 0x7f3d441f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55450/0 (socket says 172.21.15.88:55450) 2023-05-17T12:26:14.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d3bfff700 1 -- 172.21.15.88:0/3576954707 learned_addr learned my addr 172.21.15.88:0/3576954707 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:14.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d43fff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 0x7f3d441f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.248+0000 7f3d48b9c700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d44153d60 0x7f3d441f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d3bfff700 1 -- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 msgr2=0x7f3d441f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d3bfff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 0x7f3d441f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d3bfff700 1 -- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d44153d60 msgr2=0x7f3d441f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d3bfff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d44153d60 0x7f3d441f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d3bfff700 1 -- 172.21.15.88:0/3576954707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c00b7f0 con 0x7f3d440cdb10 2023-05-17T12:26:14.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d3bfff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 0x7f3d441f51a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c000c00 tx=0x7f3d2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:14.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d417fa700 1 -- 172.21.15.88:0/3576954707 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c003b70 con 0x7f3d440cdb10 2023-05-17T12:26:14.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d417fa700 1 -- 172.21.15.88:0/3576954707 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c003cd0 con 0x7f3d440cdb10 2023-05-17T12:26:14.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4415aa50 con 0x7f3d440cdb10 2023-05-17T12:26:14.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d417fa700 1 -- 172.21.15.88:0/3576954707 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c0106b0 con 0x7f3d440cdb10 2023-05-17T12:26:14.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.249+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4415a770 con 0x7f3d440cdb10 2023-05-17T12:26:14.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.250+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d440cc0d0 con 0x7f3d440cdb10 2023-05-17T12:26:14.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.251+0000 7f3d417fa700 1 -- 172.21.15.88:0/3576954707 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d2c019400 con 0x7f3d440cdb10 2023-05-17T12:26:14.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.252+0000 7f3d417fa700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3d2406ace0 0x7f3d2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.253+0000 7f3d417fa700 1 -- 172.21.15.88:0/3576954707 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3d2c08aaf0 con 0x7f3d440cdb10 2023-05-17T12:26:14.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.253+0000 7f3d43fff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3d2406ace0 0x7f3d2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.253+0000 7f3d43fff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3d2406ace0 0x7f3d2406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d34007fd0 tx=0x7f3d34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:14.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.256+0000 7f3d417fa700 1 -- 172.21.15.88:0/3576954707 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3d2c055860 con 0x7f3d440cdb10 2023-05-17T12:26:14.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.451+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d44074530 con 0x7f3d440cdb10 2023-05-17T12:26:14.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.451+0000 7f3d417fa700 1 -- 172.21.15.88:0/3576954707 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d2c058e80 con 0x7f3d440cdb10 2023-05-17T12:26:14.455 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:14.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.453+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3d2406ace0 msgr2=0x7f3d2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.453+0000 7f3d4a5ff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3d2406ace0 0x7f3d2406d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d34007fd0 tx=0x7f3d34009040 comp rx=0 tx=0).stop 2023-05-17T12:26:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.453+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 msgr2=0x7f3d441f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.453+0000 7f3d4a5ff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 0x7f3d441f51a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c000c00 tx=0x7f3d2c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.454+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 shutdown_connections 2023-05-17T12:26:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.454+0000 7f3d4a5ff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3d2406ace0 0x7f3d2406d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.454+0000 7f3d4a5ff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d44153d60 0x7f3d441f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.454+0000 7f3d4a5ff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d440ca660 0x7f3d441f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.454+0000 7f3d4a5ff700 1 --2- 172.21.15.88:0/3576954707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d440cdb10 0x7f3d441f51a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.454+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 >> 172.21.15.88:0/3576954707 conn(0x7f3d440cf970 msgr2=0x7f3d44152000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:14.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.454+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 shutdown_connections 2023-05-17T12:26:14.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.454+0000 7f3d4a5ff700 1 -- 172.21.15.88:0/3576954707 wait complete. 2023-05-17T12:26:14.475 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:14.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.659+0000 7efc5e7ff700 1 Processor -- start 2023-05-17T12:26:14.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.659+0000 7efc5e7ff700 1 -- start start 2023-05-17T12:26:14.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.661+0000 7efc5e7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc580b23a0 0x7efc5806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.661+0000 7efc5e7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5806b4a0 con 0x7efc580cf190 2023-05-17T12:26:14.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.661+0000 7efc5e7ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5806a510 con 0x7efc5806c760 2023-05-17T12:26:14.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.661+0000 7efc5e7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc580cd840 con 0x7efc580b23a0 2023-05-17T12:26:14.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.661+0000 7efc577fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc580b23a0 0x7efc5806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.661+0000 7efc5cd9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efc580cf190 0x7efc58160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59560/0 (socket says 172.21.15.88:59560) 2023-05-17T12:26:14.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.661+0000 7efc577fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc580b23a0 0x7efc5806af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55456/0 (socket says 172.21.15.88:55456) 2023-05-17T12:26:14.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.661+0000 7efc5cd9c700 1 -- 172.21.15.88:0/3982804985 learned_addr learned my addr 172.21.15.88:0/3982804985 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:14.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.662+0000 7efc577fe700 1 -- 172.21.15.88:0/3982804985 >> v1:172.21.15.187:6789/0 conn(0x7efc5806c760 legacy=0x7efc5806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.662+0000 7efc577fe700 1 -- 172.21.15.88:0/3982804985 >> v1:172.21.15.88:6789/0 conn(0x7efc580cf190 legacy=0x7efc58160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.662+0000 7efc577fe700 1 -- 172.21.15.88:0/3982804985 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc580cdb20 con 0x7efc580b23a0 2023-05-17T12:26:14.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.662+0000 7efc577fe700 1 --2- 172.21.15.88:0/3982804985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580b23a0 0x7efc5806af60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009840 tx=0x7efc4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5777bfc790a0bf server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:14.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.662+0000 7efc56ffd700 1 -- 172.21.15.88:0/3982804985 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c011830 con 0x7efc580b23a0 2023-05-17T12:26:14.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.662+0000 7efc56ffd700 1 -- 172.21.15.88:0/3982804985 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c011990 con 0x7efc580b23a0 2023-05-17T12:26:14.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.662+0000 7efc56ffd700 1 -- 172.21.15.88:0/3982804985 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c011d20 con 0x7efc580b23a0 2023-05-17T12:26:14.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.663+0000 7efc5e7ff700 1 -- 172.21.15.88:0/3982804985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580b23a0 msgr2=0x7efc5806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.663+0000 7efc5e7ff700 1 --2- 172.21.15.88:0/3982804985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580b23a0 0x7efc5806af60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009840 tx=0x7efc4c009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:14.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.663+0000 7efc5e7ff700 1 -- 172.21.15.88:0/3982804985 shutdown_connections 2023-05-17T12:26:14.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.663+0000 7efc5e7ff700 1 --2- 172.21.15.88:0/3982804985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580b23a0 0x7efc5806af60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.663+0000 7efc5e7ff700 1 -- 172.21.15.88:0/3982804985 >> 172.21.15.88:0/3982804985 conn(0x7efc580d06f0 msgr2=0x7efc580d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:14.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.663+0000 7efc5e7ff700 1 -- 172.21.15.88:0/3982804985 shutdown_connections 2023-05-17T12:26:14.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.663+0000 7efc5e7ff700 1 -- 172.21.15.88:0/3982804985 wait complete. 2023-05-17T12:26:14.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.665+0000 7efc5e7ff700 1 Processor -- start 2023-05-17T12:26:14.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.665+0000 7efc5e7ff700 1 -- start start 2023-05-17T12:26:14.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.666+0000 7efc5e7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc5806c760 0x7efc581f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.666+0000 7efc5e7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580cf190 0x7efc580d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.666+0000 7efc5e7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc581552e0 0x7efc580d1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.666+0000 7efc5e7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc581f2c90 con 0x7efc580cf190 2023-05-17T12:26:14.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.666+0000 7efc5e7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc581f2f70 con 0x7efc5806c760 2023-05-17T12:26:14.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.666+0000 7efc5e7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc581f3250 con 0x7efc581552e0 2023-05-17T12:26:14.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc577fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580cf190 0x7efc580d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc577fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580cf190 0x7efc580d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55466/0 (socket says 172.21.15.88:55466) 2023-05-17T12:26:14.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc577fe700 1 -- 172.21.15.88:0/1426129965 learned_addr learned my addr 172.21.15.88:0/1426129965 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:14.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc5cd9c700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc581552e0 0x7efc580d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc57fff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc5806c760 0x7efc581f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc577fe700 1 -- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc581552e0 msgr2=0x7efc580d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc577fe700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc581552e0 0x7efc580d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc577fe700 1 -- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc5806c760 msgr2=0x7efc581f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc577fe700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc5806c760 0x7efc581f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc577fe700 1 -- 172.21.15.88:0/1426129965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c0094a0 con 0x7efc580cf190 2023-05-17T12:26:14.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc5cd9c700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc581552e0 0x7efc580d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc57fff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc5806c760 0x7efc581f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.667+0000 7efc577fe700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580cf190 0x7efc580d0ac0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0090b0 tx=0x7efc4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.668+0000 7efc54ff9700 1 -- 172.21.15.88:0/1426129965 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0038a0 con 0x7efc580cf190 2023-05-17T12:26:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.668+0000 7efc54ff9700 1 -- 172.21.15.88:0/1426129965 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c01f070 con 0x7efc580cf190 2023-05-17T12:26:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.668+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5806aa40 con 0x7efc580cf190 2023-05-17T12:26:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.668+0000 7efc54ff9700 1 -- 172.21.15.88:0/1426129965 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c003c60 con 0x7efc580cf190 2023-05-17T12:26:14.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.668+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5806a760 con 0x7efc580cf190 2023-05-17T12:26:14.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.669+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5815cb40 con 0x7efc580cf190 2023-05-17T12:26:14.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.670+0000 7efc54ff9700 1 -- 172.21.15.88:0/1426129965 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc4c01a430 con 0x7efc580cf190 2023-05-17T12:26:14.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.671+0000 7efc54ff9700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efc4406ace0 0x7efc4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:14.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.671+0000 7efc54ff9700 1 -- 172.21.15.88:0/1426129965 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efc4c021070 con 0x7efc580cf190 2023-05-17T12:26:14.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.671+0000 7efc57fff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efc4406ace0 0x7efc4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:14.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.672+0000 7efc57fff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efc4406ace0 0x7efc4406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc48000f60 tx=0x7efc48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:14.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.675+0000 7efc54ff9700 1 -- 172.21.15.88:0/1426129965 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efc4c056070 con 0x7efc580cf190 2023-05-17T12:26:14.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.866+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc58074530 con 0x7efc580cf190 2023-05-17T12:26:14.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.866+0000 7efc54ff9700 1 -- 172.21.15.88:0/1426129965 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7efc4c059690 con 0x7efc580cf190 2023-05-17T12:26:14.870 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:14.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.868+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efc4406ace0 msgr2=0x7efc4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.868+0000 7efc5e7ff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efc4406ace0 0x7efc4406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc48000f60 tx=0x7efc48009040 comp rx=0 tx=0).stop 2023-05-17T12:26:14.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.868+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580cf190 msgr2=0x7efc580d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:14.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.868+0000 7efc5e7ff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580cf190 0x7efc580d0ac0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0090b0 tx=0x7efc4c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:14.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.869+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 shutdown_connections 2023-05-17T12:26:14.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.869+0000 7efc5e7ff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7efc4406ace0 0x7efc4406d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.869+0000 7efc5e7ff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc581552e0 0x7efc580d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.869+0000 7efc5e7ff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc5806c760 0x7efc581f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.869+0000 7efc5e7ff700 1 --2- 172.21.15.88:0/1426129965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc580cf190 0x7efc580d0ac0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:14.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.869+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 >> 172.21.15.88:0/1426129965 conn(0x7efc580d06f0 msgr2=0x7efc5815bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:14.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.869+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 shutdown_connections 2023-05-17T12:26:14.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:14.869+0000 7efc5e7ff700 1 -- 172.21.15.88:0/1426129965 wait complete. 2023-05-17T12:26:14.889 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:26:15.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.070+0000 7fc3793ff700 1 Processor -- start 2023-05-17T12:26:15.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.071+0000 7fc3793ff700 1 -- start start 2023-05-17T12:26:15.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc3793ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc37415ca90 0x7fc3740cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc3793ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc374160f90 0x7fc37406c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc3793ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc37406ca50 0x7fc37406a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc3793ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37406ced0 con 0x7fc37415ca90 2023-05-17T12:26:15.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc3793ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3740cde90 con 0x7fc37406ca50 2023-05-17T12:26:15.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc3793ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37415d270 con 0x7fc374160f90 2023-05-17T12:26:15.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc372ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc37415ca90 0x7fc3740cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc372ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc37415ca90 0x7fc3740cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55478/0 (socket says 172.21.15.88:55478) 2023-05-17T12:26:15.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc372ffd700 1 -- 172.21.15.88:0/517692659 learned_addr learned my addr 172.21.15.88:0/517692659 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:15.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc36bfff700 1 --2- 172.21.15.88:0/517692659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc374160f90 0x7fc37406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.072+0000 7fc3737fe700 1 --2- 172.21.15.88:0/517692659 >> v2:172.21.15.187:3300/0 conn(0x7fc37406ca50 0x7fc37406a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.073+0000 7fc372ffd700 1 -- 172.21.15.88:0/517692659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc374160f90 msgr2=0x7fc37406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:15.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.073+0000 7fc372ffd700 1 --2- 172.21.15.88:0/517692659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc374160f90 0x7fc37406c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.073+0000 7fc372ffd700 1 -- 172.21.15.88:0/517692659 >> v2:172.21.15.187:3300/0 conn(0x7fc37406ca50 msgr2=0x7fc37406a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:15.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.073+0000 7fc372ffd700 1 --2- 172.21.15.88:0/517692659 >> v2:172.21.15.187:3300/0 conn(0x7fc37406ca50 0x7fc37406a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.073+0000 7fc372ffd700 1 -- 172.21.15.88:0/517692659 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37415d550 con 0x7fc37415ca90 2023-05-17T12:26:15.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.073+0000 7fc372ffd700 1 --2- 172.21.15.88:0/517692659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc37415ca90 0x7fc3740cd800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc3740ca210 tx=0x7fc364009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c6b964b053c46e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:15.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.073+0000 7fc3727fc700 1 -- 172.21.15.88:0/517692659 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364011830 con 0x7fc37415ca90 2023-05-17T12:26:15.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.073+0000 7fc3727fc700 1 -- 172.21.15.88:0/517692659 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc364011990 con 0x7fc37415ca90 2023-05-17T12:26:15.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.073+0000 7fc3727fc700 1 -- 172.21.15.88:0/517692659 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364011d20 con 0x7fc37415ca90 2023-05-17T12:26:15.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.074+0000 7fc3793ff700 1 -- 172.21.15.88:0/517692659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc37415ca90 msgr2=0x7fc3740cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.074+0000 7fc3793ff700 1 --2- 172.21.15.88:0/517692659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc37415ca90 0x7fc3740cd800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc3740ca210 tx=0x7fc364009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.074+0000 7fc3793ff700 1 -- 172.21.15.88:0/517692659 shutdown_connections 2023-05-17T12:26:15.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.074+0000 7fc3793ff700 1 --2- 172.21.15.88:0/517692659 >> v2:172.21.15.187:3300/0 conn(0x7fc37406ca50 0x7fc37406a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.074+0000 7fc3793ff700 1 --2- 172.21.15.88:0/517692659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc37415ca90 0x7fc3740cd800 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.074+0000 7fc3793ff700 1 --2- 172.21.15.88:0/517692659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc374160f90 0x7fc37406c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.074+0000 7fc3793ff700 1 -- 172.21.15.88:0/517692659 >> 172.21.15.88:0/517692659 conn(0x7fc3740d3ed0 msgr2=0x7fc3740cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:15.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.074+0000 7fc3793ff700 1 -- 172.21.15.88:0/517692659 shutdown_connections 2023-05-17T12:26:15.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.074+0000 7fc3793ff700 1 -- 172.21.15.88:0/517692659 wait complete. 2023-05-17T12:26:15.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.075+0000 7fc3793ff700 1 Processor -- start 2023-05-17T12:26:15.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.076+0000 7fc3793ff700 1 -- start start 2023-05-17T12:26:15.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.076+0000 7fc3793ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc37406ca50 0x7fc3740c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3793ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc37415ca90 0x7fc3741e86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3793ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc374160f90 0x7fc3741441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3793ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741560b0 con 0x7fc374160f90 2023-05-17T12:26:15.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3793ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc374156300 con 0x7fc37415ca90 2023-05-17T12:26:15.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3793ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741565e0 con 0x7fc37406ca50 2023-05-17T12:26:15.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc374160f90 0x7fc3741441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc374160f90 0x7fc3741441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55492/0 (socket says 172.21.15.88:55492) 2023-05-17T12:26:15.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3737fe700 1 -- 172.21.15.88:0/4011642341 learned_addr learned my addr 172.21.15.88:0/4011642341 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:15.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc372ffd700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc37406ca50 0x7fc3740c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc36bfff700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc37415ca90 0x7fc3741e86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3737fe700 1 -- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc37406ca50 msgr2=0x7fc3740c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3737fe700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc37406ca50 0x7fc3740c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3737fe700 1 -- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc37415ca90 msgr2=0x7fc3741e86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3737fe700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc37415ca90 0x7fc3741e86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc3737fe700 1 -- 172.21.15.88:0/4011642341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc364009550 con 0x7fc374160f90 2023-05-17T12:26:15.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.077+0000 7fc36bfff700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc37415ca90 0x7fc3741e86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:15.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.078+0000 7fc3737fe700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc374160f90 0x7fc3741441c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc36c007e60 tx=0x7fc36c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:15.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.078+0000 7fc36b7fe700 1 -- 172.21.15.88:0/4011642341 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00ede0 con 0x7fc374160f90 2023-05-17T12:26:15.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.078+0000 7fc36b7fe700 1 -- 172.21.15.88:0/4011642341 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c014420 con 0x7fc374160f90 2023-05-17T12:26:15.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.078+0000 7fc36b7fe700 1 -- 172.21.15.88:0/4011642341 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0147d0 con 0x7fc374160f90 2023-05-17T12:26:15.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.078+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3741613e0 con 0x7fc374160f90 2023-05-17T12:26:15.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.078+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37415d830 con 0x7fc374160f90 2023-05-17T12:26:15.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.079+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37415dd50 con 0x7fc374160f90 2023-05-17T12:26:15.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.080+0000 7fc36b7fe700 1 -- 172.21.15.88:0/4011642341 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc36c014930 con 0x7fc374160f90 2023-05-17T12:26:15.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.081+0000 7fc36b7fe700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc35406ace0 0x7fc35406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.081+0000 7fc36b7fe700 1 -- 172.21.15.88:0/4011642341 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc36c089eb0 con 0x7fc374160f90 2023-05-17T12:26:15.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.081+0000 7fc372ffd700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc35406ace0 0x7fc35406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.082+0000 7fc372ffd700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc35406ace0 0x7fc35406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc364009c10 tx=0x7fc364008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:15.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.085+0000 7fc36b7fe700 1 -- 172.21.15.88:0/4011642341 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc36c054c20 con 0x7fc374160f90 2023-05-17T12:26:15.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.297+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc374074530 con 0x7fc374160f90 2023-05-17T12:26:15.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.298+0000 7fc36b7fe700 1 -- 172.21.15.88:0/4011642341 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc36c058240 con 0x7fc374160f90 2023-05-17T12:26:15.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc35406ace0 msgr2=0x7fc35406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc35406ace0 0x7fc35406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc364009c10 tx=0x7fc364008030 comp rx=0 tx=0).stop 2023-05-17T12:26:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc374160f90 msgr2=0x7fc3741441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc374160f90 0x7fc3741441c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc36c007e60 tx=0x7fc36c00e3c0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 shutdown_connections 2023-05-17T12:26:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc35406ace0 0x7fc35406d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc374160f90 0x7fc3741441c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc37406ca50 0x7fc3740c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 --2- 172.21.15.88:0/4011642341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc37415ca90 0x7fc3741e86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 >> 172.21.15.88:0/4011642341 conn(0x7fc3740d3ed0 msgr2=0x7fc37415fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:15.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 shutdown_connections 2023-05-17T12:26:15.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.300+0000 7fc3793ff700 1 -- 172.21.15.88:0/4011642341 wait complete. 2023-05-17T12:26:15.306 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:26:15.321 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:26:15.322 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:15.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:15.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.586+0000 7fc7b87ff700 1 Processor -- start 2023-05-17T12:26:15.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.586+0000 7fc7b87ff700 1 -- start start 2023-05-17T12:26:15.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.587+0000 7fc7b87ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a950 0x7fc7b0070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.587+0000 7fc7b87ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7b0071370 0x7fc7b00ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.587+0000 7fc7b87ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b015ec80 con 0x7fc7b015a580 2023-05-17T12:26:15.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.587+0000 7fc7b87ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b00717f0 con 0x7fc7b0071370 2023-05-17T12:26:15.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.587+0000 7fc7b87ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b015f110 con 0x7fc7b015a950 2023-05-17T12:26:15.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.587+0000 7fc7b659b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc7b015a580 0x7fc7b00c9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59566/0 (socket says 172.21.15.88:59566) 2023-05-17T12:26:15.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.587+0000 7fc7b659b700 1 -- 172.21.15.88:0/1153089274 learned_addr learned my addr 172.21.15.88:0/1153089274 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:15.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.587+0000 7fc7b6d9c700 1 --2- 172.21.15.88:0/1153089274 >> v2:172.21.15.88:3300/0 conn(0x7fc7b0071370 0x7fc7b00ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b5d9a700 1 --2- 172.21.15.88:0/1153089274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a950 0x7fc7b0070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b6d9c700 1 -- 172.21.15.88:0/1153089274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a950 msgr2=0x7fc7b0070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:15.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b6d9c700 1 --2- 172.21.15.88:0/1153089274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a950 0x7fc7b0070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b6d9c700 1 -- 172.21.15.88:0/1153089274 >> v1:172.21.15.88:6789/0 conn(0x7fc7b015a580 legacy=0x7fc7b00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b6d9c700 1 -- 172.21.15.88:0/1153089274 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b015e350 con 0x7fc7b0071370 2023-05-17T12:26:15.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b5599700 1 -- 172.21.15.88:0/1153089274 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228928676 0 0) 0x7fc7b015ec80 con 0x7fc7b015a580 2023-05-17T12:26:15.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b6d9c700 1 --2- 172.21.15.88:0/1153089274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b0071370 0x7fc7b00ccdf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009d90 tx=0x7fc7a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1190344cde72d8ed server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:15.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b5599700 1 -- 172.21.15.88:0/1153089274 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800e070 con 0x7fc7b0071370 2023-05-17T12:26:15.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b5599700 1 -- 172.21.15.88:0/1153089274 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a800bb20 con 0x7fc7b0071370 2023-05-17T12:26:15.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.588+0000 7fc7b5599700 1 -- 172.21.15.88:0/1153089274 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8012430 con 0x7fc7b0071370 2023-05-17T12:26:15.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.589+0000 7fc7b87ff700 1 -- 172.21.15.88:0/1153089274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b0071370 msgr2=0x7fc7b00ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.589+0000 7fc7b87ff700 1 --2- 172.21.15.88:0/1153089274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b0071370 0x7fc7b00ccdf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009d90 tx=0x7fc7a800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:15.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.589+0000 7fc7b87ff700 1 -- 172.21.15.88:0/1153089274 shutdown_connections 2023-05-17T12:26:15.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.589+0000 7fc7b87ff700 1 --2- 172.21.15.88:0/1153089274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b0071370 0x7fc7b00ccdf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.589+0000 7fc7b87ff700 1 --2- 172.21.15.88:0/1153089274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a950 0x7fc7b0070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.589+0000 7fc7b87ff700 1 -- 172.21.15.88:0/1153089274 >> 172.21.15.88:0/1153089274 conn(0x7fc7b00ced10 msgr2=0x7fc7b00cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:15.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.589+0000 7fc7b87ff700 1 -- 172.21.15.88:0/1153089274 shutdown_connections 2023-05-17T12:26:15.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.589+0000 7fc7b87ff700 1 -- 172.21.15.88:0/1153089274 wait complete. 2023-05-17T12:26:15.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.591+0000 7fc7b87ff700 1 Processor -- start 2023-05-17T12:26:15.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.591+0000 7fc7b87ff700 1 -- start start 2023-05-17T12:26:15.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b87ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7b0071370 0x7fc7b015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b87ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a580 0x7fc7b0148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b87ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b015a950 0x7fc7b00c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b87ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b015ba40 con 0x7fc7b015a950 2023-05-17T12:26:15.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b87ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b015ae30 con 0x7fc7b0071370 2023-05-17T12:26:15.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b87ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b015b110 con 0x7fc7b015a580 2023-05-17T12:26:15.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b6d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b015a950 0x7fc7b00c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b6d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b015a950 0x7fc7b00c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55516/0 (socket says 172.21.15.88:55516) 2023-05-17T12:26:15.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b6d9c700 1 -- 172.21.15.88:0/3960719487 learned_addr learned my addr 172.21.15.88:0/3960719487 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:15.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b5d9a700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a580 0x7fc7b0148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.592+0000 7fc7b659b700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7b0071370 0x7fc7b015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7b6d9c700 1 -- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a580 msgr2=0x7fc7b0148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7b6d9c700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a580 0x7fc7b0148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7b6d9c700 1 -- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7b0071370 msgr2=0x7fc7b015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7b6d9c700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7b0071370 0x7fc7b015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7b6d9c700 1 -- 172.21.15.88:0/3960719487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8009a70 con 0x7fc7b015a950 2023-05-17T12:26:15.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7b659b700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7b0071370 0x7fc7b015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:15.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7b6d9c700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b015a950 0x7fc7b00c7ec0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00cfc20 tx=0x7fc7a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:15.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7a6ffd700 1 -- 172.21.15.88:0/3960719487 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8012430 con 0x7fc7b015a950 2023-05-17T12:26:15.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7a6ffd700 1 -- 172.21.15.88:0/3960719487 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a8020070 con 0x7fc7b015a950 2023-05-17T12:26:15.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b015e910 con 0x7fc7b015a950 2023-05-17T12:26:15.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7a6ffd700 1 -- 172.21.15.88:0/3960719487 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8004280 con 0x7fc7b015a950 2023-05-17T12:26:15.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.593+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b015e630 con 0x7fc7b015a950 2023-05-17T12:26:15.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.594+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b00cea60 con 0x7fc7b015a950 2023-05-17T12:26:15.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.595+0000 7fc7a6ffd700 1 -- 172.21.15.88:0/3960719487 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7a80043e0 con 0x7fc7b015a950 2023-05-17T12:26:15.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.597+0000 7fc7a6ffd700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc79406ace0 0x7fc79406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:15.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.597+0000 7fc7a6ffd700 1 -- 172.21.15.88:0/3960719487 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc7a8022070 con 0x7fc7b015a950 2023-05-17T12:26:15.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.597+0000 7fc7b659b700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc79406ace0 0x7fc79406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:15.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.598+0000 7fc7b659b700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc79406ace0 0x7fc79406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac000f60 tx=0x7fc7ac007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:15.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.601+0000 7fc7a6ffd700 1 -- 172.21.15.88:0/3960719487 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc7a80562c0 con 0x7fc7b015a950 2023-05-17T12:26:15.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.795+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7b0066cb0 con 0x7fc7b015a950 2023-05-17T12:26:15.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.796+0000 7fc7a6ffd700 1 -- 172.21.15.88:0/3960719487 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fc7a80598e0 con 0x7fc7b015a950 2023-05-17T12:26:15.801 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:15.801 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:15.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc79406ace0 msgr2=0x7fc79406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc79406ace0 0x7fc79406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac000f60 tx=0x7fc7ac007ca0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b015a950 msgr2=0x7fc7b00c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b015a950 0x7fc7b00c7ec0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00cfc20 tx=0x7fc7a8004ad0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 shutdown_connections 2023-05-17T12:26:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc79406ace0 0x7fc79406d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7b015a950 0x7fc7b00c7ec0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7b0071370 0x7fc7b015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 --2- 172.21.15.88:0/3960719487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7b015a580 0x7fc7b0148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:15.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 >> 172.21.15.88:0/3960719487 conn(0x7fc7b00ced10 msgr2=0x7fc7b00cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:15.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 shutdown_connections 2023-05-17T12:26:15.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:15.799+0000 7fc7b87ff700 1 -- 172.21.15.88:0/3960719487 wait complete. 2023-05-17T12:26:15.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:15.821 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:16.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.005+0000 7f4d4a1ff700 1 Processor -- start 2023-05-17T12:26:16.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.005+0000 7f4d4a1ff700 1 -- start start 2023-05-17T12:26:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d4a1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440cf290 0x7f4d44160e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d4a1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d440b39d0 con 0x7f4d440b3280 2023-05-17T12:26:16.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d4a1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d440cbd10 con 0x7f4d4415c9c0 2023-05-17T12:26:16.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d4a1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4415cd90 con 0x7f4d440cf290 2023-05-17T12:26:16.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d3bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4d440b3280 0x7f4d440ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59576/0 (socket says 172.21.15.88:59576) 2023-05-17T12:26:16.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d3bfff700 1 -- 172.21.15.88:0/3423770134 learned_addr learned my addr 172.21.15.88:0/3423770134 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:16.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d43fff700 1 --2- 172.21.15.88:0/3423770134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440cf290 0x7f4d44160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d42ffd700 1 -- 172.21.15.88:0/3423770134 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966975420 0 0) 0x7f4d440b39d0 con 0x7f4d440b3280 2023-05-17T12:26:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d42ffd700 1 -- 172.21.15.88:0/3423770134 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d300035b0 con 0x7f4d440b3280 2023-05-17T12:26:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d42ffd700 1 -- 172.21.15.88:0/3423770134 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016603101 0 0) 0x7f4d440cbd10 con 0x7f4d4415c9c0 2023-05-17T12:26:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d43fff700 1 -- 172.21.15.88:0/3423770134 >> v1:172.21.15.187:6789/0 conn(0x7f4d4415c9c0 legacy=0x7f4d440cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d43fff700 1 -- 172.21.15.88:0/3423770134 >> v1:172.21.15.88:6789/0 conn(0x7f4d440b3280 legacy=0x7f4d440ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.007+0000 7f4d43fff700 1 -- 172.21.15.88:0/3423770134 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4406c1f0 con 0x7f4d440cf290 2023-05-17T12:26:16.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.008+0000 7f4d43fff700 1 --2- 172.21.15.88:0/3423770134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440cf290 0x7f4d44160e80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009dc0 tx=0x7f4d3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e89854ed2f9af77 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:16.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.008+0000 7f4d42ffd700 1 -- 172.21.15.88:0/3423770134 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00e070 con 0x7f4d440cf290 2023-05-17T12:26:16.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.008+0000 7f4d42ffd700 1 -- 172.21.15.88:0/3423770134 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c00bb20 con 0x7f4d440cf290 2023-05-17T12:26:16.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.008+0000 7f4d42ffd700 1 -- 172.21.15.88:0/3423770134 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00bed0 con 0x7f4d440cf290 2023-05-17T12:26:16.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.009+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/3423770134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440cf290 msgr2=0x7f4d44160e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.009+0000 7f4d4a1ff700 1 --2- 172.21.15.88:0/3423770134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440cf290 0x7f4d44160e80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009dc0 tx=0x7f4d3c00b330 comp rx=0 tx=0).stop 2023-05-17T12:26:16.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.009+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/3423770134 shutdown_connections 2023-05-17T12:26:16.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.009+0000 7f4d4a1ff700 1 --2- 172.21.15.88:0/3423770134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440cf290 0x7f4d44160e80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.009+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/3423770134 >> 172.21.15.88:0/3423770134 conn(0x7f4d440d1c40 msgr2=0x7f4d440b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:16.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.009+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/3423770134 shutdown_connections 2023-05-17T12:26:16.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.009+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/3423770134 wait complete. 2023-05-17T12:26:16.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.011+0000 7f4d4a1ff700 1 Processor -- start 2023-05-17T12:26:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.011+0000 7f4d4a1ff700 1 -- start start 2023-05-17T12:26:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.011+0000 7f4d4a1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440b3280 0x7f4d4414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.011+0000 7f4d4a1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d440cf290 0x7f4d4415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d4a1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4415c9c0 0x7f4d4414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d4a1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4415ad20 con 0x7f4d440cf290 2023-05-17T12:26:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d4a1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4415fcc0 con 0x7f4d4415c9c0 2023-05-17T12:26:16.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d4a1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4415a150 con 0x7f4d440b3280 2023-05-17T12:26:16.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d440cf290 0x7f4d4415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d440cf290 0x7f4d4415b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55518/0 (socket says 172.21.15.88:55518) 2023-05-17T12:26:16.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d3bfff700 1 -- 172.21.15.88:0/2052964573 learned_addr learned my addr 172.21.15.88:0/2052964573 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:16.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d3bfff700 1 -- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440b3280 msgr2=0x7f4d4414d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d3bfff700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440b3280 0x7f4d4414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d3bfff700 1 -- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4415c9c0 msgr2=0x7f4d4414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d3bfff700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4415c9c0 0x7f4d4414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d3bfff700 1 -- 172.21.15.88:0/2052964573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c009a70 con 0x7f4d440cf290 2023-05-17T12:26:16.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.012+0000 7f4d3bfff700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d440cf290 0x7f4d4415b1b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c420 tx=0x7f4d2c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:16.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.013+0000 7f4d40ff9700 1 -- 172.21.15.88:0/2052964573 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c005d70 con 0x7f4d440cf290 2023-05-17T12:26:16.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.013+0000 7f4d40ff9700 1 -- 172.21.15.88:0/2052964573 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c0070d0 con 0x7f4d440cf290 2023-05-17T12:26:16.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.013+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4406c7b0 con 0x7f4d440cf290 2023-05-17T12:26:16.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.013+0000 7f4d40ff9700 1 -- 172.21.15.88:0/2052964573 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c007440 con 0x7f4d440cf290 2023-05-17T12:26:16.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.013+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4406c4d0 con 0x7f4d440cf290 2023-05-17T12:26:16.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.014+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4406ca90 con 0x7f4d440cf290 2023-05-17T12:26:16.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.015+0000 7f4d40ff9700 1 -- 172.21.15.88:0/2052964573 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d2c0075a0 con 0x7f4d440cf290 2023-05-17T12:26:16.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.016+0000 7f4d40ff9700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4d2406ace0 0x7f4d2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.016+0000 7f4d40ff9700 1 -- 172.21.15.88:0/2052964573 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4d2c088aa0 con 0x7f4d440cf290 2023-05-17T12:26:16.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.016+0000 7f4d437fe700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4d2406ace0 0x7f4d2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.017+0000 7f4d437fe700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4d2406ace0 0x7f4d2406d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d34007fd0 tx=0x7f4d34007960 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:16.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.020+0000 7f4d40ff9700 1 -- 172.21.15.88:0/2052964573 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4d2c053960 con 0x7f4d440cf290 2023-05-17T12:26:16.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.214+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d440668d0 con 0x7f4d440cf290 2023-05-17T12:26:16.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.214+0000 7f4d40ff9700 1 -- 172.21.15.88:0/2052964573 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d2c017020 con 0x7f4d440cf290 2023-05-17T12:26:16.219 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:16.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4d2406ace0 msgr2=0x7f4d2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4d2406ace0 0x7f4d2406d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d34007fd0 tx=0x7f4d34007960 comp rx=0 tx=0).stop 2023-05-17T12:26:16.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d440cf290 msgr2=0x7f4d4415b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d440cf290 0x7f4d4415b1b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c420 tx=0x7f4d2c00c7e0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 shutdown_connections 2023-05-17T12:26:16.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4d2406ace0 0x7f4d2406d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4415c9c0 0x7f4d4414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d440b3280 0x7f4d4414d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 --2- 172.21.15.88:0/2052964573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d440cf290 0x7f4d4415b1b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 >> 172.21.15.88:0/2052964573 conn(0x7f4d440d1c40 msgr2=0x7f4d4406ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:16.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 shutdown_connections 2023-05-17T12:26:16.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.217+0000 7f4d4a1ff700 1 -- 172.21.15.88:0/2052964573 wait complete. 2023-05-17T12:26:16.237 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:16.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.421+0000 7fd6effff700 1 Processor -- start 2023-05-17T12:26:16.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.421+0000 7fd6effff700 1 -- start start 2023-05-17T12:26:16.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.423+0000 7fd6effff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6e806c760 0x7fd6e806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.423+0000 7fd6effff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80b23a0 0x7fd6e806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.423+0000 7fd6effff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e806b4a0 con 0x7fd6e80cf190 2023-05-17T12:26:16.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.423+0000 7fd6effff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e806a510 con 0x7fd6e806c760 2023-05-17T12:26:16.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.423+0000 7fd6effff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e806d070 con 0x7fd6e80b23a0 2023-05-17T12:26:16.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.423+0000 7fd6edd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6e806c760 0x7fd6e806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.423+0000 7fd6edd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6e806c760 0x7fd6e806af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55520/0 (socket says 172.21.15.88:55520) 2023-05-17T12:26:16.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.423+0000 7fd6edd9b700 1 -- 172.21.15.88:0/1119574855 learned_addr learned my addr 172.21.15.88:0/1119574855 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:16.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.423+0000 7fd6ed59a700 1 --2- 172.21.15.88:0/1119574855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80b23a0 0x7fd6e806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.424+0000 7fd6edd9b700 1 -- 172.21.15.88:0/1119574855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80b23a0 msgr2=0x7fd6e806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.424+0000 7fd6edd9b700 1 --2- 172.21.15.88:0/1119574855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80b23a0 0x7fd6e806cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.424+0000 7fd6edd9b700 1 -- 172.21.15.88:0/1119574855 >> v1:172.21.15.187:6789/0 conn(0x7fd6e80cf190 legacy=0x7fd6e8160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.424+0000 7fd6edd9b700 1 -- 172.21.15.88:0/1119574855 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80cd840 con 0x7fd6e806c760 2023-05-17T12:26:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.424+0000 7fd6edd9b700 1 --2- 172.21.15.88:0/1119574855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e806c760 0x7fd6e806af60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40098f0 tx=0x7fd6e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852832d00fa17441 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.424+0000 7fd6ecd99700 1 -- 172.21.15.88:0/1119574855 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4011830 con 0x7fd6e806c760 2023-05-17T12:26:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.424+0000 7fd6ecd99700 1 -- 172.21.15.88:0/1119574855 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4011990 con 0x7fd6e806c760 2023-05-17T12:26:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.424+0000 7fd6ecd99700 1 -- 172.21.15.88:0/1119574855 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4011d20 con 0x7fd6e806c760 2023-05-17T12:26:16.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.425+0000 7fd6effff700 1 -- 172.21.15.88:0/1119574855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e806c760 msgr2=0x7fd6e806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.425+0000 7fd6effff700 1 --2- 172.21.15.88:0/1119574855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e806c760 0x7fd6e806af60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40098f0 tx=0x7fd6e4009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:16.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.425+0000 7fd6effff700 1 -- 172.21.15.88:0/1119574855 shutdown_connections 2023-05-17T12:26:16.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.425+0000 7fd6effff700 1 --2- 172.21.15.88:0/1119574855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e806c760 0x7fd6e806af60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.425+0000 7fd6effff700 1 --2- 172.21.15.88:0/1119574855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80b23a0 0x7fd6e806cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.425+0000 7fd6effff700 1 -- 172.21.15.88:0/1119574855 >> 172.21.15.88:0/1119574855 conn(0x7fd6e80d06f0 msgr2=0x7fd6e80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:16.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.425+0000 7fd6effff700 1 -- 172.21.15.88:0/1119574855 shutdown_connections 2023-05-17T12:26:16.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.425+0000 7fd6effff700 1 -- 172.21.15.88:0/1119574855 wait complete. 2023-05-17T12:26:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.427+0000 7fd6effff700 1 Processor -- start 2023-05-17T12:26:16.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.427+0000 7fd6effff700 1 -- start start 2023-05-17T12:26:16.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6effff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e806c760 0x7fd6e81f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6effff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e80cf190 0x7fd6e81e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6effff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80ca120 0x7fd6e80cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6effff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e815aa40 con 0x7fd6e80cf190 2023-05-17T12:26:16.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6effff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81e7800 con 0x7fd6e806c760 2023-05-17T12:26:16.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6effff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e8147ce0 con 0x7fd6e80ca120 2023-05-17T12:26:16.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ed59a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e80cf190 0x7fd6e81e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ed59a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e80cf190 0x7fd6e81e72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55522/0 (socket says 172.21.15.88:55522) 2023-05-17T12:26:16.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ed59a700 1 -- 172.21.15.88:0/3269591024 learned_addr learned my addr 172.21.15.88:0/3269591024 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:16.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6edd9b700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e806c760 0x7fd6e81f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ee59c700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80ca120 0x7fd6e80cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ed59a700 1 -- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80ca120 msgr2=0x7fd6e80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ed59a700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80ca120 0x7fd6e80cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ed59a700 1 -- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e806c760 msgr2=0x7fd6e81f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ed59a700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e806c760 0x7fd6e81f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ed59a700 1 -- 172.21.15.88:0/3269591024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e4009550 con 0x7fd6e80cf190 2023-05-17T12:26:16.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.428+0000 7fd6ed59a700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e80cf190 0x7fd6e81e72c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800e9e0 tx=0x7fd6d800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:16.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.429+0000 7fd6de7fc700 1 -- 172.21.15.88:0/3269591024 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8009710 con 0x7fd6e80cf190 2023-05-17T12:26:16.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.429+0000 7fd6de7fc700 1 -- 172.21.15.88:0/3269591024 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d800c850 con 0x7fd6e80cf190 2023-05-17T12:26:16.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.429+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e806a760 con 0x7fd6e80cf190 2023-05-17T12:26:16.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.429+0000 7fd6de7fc700 1 -- 172.21.15.88:0/3269591024 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800cbc0 con 0x7fd6e80cf190 2023-05-17T12:26:16.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.429+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e80cdb20 con 0x7fd6e80cf190 2023-05-17T12:26:16.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.430+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e806aa40 con 0x7fd6e80cf190 2023-05-17T12:26:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.431+0000 7fd6de7fc700 1 -- 172.21.15.88:0/3269591024 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6d800cd20 con 0x7fd6e80cf190 2023-05-17T12:26:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.432+0000 7fd6de7fc700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd6cc06ace0 0x7fd6cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.432+0000 7fd6de7fc700 1 -- 172.21.15.88:0/3269591024 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd6d8089800 con 0x7fd6e80cf190 2023-05-17T12:26:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.432+0000 7fd6edd9b700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd6cc06ace0 0x7fd6cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.433+0000 7fd6edd9b700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd6cc06ace0 0x7fd6cc06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4014040 tx=0x7fd6e4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:16.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.436+0000 7fd6de7fc700 1 -- 172.21.15.88:0/3269591024 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd6d8054570 con 0x7fd6e80cf190 2023-05-17T12:26:16.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.629+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd6e8074530 con 0x7fd6e80cf190 2023-05-17T12:26:16.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.630+0000 7fd6de7fc700 1 -- 172.21.15.88:0/3269591024 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6d8057b90 con 0x7fd6e80cf190 2023-05-17T12:26:16.634 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:16.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd6cc06ace0 msgr2=0x7fd6cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd6cc06ace0 0x7fd6cc06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4014040 tx=0x7fd6e4008030 comp rx=0 tx=0).stop 2023-05-17T12:26:16.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e80cf190 msgr2=0x7fd6e81e72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e80cf190 0x7fd6e81e72c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800e9e0 tx=0x7fd6d800ecf0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 shutdown_connections 2023-05-17T12:26:16.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd6cc06ace0 0x7fd6cc06d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e80ca120 0x7fd6e80cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e806c760 0x7fd6e81f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 --2- 172.21.15.88:0/3269591024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6e80cf190 0x7fd6e81e72c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 >> 172.21.15.88:0/3269591024 conn(0x7fd6e80d06f0 msgr2=0x7fd6e80c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:16.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 shutdown_connections 2023-05-17T12:26:16.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.632+0000 7fd6effff700 1 -- 172.21.15.88:0/3269591024 wait complete. 2023-05-17T12:26:16.653 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.842+0000 7f5517bff700 1 Processor -- start 2023-05-17T12:26:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.842+0000 7f5517bff700 1 -- start start 2023-05-17T12:26:16.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.843+0000 7f5517bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f55100b2510 0x7f55100b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.843+0000 7f5517bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55100b0840 0x7f551006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.843+0000 7f5517bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551006b770 con 0x7f551015cd80 2023-05-17T12:26:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f5517bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55100b0cc0 con 0x7f55100b0840 2023-05-17T12:26:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f5517bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551015d150 con 0x7f55100b2510 2023-05-17T12:26:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f551619c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55100b0840 0x7f551006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f551619c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55100b0840 0x7f551006bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55530/0 (socket says 172.21.15.88:55530) 2023-05-17T12:26:16.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f551619c700 1 -- 172.21.15.88:0/3625852319 learned_addr learned my addr 172.21.15.88:0/3625852319 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:16.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f551519a700 1 --2- 172.21.15.88:0/3625852319 >> v2:172.21.15.187:3300/0 conn(0x7f55100b2510 0x7f55100b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f551619c700 1 -- 172.21.15.88:0/3625852319 >> v2:172.21.15.187:3300/0 conn(0x7f55100b2510 msgr2=0x7f55100b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:16.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f551619c700 1 --2- 172.21.15.88:0/3625852319 >> v2:172.21.15.187:3300/0 conn(0x7f55100b2510 0x7f55100b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f551619c700 1 -- 172.21.15.88:0/3625852319 >> v1:172.21.15.88:6789/0 conn(0x7f551015cd80 legacy=0x7f551006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f551619c700 1 -- 172.21.15.88:0/3625852319 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551006d810 con 0x7f55100b0840 2023-05-17T12:26:16.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.844+0000 7f551619c700 1 --2- 172.21.15.88:0/3625852319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55100b0840 0x7f551006bc00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5510071a30 tx=0x7f550800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec079e3820566b4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:16.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5514999700 1 -- 172.21.15.88:0/3625852319 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800e070 con 0x7f55100b0840 2023-05-17T12:26:16.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5514999700 1 -- 172.21.15.88:0/3625852319 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550800b9c0 con 0x7f55100b0840 2023-05-17T12:26:16.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5514999700 1 -- 172.21.15.88:0/3625852319 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800bd70 con 0x7f55100b0840 2023-05-17T12:26:16.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5517bff700 1 -- 172.21.15.88:0/3625852319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55100b0840 msgr2=0x7f551006bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5517bff700 1 --2- 172.21.15.88:0/3625852319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55100b0840 0x7f551006bc00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5510071a30 tx=0x7f550800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:16.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5517bff700 1 -- 172.21.15.88:0/3625852319 shutdown_connections 2023-05-17T12:26:16.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5517bff700 1 --2- 172.21.15.88:0/3625852319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55100b0840 0x7f551006bc00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5517bff700 1 --2- 172.21.15.88:0/3625852319 >> v2:172.21.15.187:3300/0 conn(0x7f55100b2510 0x7f55100b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5517bff700 1 -- 172.21.15.88:0/3625852319 >> 172.21.15.88:0/3625852319 conn(0x7f55100b2de0 msgr2=0x7f55100b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:16.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5517bff700 1 -- 172.21.15.88:0/3625852319 shutdown_connections 2023-05-17T12:26:16.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.845+0000 7f5517bff700 1 -- 172.21.15.88:0/3625852319 wait complete. 2023-05-17T12:26:16.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.847+0000 7f5517bff700 1 Processor -- start 2023-05-17T12:26:16.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.847+0000 7f5517bff700 1 -- start start 2023-05-17T12:26:16.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f5517bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55100b0840 0x7f551015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f5517bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55100b2510 0x7f551015fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f5517bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f551015cd80 0x7f55101e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f5517bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551015e990 con 0x7f551015cd80 2023-05-17T12:26:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f5517bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551015ec70 con 0x7f55100b2510 2023-05-17T12:26:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f5517bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551015ef50 con 0x7f55100b0840 2023-05-17T12:26:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f551619c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f551015cd80 0x7f55101e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f551619c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f551015cd80 0x7f55101e64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55540/0 (socket says 172.21.15.88:55540) 2023-05-17T12:26:16.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f551619c700 1 -- 172.21.15.88:0/2720064565 learned_addr learned my addr 172.21.15.88:0/2720064565 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f551599b700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55100b0840 0x7f551015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.848+0000 7f551519a700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55100b2510 0x7f551015fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f551619c700 1 -- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55100b0840 msgr2=0x7f551015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f551619c700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55100b0840 0x7f551015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f551619c700 1 -- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55100b2510 msgr2=0x7f551015fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:16.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f551619c700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55100b2510 0x7f551015fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f551619c700 1 -- 172.21.15.88:0/2720064565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508009b30 con 0x7f551015cd80 2023-05-17T12:26:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f551519a700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55100b2510 0x7f551015fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f551619c700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f551015cd80 0x7f55101e64c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f550800b370 tx=0x7f5508004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f55067fc700 1 -- 172.21.15.88:0/2720064565 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508004930 con 0x7f551015cd80 2023-05-17T12:26:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f55067fc700 1 -- 172.21.15.88:0/2720064565 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55080099b0 con 0x7f551015cd80 2023-05-17T12:26:16.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551006b120 con 0x7f551015cd80 2023-05-17T12:26:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f55067fc700 1 -- 172.21.15.88:0/2720064565 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550801c660 con 0x7f551015cd80 2023-05-17T12:26:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.849+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551006ae40 con 0x7f551015cd80 2023-05-17T12:26:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.850+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551006b400 con 0x7f551015cd80 2023-05-17T12:26:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.851+0000 7f55067fc700 1 -- 172.21.15.88:0/2720064565 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f550801c7c0 con 0x7f551015cd80 2023-05-17T12:26:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.852+0000 7f55067fc700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f54f406ace0 0x7f54f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:16.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.852+0000 7f55067fc700 1 -- 172.21.15.88:0/2720064565 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f550808b190 con 0x7f551015cd80 2023-05-17T12:26:16.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.852+0000 7f551599b700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f54f406ace0 0x7f54f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:16.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.853+0000 7f551599b700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f54f406ace0 0x7f54f406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f550c007fd0 tx=0x7f550c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:16.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:16.856+0000 7f55067fc700 1 -- 172.21.15.88:0/2720064565 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5508055f00 con 0x7f551015cd80 2023-05-17T12:26:17.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.050+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5510074530 con 0x7f551015cd80 2023-05-17T12:26:17.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.051+0000 7f55067fc700 1 -- 172.21.15.88:0/2720064565 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5508059520 con 0x7f551015cd80 2023-05-17T12:26:17.055 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:17.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f54f406ace0 msgr2=0x7f54f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f54f406ace0 0x7f54f406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f550c007fd0 tx=0x7f550c009040 comp rx=0 tx=0).stop 2023-05-17T12:26:17.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f551015cd80 msgr2=0x7f55101e64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f551015cd80 0x7f55101e64c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f550800b370 tx=0x7f5508004ad0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 shutdown_connections 2023-05-17T12:26:17.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f54f406ace0 0x7f54f406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f551015cd80 0x7f55101e64c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55100b0840 0x7f551015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 --2- 172.21.15.88:0/2720064565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55100b2510 0x7f551015fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 >> 172.21.15.88:0/2720064565 conn(0x7f55100b2de0 msgr2=0x7f55100b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:17.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 shutdown_connections 2023-05-17T12:26:17.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.053+0000 7f5517bff700 1 -- 172.21.15.88:0/2720064565 wait complete. 2023-05-17T12:26:17.074 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:17.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.264+0000 7f283c9ff700 1 Processor -- start 2023-05-17T12:26:17.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.265+0000 7f283c9ff700 1 -- start start 2023-05-17T12:26:17.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f283c9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f283806c8f0 0x7f28380cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f283c9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2838160d10 0x7f28380d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f283c9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28380d0c30 con 0x7f28380b89e0 2023-05-17T12:26:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f283c9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28380b28d0 con 0x7f283806c8f0 2023-05-17T12:26:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f283c9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28381611b0 con 0x7f2838160d10 2023-05-17T12:26:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f282ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f283806c8f0 0x7f28380cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f282ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f283806c8f0 0x7f28380cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55556/0 (socket says 172.21.15.88:55556) 2023-05-17T12:26:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f282ffff700 1 -- 172.21.15.88:0/3950041219 learned_addr learned my addr 172.21.15.88:0/3950041219 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f2836d9d700 1 --2- 172.21.15.88:0/3950041219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2838160d10 0x7f28380d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f282ffff700 1 -- 172.21.15.88:0/3950041219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2838160d10 msgr2=0x7f28380d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:17.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f282ffff700 1 --2- 172.21.15.88:0/3950041219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2838160d10 0x7f28380d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f282ffff700 1 -- 172.21.15.88:0/3950041219 >> v1:172.21.15.88:6789/0 conn(0x7f28380b89e0 legacy=0x7f283806c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.266+0000 7f282ffff700 1 -- 172.21.15.88:0/3950041219 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380cd750 con 0x7f283806c8f0 2023-05-17T12:26:17.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.267+0000 7f282ffff700 1 --2- 172.21.15.88:0/3950041219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 0x7f28380cf320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f28200098f0 tx=0x7f2820009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29e9e93ed02a941 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:17.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.267+0000 7f2835d9b700 1 -- 172.21.15.88:0/3950041219 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000b8a0 con 0x7f283806c8f0 2023-05-17T12:26:17.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.267+0000 7f2835d9b700 1 -- 172.21.15.88:0/3950041219 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282000ba00 con 0x7f283806c8f0 2023-05-17T12:26:17.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.267+0000 7f2835d9b700 1 -- 172.21.15.88:0/3950041219 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282000bd90 con 0x7f283806c8f0 2023-05-17T12:26:17.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.267+0000 7f283c9ff700 1 -- 172.21.15.88:0/3950041219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 msgr2=0x7f28380cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.267+0000 7f283c9ff700 1 --2- 172.21.15.88:0/3950041219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 0x7f28380cf320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f28200098f0 tx=0x7f2820009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.267+0000 7f283c9ff700 1 -- 172.21.15.88:0/3950041219 shutdown_connections 2023-05-17T12:26:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.267+0000 7f283c9ff700 1 --2- 172.21.15.88:0/3950041219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2838160d10 0x7f28380d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.267+0000 7f283c9ff700 1 --2- 172.21.15.88:0/3950041219 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 0x7f28380cf320 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.268+0000 7f283c9ff700 1 -- 172.21.15.88:0/3950041219 >> 172.21.15.88:0/3950041219 conn(0x7f28380d05c0 msgr2=0x7f28380d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.268+0000 7f283c9ff700 1 -- 172.21.15.88:0/3950041219 shutdown_connections 2023-05-17T12:26:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.268+0000 7f283c9ff700 1 -- 172.21.15.88:0/3950041219 wait complete. 2023-05-17T12:26:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.269+0000 7f283c9ff700 1 Processor -- start 2023-05-17T12:26:17.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.269+0000 7f283c9ff700 1 -- start start 2023-05-17T12:26:17.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.270+0000 7f283c9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 0x7f283815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.270+0000 7f283c9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28380b89e0 0x7f28380c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.270+0000 7f283c9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2838160d10 0x7f283814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.270+0000 7f283c9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28380c95c0 con 0x7f283806c8f0 2023-05-17T12:26:17.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.270+0000 7f283c9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28380c9340 con 0x7f2838160d10 2023-05-17T12:26:17.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.270+0000 7f283c9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28381f5dd0 con 0x7f28380b89e0 2023-05-17T12:26:17.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.270+0000 7f283659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 0x7f283815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.270+0000 7f283659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 0x7f283815b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55558/0 (socket says 172.21.15.88:55558) 2023-05-17T12:26:17.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f283659c700 1 -- 172.21.15.88:0/1405524314 learned_addr learned my addr 172.21.15.88:0/1405524314 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:17.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f282ffff700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28380b89e0 0x7f28380c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f2836d9d700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2838160d10 0x7f283814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f283659c700 1 -- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28380b89e0 msgr2=0x7f28380c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f283659c700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28380b89e0 0x7f28380c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f283659c700 1 -- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2838160d10 msgr2=0x7f283814e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f283659c700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2838160d10 0x7f283814e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f283659c700 1 -- 172.21.15.88:0/1405524314 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2820009550 con 0x7f283806c8f0 2023-05-17T12:26:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f2836d9d700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2838160d10 0x7f283814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f283659c700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 0x7f283815b6b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f282800c4e0 tx=0x7f282800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f282effd700 1 -- 172.21.15.88:0/1405524314 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28280052d0 con 0x7f283806c8f0 2023-05-17T12:26:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f282effd700 1 -- 172.21.15.88:0/1405524314 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2828005430 con 0x7f283806c8f0 2023-05-17T12:26:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f282effd700 1 -- 172.21.15.88:0/1405524314 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28280038c0 con 0x7f283806c8f0 2023-05-17T12:26:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.271+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28380cdd10 con 0x7f283806c8f0 2023-05-17T12:26:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.272+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28380cda30 con 0x7f283806c8f0 2023-05-17T12:26:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.273+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28380d0e80 con 0x7f283806c8f0 2023-05-17T12:26:17.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.273+0000 7f282effd700 1 -- 172.21.15.88:0/1405524314 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2828003a20 con 0x7f283806c8f0 2023-05-17T12:26:17.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.275+0000 7f282effd700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f281806ace0 0x7f281806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.275+0000 7f282effd700 1 -- 172.21.15.88:0/1405524314 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2828088c80 con 0x7f283806c8f0 2023-05-17T12:26:17.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.275+0000 7f282ffff700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f281806ace0 0x7f281806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.276+0000 7f282ffff700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f281806ace0 0x7f281806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f283806cce0 tx=0x7f2820008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:17.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.279+0000 7f282effd700 1 -- 172.21.15.88:0/1405524314 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2828053960 con 0x7f283806c8f0 2023-05-17T12:26:17.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.476+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28381f6b50 con 0x7f283806c8f0 2023-05-17T12:26:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.477+0000 7f282effd700 1 -- 172.21.15.88:0/1405524314 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2828017020 con 0x7f283806c8f0 2023-05-17T12:26:17.481 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:17.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f281806ace0 msgr2=0x7f281806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f281806ace0 0x7f281806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f283806cce0 tx=0x7f2820008030 comp rx=0 tx=0).stop 2023-05-17T12:26:17.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 msgr2=0x7f283815b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 0x7f283815b6b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f282800c4e0 tx=0x7f282800c7f0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 shutdown_connections 2023-05-17T12:26:17.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f281806ace0 0x7f281806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2838160d10 0x7f283814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f283806c8f0 0x7f283815b6b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 --2- 172.21.15.88:0/1405524314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28380b89e0 0x7f28380c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.479+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 >> 172.21.15.88:0/1405524314 conn(0x7f28380d05c0 msgr2=0x7f28380b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.480+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 shutdown_connections 2023-05-17T12:26:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.480+0000 7f283c9ff700 1 -- 172.21.15.88:0/1405524314 wait complete. 2023-05-17T12:26:17.501 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:17.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.689+0000 7f12d27ff700 1 Processor -- start 2023-05-17T12:26:17.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.690+0000 7f12d27ff700 1 -- start start 2023-05-17T12:26:17.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.691+0000 7f12d27ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f12cc0b23a0 0x7f12cc06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.691+0000 7f12d27ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f12cc0cf190 0x7f12cc160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.691+0000 7f12d27ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12cc06b4a0 con 0x7f12cc06c760 2023-05-17T12:26:17.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.691+0000 7f12d27ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12cc06a510 con 0x7f12cc0cf190 2023-05-17T12:26:17.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.691+0000 7f12d27ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12cc0cd840 con 0x7f12cc0b23a0 2023-05-17T12:26:17.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.691+0000 7f12d0d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f12cc0cf190 0x7f12cc160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.691+0000 7f12d0d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f12cc0cf190 0x7f12cc160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55564/0 (socket says 172.21.15.88:55564) 2023-05-17T12:26:17.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.691+0000 7f12d0d9c700 1 -- 172.21.15.88:0/3821446354 learned_addr learned my addr 172.21.15.88:0/3821446354 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:17.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.691+0000 7f12c3fff700 1 --2- 172.21.15.88:0/3821446354 >> v2:172.21.15.187:3300/0 conn(0x7f12cc0b23a0 0x7f12cc06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.692+0000 7f12d0d9c700 1 -- 172.21.15.88:0/3821446354 >> v2:172.21.15.187:3300/0 conn(0x7f12cc0b23a0 msgr2=0x7f12cc06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:17.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.692+0000 7f12d0d9c700 1 --2- 172.21.15.88:0/3821446354 >> v2:172.21.15.187:3300/0 conn(0x7f12cc0b23a0 0x7f12cc06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.692+0000 7f12d0d9c700 1 -- 172.21.15.88:0/3821446354 >> v1:172.21.15.187:6789/0 conn(0x7f12cc06c760 legacy=0x7f12cc06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.692+0000 7f12d0d9c700 1 -- 172.21.15.88:0/3821446354 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc0cdb20 con 0x7f12cc0cf190 2023-05-17T12:26:17.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.692+0000 7f12d0d9c700 1 --2- 172.21.15.88:0/3821446354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0cf190 0x7f12cc160380 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f12cc06c540 tx=0x7f12c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ffc8d621b854a8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:17.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.692+0000 7f12cb7fe700 1 -- 172.21.15.88:0/3821446354 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400e070 con 0x7f12cc0cf190 2023-05-17T12:26:17.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.692+0000 7f12cb7fe700 1 -- 172.21.15.88:0/3821446354 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c400b910 con 0x7f12cc0cf190 2023-05-17T12:26:17.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.692+0000 7f12cb7fe700 1 -- 172.21.15.88:0/3821446354 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400bcc0 con 0x7f12cc0cf190 2023-05-17T12:26:17.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.693+0000 7f12d27ff700 1 -- 172.21.15.88:0/3821446354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0cf190 msgr2=0x7f12cc160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.693+0000 7f12d27ff700 1 --2- 172.21.15.88:0/3821446354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0cf190 0x7f12cc160380 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f12cc06c540 tx=0x7f12c400b330 comp rx=0 tx=0).stop 2023-05-17T12:26:17.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.693+0000 7f12d27ff700 1 -- 172.21.15.88:0/3821446354 shutdown_connections 2023-05-17T12:26:17.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.693+0000 7f12d27ff700 1 --2- 172.21.15.88:0/3821446354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0cf190 0x7f12cc160380 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.693+0000 7f12d27ff700 1 --2- 172.21.15.88:0/3821446354 >> v2:172.21.15.187:3300/0 conn(0x7f12cc0b23a0 0x7f12cc06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.693+0000 7f12d27ff700 1 -- 172.21.15.88:0/3821446354 >> 172.21.15.88:0/3821446354 conn(0x7f12cc0d06f0 msgr2=0x7f12cc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:17.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.693+0000 7f12d27ff700 1 -- 172.21.15.88:0/3821446354 shutdown_connections 2023-05-17T12:26:17.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.693+0000 7f12d27ff700 1 -- 172.21.15.88:0/3821446354 wait complete. 2023-05-17T12:26:17.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.694+0000 7f12d27ff700 1 Processor -- start 2023-05-17T12:26:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.695+0000 7f12d27ff700 1 -- start start 2023-05-17T12:26:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.695+0000 7f12d27ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc06c760 0x7f12cc0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.695+0000 7f12d27ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0cf190 0x7f12cc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.695+0000 7f12d27ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc155040 0x7f12cc0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.695+0000 7f12d27ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0b6ed0 con 0x7f12cc06c760 2023-05-17T12:26:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.695+0000 7f12d27ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc1554e0 con 0x7f12cc0cf190 2023-05-17T12:26:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.695+0000 7f12d27ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc0c9080 con 0x7f12cc155040 2023-05-17T12:26:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12cbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc06c760 0x7f12cc0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12cbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc06c760 0x7f12cc0cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55574/0 (socket says 172.21.15.88:55574) 2023-05-17T12:26:17.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12cbfff700 1 -- 172.21.15.88:0/4183035953 learned_addr learned my addr 172.21.15.88:0/4183035953 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:17.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12cbfff700 1 -- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc155040 msgr2=0x7f12cc0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12cbfff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc155040 0x7f12cc0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12cbfff700 1 -- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0cf190 msgr2=0x7f12cc154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12c3fff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0cf190 0x7f12cc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12cbfff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0cf190 0x7f12cc154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12cbfff700 1 -- 172.21.15.88:0/4183035953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4009b30 con 0x7f12cc06c760 2023-05-17T12:26:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.696+0000 7f12cbfff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc06c760 0x7f12cc0cc850 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c510 tx=0x7f12bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.697+0000 7f12c97fa700 1 -- 172.21.15.88:0/4183035953 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0052d0 con 0x7f12cc06c760 2023-05-17T12:26:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.697+0000 7f12c97fa700 1 -- 172.21.15.88:0/4183035953 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc005430 con 0x7f12cc06c760 2023-05-17T12:26:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.697+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc06aa40 con 0x7f12cc06c760 2023-05-17T12:26:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.697+0000 7f12c97fa700 1 -- 172.21.15.88:0/4183035953 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0038c0 con 0x7f12cc06c760 2023-05-17T12:26:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.697+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12cc06a760 con 0x7f12cc06c760 2023-05-17T12:26:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.698+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12cc15cb40 con 0x7f12cc06c760 2023-05-17T12:26:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.699+0000 7f12c97fa700 1 -- 172.21.15.88:0/4183035953 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12bc003a20 con 0x7f12cc06c760 2023-05-17T12:26:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.700+0000 7f12c97fa700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12ac06ace0 0x7f12ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.700+0000 7f12c97fa700 1 -- 172.21.15.88:0/4183035953 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f12bc088a20 con 0x7f12cc06c760 2023-05-17T12:26:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.700+0000 7f12c3fff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12ac06ace0 0x7f12ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.701+0000 7f12c3fff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12ac06ace0 0x7f12ac06d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12cc1f5e40 tx=0x7f12b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:17.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.704+0000 7f12c97fa700 1 -- 172.21.15.88:0/4183035953 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f12bc053700 con 0x7f12cc06c760 2023-05-17T12:26:17.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.900+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f12cc06b4a0 con 0x7f12cc06c760 2023-05-17T12:26:17.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.901+0000 7f12c97fa700 1 -- 172.21.15.88:0/4183035953 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f12cc06b4a0 con 0x7f12cc06c760 2023-05-17T12:26:17.905 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:17.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12ac06ace0 msgr2=0x7f12ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12ac06ace0 0x7f12ac06d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12cc1f5e40 tx=0x7f12b4008040 comp rx=0 tx=0).stop 2023-05-17T12:26:17.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc06c760 msgr2=0x7f12cc0cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:17.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc06c760 0x7f12cc0cc850 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c510 tx=0x7f12bc00c8d0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 shutdown_connections 2023-05-17T12:26:17.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f12ac06ace0 0x7f12ac06d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12cc155040 0x7f12cc0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc06c760 0x7f12cc0cc850 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 --2- 172.21.15.88:0/4183035953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12cc0cf190 0x7f12cc154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:17.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 >> 172.21.15.88:0/4183035953 conn(0x7f12cc0d06f0 msgr2=0x7f12cc0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:17.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 shutdown_connections 2023-05-17T12:26:17.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:17.903+0000 7f12d27ff700 1 -- 172.21.15.88:0/4183035953 wait complete. 2023-05-17T12:26:17.924 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:26:18.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.104+0000 7ff8f69ff700 1 Processor -- start 2023-05-17T12:26:18.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.105+0000 7ff8f69ff700 1 -- start start 2023-05-17T12:26:18.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8f69ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015ab80 0x7ff8f006b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8f69ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8f0070f70 0x7ff8f0071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8f69ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f006b2c0 con 0x7ff8f00cd590 2023-05-17T12:26:18.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8f69ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f015af50 con 0x7ff8f0070f70 2023-05-17T12:26:18.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8f69ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00718d0 con 0x7ff8f015ab80 2023-05-17T12:26:18.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8e7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff8f00cd590 0x7ff8f006da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59600/0 (socket says 172.21.15.88:59600) 2023-05-17T12:26:18.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8e7fff700 1 -- 172.21.15.88:0/3600163009 learned_addr learned my addr 172.21.15.88:0/3600163009 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:18.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8effff700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015ab80 0x7ff8f006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8f4f9c700 1 --2- 172.21.15.88:0/3600163009 >> v2:172.21.15.187:3300/0 conn(0x7ff8f0070f70 0x7ff8f0071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003997076 0 0) 0x7ff8f006b2c0 con 0x7ff8f00cd590 2023-05-17T12:26:18.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.106+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8dc0035b0 con 0x7ff8f00cd590 2023-05-17T12:26:18.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567354760 0 0) 0x7ff8dc0035b0 con 0x7ff8f00cd590 2023-05-17T12:26:18.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015ab80 msgr2=0x7ff8f006b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:18.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015ab80 0x7ff8f006b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 >> v2:172.21.15.187:3300/0 conn(0x7ff8f0070f70 msgr2=0x7ff8f0071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:18.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 --2- 172.21.15.88:0/3600163009 >> v2:172.21.15.187:3300/0 conn(0x7ff8f0070f70 0x7ff8f0071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f006bc90 con 0x7ff8f00cd590 2023-05-17T12:26:18.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7ff8d8001670 con 0x7ff8f00cd590 2023-05-17T12:26:18.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 >> v1:172.21.15.88:6789/0 conn(0x7ff8f00cd590 legacy=0x7ff8f006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc003a00 0x7ff8dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8dc0043e0 0x7ff8dc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc004f20 0x7ff8dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f015af50 con 0x7ff8dc0043e0 2023-05-17T12:26:18.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00718d0 con 0x7ff8dc004f20 2023-05-17T12:26:18.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc00bf50 con 0x7ff8dc003a00 2023-05-17T12:26:18.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.107+0000 7ff8effff700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015ab80 0x7ff8f006b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:18.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8e7fff700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8dc0043e0 0x7ff8dc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8f4f9c700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc004f20 0x7ff8dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8effff700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc003a00 0x7ff8dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8e7fff700 1 -- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc003a00 msgr2=0x7ff8dc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8e7fff700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8dc003a00 0x7ff8dc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8e7fff700 1 -- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc004f20 msgr2=0x7ff8dc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8e7fff700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc004f20 0x7ff8dc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8e7fff700 1 -- 172.21.15.88:0/3600163009 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0035b0 con 0x7ff8dc0043e0 2023-05-17T12:26:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8e7fff700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8dc0043e0 0x7ff8dc0048b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c320 tx=0x7ff8dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04e8a54c7808fac server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800ce60 con 0x7ff8dc0043e0 2023-05-17T12:26:18.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8005960 con 0x7ff8dc0043e0 2023-05-17T12:26:18.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.108+0000 7ff8ef7fe700 1 -- 172.21.15.88:0/3600163009 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8005cf0 con 0x7ff8dc0043e0 2023-05-17T12:26:18.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.109+0000 7ff8f69ff700 1 -- 172.21.15.88:0/3600163009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8dc0043e0 msgr2=0x7ff8dc0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.109+0000 7ff8f69ff700 1 --2- 172.21.15.88:0/3600163009 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8dc0043e0 0x7ff8dc0048b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c320 tx=0x7ff8dc005880 comp rx=0 tx=0).stop 2023-05-17T12:26:18.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.109+0000 7ff8f4f9c700 1 -- 172.21.15.88:0/3600163009 reap_dead start 2023-05-17T12:26:18.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.109+0000 7ff8f69ff700 1 -- 172.21.15.88:0/3600163009 shutdown_connections 2023-05-17T12:26:18.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.109+0000 7ff8f69ff700 1 -- 172.21.15.88:0/3600163009 >> 172.21.15.88:0/3600163009 conn(0x7ff8f00b1530 msgr2=0x7ff8f00ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:18.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.109+0000 7ff8f69ff700 1 -- 172.21.15.88:0/3600163009 shutdown_connections 2023-05-17T12:26:18.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.109+0000 7ff8f69ff700 1 -- 172.21.15.88:0/3600163009 wait complete. 2023-05-17T12:26:18.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.111+0000 7ff8f69ff700 1 Processor -- start 2023-05-17T12:26:18.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.111+0000 7ff8f69ff700 1 -- start start 2023-05-17T12:26:18.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8f69ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0043e0 0x7ff8f00aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8f69ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015b120 0x7ff8f015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8f69ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f01f5cb0 0x7ff8f01f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8f69ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f015e4e0 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8f69ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f01f6690 con 0x7ff8dc0043e0 2023-05-17T12:26:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8f69ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00b3100 con 0x7ff8f015b120 2023-05-17T12:26:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8f4f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f01f5cb0 0x7ff8f01f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8f4f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f01f5cb0 0x7ff8f01f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55592/0 (socket says 172.21.15.88:55592) 2023-05-17T12:26:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8f4f9c700 1 -- 172.21.15.88:0/2224804826 learned_addr learned my addr 172.21.15.88:0/2224804826 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8e7fff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015b120 0x7ff8f015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.112+0000 7ff8effff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0043e0 0x7ff8f00aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8f4f9c700 1 -- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015b120 msgr2=0x7ff8f015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8f4f9c700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015b120 0x7ff8f015b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8f4f9c700 1 -- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0043e0 msgr2=0x7ff8f00aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8f4f9c700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0043e0 0x7ff8f00aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8f4f9c700 1 -- 172.21.15.88:0/2224804826 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f006a990 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8f4f9c700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f01f5cb0 0x7ff8f01f6150 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff8f006f0b0 tx=0x7ff8e8011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:18.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8ed7fa700 1 -- 172.21.15.88:0/2224804826 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800e040 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8ed7fa700 1 -- 172.21.15.88:0/2224804826 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e800f040 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8ed7fa700 1 -- 172.21.15.88:0/2224804826 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800fc40 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f006a6b0 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.113+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f006ac70 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.114+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f0159e00 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.115+0000 7ff8ed7fa700 1 -- 172.21.15.88:0/2224804826 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8e8015430 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.116+0000 7ff8ed7fa700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8d006ace0 0x7ff8d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.116+0000 7ff8ed7fa700 1 -- 172.21.15.88:0/2224804826 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff8e8089cd0 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.117+0000 7ff8effff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8d006ace0 0x7ff8d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.117+0000 7ff8effff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8d006ace0 0x7ff8d006d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00cfc20 tx=0x7ff8e0009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:18.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.120+0000 7ff8ed7fa700 1 -- 172.21.15.88:0/2224804826 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff8e80584d0 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.328+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff8f0074530 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.328+0000 7ff8ed7fa700 1 -- 172.21.15.88:0/2224804826 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff8e8058060 con 0x7ff8f01f5cb0 2023-05-17T12:26:18.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.330+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8d006ace0 msgr2=0x7ff8d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.330+0000 7ff8f69ff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8d006ace0 0x7ff8d006d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00cfc20 tx=0x7ff8e0009210 comp rx=0 tx=0).stop 2023-05-17T12:26:18.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.330+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f01f5cb0 msgr2=0x7ff8f01f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.330+0000 7ff8f69ff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f01f5cb0 0x7ff8f01f6150 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff8f006f0b0 tx=0x7ff8e8011ed0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.330+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 shutdown_connections 2023-05-17T12:26:18.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.330+0000 7ff8f69ff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8d006ace0 0x7ff8d006d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.330+0000 7ff8f69ff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8f01f5cb0 0x7ff8f01f6150 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.330+0000 7ff8f69ff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8dc0043e0 0x7ff8f00aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.331+0000 7ff8f69ff700 1 --2- 172.21.15.88:0/2224804826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8f015b120 0x7ff8f015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.331+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 >> 172.21.15.88:0/2224804826 conn(0x7ff8f00b1530 msgr2=0x7ff8f00b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.331+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 shutdown_connections 2023-05-17T12:26:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.331+0000 7ff8f69ff700 1 -- 172.21.15.88:0/2224804826 wait complete. 2023-05-17T12:26:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:26:18.352 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-05-17T12:26:18.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:26:18.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-05-17T12:26:18.416 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T12:26:18.417 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T12:26:18.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:26:18.418 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T12:26:18.459 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:26:18.460 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:18.507 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:26:18.507 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:18.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.771+0000 7fb9b5fff700 1 Processor -- start 2023-05-17T12:26:18.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.771+0000 7fb9b5fff700 1 -- start start 2023-05-17T12:26:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.772+0000 7fb9b5fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb9b006b0b0 0x7fb9b006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.772+0000 7fb9b5fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9b006c330 0x7fb9b006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9b5fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b00cd6b0 con 0x7fb9b015c840 2023-05-17T12:26:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9b5fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b00cdf50 con 0x7fb9b006c330 2023-05-17T12:26:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9b5fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b006ccb0 con 0x7fb9b006b0b0 2023-05-17T12:26:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9af7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb9b015c840 0x7fb9b00cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59616/0 (socket says 172.21.15.88:59616) 2023-05-17T12:26:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9af7fe700 1 -- 172.21.15.88:0/47010954 learned_addr learned my addr 172.21.15.88:0/47010954 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9affff700 1 --2- 172.21.15.88:0/47010954 >> v2:172.21.15.88:3300/0 conn(0x7fb9b006c330 0x7fb9b006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9aeffd700 1 --2- 172.21.15.88:0/47010954 >> v2:172.21.15.187:3300/0 conn(0x7fb9b006b0b0 0x7fb9b006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9affff700 1 -- 172.21.15.88:0/47010954 >> v2:172.21.15.187:3300/0 conn(0x7fb9b006b0b0 msgr2=0x7fb9b006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9affff700 1 --2- 172.21.15.88:0/47010954 >> v2:172.21.15.187:3300/0 conn(0x7fb9b006b0b0 0x7fb9b006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9affff700 1 -- 172.21.15.88:0/47010954 >> v1:172.21.15.88:6789/0 conn(0x7fb9b015c840 legacy=0x7fb9b00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9ae7fc700 1 -- 172.21.15.88:0/47010954 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004693915 0 0) 0x7fb9b00cd6b0 con 0x7fb9b015c840 2023-05-17T12:26:18.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.773+0000 7fb9affff700 1 -- 172.21.15.88:0/47010954 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b00b2460 con 0x7fb9b006c330 2023-05-17T12:26:18.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9affff700 1 --2- 172.21.15.88:0/47010954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006c330 0x7fb9b006c770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00cead0 tx=0x7fb9a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc24646c421755c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:18.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9ae7fc700 1 -- 172.21.15.88:0/47010954 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800e070 con 0x7fb9b006c330 2023-05-17T12:26:18.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9ae7fc700 1 -- 172.21.15.88:0/47010954 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a800bbd0 con 0x7fb9b006c330 2023-05-17T12:26:18.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9ae7fc700 1 -- 172.21.15.88:0/47010954 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8012430 con 0x7fb9b006c330 2023-05-17T12:26:18.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9b5fff700 1 -- 172.21.15.88:0/47010954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006c330 msgr2=0x7fb9b006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9b5fff700 1 --2- 172.21.15.88:0/47010954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006c330 0x7fb9b006c770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00cead0 tx=0x7fb9a800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:18.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9b5fff700 1 -- 172.21.15.88:0/47010954 shutdown_connections 2023-05-17T12:26:18.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9b5fff700 1 --2- 172.21.15.88:0/47010954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006c330 0x7fb9b006c770 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9b5fff700 1 --2- 172.21.15.88:0/47010954 >> v2:172.21.15.187:3300/0 conn(0x7fb9b006b0b0 0x7fb9b006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.774+0000 7fb9b5fff700 1 -- 172.21.15.88:0/47010954 >> 172.21.15.88:0/47010954 conn(0x7fb9b00d3060 msgr2=0x7fb9b00d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:18.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.775+0000 7fb9b5fff700 1 -- 172.21.15.88:0/47010954 shutdown_connections 2023-05-17T12:26:18.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.775+0000 7fb9b5fff700 1 -- 172.21.15.88:0/47010954 wait complete. 2023-05-17T12:26:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.776+0000 7fb9b5fff700 1 Processor -- start 2023-05-17T12:26:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.776+0000 7fb9b5fff700 1 -- start start 2023-05-17T12:26:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.777+0000 7fb9b5fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006b0b0 0x7fb9b01570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.777+0000 7fb9b5fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9b006c330 0x7fb9b0159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.777+0000 7fb9b5fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9b015c840 0x7fb9b00cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.777+0000 7fb9b5fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b01601c0 con 0x7fb9b006b0b0 2023-05-17T12:26:18.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.777+0000 7fb9b5fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b01604a0 con 0x7fb9b006c330 2023-05-17T12:26:18.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.777+0000 7fb9b5fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0160780 con 0x7fb9b015c840 2023-05-17T12:26:18.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.777+0000 7fb9af7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006b0b0 0x7fb9b01570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9af7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006b0b0 0x7fb9b01570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55620/0 (socket says 172.21.15.88:55620) 2023-05-17T12:26:18.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9af7fe700 1 -- 172.21.15.88:0/2622070456 learned_addr learned my addr 172.21.15.88:0/2622070456 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9affff700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9b015c840 0x7fb9b00cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9af7fe700 1 -- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9b015c840 msgr2=0x7fb9b00cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9aeffd700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9b006c330 0x7fb9b0159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9af7fe700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9b015c840 0x7fb9b00cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9af7fe700 1 -- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9b006c330 msgr2=0x7fb9b0159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9af7fe700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9b006c330 0x7fb9b0159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9af7fe700 1 -- 172.21.15.88:0/2622070456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8009a70 con 0x7fb9b006b0b0 2023-05-17T12:26:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9affff700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9b015c840 0x7fb9b00cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9aeffd700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9b006c330 0x7fb9b0159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb9af7fe700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006b0b0 0x7fb9b01570f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000c550 tx=0x7fb9a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb997fff700 1 -- 172.21.15.88:0/2622070456 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0004c80 con 0x7fb9b006b0b0 2023-05-17T12:26:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.778+0000 7fb997fff700 1 -- 172.21.15.88:0/2622070456 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0004e00 con 0x7fb9b006b0b0 2023-05-17T12:26:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.779+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b00cd900 con 0x7fb9b006b0b0 2023-05-17T12:26:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.779+0000 7fb997fff700 1 -- 172.21.15.88:0/2622070456 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0007310 con 0x7fb9b006b0b0 2023-05-17T12:26:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.779+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b00b2740 con 0x7fb9b006b0b0 2023-05-17T12:26:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.780+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b00cdbe0 con 0x7fb9b006b0b0 2023-05-17T12:26:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.781+0000 7fb997fff700 1 -- 172.21.15.88:0/2622070456 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9a0007470 con 0x7fb9b006b0b0 2023-05-17T12:26:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.782+0000 7fb997fff700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb99c06ace0 0x7fb99c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.782+0000 7fb997fff700 1 -- 172.21.15.88:0/2622070456 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb9a00894d0 con 0x7fb9b006b0b0 2023-05-17T12:26:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.782+0000 7fb9aeffd700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb99c06ace0 0x7fb99c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.783+0000 7fb9aeffd700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb99c06ace0 0x7fb99c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0159730 tx=0x7fb9a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:18.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.786+0000 7fb997fff700 1 -- 172.21.15.88:0/2622070456 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb9a0054240 con 0x7fb9b006b0b0 2023-05-17T12:26:18.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.980+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9b0160c40 con 0x7fb9b006b0b0 2023-05-17T12:26:18.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.982+0000 7fb997fff700 1 -- 172.21.15.88:0/2622070456 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fb9a0057860 con 0x7fb9b006b0b0 2023-05-17T12:26:18.986 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:18.986 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:18.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb99c06ace0 msgr2=0x7fb99c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb99c06ace0 0x7fb99c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0159730 tx=0x7fb9a4008040 comp rx=0 tx=0).stop 2023-05-17T12:26:18.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006b0b0 msgr2=0x7fb9b01570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:18.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006b0b0 0x7fb9b01570f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000c550 tx=0x7fb9a000c910 comp rx=0 tx=0).stop 2023-05-17T12:26:18.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 shutdown_connections 2023-05-17T12:26:18.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb99c06ace0 0x7fb99c06d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9b015c840 0x7fb9b00cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9b006b0b0 0x7fb9b01570f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 --2- 172.21.15.88:0/2622070456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9b006c330 0x7fb9b0159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:18.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.984+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 >> 172.21.15.88:0/2622070456 conn(0x7fb9b00d3060 msgr2=0x7fb9b00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:18.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.985+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 shutdown_connections 2023-05-17T12:26:18.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:18.985+0000 7fb9b5fff700 1 -- 172.21.15.88:0/2622070456 wait complete. 2023-05-17T12:26:19.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:19.007 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.191+0000 7f31a33ff700 1 Processor -- start 2023-05-17T12:26:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.191+0000 7f31a33ff700 1 -- start start 2023-05-17T12:26:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f31a33ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c06a510 0x7f319c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f31a33ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f319c0b4750 0x7f319c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f31a33ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c06b430 con 0x7f319c0c9370 2023-05-17T12:26:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f31a33ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c06b680 con 0x7f319c0b4750 2023-05-17T12:26:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f31a33ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c06b960 con 0x7f319c06a510 2023-05-17T12:26:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f31a119b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f319c0c9370 0x7f319c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59628/0 (socket says 172.21.15.88:59628) 2023-05-17T12:26:19.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f31a119b700 1 -- 172.21.15.88:0/198855670 learned_addr learned my addr 172.21.15.88:0/198855670 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:19.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f31a099a700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c06a510 0x7f319c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f31a199c700 1 --2- 172.21.15.88:0/198855670 >> v2:172.21.15.187:3300/0 conn(0x7f319c0b4750 0x7f319c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.193+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962578836 0 0) 0x7f319c06b430 con 0x7f319c0c9370 2023-05-17T12:26:19.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31880035b0 con 0x7f319c0c9370 2023-05-17T12:26:19.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1294066165 0 0) 0x7f31880035b0 con 0x7f319c0c9370 2023-05-17T12:26:19.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c06a510 msgr2=0x7f319c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:19.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c06a510 0x7f319c0cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 >> v2:172.21.15.187:3300/0 conn(0x7f319c0b4750 msgr2=0x7f319c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:19.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 --2- 172.21.15.88:0/198855670 >> v2:172.21.15.187:3300/0 conn(0x7f319c0b4750 0x7f319c0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c06bc40 con 0x7f319c0c9370 2023-05-17T12:26:19.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f3198001670 con 0x7f319c0c9370 2023-05-17T12:26:19.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 >> v1:172.21.15.88:6789/0 conn(0x7f319c0c9370 legacy=0x7f319c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f3188003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c06a510 0x7f3188004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3188004d90 0x7f3188005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c06b680 con 0x7f3188003a00 2023-05-17T12:26:19.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c06b960 con 0x7f3188004d90 2023-05-17T12:26:19.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318800ba10 con 0x7f319c06a510 2023-05-17T12:26:19.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f31a119b700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f3188003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f31a199c700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3188004d90 0x7f3188005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.194+0000 7f31a099a700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c06a510 0x7f3188004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f31a119b700 1 -- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c06a510 msgr2=0x7f3188004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:19.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f31a119b700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c06a510 0x7f3188004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f31a119b700 1 -- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3188004d90 msgr2=0x7f3188005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:19.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f31a119b700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3188004d90 0x7f3188005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f31a119b700 1 -- 172.21.15.88:0/198855670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880035b0 con 0x7f3188003a00 2023-05-17T12:26:19.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f31a199c700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3188004d90 0x7f3188005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:19.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f31a099a700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c06a510 0x7f3188004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:19.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f31a119b700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f3188003e10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3198007d60 tx=0x7f3188005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd54cf63a0a6ee4e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:19.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800ce30 con 0x7f3188003a00 2023-05-17T12:26:19.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3198005960 con 0x7f3188003a00 2023-05-17T12:26:19.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.195+0000 7f3193fff700 1 -- 172.21.15.88:0/198855670 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198005d10 con 0x7f3188003a00 2023-05-17T12:26:19.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.196+0000 7f31a33ff700 1 -- 172.21.15.88:0/198855670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 msgr2=0x7f3188003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.196+0000 7f31a33ff700 1 --2- 172.21.15.88:0/198855670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f3188003e10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3198007d60 tx=0x7f3188005880 comp rx=0 tx=0).stop 2023-05-17T12:26:19.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.196+0000 7f31a199c700 1 -- 172.21.15.88:0/198855670 reap_dead start 2023-05-17T12:26:19.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.196+0000 7f31a33ff700 1 -- 172.21.15.88:0/198855670 shutdown_connections 2023-05-17T12:26:19.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.196+0000 7f31a33ff700 1 -- 172.21.15.88:0/198855670 >> 172.21.15.88:0/198855670 conn(0x7f319c0cf970 msgr2=0x7f319c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:19.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.196+0000 7f31a33ff700 1 -- 172.21.15.88:0/198855670 shutdown_connections 2023-05-17T12:26:19.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.196+0000 7f31a33ff700 1 -- 172.21.15.88:0/198855670 wait complete. 2023-05-17T12:26:19.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.198+0000 7f31a33ff700 1 Processor -- start 2023-05-17T12:26:19.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.198+0000 7f31a33ff700 1 -- start start 2023-05-17T12:26:19.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.199+0000 7f31a33ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f319c1f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.199+0000 7f31a33ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f319c1503d0 0x7f319c14d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.199+0000 7f31a33ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c14af20 0x7f319c14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a33ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c1f2ee0 con 0x7f3188003a00 2023-05-17T12:26:19.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a33ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c1f2640 con 0x7f319c1503d0 2023-05-17T12:26:19.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a33ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c1f2920 con 0x7f319c14af20 2023-05-17T12:26:19.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a119b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f319c1f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a119b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f319c1f1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55646/0 (socket says 172.21.15.88:55646) 2023-05-17T12:26:19.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a119b700 1 -- 172.21.15.88:0/1766590053 learned_addr learned my addr 172.21.15.88:0/1766590053 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:19.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a199c700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c14af20 0x7f319c14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a099a700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f319c1503d0 0x7f319c14d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a119b700 1 -- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c14af20 msgr2=0x7f319c14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a119b700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c14af20 0x7f319c14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a119b700 1 -- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f319c1503d0 msgr2=0x7f319c14d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a119b700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f319c1503d0 0x7f319c14d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a119b700 1 -- 172.21.15.88:0/1766590053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c071f30 con 0x7f3188003a00 2023-05-17T12:26:19.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.200+0000 7f31a119b700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f319c1f1fb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3198008fd0 tx=0x7f3198001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:19.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.201+0000 7f3191ffb700 1 -- 172.21.15.88:0/1766590053 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198020070 con 0x7f3188003a00 2023-05-17T12:26:19.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.201+0000 7f3191ffb700 1 -- 172.21.15.88:0/1766590053 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3198007ba0 con 0x7f3188003a00 2023-05-17T12:26:19.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.201+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c15a8e0 con 0x7f3188003a00 2023-05-17T12:26:19.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.201+0000 7f3191ffb700 1 -- 172.21.15.88:0/1766590053 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198004870 con 0x7f3188003a00 2023-05-17T12:26:19.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.201+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c0720c0 con 0x7f3188003a00 2023-05-17T12:26:19.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.202+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c074530 con 0x7f3188003a00 2023-05-17T12:26:19.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.203+0000 7f3191ffb700 1 -- 172.21.15.88:0/1766590053 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3198017020 con 0x7f3188003a00 2023-05-17T12:26:19.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.204+0000 7f3191ffb700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f318006ace0 0x7f318006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.204+0000 7f3191ffb700 1 -- 172.21.15.88:0/1766590053 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f319808dfa0 con 0x7f3188003a00 2023-05-17T12:26:19.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.204+0000 7f31a099a700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f318006ace0 0x7f318006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.205+0000 7f31a099a700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f318006ace0 0x7f318006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f319c14f970 tx=0x7f318c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:19.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.208+0000 7f3191ffb700 1 -- 172.21.15.88:0/1766590053 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3198058dd0 con 0x7f3188003a00 2023-05-17T12:26:19.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.403+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f319c06e790 con 0x7f3188003a00 2023-05-17T12:26:19.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.404+0000 7f3191ffb700 1 -- 172.21.15.88:0/1766590053 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3198007da0 con 0x7f3188003a00 2023-05-17T12:26:19.408 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:19.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f318006ace0 msgr2=0x7f318006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f318006ace0 0x7f318006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f319c14f970 tx=0x7f318c008040 comp rx=0 tx=0).stop 2023-05-17T12:26:19.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 msgr2=0x7f319c1f1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f319c1f1fb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3198008fd0 tx=0x7f3198001a00 comp rx=0 tx=0).stop 2023-05-17T12:26:19.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 shutdown_connections 2023-05-17T12:26:19.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f318006ace0 0x7f318006d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319c14af20 0x7f319c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3188003a00 0x7f319c1f1fb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 --2- 172.21.15.88:0/1766590053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f319c1503d0 0x7f319c14d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 >> 172.21.15.88:0/1766590053 conn(0x7f319c0cf970 msgr2=0x7f319c0b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:19.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 shutdown_connections 2023-05-17T12:26:19.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.407+0000 7f31a33ff700 1 -- 172.21.15.88:0/1766590053 wait complete. 2023-05-17T12:26:19.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:19.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.613+0000 7fa2967ff700 1 Processor -- start 2023-05-17T12:26:19.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.613+0000 7fa2967ff700 1 -- start start 2023-05-17T12:26:19.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.614+0000 7fa2967ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2900b23a0 0x7fa29006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.614+0000 7fa2967ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2900cf190 0x7fa290160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.614+0000 7fa2967ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29006b4a0 con 0x7fa29006c760 2023-05-17T12:26:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.614+0000 7fa2967ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29006a510 con 0x7fa2900cf190 2023-05-17T12:26:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.614+0000 7fa2967ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2900cd840 con 0x7fa2900b23a0 2023-05-17T12:26:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.614+0000 7fa294d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2900cf190 0x7fa290160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.614+0000 7fa294d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2900cf190 0x7fa290160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55658/0 (socket says 172.21.15.88:55658) 2023-05-17T12:26:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.614+0000 7fa294d9c700 1 -- 172.21.15.88:0/3700249699 learned_addr learned my addr 172.21.15.88:0/3700249699 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.615+0000 7fa28f7fe700 1 --2- 172.21.15.88:0/3700249699 >> v2:172.21.15.187:3300/0 conn(0x7fa2900b23a0 0x7fa29006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.615+0000 7fa294d9c700 1 -- 172.21.15.88:0/3700249699 >> v2:172.21.15.187:3300/0 conn(0x7fa2900b23a0 msgr2=0x7fa29006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.615+0000 7fa294d9c700 1 --2- 172.21.15.88:0/3700249699 >> v2:172.21.15.187:3300/0 conn(0x7fa2900b23a0 0x7fa29006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.615+0000 7fa294d9c700 1 -- 172.21.15.88:0/3700249699 >> v1:172.21.15.187:6789/0 conn(0x7fa29006c760 legacy=0x7fa29006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.615+0000 7fa294d9c700 1 -- 172.21.15.88:0/3700249699 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900cdb20 con 0x7fa2900cf190 2023-05-17T12:26:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.615+0000 7fa294d9c700 1 --2- 172.21.15.88:0/3700249699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa290160380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa29006c540 tx=0x7fa28800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450ca98ff06f010d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.615+0000 7fa28effd700 1 -- 172.21.15.88:0/3700249699 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800e070 con 0x7fa2900cf190 2023-05-17T12:26:19.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.615+0000 7fa28effd700 1 -- 172.21.15.88:0/3700249699 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28800b910 con 0x7fa2900cf190 2023-05-17T12:26:19.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.615+0000 7fa28effd700 1 -- 172.21.15.88:0/3700249699 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800bcc0 con 0x7fa2900cf190 2023-05-17T12:26:19.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.616+0000 7fa2967ff700 1 -- 172.21.15.88:0/3700249699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 msgr2=0x7fa290160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.616+0000 7fa2967ff700 1 --2- 172.21.15.88:0/3700249699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa290160380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa29006c540 tx=0x7fa28800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:19.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.616+0000 7fa2967ff700 1 -- 172.21.15.88:0/3700249699 shutdown_connections 2023-05-17T12:26:19.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.616+0000 7fa2967ff700 1 --2- 172.21.15.88:0/3700249699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa290160380 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.616+0000 7fa2967ff700 1 --2- 172.21.15.88:0/3700249699 >> v2:172.21.15.187:3300/0 conn(0x7fa2900b23a0 0x7fa29006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.616+0000 7fa2967ff700 1 -- 172.21.15.88:0/3700249699 >> 172.21.15.88:0/3700249699 conn(0x7fa2900d06f0 msgr2=0x7fa2900d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:19.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.616+0000 7fa2967ff700 1 -- 172.21.15.88:0/3700249699 shutdown_connections 2023-05-17T12:26:19.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.616+0000 7fa2967ff700 1 -- 172.21.15.88:0/3700249699 wait complete. 2023-05-17T12:26:19.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.618+0000 7fa2967ff700 1 Processor -- start 2023-05-17T12:26:19.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.618+0000 7fa2967ff700 1 -- start start 2023-05-17T12:26:19.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa2967ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa2900cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa2967ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa290154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa2967ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290155040 0x7fa2900c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa2967ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900b6ed0 con 0x7fa2900cf190 2023-05-17T12:26:19.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa2967ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2901554e0 con 0x7fa290155040 2023-05-17T12:26:19.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa2967ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c9080 con 0x7fa29006c760 2023-05-17T12:26:19.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa28f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa290154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa28f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa290154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55668/0 (socket says 172.21.15.88:55668) 2023-05-17T12:26:19.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa28f7fe700 1 -- 172.21.15.88:0/3132999329 learned_addr learned my addr 172.21.15.88:0/3132999329 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:19.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa294d9c700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290155040 0x7fa2900c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa28ffff700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa2900cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa28f7fe700 1 -- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 msgr2=0x7fa2900cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa28f7fe700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa2900cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa28f7fe700 1 -- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290155040 msgr2=0x7fa2900c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa28f7fe700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290155040 0x7fa2900c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.619+0000 7fa28f7fe700 1 -- 172.21.15.88:0/3132999329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa288009b30 con 0x7fa2900cf190 2023-05-17T12:26:19.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.620+0000 7fa28f7fe700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa290154b00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa28400e9e0 tx=0x7fa28400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:19.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.620+0000 7fa28cff9700 1 -- 172.21.15.88:0/3132999329 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284009710 con 0x7fa2900cf190 2023-05-17T12:26:19.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.620+0000 7fa28cff9700 1 -- 172.21.15.88:0/3132999329 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28400ee80 con 0x7fa2900cf190 2023-05-17T12:26:19.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.620+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29006aa40 con 0x7fa2900cf190 2023-05-17T12:26:19.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.620+0000 7fa28cff9700 1 -- 172.21.15.88:0/3132999329 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28400ca50 con 0x7fa2900cf190 2023-05-17T12:26:19.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.620+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29006a760 con 0x7fa2900cf190 2023-05-17T12:26:19.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.621+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29015cb40 con 0x7fa2900cf190 2023-05-17T12:26:19.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.622+0000 7fa28cff9700 1 -- 172.21.15.88:0/3132999329 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa28400cbb0 con 0x7fa2900cf190 2023-05-17T12:26:19.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.623+0000 7fa28cff9700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27c06ace0 0x7fa27c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:19.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.623+0000 7fa28cff9700 1 -- 172.21.15.88:0/3132999329 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa284089830 con 0x7fa2900cf190 2023-05-17T12:26:19.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.623+0000 7fa28ffff700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27c06ace0 0x7fa27c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:19.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.624+0000 7fa28ffff700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27c06ace0 0x7fa27c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa280007fd0 tx=0x7fa280009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:19.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.627+0000 7fa28cff9700 1 -- 172.21.15.88:0/3132999329 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa284057fa0 con 0x7fa2900cf190 2023-05-17T12:26:19.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.822+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa2900b7040 con 0x7fa2900cf190 2023-05-17T12:26:19.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.822+0000 7fa28cff9700 1 -- 172.21.15.88:0/3132999329 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa2900b7040 con 0x7fa2900cf190 2023-05-17T12:26:19.825 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:19.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.824+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27c06ace0 msgr2=0x7fa27c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.824+0000 7fa2967ff700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27c06ace0 0x7fa27c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa280007fd0 tx=0x7fa280009040 comp rx=0 tx=0).stop 2023-05-17T12:26:19.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.824+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 msgr2=0x7fa290154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:19.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.824+0000 7fa2967ff700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa290154b00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa28400e9e0 tx=0x7fa28400ecf0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.825+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 shutdown_connections 2023-05-17T12:26:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.825+0000 7fa2967ff700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27c06ace0 0x7fa27c06d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.825+0000 7fa2967ff700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290155040 0x7fa2900c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.825+0000 7fa2967ff700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa2900cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.825+0000 7fa2967ff700 1 --2- 172.21.15.88:0/3132999329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa290154b00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.825+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 >> 172.21.15.88:0/3132999329 conn(0x7fa2900d06f0 msgr2=0x7fa2900d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.825+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 shutdown_connections 2023-05-17T12:26:19.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:19.825+0000 7fa2967ff700 1 -- 172.21.15.88:0/3132999329 wait complete. 2023-05-17T12:26:19.845 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:20.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.031+0000 7f16e0dff700 1 Processor -- start 2023-05-17T12:26:20.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.031+0000 7f16e0dff700 1 -- start start 2023-05-17T12:26:20.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.032+0000 7f16e0dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc06af60 0x7f16dc160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.032+0000 7f16e0dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc06a510 con 0x7f16dc06c760 2023-05-17T12:26:20.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.032+0000 7f16e0dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0cf8a0 con 0x7f16dc0b23a0 2023-05-17T12:26:20.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.032+0000 7f16e0dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0cd840 con 0x7f16dc06af60 2023-05-17T12:26:20.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.032+0000 7f16da59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f16dc06c760 0x7f16dc06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59634/0 (socket says 172.21.15.88:59634) 2023-05-17T12:26:20.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.032+0000 7f16da59c700 1 -- 172.21.15.88:0/2883178089 learned_addr learned my addr 172.21.15.88:0/2883178089 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:20.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.032+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7011370 0 0) 0x7f16dc06a510 con 0x7f16dc06c760 2023-05-17T12:26:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16dad9d700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc06af60 0x7f16dc160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c80035b0 con 0x7f16dc06c760 2023-05-17T12:26:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135120586 0 0) 0x7f16c80035b0 con 0x7f16dc06c760 2023-05-17T12:26:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc06af60 msgr2=0x7f16dc160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc06af60 0x7f16dc160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 >> v1:172.21.15.187:6789/0 conn(0x7f16dc0b23a0 legacy=0x7f16dc0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0cdb20 con 0x7f16dc06c760 2023-05-17T12:26:20.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f16cc001670 con 0x7f16dc06c760 2023-05-17T12:26:20.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 >> v1:172.21.15.88:6789/0 conn(0x7f16dc06c760 legacy=0x7f16dc06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16c8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc06af60 0x7f16c8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16c8004d90 0x7f16c8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0cd840 con 0x7f16c8003a30 2023-05-17T12:26:20.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800bac0 con 0x7f16c8004d90 2023-05-17T12:26:20.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800bc50 con 0x7f16dc06af60 2023-05-17T12:26:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16da59c700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16c8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16dad9d700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16c8004d90 0x7f16c8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.033+0000 7f16d3fff700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc06af60 0x7f16c8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.034+0000 7f16da59c700 1 -- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc06af60 msgr2=0x7f16c8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.034+0000 7f16da59c700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc06af60 0x7f16c8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.034+0000 7f16da59c700 1 -- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16c8004d90 msgr2=0x7f16c8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.034+0000 7f16da59c700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16c8004d90 0x7f16c8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.034+0000 7f16da59c700 1 -- 172.21.15.88:0/2883178089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80035b0 con 0x7f16c8003a30 2023-05-17T12:26:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.034+0000 7f16da59c700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16c8003e40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c240 tx=0x7f16c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b372d6c3a331b70 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.034+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc007c10 con 0x7f16c8003a30 2023-05-17T12:26:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.034+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc00ce00 con 0x7f16c8003a30 2023-05-17T12:26:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.034+0000 7f16d9d9b700 1 -- 172.21.15.88:0/2883178089 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc005ba0 con 0x7f16c8003a30 2023-05-17T12:26:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.035+0000 7f16e0dff700 1 -- 172.21.15.88:0/2883178089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 msgr2=0x7f16c8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.035+0000 7f16e0dff700 1 --2- 172.21.15.88:0/2883178089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16c8003e40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c240 tx=0x7f16c8005880 comp rx=0 tx=0).stop 2023-05-17T12:26:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.035+0000 7f16dad9d700 1 -- 172.21.15.88:0/2883178089 reap_dead start 2023-05-17T12:26:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.035+0000 7f16e0dff700 1 -- 172.21.15.88:0/2883178089 shutdown_connections 2023-05-17T12:26:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.035+0000 7f16e0dff700 1 -- 172.21.15.88:0/2883178089 >> 172.21.15.88:0/2883178089 conn(0x7f16dc0d06f0 msgr2=0x7f16dc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.035+0000 7f16e0dff700 1 -- 172.21.15.88:0/2883178089 shutdown_connections 2023-05-17T12:26:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.035+0000 7f16e0dff700 1 -- 172.21.15.88:0/2883178089 wait complete. 2023-05-17T12:26:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.037+0000 7f16e0dff700 1 Processor -- start 2023-05-17T12:26:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.037+0000 7f16e0dff700 1 -- start start 2023-05-17T12:26:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16e0dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16dc0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16e0dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16dc1f6720 0x7f16dc0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16e0dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc1f6b90 0x7f16dc0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16e0dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0cbc00 con 0x7f16c8003a30 2023-05-17T12:26:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16e0dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc1f29e0 con 0x7f16dc1f6720 2023-05-17T12:26:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16e0dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc1f2ca0 con 0x7f16dc1f6b90 2023-05-17T12:26:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16da59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16dc0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16da59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16dc0cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55678/0 (socket says 172.21.15.88:55678) 2023-05-17T12:26:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16da59c700 1 -- 172.21.15.88:0/657195879 learned_addr learned my addr 172.21.15.88:0/657195879 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16d3fff700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16dc1f6720 0x7f16dc0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16dad9d700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc1f6b90 0x7f16dc0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16da59c700 1 -- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc1f6b90 msgr2=0x7f16dc0c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16da59c700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc1f6b90 0x7f16dc0c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16da59c700 1 -- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16dc1f6720 msgr2=0x7f16dc0c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16da59c700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16dc1f6720 0x7f16dc0c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.038+0000 7f16da59c700 1 -- 172.21.15.88:0/657195879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc06aa40 con 0x7f16c8003a30 2023-05-17T12:26:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.039+0000 7f16da59c700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16dc0cb6c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c830 tx=0x7f16cc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.039+0000 7f16d2ffd700 1 -- 172.21.15.88:0/657195879 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc001630 con 0x7f16c8003a30 2023-05-17T12:26:20.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.039+0000 7f16d2ffd700 1 -- 172.21.15.88:0/657195879 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc0070d0 con 0x7f16c8003a30 2023-05-17T12:26:20.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.039+0000 7f16d2ffd700 1 -- 172.21.15.88:0/657195879 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc007440 con 0x7f16c8003a30 2023-05-17T12:26:20.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.039+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc06a760 con 0x7f16c8003a30 2023-05-17T12:26:20.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.039+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc06b3c0 con 0x7f16c8003a30 2023-05-17T12:26:20.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.040+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc141fb0 con 0x7f16c8003a30 2023-05-17T12:26:20.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.041+0000 7f16d2ffd700 1 -- 172.21.15.88:0/657195879 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16cc019030 con 0x7f16c8003a30 2023-05-17T12:26:20.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.042+0000 7f16d2ffd700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16bc06ad10 0x7f16bc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.042+0000 7f16d2ffd700 1 -- 172.21.15.88:0/657195879 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f16cc08a9e0 con 0x7f16c8003a30 2023-05-17T12:26:20.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.042+0000 7f16d3fff700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16bc06ad10 0x7f16bc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.043+0000 7f16d3fff700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16bc06ad10 0x7f16bc06d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f16dc1f7040 tx=0x7f16c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:20.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.046+0000 7f16d2ffd700 1 -- 172.21.15.88:0/657195879 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f16dc141fb0 con 0x7f16c8003a30 2023-05-17T12:26:20.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.238+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16dc141fb0 con 0x7f16c8003a30 2023-05-17T12:26:20.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.239+0000 7f16d2ffd700 1 -- 172.21.15.88:0/657195879 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16dc141fb0 con 0x7f16c8003a30 2023-05-17T12:26:20.242 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:20.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16bc06ad10 msgr2=0x7f16bc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16bc06ad10 0x7f16bc06d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f16dc1f7040 tx=0x7f16c4009040 comp rx=0 tx=0).stop 2023-05-17T12:26:20.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 msgr2=0x7f16dc0cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16dc0cb6c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c830 tx=0x7f16cc001a00 comp rx=0 tx=0).stop 2023-05-17T12:26:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 shutdown_connections 2023-05-17T12:26:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f16bc06ad10 0x7f16bc06d1c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16dc1f6b90 0x7f16dc0c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c8003a30 0x7f16dc0cb6c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 --2- 172.21.15.88:0/657195879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16dc1f6720 0x7f16dc0c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 >> 172.21.15.88:0/657195879 conn(0x7f16dc0d06f0 msgr2=0x7f16dc06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:20.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 shutdown_connections 2023-05-17T12:26:20.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.241+0000 7f16e0dff700 1 -- 172.21.15.88:0/657195879 wait complete. 2023-05-17T12:26:20.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.445+0000 7f75abdff700 1 Processor -- start 2023-05-17T12:26:20.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.446+0000 7f75abdff700 1 -- start start 2023-05-17T12:26:20.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.447+0000 7f75abdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a415c9c0 0x7f75a40b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.447+0000 7f75abdff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f75a4160e80 0x7f75a40cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.447+0000 7f75abdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a40b39d0 con 0x7f75a40ceb80 2023-05-17T12:26:20.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.447+0000 7f75abdff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a415cd90 con 0x7f75a4160e80 2023-05-17T12:26:20.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.447+0000 7f75abdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a40b37c0 con 0x7f75a415c9c0 2023-05-17T12:26:20.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.447+0000 7f75a9b9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a415c9c0 0x7f75a40b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.447+0000 7f75a939a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f75a4160e80 0x7f75a40cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.447+0000 7f75aa39c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f75a40ceb80 0x7f75a406cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:43300/0 (socket says 172.21.15.88:43300) 2023-05-17T12:26:20.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.447+0000 7f75aa39c700 1 -- 172.21.15.88:0/2160689525 learned_addr learned my addr 172.21.15.88:0/2160689525 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:20.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.448+0000 7f75a8b99700 1 -- 172.21.15.88:0/2160689525 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236800925 0 0) 0x7f75a40b39d0 con 0x7f75a40ceb80 2023-05-17T12:26:20.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.448+0000 7f75a8b99700 1 -- 172.21.15.88:0/2160689525 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75900035b0 con 0x7f75a40ceb80 2023-05-17T12:26:20.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.448+0000 7f75a9b9b700 1 -- 172.21.15.88:0/2160689525 >> v2:172.21.15.187:3300/0 conn(0x7f75a4160e80 msgr2=0x7f75a40cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:20.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.448+0000 7f75a9b9b700 1 --2- 172.21.15.88:0/2160689525 >> v2:172.21.15.187:3300/0 conn(0x7f75a4160e80 0x7f75a40cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.448+0000 7f75a9b9b700 1 -- 172.21.15.88:0/2160689525 >> v1:172.21.15.187:6789/0 conn(0x7f75a40ceb80 legacy=0x7f75a406cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.448+0000 7f75a9b9b700 1 -- 172.21.15.88:0/2160689525 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a406c1f0 con 0x7f75a415c9c0 2023-05-17T12:26:20.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.448+0000 7f75a9b9b700 1 --2- 172.21.15.88:0/2160689525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a415c9c0 0x7f75a40b3280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009840 tx=0x7f75a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f77fd51174ff5b91 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:20.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75a8b99700 1 -- 172.21.15.88:0/2160689525 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0011830 con 0x7f75a415c9c0 2023-05-17T12:26:20.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75a8b99700 1 -- 172.21.15.88:0/2160689525 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a0011990 con 0x7f75a415c9c0 2023-05-17T12:26:20.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75a8b99700 1 -- 172.21.15.88:0/2160689525 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0011d20 con 0x7f75a415c9c0 2023-05-17T12:26:20.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75abdff700 1 -- 172.21.15.88:0/2160689525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a415c9c0 msgr2=0x7f75a40b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75abdff700 1 --2- 172.21.15.88:0/2160689525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a415c9c0 0x7f75a40b3280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009840 tx=0x7f75a0009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:20.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75abdff700 1 -- 172.21.15.88:0/2160689525 shutdown_connections 2023-05-17T12:26:20.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75abdff700 1 --2- 172.21.15.88:0/2160689525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a415c9c0 0x7f75a40b3280 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75abdff700 1 --2- 172.21.15.88:0/2160689525 >> v2:172.21.15.187:3300/0 conn(0x7f75a4160e80 0x7f75a40cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75abdff700 1 -- 172.21.15.88:0/2160689525 >> 172.21.15.88:0/2160689525 conn(0x7f75a40d1c40 msgr2=0x7f75a40b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:20.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.449+0000 7f75abdff700 1 -- 172.21.15.88:0/2160689525 shutdown_connections 2023-05-17T12:26:20.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.450+0000 7f75abdff700 1 -- 172.21.15.88:0/2160689525 wait complete. 2023-05-17T12:26:20.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.451+0000 7f75abdff700 1 Processor -- start 2023-05-17T12:26:20.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.451+0000 7f75abdff700 1 -- start start 2023-05-17T12:26:20.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.452+0000 7f75abdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75a40ceb80 0x7f75a41f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.452+0000 7f75abdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75a415c9c0 0x7f75a414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.452+0000 7f75abdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a4160e80 0x7f75a40b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.452+0000 7f75abdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4158610 con 0x7f75a415c9c0 2023-05-17T12:26:20.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.452+0000 7f75abdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a415cee0 con 0x7f75a40ceb80 2023-05-17T12:26:20.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.452+0000 7f75abdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a41f5f50 con 0x7f75a4160e80 2023-05-17T12:26:20.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.452+0000 7f75a939a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75a415c9c0 0x7f75a414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75a939a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75a415c9c0 0x7f75a414f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55682/0 (socket says 172.21.15.88:55682) 2023-05-17T12:26:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75a939a700 1 -- 172.21.15.88:0/263246694 learned_addr learned my addr 172.21.15.88:0/263246694 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75a9b9b700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75a40ceb80 0x7f75a41f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75aa39c700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a4160e80 0x7f75a40b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75a939a700 1 -- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a4160e80 msgr2=0x7f75a40b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75a939a700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a4160e80 0x7f75a40b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75a939a700 1 -- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75a40ceb80 msgr2=0x7f75a41f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75a939a700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75a40ceb80 0x7f75a41f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75a939a700 1 -- 172.21.15.88:0/263246694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00094a0 con 0x7f75a415c9c0 2023-05-17T12:26:20.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75aa39c700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a4160e80 0x7f75a40b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:20.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75a939a700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75a415c9c0 0x7f75a414f4a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f759400e9b0 tx=0x7f759400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:20.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f759a7fc700 1 -- 172.21.15.88:0/263246694 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594009710 con 0x7f75a415c9c0 2023-05-17T12:26:20.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f759a7fc700 1 -- 172.21.15.88:0/263246694 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759400c850 con 0x7f75a415c9c0 2023-05-17T12:26:20.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f759a7fc700 1 -- 172.21.15.88:0/263246694 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400cbc0 con 0x7f75a415c9c0 2023-05-17T12:26:20.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.453+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a406c7b0 con 0x7f75a415c9c0 2023-05-17T12:26:20.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.454+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a406c4d0 con 0x7f75a415c9c0 2023-05-17T12:26:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.455+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a406ca90 con 0x7f75a415c9c0 2023-05-17T12:26:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.455+0000 7f759a7fc700 1 -- 172.21.15.88:0/263246694 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f759400cd20 con 0x7f75a415c9c0 2023-05-17T12:26:20.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.456+0000 7f759a7fc700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f758806ace0 0x7f758806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.456+0000 7f759a7fc700 1 -- 172.21.15.88:0/263246694 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f75940899f0 con 0x7f75a415c9c0 2023-05-17T12:26:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.457+0000 7f75a9b9b700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f758806ace0 0x7f758806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.458+0000 7f75a9b9b700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f758806ace0 0x7f758806d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000c00 tx=0x7f75a001c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:20.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.461+0000 7f759a7fc700 1 -- 172.21.15.88:0/263246694 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f75940580d0 con 0x7f75a415c9c0 2023-05-17T12:26:20.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.655+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75a4074530 con 0x7f75a415c9c0 2023-05-17T12:26:20.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.655+0000 7f759a7fc700 1 -- 172.21.15.88:0/263246694 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75940170a0 con 0x7f75a415c9c0 2023-05-17T12:26:20.658 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:20.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f758806ace0 msgr2=0x7f758806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f758806ace0 0x7f758806d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75a0000c00 tx=0x7f75a001c040 comp rx=0 tx=0).stop 2023-05-17T12:26:20.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75a415c9c0 msgr2=0x7f75a414f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75a415c9c0 0x7f75a414f4a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f759400e9b0 tx=0x7f759400ed70 comp rx=0 tx=0).stop 2023-05-17T12:26:20.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 shutdown_connections 2023-05-17T12:26:20.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f758806ace0 0x7f758806d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75a4160e80 0x7f75a40b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75a40ceb80 0x7f75a41f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 --2- 172.21.15.88:0/263246694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75a415c9c0 0x7f75a414f4a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.657+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 >> 172.21.15.88:0/263246694 conn(0x7f75a40d1c40 msgr2=0x7f75a40cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:20.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.658+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 shutdown_connections 2023-05-17T12:26:20.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.658+0000 7f75abdff700 1 -- 172.21.15.88:0/263246694 wait complete. 2023-05-17T12:26:20.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.861+0000 7f3f74dff700 1 Processor -- start 2023-05-17T12:26:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.861+0000 7f3f74dff700 1 -- start start 2023-05-17T12:26:20.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.862+0000 7f3f74dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f700b89e0 0x7f3f700cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.862+0000 7f3f74dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f70160d10 0x7f3f7006c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.862+0000 7f3f74dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7006cb70 con 0x7f3f7006c720 2023-05-17T12:26:20.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.862+0000 7f3f74dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f700b28d0 con 0x7f3f700b89e0 2023-05-17T12:26:20.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.862+0000 7f3f74dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700d0c30 con 0x7f3f70160d10 2023-05-17T12:26:20.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f700b89e0 0x7f3f700cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f700b89e0 0x7f3f700cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55690/0 (socket says 172.21.15.88:55690) 2023-05-17T12:26:20.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6e59c700 1 -- 172.21.15.88:0/1970891377 learned_addr learned my addr 172.21.15.88:0/1970891377 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6e59c700 1 -- 172.21.15.88:0/1970891377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f70160d10 msgr2=0x7f3f7006c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6dd9b700 1 --2- 172.21.15.88:0/1970891377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f70160d10 0x7f3f7006c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6e59c700 1 --2- 172.21.15.88:0/1970891377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f70160d10 0x7f3f7006c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6e59c700 1 -- 172.21.15.88:0/1970891377 >> v1:172.21.15.88:6789/0 conn(0x7f3f7006c720 legacy=0x7f3f7006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6e59c700 1 -- 172.21.15.88:0/1970891377 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70161180 con 0x7f3f700b89e0 2023-05-17T12:26:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6dd9b700 1 --2- 172.21.15.88:0/1970891377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f70160d10 0x7f3f7006c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.863+0000 7f3f6e59c700 1 --2- 172.21.15.88:0/1970891377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f700b89e0 0x7f3f700cf320 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3f600098f0 tx=0x7f3f60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fa542bf171100 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:20.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f6d59a700 1 -- 172.21.15.88:0/1970891377 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6000b8a0 con 0x7f3f700b89e0 2023-05-17T12:26:20.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f6d59a700 1 -- 172.21.15.88:0/1970891377 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6000ba00 con 0x7f3f700b89e0 2023-05-17T12:26:20.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f6d59a700 1 -- 172.21.15.88:0/1970891377 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6000bd90 con 0x7f3f700b89e0 2023-05-17T12:26:20.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f74dff700 1 -- 172.21.15.88:0/1970891377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f700b89e0 msgr2=0x7f3f700cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f74dff700 1 --2- 172.21.15.88:0/1970891377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f700b89e0 0x7f3f700cf320 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3f600098f0 tx=0x7f3f60009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:20.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f74dff700 1 -- 172.21.15.88:0/1970891377 shutdown_connections 2023-05-17T12:26:20.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f74dff700 1 --2- 172.21.15.88:0/1970891377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f700b89e0 0x7f3f700cf320 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f74dff700 1 --2- 172.21.15.88:0/1970891377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f70160d10 0x7f3f7006c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f74dff700 1 -- 172.21.15.88:0/1970891377 >> 172.21.15.88:0/1970891377 conn(0x7f3f700d05c0 msgr2=0x7f3f700d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:20.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f74dff700 1 -- 172.21.15.88:0/1970891377 shutdown_connections 2023-05-17T12:26:20.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.864+0000 7f3f74dff700 1 -- 172.21.15.88:0/1970891377 wait complete. 2023-05-17T12:26:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.866+0000 7f3f74dff700 1 Processor -- start 2023-05-17T12:26:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.866+0000 7f3f74dff700 1 -- start start 2023-05-17T12:26:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f74dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f7006c720 0x7f3f70150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f74dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f700b89e0 0x7f3f700c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f74dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f70160d10 0x7f3f700d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f74dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f701e6100 con 0x7f3f70160d10 2023-05-17T12:26:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f74dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f701e62e0 con 0x7f3f700b89e0 2023-05-17T12:26:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f74dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f701e65c0 con 0x7f3f7006c720 2023-05-17T12:26:20.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f6ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f70160d10 0x7f3f700d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f6ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f70160d10 0x7f3f700d22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55706/0 (socket says 172.21.15.88:55706) 2023-05-17T12:26:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f6ed9d700 1 -- 172.21.15.88:0/753816568 learned_addr learned my addr 172.21.15.88:0/753816568 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f6e59c700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f7006c720 0x7f3f70150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.867+0000 7f3f6dd9b700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f700b89e0 0x7f3f700c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f6ed9d700 1 -- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f7006c720 msgr2=0x7f3f70150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f6ed9d700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f7006c720 0x7f3f70150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f6ed9d700 1 -- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f700b89e0 msgr2=0x7f3f700c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:20.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f6ed9d700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f700b89e0 0x7f3f700c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:20.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f6ed9d700 1 -- 172.21.15.88:0/753816568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f60009550 con 0x7f3f70160d10 2023-05-17T12:26:20.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f6dd9b700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f700b89e0 0x7f3f700c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:20.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f6ed9d700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f70160d10 0x7f3f700d22f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800cc50 tx=0x7f3f6800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:20.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f5effd700 1 -- 172.21.15.88:0/753816568 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68003c00 con 0x7f3f70160d10 2023-05-17T12:26:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f5effd700 1 -- 172.21.15.88:0/753816568 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68003d60 con 0x7f3f70160d10 2023-05-17T12:26:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f700cda30 con 0x7f3f70160d10 2023-05-17T12:26:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f5effd700 1 -- 172.21.15.88:0/753816568 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800ab60 con 0x7f3f70160d10 2023-05-17T12:26:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.868+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f700cd750 con 0x7f3f70160d10 2023-05-17T12:26:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.869+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f700cdd10 con 0x7f3f70160d10 2023-05-17T12:26:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.870+0000 7f3f5effd700 1 -- 172.21.15.88:0/753816568 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f6800acc0 con 0x7f3f70160d10 2023-05-17T12:26:20.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.871+0000 7f3f5effd700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f5006ace0 0x7f3f5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:20.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.871+0000 7f3f5effd700 1 -- 172.21.15.88:0/753816568 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3f68089700 con 0x7f3f70160d10 2023-05-17T12:26:20.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.872+0000 7f3f6e59c700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f5006ace0 0x7f3f5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:20.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.872+0000 7f3f6e59c700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f5006ace0 0x7f3f5006d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009c40 tx=0x7f3f60008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:20.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:20.876+0000 7f3f5effd700 1 -- 172.21.15.88:0/753816568 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3f680543e0 con 0x7f3f70160d10 2023-05-17T12:26:21.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.070+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3f7006cb70 con 0x7f3f70160d10 2023-05-17T12:26:21.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.071+0000 7f3f5effd700 1 -- 172.21.15.88:0/753816568 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3f7006cb70 con 0x7f3f70160d10 2023-05-17T12:26:21.074 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:21.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f5006ace0 msgr2=0x7f3f5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f5006ace0 0x7f3f5006d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009c40 tx=0x7f3f60008030 comp rx=0 tx=0).stop 2023-05-17T12:26:21.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f70160d10 msgr2=0x7f3f700d22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f70160d10 0x7f3f700d22f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800cc50 tx=0x7f3f6800cf60 comp rx=0 tx=0).stop 2023-05-17T12:26:21.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 shutdown_connections 2023-05-17T12:26:21.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f5006ace0 0x7f3f5006d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f70160d10 0x7f3f700d22f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f7006c720 0x7f3f70150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 --2- 172.21.15.88:0/753816568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f700b89e0 0x7f3f700c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 >> 172.21.15.88:0/753816568 conn(0x7f3f700d05c0 msgr2=0x7f3f7006ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 shutdown_connections 2023-05-17T12:26:21.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.073+0000 7f3f74dff700 1 -- 172.21.15.88:0/753816568 wait complete. 2023-05-17T12:26:21.093 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:26:21.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.276+0000 7f1aba1ff700 1 Processor -- start 2023-05-17T12:26:21.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.276+0000 7f1aba1ff700 1 -- start start 2023-05-17T12:26:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.277+0000 7f1aba1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ab415ca90 0x7f1ab40cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.277+0000 7f1aba1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab4161410 con 0x7f1ab4160f90 2023-05-17T12:26:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.277+0000 7f1aba1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40cde90 con 0x7f1ab406cc20 2023-05-17T12:26:21.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.277+0000 7f1aba1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab415d270 con 0x7f1ab415ca90 2023-05-17T12:26:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.278+0000 7f1ab37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ab415ca90 0x7f1ab40cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.278+0000 7f1ab37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ab415ca90 0x7f1ab40cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54308/0 (socket says 172.21.15.88:54308) 2023-05-17T12:26:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.278+0000 7f1ab37fe700 1 -- 172.21.15.88:0/2119824863 learned_addr learned my addr 172.21.15.88:0/2119824863 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.278+0000 7f1ab37fe700 1 -- 172.21.15.88:0/2119824863 >> v1:172.21.15.187:6789/0 conn(0x7f1ab406cc20 legacy=0x7f1ab40d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.278+0000 7f1ab37fe700 1 -- 172.21.15.88:0/2119824863 >> v1:172.21.15.88:6789/0 conn(0x7f1ab4160f90 legacy=0x7f1ab406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.278+0000 7f1ab37fe700 1 -- 172.21.15.88:0/2119824863 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab415d550 con 0x7f1ab415ca90 2023-05-17T12:26:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.278+0000 7f1ab37fe700 1 --2- 172.21.15.88:0/2119824863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab415ca90 0x7f1ab40cd800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40098f0 tx=0x7f1aa4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be43b4ff2533e0b6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1ab27fc700 1 -- 172.21.15.88:0/2119824863 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400b8a0 con 0x7f1ab415ca90 2023-05-17T12:26:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1ab27fc700 1 -- 172.21.15.88:0/2119824863 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa400ba00 con 0x7f1ab415ca90 2023-05-17T12:26:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1ab27fc700 1 -- 172.21.15.88:0/2119824863 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400bd90 con 0x7f1ab415ca90 2023-05-17T12:26:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2119824863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab415ca90 msgr2=0x7f1ab40cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1aba1ff700 1 --2- 172.21.15.88:0/2119824863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab415ca90 0x7f1ab40cd800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40098f0 tx=0x7f1aa4009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2119824863 shutdown_connections 2023-05-17T12:26:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1aba1ff700 1 --2- 172.21.15.88:0/2119824863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab415ca90 0x7f1ab40cd800 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2119824863 >> 172.21.15.88:0/2119824863 conn(0x7f1ab40d3ed0 msgr2=0x7f1ab40cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2119824863 shutdown_connections 2023-05-17T12:26:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.279+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2119824863 wait complete. 2023-05-17T12:26:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.282+0000 7f1aba1ff700 1 Processor -- start 2023-05-17T12:26:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.282+0000 7f1aba1ff700 1 -- start start 2023-05-17T12:26:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1aba1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ab406cc20 0x7f1ab41e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1aba1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ab415ca90 0x7f1ab41f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1aba1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab4160f90 0x7f1ab41f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1aba1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab414dbf0 con 0x7f1ab4160f90 2023-05-17T12:26:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1aba1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab415c340 con 0x7f1ab406cc20 2023-05-17T12:26:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1aba1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40b8b90 con 0x7f1ab415ca90 2023-05-17T12:26:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1ab3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab4160f90 0x7f1ab41f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1ab3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab4160f90 0x7f1ab41f65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54324/0 (socket says 172.21.15.88:54324) 2023-05-17T12:26:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1ab3fff700 1 -- 172.21.15.88:0/2823769025 learned_addr learned my addr 172.21.15.88:0/2823769025 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.283+0000 7f1ab37fe700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ab406cc20 0x7f1ab41e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1ab2ffd700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ab415ca90 0x7f1ab41f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1ab3fff700 1 -- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ab415ca90 msgr2=0x7f1ab41f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1ab3fff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ab415ca90 0x7f1ab41f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1ab3fff700 1 -- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ab406cc20 msgr2=0x7f1ab41e8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1ab3fff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ab406cc20 0x7f1ab41e8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1ab3fff700 1 -- 172.21.15.88:0/2823769025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4009550 con 0x7f1ab4160f90 2023-05-17T12:26:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1ab3fff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab4160f90 0x7f1ab41f65a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00cc50 tx=0x7f1aac00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1a9bfff700 1 -- 172.21.15.88:0/2823769025 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac003c00 con 0x7f1ab4160f90 2023-05-17T12:26:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1a9bfff700 1 -- 172.21.15.88:0/2823769025 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac003d60 con 0x7f1ab4160f90 2023-05-17T12:26:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab415dd50 con 0x7f1ab4160f90 2023-05-17T12:26:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.284+0000 7f1a9bfff700 1 -- 172.21.15.88:0/2823769025 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00aab0 con 0x7f1ab4160f90 2023-05-17T12:26:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.285+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab415d830 con 0x7f1ab4160f90 2023-05-17T12:26:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.286+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab415ce60 con 0x7f1ab4160f90 2023-05-17T12:26:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.287+0000 7f1a9bfff700 1 -- 172.21.15.88:0/2823769025 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1aac00ac10 con 0x7f1ab4160f90 2023-05-17T12:26:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.287+0000 7f1a9bfff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1aa006ace0 0x7f1aa006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.287+0000 7f1a9bfff700 1 -- 172.21.15.88:0/2823769025 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1aac089760 con 0x7f1ab4160f90 2023-05-17T12:26:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.288+0000 7f1ab37fe700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1aa006ace0 0x7f1aa006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.288+0000 7f1ab37fe700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1aa006ace0 0x7f1aa006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009c40 tx=0x7f1aa4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.292+0000 7f1a9bfff700 1 -- 172.21.15.88:0/2823769025 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1aac0544d0 con 0x7f1ab4160f90 2023-05-17T12:26:21.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.504+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1ab40cb260 con 0x7f1ab4160f90 2023-05-17T12:26:21.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.504+0000 7f1a9bfff700 1 -- 172.21.15.88:0/2823769025 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1ab40cb260 con 0x7f1ab4160f90 2023-05-17T12:26:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1aa006ace0 msgr2=0x7f1aa006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1aa006ace0 0x7f1aa006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009c40 tx=0x7f1aa4008030 comp rx=0 tx=0).stop 2023-05-17T12:26:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab4160f90 msgr2=0x7f1ab41f65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab4160f90 0x7f1ab41f65a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00cc50 tx=0x7f1aac00cf60 comp rx=0 tx=0).stop 2023-05-17T12:26:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 shutdown_connections 2023-05-17T12:26:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1aa006ace0 0x7f1aa006d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ab4160f90 0x7f1ab41f65a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ab406cc20 0x7f1ab41e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 --2- 172.21.15.88:0/2823769025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ab415ca90 0x7f1ab41f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 >> 172.21.15.88:0/2823769025 conn(0x7f1ab40d3ed0 msgr2=0x7f1ab415fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 shutdown_connections 2023-05-17T12:26:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.507+0000 7f1aba1ff700 1 -- 172.21.15.88:0/2823769025 wait complete. 2023-05-17T12:26:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:26:21.527 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:26:21.527 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:21.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.756+0000 7fc8e1fff700 1 Processor -- start 2023-05-17T12:26:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.757+0000 7fc8e1fff700 1 -- start start 2023-05-17T12:26:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8e1fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06b0b0 0x7fc8dc06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8e1fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc8dc06c330 0x7fc8dc06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8e1fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0cd6b0 con 0x7fc8dc15c840 2023-05-17T12:26:21.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8e1fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc0cdf50 con 0x7fc8dc06c330 2023-05-17T12:26:21.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8e1fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc06ccf0 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8d3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06b0b0 0x7fc8dc06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8dbfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc8dc06c330 0x7fc8dc06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8d3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06b0b0 0x7fc8dc06b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:53664/0 (socket says 172.21.15.88:53664) 2023-05-17T12:26:21.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8d3fff700 1 -- 172.21.15.88:0/3821754683 learned_addr learned my addr 172.21.15.88:0/3821754683 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:21.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.758+0000 7fc8db7fe700 1 --1- 172.21.15.88:0/3821754683 >> v1:172.21.15.187:6789/0 conn(0x7fc8dc15c840 0x7fc8dc0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:59406/0 (socket says 172.21.15.88:59406) 2023-05-17T12:26:21.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.759+0000 7fc8dbfff700 1 -- 172.21.15.88:0/3821754683 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06b0b0 msgr2=0x7fc8dc06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:21.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.759+0000 7fc8dbfff700 1 --2- 172.21.15.88:0/3821754683 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06b0b0 0x7fc8dc06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.759+0000 7fc8dbfff700 1 -- 172.21.15.88:0/3821754683 >> v1:172.21.15.187:6789/0 conn(0x7fc8dc15c840 legacy=0x7fc8dc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.759+0000 7fc8dbfff700 1 -- 172.21.15.88:0/3821754683 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0b2460 con 0x7fc8dc06c330 2023-05-17T12:26:21.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.759+0000 7fc8daffd700 1 -- 172.21.15.88:0/3821754683 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342117818 0 0) 0x7fc8dc0cd6b0 con 0x7fc8dc15c840 2023-05-17T12:26:21.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.759+0000 7fc8dbfff700 1 --2- 172.21.15.88:0/3821754683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8dc06c330 0x7fc8dc06c7b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009d90 tx=0x7fc8d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6abc5c05bd8b1fd1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:21.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.759+0000 7fc8daffd700 1 -- 172.21.15.88:0/3821754683 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400e070 con 0x7fc8dc06c330 2023-05-17T12:26:21.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8daffd700 1 -- 172.21.15.88:0/3821754683 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d400bb20 con 0x7fc8dc06c330 2023-05-17T12:26:21.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8daffd700 1 -- 172.21.15.88:0/3821754683 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4012430 con 0x7fc8dc06c330 2023-05-17T12:26:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8e1fff700 1 -- 172.21.15.88:0/3821754683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8dc06c330 msgr2=0x7fc8dc06c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8e1fff700 1 --2- 172.21.15.88:0/3821754683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8dc06c330 0x7fc8dc06c7b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009d90 tx=0x7fc8d400b330 comp rx=0 tx=0).stop 2023-05-17T12:26:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8e1fff700 1 -- 172.21.15.88:0/3821754683 shutdown_connections 2023-05-17T12:26:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8e1fff700 1 --2- 172.21.15.88:0/3821754683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8dc06c330 0x7fc8dc06c7b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8e1fff700 1 --2- 172.21.15.88:0/3821754683 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06b0b0 0x7fc8dc06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8e1fff700 1 -- 172.21.15.88:0/3821754683 >> 172.21.15.88:0/3821754683 conn(0x7fc8dc0d3060 msgr2=0x7fc8dc0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:21.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8e1fff700 1 -- 172.21.15.88:0/3821754683 shutdown_connections 2023-05-17T12:26:21.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.760+0000 7fc8e1fff700 1 -- 172.21.15.88:0/3821754683 wait complete. 2023-05-17T12:26:21.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.762+0000 7fc8e1fff700 1 Processor -- start 2023-05-17T12:26:21.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.762+0000 7fc8e1fff700 1 -- start start 2023-05-17T12:26:21.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8e1fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8dc06b0b0 0x7fc8dc159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8e1fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06c330 0x7fc8dc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8e1fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8dc15c840 0x7fc8dc150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8e1fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc1590f0 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8e1fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc158570 con 0x7fc8dc15c840 2023-05-17T12:26:21.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8e1fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc158850 con 0x7fc8dc06c330 2023-05-17T12:26:21.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8db7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8dc06b0b0 0x7fc8dc159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8db7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8dc06b0b0 0x7fc8dc159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54336/0 (socket says 172.21.15.88:54336) 2023-05-17T12:26:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8db7fe700 1 -- 172.21.15.88:0/2720416449 learned_addr learned my addr 172.21.15.88:0/2720416449 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8d3fff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06c330 0x7fc8dc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.763+0000 7fc8dbfff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8dc15c840 0x7fc8dc150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8db7fe700 1 -- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06c330 msgr2=0x7fc8dc0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8db7fe700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06c330 0x7fc8dc0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8db7fe700 1 -- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8dc15c840 msgr2=0x7fc8dc150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8db7fe700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8dc15c840 0x7fc8dc150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8db7fe700 1 -- 172.21.15.88:0/2720416449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4009a70 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8db7fe700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8dc06b0b0 0x7fc8dc159fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c550 tx=0x7fc8cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8d8ff9700 1 -- 172.21.15.88:0/2720416449 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc004c80 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8d8ff9700 1 -- 172.21.15.88:0/2720416449 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc004e00 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8d8ff9700 1 -- 172.21.15.88:0/2720416449 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc007310 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc0cd900 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.764+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc0b2740 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.765+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc0cdbe0 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.766+0000 7fc8d8ff9700 1 -- 172.21.15.88:0/2720416449 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8cc007470 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.767+0000 7fc8d8ff9700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc8bc06ace0 0x7fc8bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:21.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.767+0000 7fc8d8ff9700 1 -- 172.21.15.88:0/2720416449 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc8cc089500 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.767+0000 7fc8d3fff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc8bc06ace0 0x7fc8bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:21.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.768+0000 7fc8d3fff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc8bc06ace0 0x7fc8bc06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0b5ad0 tx=0x7fc8c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:21.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.771+0000 7fc8d8ff9700 1 -- 172.21.15.88:0/2720416449 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc8cc054270 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.974+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8dc074530 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.976+0000 7fc8d8ff9700 1 -- 172.21.15.88:0/2720416449 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fc8cc057890 con 0x7fc8dc06b0b0 2023-05-17T12:26:21.979 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:21.979 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:21.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc8bc06ace0 msgr2=0x7fc8bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc8bc06ace0 0x7fc8bc06d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0b5ad0 tx=0x7fc8c4008040 comp rx=0 tx=0).stop 2023-05-17T12:26:21.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8dc06b0b0 msgr2=0x7fc8dc159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:21.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8dc06b0b0 0x7fc8dc159fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c550 tx=0x7fc8cc00c910 comp rx=0 tx=0).stop 2023-05-17T12:26:21.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 shutdown_connections 2023-05-17T12:26:21.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc8bc06ace0 0x7fc8bc06d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8dc15c840 0x7fc8dc150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8dc06b0b0 0x7fc8dc159fc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 --2- 172.21.15.88:0/2720416449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8dc06c330 0x7fc8dc0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:21.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 >> 172.21.15.88:0/2720416449 conn(0x7fc8dc0d3060 msgr2=0x7fc8dc0cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:21.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 shutdown_connections 2023-05-17T12:26:21.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:21.978+0000 7fc8e1fff700 1 -- 172.21.15.88:0/2720416449 wait complete. 2023-05-17T12:26:21.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:21.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.184+0000 7ff2609ff700 1 Processor -- start 2023-05-17T12:26:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.185+0000 7ff2609ff700 1 -- start start 2023-05-17T12:26:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff2609ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c1421a0 0x7ff25c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff2609ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff25c06ed80 0x7ff25c0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff2609ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff25c0c9f20 0x7ff25c0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff2609ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c06a510 con 0x7ff25c0c9f20 2023-05-17T12:26:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff2609ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c06a720 con 0x7ff25c06ed80 2023-05-17T12:26:22.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff2609ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c06aa00 con 0x7ff25c1421a0 2023-05-17T12:26:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff25ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff25c0c9f20 0x7ff25c0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff25ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff25c0c9f20 0x7ff25c0cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54342/0 (socket says 172.21.15.88:54342) 2023-05-17T12:26:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff25ad9d700 1 -- 172.21.15.88:0/568868136 learned_addr learned my addr 172.21.15.88:0/568868136 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff25a59c700 1 --2- 172.21.15.88:0/568868136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c1421a0 0x7ff25c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.186+0000 7ff253fff700 1 --2- 172.21.15.88:0/568868136 >> v2:172.21.15.187:3300/0 conn(0x7ff25c06ed80 0x7ff25c0c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff25ad9d700 1 -- 172.21.15.88:0/568868136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c1421a0 msgr2=0x7ff25c06e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff25ad9d700 1 --2- 172.21.15.88:0/568868136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c1421a0 0x7ff25c06e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff25ad9d700 1 -- 172.21.15.88:0/568868136 >> v2:172.21.15.187:3300/0 conn(0x7ff25c06ed80 msgr2=0x7ff25c0c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff25ad9d700 1 --2- 172.21.15.88:0/568868136 >> v2:172.21.15.187:3300/0 conn(0x7ff25c06ed80 0x7ff25c0c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff25ad9d700 1 -- 172.21.15.88:0/568868136 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c06ace0 con 0x7ff25c0c9f20 2023-05-17T12:26:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff253fff700 1 --2- 172.21.15.88:0/568868136 >> v2:172.21.15.187:3300/0 conn(0x7ff25c06ed80 0x7ff25c0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff25ad9d700 1 --2- 172.21.15.88:0/568868136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c0c9f20 0x7ff25c0cd270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff25c06c3f0 tx=0x7ff25400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87fbc0c322a9226 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:22.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff259d9b700 1 -- 172.21.15.88:0/568868136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25400e070 con 0x7ff25c0c9f20 2023-05-17T12:26:22.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff259d9b700 1 -- 172.21.15.88:0/568868136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25400b910 con 0x7ff25c0c9f20 2023-05-17T12:26:22.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.187+0000 7ff259d9b700 1 -- 172.21.15.88:0/568868136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25400bcc0 con 0x7ff25c0c9f20 2023-05-17T12:26:22.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.188+0000 7ff2609ff700 1 -- 172.21.15.88:0/568868136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c0c9f20 msgr2=0x7ff25c0cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.188+0000 7ff2609ff700 1 --2- 172.21.15.88:0/568868136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c0c9f20 0x7ff25c0cd270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff25c06c3f0 tx=0x7ff25400b330 comp rx=0 tx=0).stop 2023-05-17T12:26:22.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.188+0000 7ff2609ff700 1 -- 172.21.15.88:0/568868136 shutdown_connections 2023-05-17T12:26:22.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.188+0000 7ff2609ff700 1 --2- 172.21.15.88:0/568868136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c0c9f20 0x7ff25c0cd270 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.188+0000 7ff2609ff700 1 --2- 172.21.15.88:0/568868136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c1421a0 0x7ff25c06e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.188+0000 7ff2609ff700 1 --2- 172.21.15.88:0/568868136 >> v2:172.21.15.187:3300/0 conn(0x7ff25c06ed80 0x7ff25c0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.188+0000 7ff2609ff700 1 -- 172.21.15.88:0/568868136 >> 172.21.15.88:0/568868136 conn(0x7ff25c0cf970 msgr2=0x7ff25c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:22.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.188+0000 7ff2609ff700 1 -- 172.21.15.88:0/568868136 shutdown_connections 2023-05-17T12:26:22.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.188+0000 7ff2609ff700 1 -- 172.21.15.88:0/568868136 wait complete. 2023-05-17T12:26:22.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.189+0000 7ff2609ff700 1 Processor -- start 2023-05-17T12:26:22.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.190+0000 7ff2609ff700 1 -- start start 2023-05-17T12:26:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.190+0000 7ff2609ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff25c06ed80 0x7ff25c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.190+0000 7ff2609ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c0c9f20 0x7ff25c1373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.190+0000 7ff2609ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c1421a0 0x7ff25c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.190+0000 7ff2609ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c15af10 con 0x7ff25c1421a0 2023-05-17T12:26:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.190+0000 7ff2609ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c157020 con 0x7ff25c06ed80 2023-05-17T12:26:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.190+0000 7ff2609ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c137930 con 0x7ff25c0c9f20 2023-05-17T12:26:22.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c1421a0 0x7ff25c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c1421a0 0x7ff25c157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54356/0 (socket says 172.21.15.88:54356) 2023-05-17T12:26:22.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25ad9d700 1 -- 172.21.15.88:0/1017102024 learned_addr learned my addr 172.21.15.88:0/1017102024 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:22.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25ad9d700 1 -- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c0c9f20 msgr2=0x7ff25c1373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff253fff700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c0c9f20 0x7ff25c1373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25a59c700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff25c06ed80 0x7ff25c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25ad9d700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c0c9f20 0x7ff25c1373f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25ad9d700 1 -- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff25c06ed80 msgr2=0x7ff25c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25ad9d700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff25c06ed80 0x7ff25c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25ad9d700 1 -- 172.21.15.88:0/1017102024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254009b30 con 0x7ff25c1421a0 2023-05-17T12:26:22.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25a59c700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff25c06ed80 0x7ff25c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:22.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.191+0000 7ff25ad9d700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c1421a0 0x7ff25c157c10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0676b0 tx=0x7ff254004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:22.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.192+0000 7ff252ffd700 1 -- 172.21.15.88:0/1017102024 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2540099b0 con 0x7ff25c1421a0 2023-05-17T12:26:22.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.192+0000 7ff252ffd700 1 -- 172.21.15.88:0/1017102024 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff254004250 con 0x7ff25c1421a0 2023-05-17T12:26:22.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.192+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c142570 con 0x7ff25c1421a0 2023-05-17T12:26:22.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.192+0000 7ff252ffd700 1 -- 172.21.15.88:0/1017102024 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254004600 con 0x7ff25c1421a0 2023-05-17T12:26:22.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.192+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c06afc0 con 0x7ff25c1421a0 2023-05-17T12:26:22.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.193+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c142a50 con 0x7ff25c1421a0 2023-05-17T12:26:22.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.194+0000 7ff252ffd700 1 -- 172.21.15.88:0/1017102024 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff254004760 con 0x7ff25c1421a0 2023-05-17T12:26:22.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.195+0000 7ff252ffd700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff23c06ace0 0x7ff23c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.195+0000 7ff252ffd700 1 -- 172.21.15.88:0/1017102024 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff25408a840 con 0x7ff25c1421a0 2023-05-17T12:26:22.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.196+0000 7ff25a59c700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff23c06ace0 0x7ff23c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.196+0000 7ff25a59c700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff23c06ace0 0x7ff23c06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009ac0 tx=0x7ff24c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:22.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.200+0000 7ff252ffd700 1 -- 172.21.15.88:0/1017102024 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff254055650 con 0x7ff25c1421a0 2023-05-17T12:26:22.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.394+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff25c15b050 con 0x7ff25c1421a0 2023-05-17T12:26:22.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.395+0000 7ff252ffd700 1 -- 172.21.15.88:0/1017102024 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff25c15b050 con 0x7ff25c1421a0 2023-05-17T12:26:22.398 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:22.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff23c06ace0 msgr2=0x7ff23c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff23c06ace0 0x7ff23c06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009ac0 tx=0x7ff24c008040 comp rx=0 tx=0).stop 2023-05-17T12:26:22.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c1421a0 msgr2=0x7ff25c157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c1421a0 0x7ff25c157c10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0676b0 tx=0x7ff254004ad0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 shutdown_connections 2023-05-17T12:26:22.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff23c06ace0 0x7ff23c06d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff25c1421a0 0x7ff25c157c10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff25c06ed80 0x7ff25c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 --2- 172.21.15.88:0/1017102024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff25c0c9f20 0x7ff25c1373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 >> 172.21.15.88:0/1017102024 conn(0x7ff25c0cf970 msgr2=0x7ff25c0cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:22.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 shutdown_connections 2023-05-17T12:26:22.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.397+0000 7ff2609ff700 1 -- 172.21.15.88:0/1017102024 wait complete. 2023-05-17T12:26:22.417 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.603+0000 7fe425dff700 1 Processor -- start 2023-05-17T12:26:22.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.603+0000 7fe425dff700 1 -- start start 2023-05-17T12:26:22.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.604+0000 7fe425dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe42015fe00 0x7fe4200b1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.604+0000 7fe425dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe420142890 0x7fe420166630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.604+0000 7fe425dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe420143160 con 0x7fe4200b1570 2023-05-17T12:26:22.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.604+0000 7fe425dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4200b19e0 con 0x7fe42015fe00 2023-05-17T12:26:22.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.604+0000 7fe425dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200cdec0 con 0x7fe420142890 2023-05-17T12:26:22.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe420142890 0x7fe420166630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41f7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe42015fe00 0x7fe4200b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe420142890 0x7fe420166630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:53706/0 (socket says 172.21.15.88:53706) 2023-05-17T12:26:22.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41ffff700 1 -- 172.21.15.88:0/1424086187 learned_addr learned my addr 172.21.15.88:0/1424086187 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:22.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41f7fe700 1 --2- 172.21.15.88:0/1424086187 >> v2:172.21.15.187:3300/0 conn(0x7fe42015fe00 0x7fe4200b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:44124/0 (socket says 172.21.15.88:44124) 2023-05-17T12:26:22.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41ffff700 1 -- 172.21.15.88:0/1424086187 >> v2:172.21.15.187:3300/0 conn(0x7fe42015fe00 msgr2=0x7fe4200b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:22.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41ffff700 1 --2- 172.21.15.88:0/1424086187 >> v2:172.21.15.187:3300/0 conn(0x7fe42015fe00 0x7fe4200b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41ffff700 1 -- 172.21.15.88:0/1424086187 >> v1:172.21.15.187:6789/0 conn(0x7fe4200b1570 legacy=0x7fe420142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41ffff700 1 -- 172.21.15.88:0/1424086187 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420160f80 con 0x7fe420142890 2023-05-17T12:26:22.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.605+0000 7fe41ffff700 1 --2- 172.21.15.88:0/1424086187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe420142890 0x7fe420166630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe418009e50 tx=0x7fe41800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f599bf4eabdc8c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:22.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.606+0000 7fe41e7fc700 1 -- 172.21.15.88:0/1424086187 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800e070 con 0x7fe420142890 2023-05-17T12:26:22.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.606+0000 7fe41e7fc700 1 -- 172.21.15.88:0/1424086187 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41800b910 con 0x7fe420142890 2023-05-17T12:26:22.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.606+0000 7fe41e7fc700 1 -- 172.21.15.88:0/1424086187 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800bcc0 con 0x7fe420142890 2023-05-17T12:26:22.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.607+0000 7fe425dff700 1 -- 172.21.15.88:0/1424086187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe420142890 msgr2=0x7fe420166630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.607+0000 7fe425dff700 1 --2- 172.21.15.88:0/1424086187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe420142890 0x7fe420166630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe418009e50 tx=0x7fe41800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:22.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.607+0000 7fe425dff700 1 -- 172.21.15.88:0/1424086187 shutdown_connections 2023-05-17T12:26:22.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.607+0000 7fe425dff700 1 --2- 172.21.15.88:0/1424086187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe420142890 0x7fe420166630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.607+0000 7fe425dff700 1 --2- 172.21.15.88:0/1424086187 >> v2:172.21.15.187:3300/0 conn(0x7fe42015fe00 0x7fe4200b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.607+0000 7fe425dff700 1 -- 172.21.15.88:0/1424086187 >> 172.21.15.88:0/1424086187 conn(0x7fe4200cf5b0 msgr2=0x7fe4200cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:22.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.607+0000 7fe425dff700 1 -- 172.21.15.88:0/1424086187 shutdown_connections 2023-05-17T12:26:22.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.607+0000 7fe425dff700 1 -- 172.21.15.88:0/1424086187 wait complete. 2023-05-17T12:26:22.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.608+0000 7fe425dff700 1 Processor -- start 2023-05-17T12:26:22.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.609+0000 7fe425dff700 1 -- start start 2023-05-17T12:26:22.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.609+0000 7fe425dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4200b1570 0x7fe4201f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.609+0000 7fe425dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe420142890 0x7fe42015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.609+0000 7fe425dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe42015fe00 0x7fe420144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe425dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200b2d80 con 0x7fe4200b1570 2023-05-17T12:26:22.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe425dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200c43c0 con 0x7fe420142890 2023-05-17T12:26:22.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe425dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200b35d0 con 0x7fe42015fe00 2023-05-17T12:26:22.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4200b1570 0x7fe4201f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4200b1570 0x7fe4201f18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54368/0 (socket says 172.21.15.88:54368) 2023-05-17T12:26:22.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41f7fe700 1 -- 172.21.15.88:0/1911077221 learned_addr learned my addr 172.21.15.88:0/1911077221 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:22.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41effd700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe420142890 0x7fe42015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41ffff700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe42015fe00 0x7fe420144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41f7fe700 1 -- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe42015fe00 msgr2=0x7fe420144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41f7fe700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe42015fe00 0x7fe420144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41f7fe700 1 -- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe420142890 msgr2=0x7fe42015bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41f7fe700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe420142890 0x7fe42015bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41f7fe700 1 -- 172.21.15.88:0/1911077221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe418009b30 con 0x7fe4200b1570 2023-05-17T12:26:22.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41effd700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe420142890 0x7fe42015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:22.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.610+0000 7fe41f7fe700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4200b1570 0x7fe4201f18b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe41000e8a0 tx=0x7fe41000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:22.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.611+0000 7fe407fff700 1 -- 172.21.15.88:0/1911077221 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410009590 con 0x7fe4200b1570 2023-05-17T12:26:22.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.611+0000 7fe407fff700 1 -- 172.21.15.88:0/1911077221 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41000eea0 con 0x7fe4200b1570 2023-05-17T12:26:22.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.611+0000 7fe407fff700 1 -- 172.21.15.88:0/1911077221 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000ca50 con 0x7fe4200b1570 2023-05-17T12:26:22.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.611+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe420160650 con 0x7fe4200b1570 2023-05-17T12:26:22.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.611+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe420161410 con 0x7fe4200b1570 2023-05-17T12:26:22.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.612+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe420160930 con 0x7fe4200b1570 2023-05-17T12:26:22.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.613+0000 7fe407fff700 1 -- 172.21.15.88:0/1911077221 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe41000cbb0 con 0x7fe4200b1570 2023-05-17T12:26:22.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.614+0000 7fe407fff700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe40c06ace0 0x7fe40c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:22.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.614+0000 7fe407fff700 1 -- 172.21.15.88:0/1911077221 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe4100897a0 con 0x7fe4200b1570 2023-05-17T12:26:22.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.614+0000 7fe41effd700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe40c06ace0 0x7fe40c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:22.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.615+0000 7fe41effd700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe40c06ace0 0x7fe40c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe420072bb0 tx=0x7fe414009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:22.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.618+0000 7fe407fff700 1 -- 172.21.15.88:0/1911077221 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe410057fa0 con 0x7fe4200b1570 2023-05-17T12:26:22.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.809+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe420074530 con 0x7fe4200b1570 2023-05-17T12:26:22.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.810+0000 7fe407fff700 1 -- 172.21.15.88:0/1911077221 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe410057b30 con 0x7fe4200b1570 2023-05-17T12:26:22.813 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:22.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe40c06ace0 msgr2=0x7fe40c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe40c06ace0 0x7fe40c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe420072bb0 tx=0x7fe414009040 comp rx=0 tx=0).stop 2023-05-17T12:26:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4200b1570 msgr2=0x7fe4201f18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4200b1570 0x7fe4201f18b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe41000e8a0 tx=0x7fe41000ec60 comp rx=0 tx=0).stop 2023-05-17T12:26:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 shutdown_connections 2023-05-17T12:26:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe40c06ace0 0x7fe40c06d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe42015fe00 0x7fe420144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4200b1570 0x7fe4201f18b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 --2- 172.21.15.88:0/1911077221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe420142890 0x7fe42015bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:22.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.812+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 >> 172.21.15.88:0/1911077221 conn(0x7fe4200cf5b0 msgr2=0x7fe4200716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:22.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.813+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 shutdown_connections 2023-05-17T12:26:22.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:22.813+0000 7fe425dff700 1 -- 172.21.15.88:0/1911077221 wait complete. 2023-05-17T12:26:22.832 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:23.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.017+0000 7f1a5ffff700 1 Processor -- start 2023-05-17T12:26:23.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.018+0000 7f1a5ffff700 1 -- start start 2023-05-17T12:26:23.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a58153d60 0x7f1a5815daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5ffff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1a580cdb10 0x7f1a580cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a580cc8f0 0x7f1a580ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5ffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a580ce4c0 con 0x7f1a580cc8f0 2023-05-17T12:26:23.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5ffff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5815e030 con 0x7f1a580cdb10 2023-05-17T12:26:23.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5ffff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58159ed0 con 0x7f1a58153d60 2023-05-17T12:26:23.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a580cc8f0 0x7f1a580ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a580cc8f0 0x7f1a580ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54378/0 (socket says 172.21.15.88:54378) 2023-05-17T12:26:23.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5e59c700 1 -- 172.21.15.88:0/807970254 learned_addr learned my addr 172.21.15.88:0/807970254 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:23.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5dd9b700 1 --2- 172.21.15.88:0/807970254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a58153d60 0x7f1a5815daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.019+0000 7f1a5d59a700 1 --2- 172.21.15.88:0/807970254 >> v2:172.21.15.187:3300/0 conn(0x7f1a580cdb10 0x7f1a580cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5e59c700 1 -- 172.21.15.88:0/807970254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a58153d60 msgr2=0x7f1a5815daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:23.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5e59c700 1 --2- 172.21.15.88:0/807970254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a58153d60 0x7f1a5815daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5e59c700 1 -- 172.21.15.88:0/807970254 >> v2:172.21.15.187:3300/0 conn(0x7f1a580cdb10 msgr2=0x7f1a580cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:23.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5e59c700 1 --2- 172.21.15.88:0/807970254 >> v2:172.21.15.187:3300/0 conn(0x7f1a580cdb10 0x7f1a580cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5e59c700 1 -- 172.21.15.88:0/807970254 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5815a1b0 con 0x7f1a580cc8f0 2023-05-17T12:26:23.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5d59a700 1 --2- 172.21.15.88:0/807970254 >> v2:172.21.15.187:3300/0 conn(0x7f1a580cdb10 0x7f1a580cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:23.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5e59c700 1 --2- 172.21.15.88:0/807970254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 0x7f1a580ccd70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1a58067630 tx=0x7f1a5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdc6834370b1609 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:23.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5cd99700 1 -- 172.21.15.88:0/807970254 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5000e070 con 0x7f1a580cc8f0 2023-05-17T12:26:23.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5cd99700 1 -- 172.21.15.88:0/807970254 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5000b9c0 con 0x7f1a580cc8f0 2023-05-17T12:26:23.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.020+0000 7f1a5cd99700 1 -- 172.21.15.88:0/807970254 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5000bd70 con 0x7f1a580cc8f0 2023-05-17T12:26:23.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.021+0000 7f1a5ffff700 1 -- 172.21.15.88:0/807970254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 msgr2=0x7f1a580ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.021+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/807970254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 0x7f1a580ccd70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1a58067630 tx=0x7f1a5000b330 comp rx=0 tx=0).stop 2023-05-17T12:26:23.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.021+0000 7f1a5ffff700 1 -- 172.21.15.88:0/807970254 shutdown_connections 2023-05-17T12:26:23.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.021+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/807970254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 0x7f1a580ccd70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.021+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/807970254 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a58153d60 0x7f1a5815daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.021+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/807970254 >> v2:172.21.15.187:3300/0 conn(0x7f1a580cdb10 0x7f1a580cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.021+0000 7f1a5ffff700 1 -- 172.21.15.88:0/807970254 >> 172.21.15.88:0/807970254 conn(0x7f1a580cf970 msgr2=0x7f1a580cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.021+0000 7f1a5ffff700 1 -- 172.21.15.88:0/807970254 shutdown_connections 2023-05-17T12:26:23.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.021+0000 7f1a5ffff700 1 -- 172.21.15.88:0/807970254 wait complete. 2023-05-17T12:26:23.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.023+0000 7f1a5ffff700 1 Processor -- start 2023-05-17T12:26:23.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.023+0000 7f1a5ffff700 1 -- start start 2023-05-17T12:26:23.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 0x7f1a580b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a580cdb10 0x7f1a58139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a58153d60 0x7f1a580c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58139ec0 con 0x7f1a580cc8f0 2023-05-17T12:26:23.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5ffff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5813b550 con 0x7f1a58153d60 2023-05-17T12:26:23.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5ffff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580b3260 con 0x7f1a580cdb10 2023-05-17T12:26:23.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5dd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 0x7f1a580b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5dd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 0x7f1a580b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54392/0 (socket says 172.21.15.88:54392) 2023-05-17T12:26:23.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5dd9b700 1 -- 172.21.15.88:0/1114969915 learned_addr learned my addr 172.21.15.88:0/1114969915 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:23.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5dd9b700 1 -- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a580cdb10 msgr2=0x7f1a58139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5dd9b700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a580cdb10 0x7f1a58139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5dd9b700 1 -- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a58153d60 msgr2=0x7f1a580c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5dd9b700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a58153d60 0x7f1a580c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5dd9b700 1 -- 172.21.15.88:0/1114969915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a50009b30 con 0x7f1a580cc8f0 2023-05-17T12:26:23.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.024+0000 7f1a5dd9b700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 0x7f1a580b2ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400d800 tx=0x7f1a5400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:23.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.025+0000 7f1a4e7fc700 1 -- 172.21.15.88:0/1114969915 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540125f0 con 0x7f1a580cc8f0 2023-05-17T12:26:23.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.025+0000 7f1a4e7fc700 1 -- 172.21.15.88:0/1114969915 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54012750 con 0x7f1a580cc8f0 2023-05-17T12:26:23.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.025+0000 7f1a4e7fc700 1 -- 172.21.15.88:0/1114969915 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54012b00 con 0x7f1a580cc8f0 2023-05-17T12:26:23.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.025+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5815a770 con 0x7f1a580cc8f0 2023-05-17T12:26:23.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.025+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5815a490 con 0x7f1a580cc8f0 2023-05-17T12:26:23.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.026+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5815aa50 con 0x7f1a580cc8f0 2023-05-17T12:26:23.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.027+0000 7f1a4e7fc700 1 -- 172.21.15.88:0/1114969915 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a54012c60 con 0x7f1a580cc8f0 2023-05-17T12:26:23.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.027+0000 7f1a4e7fc700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a3c06ad10 0x7f1a3c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.028+0000 7f1a4e7fc700 1 -- 172.21.15.88:0/1114969915 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a54089ce0 con 0x7f1a580cc8f0 2023-05-17T12:26:23.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.028+0000 7f1a5d59a700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a3c06ad10 0x7f1a3c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.028+0000 7f1a5d59a700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a3c06ad10 0x7f1a3c06d1c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a48006fd0 tx=0x7f1a48008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:23.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.032+0000 7f1a4e7fc700 1 -- 172.21.15.88:0/1114969915 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1a54054930 con 0x7f1a580cc8f0 2023-05-17T12:26:23.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.227+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a58074530 con 0x7f1a580cc8f0 2023-05-17T12:26:23.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.227+0000 7f1a4e7fc700 1 -- 172.21.15.88:0/1114969915 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a54057f50 con 0x7f1a580cc8f0 2023-05-17T12:26:23.230 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:23.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a3c06ad10 msgr2=0x7f1a3c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a3c06ad10 0x7f1a3c06d1c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1a48006fd0 tx=0x7f1a48008040 comp rx=0 tx=0).stop 2023-05-17T12:26:23.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 msgr2=0x7f1a580b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 0x7f1a580b2ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400d800 tx=0x7f1a5400dbc0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 shutdown_connections 2023-05-17T12:26:23.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a3c06ad10 0x7f1a3c06d1c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a58153d60 0x7f1a580c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580cc8f0 0x7f1a580b2ba0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 --2- 172.21.15.88:0/1114969915 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a580cdb10 0x7f1a58139980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 >> 172.21.15.88:0/1114969915 conn(0x7f1a580cf970 msgr2=0x7f1a5813a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:23.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.229+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 shutdown_connections 2023-05-17T12:26:23.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.230+0000 7f1a5ffff700 1 -- 172.21.15.88:0/1114969915 wait complete. 2023-05-17T12:26:23.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:23.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.434+0000 7f94889ff700 1 Processor -- start 2023-05-17T12:26:23.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.435+0000 7f94889ff700 1 -- start start 2023-05-17T12:26:23.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.436+0000 7f94889ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94840b23a0 0x7f948406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.436+0000 7f94889ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f94840cf190 0x7f9484160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.436+0000 7f94889ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948406b4a0 con 0x7f948406c760 2023-05-17T12:26:23.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.436+0000 7f94889ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948406a510 con 0x7f94840b23a0 2023-05-17T12:26:23.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.436+0000 7f94889ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94840cd840 con 0x7f94840cf190 2023-05-17T12:26:23.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.436+0000 7f947bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94840b23a0 0x7f948406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.436+0000 7f947bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f94840b23a0 0x7f948406af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54398/0 (socket says 172.21.15.88:54398) 2023-05-17T12:26:23.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.436+0000 7f947bfff700 1 -- 172.21.15.88:0/1068410402 learned_addr learned my addr 172.21.15.88:0/1068410402 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:23.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.436+0000 7f9482d9d700 1 --2- 172.21.15.88:0/1068410402 >> v2:172.21.15.187:3300/0 conn(0x7f94840cf190 0x7f9484160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.437+0000 7f947bfff700 1 -- 172.21.15.88:0/1068410402 >> v2:172.21.15.187:3300/0 conn(0x7f94840cf190 msgr2=0x7f9484160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:23.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.437+0000 7f947bfff700 1 --2- 172.21.15.88:0/1068410402 >> v2:172.21.15.187:3300/0 conn(0x7f94840cf190 0x7f9484160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.437+0000 7f947bfff700 1 -- 172.21.15.88:0/1068410402 >> v1:172.21.15.187:6789/0 conn(0x7f948406c760 legacy=0x7f948406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.437+0000 7f947bfff700 1 -- 172.21.15.88:0/1068410402 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94840cdb20 con 0x7f94840b23a0 2023-05-17T12:26:23.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.437+0000 7f947bfff700 1 --2- 172.21.15.88:0/1068410402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840b23a0 0x7f948406af60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f948408c360 tx=0x7f946c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc4abbf74c016cc server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:23.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.437+0000 7f9481d9b700 1 -- 172.21.15.88:0/1068410402 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c011830 con 0x7f94840b23a0 2023-05-17T12:26:23.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.437+0000 7f9481d9b700 1 -- 172.21.15.88:0/1068410402 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c011990 con 0x7f94840b23a0 2023-05-17T12:26:23.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.437+0000 7f9481d9b700 1 -- 172.21.15.88:0/1068410402 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c011d20 con 0x7f94840b23a0 2023-05-17T12:26:23.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.438+0000 7f94889ff700 1 -- 172.21.15.88:0/1068410402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840b23a0 msgr2=0x7f948406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.438+0000 7f94889ff700 1 --2- 172.21.15.88:0/1068410402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840b23a0 0x7f948406af60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f948408c360 tx=0x7f946c009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.438+0000 7f94889ff700 1 -- 172.21.15.88:0/1068410402 shutdown_connections 2023-05-17T12:26:23.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.438+0000 7f94889ff700 1 --2- 172.21.15.88:0/1068410402 >> v2:172.21.15.187:3300/0 conn(0x7f94840cf190 0x7f9484160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.438+0000 7f94889ff700 1 --2- 172.21.15.88:0/1068410402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840b23a0 0x7f948406af60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.438+0000 7f94889ff700 1 -- 172.21.15.88:0/1068410402 >> 172.21.15.88:0/1068410402 conn(0x7f94840d06f0 msgr2=0x7f94840d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:23.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.438+0000 7f94889ff700 1 -- 172.21.15.88:0/1068410402 shutdown_connections 2023-05-17T12:26:23.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.438+0000 7f94889ff700 1 -- 172.21.15.88:0/1068410402 wait complete. 2023-05-17T12:26:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.440+0000 7f94889ff700 1 Processor -- start 2023-05-17T12:26:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.440+0000 7f94889ff700 1 -- start start 2023-05-17T12:26:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f94889ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f948406c760 0x7f94841522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f94889ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840cf190 0x7f9484152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f94889ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9484151e60 0x7f94840ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f94889ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840c7640 con 0x7f94840cf190 2023-05-17T12:26:23.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f94889ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840c9ae0 con 0x7f9484151e60 2023-05-17T12:26:23.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f94889ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94840cc6f0 con 0x7f948406c760 2023-05-17T12:26:23.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f947bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840cf190 0x7f9484152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f947bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840cf190 0x7f9484152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54412/0 (socket says 172.21.15.88:54412) 2023-05-17T12:26:23.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f947bfff700 1 -- 172.21.15.88:0/387665887 learned_addr learned my addr 172.21.15.88:0/387665887 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f948259c700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f948406c760 0x7f94841522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f9482d9d700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9484151e60 0x7f94840ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f947bfff700 1 -- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f948406c760 msgr2=0x7f94841522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f947bfff700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f948406c760 0x7f94841522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f947bfff700 1 -- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9484151e60 msgr2=0x7f94840ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f947bfff700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9484151e60 0x7f94840ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.441+0000 7f947bfff700 1 -- 172.21.15.88:0/387665887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c009550 con 0x7f94840cf190 2023-05-17T12:26:23.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.442+0000 7f947bfff700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840cf190 0x7f9484152800 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f946c000c00 tx=0x7f946c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:23.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.442+0000 7f947affd700 1 -- 172.21.15.88:0/387665887 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c004570 con 0x7f94840cf190 2023-05-17T12:26:23.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.442+0000 7f947affd700 1 -- 172.21.15.88:0/387665887 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c01f070 con 0x7f94840cf190 2023-05-17T12:26:23.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.442+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948406aa40 con 0x7f94840cf190 2023-05-17T12:26:23.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.442+0000 7f947affd700 1 -- 172.21.15.88:0/387665887 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0038e0 con 0x7f94840cf190 2023-05-17T12:26:23.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.442+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948406a760 con 0x7f94840cf190 2023-05-17T12:26:23.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.443+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948415cb40 con 0x7f94840cf190 2023-05-17T12:26:23.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.444+0000 7f947affd700 1 -- 172.21.15.88:0/387665887 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f946c021030 con 0x7f94840cf190 2023-05-17T12:26:23.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.445+0000 7f947affd700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f946406ace0 0x7f946406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.445+0000 7f947affd700 1 -- 172.21.15.88:0/387665887 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f946c08ac50 con 0x7f94840cf190 2023-05-17T12:26:23.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.446+0000 7f948259c700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f946406ace0 0x7f946406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.446+0000 7f948259c700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f946406ace0 0x7f946406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9484159270 tx=0x7f9474009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:23.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.449+0000 7f947affd700 1 -- 172.21.15.88:0/387665887 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f946c0559c0 con 0x7f94840cf190 2023-05-17T12:26:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.647+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9484074530 con 0x7f94840cf190 2023-05-17T12:26:23.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.647+0000 7f947affd700 1 -- 172.21.15.88:0/387665887 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f946c0150a0 con 0x7f94840cf190 2023-05-17T12:26:23.650 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:23.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f946406ace0 msgr2=0x7f946406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f946406ace0 0x7f946406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9484159270 tx=0x7f9474009040 comp rx=0 tx=0).stop 2023-05-17T12:26:23.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840cf190 msgr2=0x7f9484152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840cf190 0x7f9484152800 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f946c000c00 tx=0x7f946c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:23.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 shutdown_connections 2023-05-17T12:26:23.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f946406ace0 0x7f946406d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9484151e60 0x7f94840ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f948406c760 0x7f94841522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 --2- 172.21.15.88:0/387665887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94840cf190 0x7f9484152800 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 >> 172.21.15.88:0/387665887 conn(0x7f94840d06f0 msgr2=0x7f94840d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:23.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 shutdown_connections 2023-05-17T12:26:23.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.650+0000 7f94889ff700 1 -- 172.21.15.88:0/387665887 wait complete. 2023-05-17T12:26:23.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:23.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.855+0000 7f56c75ff700 1 Processor -- start 2023-05-17T12:26:23.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.855+0000 7f56c75ff700 1 -- start start 2023-05-17T12:26:23.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c75ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f56c006c760 0x7f56c006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c75ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f56c00cf190 0x7f56c0160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c75ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c006b4a0 con 0x7f56c00b23a0 2023-05-17T12:26:23.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c75ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c006a510 con 0x7f56c006c760 2023-05-17T12:26:23.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c75ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c00cd840 con 0x7f56c00cf190 2023-05-17T12:26:23.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c539b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f56c006c760 0x7f56c006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c539b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f56c006c760 0x7f56c006af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54424/0 (socket says 172.21.15.88:54424) 2023-05-17T12:26:23.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c539b700 1 -- 172.21.15.88:0/203353860 learned_addr learned my addr 172.21.15.88:0/203353860 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:23.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c5b9c700 1 --2- 172.21.15.88:0/203353860 >> v2:172.21.15.187:3300/0 conn(0x7f56c00cf190 0x7f56c0160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c539b700 1 -- 172.21.15.88:0/203353860 >> v2:172.21.15.187:3300/0 conn(0x7f56c00cf190 msgr2=0x7f56c0160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:23.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c539b700 1 --2- 172.21.15.88:0/203353860 >> v2:172.21.15.187:3300/0 conn(0x7f56c00cf190 0x7f56c0160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c539b700 1 -- 172.21.15.88:0/203353860 >> v1:172.21.15.187:6789/0 conn(0x7f56c00b23a0 legacy=0x7f56c006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:23.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.857+0000 7f56c539b700 1 -- 172.21.15.88:0/203353860 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c00cdb20 con 0x7f56c006c760 2023-05-17T12:26:23.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.858+0000 7f56c539b700 1 --2- 172.21.15.88:0/203353860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 0x7f56c006af60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f56c008c360 tx=0x7f56bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cee870a6c167ff server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:23.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.858+0000 7f56b7fff700 1 -- 172.21.15.88:0/203353860 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc004230 con 0x7f56c006c760 2023-05-17T12:26:23.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.858+0000 7f56b7fff700 1 -- 172.21.15.88:0/203353860 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc004390 con 0x7f56c006c760 2023-05-17T12:26:23.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.858+0000 7f56b7fff700 1 -- 172.21.15.88:0/203353860 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0036a0 con 0x7f56c006c760 2023-05-17T12:26:23.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.858+0000 7f56c75ff700 1 -- 172.21.15.88:0/203353860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 msgr2=0x7f56c006af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.858+0000 7f56c75ff700 1 --2- 172.21.15.88:0/203353860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 0x7f56c006af60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f56c008c360 tx=0x7f56bc009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.859+0000 7f56c75ff700 1 -- 172.21.15.88:0/203353860 shutdown_connections 2023-05-17T12:26:23.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.859+0000 7f56c75ff700 1 --2- 172.21.15.88:0/203353860 >> v2:172.21.15.187:3300/0 conn(0x7f56c00cf190 0x7f56c0160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.859+0000 7f56c75ff700 1 --2- 172.21.15.88:0/203353860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 0x7f56c006af60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.859+0000 7f56c75ff700 1 -- 172.21.15.88:0/203353860 >> 172.21.15.88:0/203353860 conn(0x7f56c00d06f0 msgr2=0x7f56c00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:23.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.859+0000 7f56c75ff700 1 -- 172.21.15.88:0/203353860 shutdown_connections 2023-05-17T12:26:23.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.859+0000 7f56c75ff700 1 -- 172.21.15.88:0/203353860 wait complete. 2023-05-17T12:26:23.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.860+0000 7f56c75ff700 1 Processor -- start 2023-05-17T12:26:23.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.860+0000 7f56c75ff700 1 -- start start 2023-05-17T12:26:23.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.861+0000 7f56c75ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 0x7f56c0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.861+0000 7f56c75ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00cf190 0x7f56c0158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.861+0000 7f56c75ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c0144d60 0x7f56c0144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.861+0000 7f56c75ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c00cc790 con 0x7f56c006c760 2023-05-17T12:26:23.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.861+0000 7f56c75ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c01f23f0 con 0x7f56c0144d60 2023-05-17T12:26:23.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.861+0000 7f56c75ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c00cbb80 con 0x7f56c00cf190 2023-05-17T12:26:23.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c539b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 0x7f56c0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c539b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 0x7f56c0154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54434/0 (socket says 172.21.15.88:54434) 2023-05-17T12:26:23.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c539b700 1 -- 172.21.15.88:0/2848484956 learned_addr learned my addr 172.21.15.88:0/2848484956 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:23.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c5b9c700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c0144d60 0x7f56c0144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c4b9a700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00cf190 0x7f56c0158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c539b700 1 -- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00cf190 msgr2=0x7f56c0158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c539b700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00cf190 0x7f56c0158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c539b700 1 -- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c0144d60 msgr2=0x7f56c0144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:23.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c539b700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c0144d60 0x7f56c0144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:23.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c539b700 1 -- 172.21.15.88:0/2848484956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc009550 con 0x7f56c006c760 2023-05-17T12:26:23.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.862+0000 7f56c539b700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 0x7f56c0154d50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009130 tx=0x7f56bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:23.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.863+0000 7f56b5ffb700 1 -- 172.21.15.88:0/2848484956 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc003d40 con 0x7f56c006c760 2023-05-17T12:26:23.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.863+0000 7f56b5ffb700 1 -- 172.21.15.88:0/2848484956 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc01f070 con 0x7f56c006c760 2023-05-17T12:26:23.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.863+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c006aa40 con 0x7f56c006c760 2023-05-17T12:26:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.863+0000 7f56b5ffb700 1 -- 172.21.15.88:0/2848484956 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc011870 con 0x7f56c006c760 2023-05-17T12:26:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.863+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c006a760 con 0x7f56c006c760 2023-05-17T12:26:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.864+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c015cb40 con 0x7f56c006c760 2023-05-17T12:26:23.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.865+0000 7f56b5ffb700 1 -- 172.21.15.88:0/2848484956 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56bc021030 con 0x7f56c006c760 2023-05-17T12:26:23.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.866+0000 7f56b5ffb700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56a406ad10 0x7f56a406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:23.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.866+0000 7f56b5ffb700 1 -- 172.21.15.88:0/2848484956 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f56bc08ac60 con 0x7f56c006c760 2023-05-17T12:26:23.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.866+0000 7f56c4b9a700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56a406ad10 0x7f56a406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:23.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.867+0000 7f56c4b9a700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56a406ad10 0x7f56a406d1c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f56c01f5a70 tx=0x7f56b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:23.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:23.870+0000 7f56b5ffb700 1 -- 172.21.15.88:0/2848484956 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f56bc055a70 con 0x7f56c006c760 2023-05-17T12:26:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.065+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f56c006b4a0 con 0x7f56c006c760 2023-05-17T12:26:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.065+0000 7f56b5ffb700 1 -- 172.21.15.88:0/2848484956 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f56bc029020 con 0x7f56c006c760 2023-05-17T12:26:24.068 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:24.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56a406ad10 msgr2=0x7f56a406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56a406ad10 0x7f56a406d1c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f56c01f5a70 tx=0x7f56b0009040 comp rx=0 tx=0).stop 2023-05-17T12:26:24.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 msgr2=0x7f56c0154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 0x7f56c0154d50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009130 tx=0x7f56bc004750 comp rx=0 tx=0).stop 2023-05-17T12:26:24.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 shutdown_connections 2023-05-17T12:26:24.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f56a406ad10 0x7f56a406d1c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c0144d60 0x7f56c0144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56c006c760 0x7f56c0154d50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 --2- 172.21.15.88:0/2848484956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00cf190 0x7f56c0158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 >> 172.21.15.88:0/2848484956 conn(0x7f56c00d06f0 msgr2=0x7f56c00b7380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:24.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.067+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 shutdown_connections 2023-05-17T12:26:24.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.068+0000 7f56c75ff700 1 -- 172.21.15.88:0/2848484956 wait complete. 2023-05-17T12:26:24.087 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:26:24.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.270+0000 7f13c99ff700 1 Processor -- start 2023-05-17T12:26:24.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.270+0000 7f13c99ff700 1 -- start start 2023-05-17T12:26:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.271+0000 7f13c99ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c40d1bb0 0x7f13c40d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c99ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c41574f0 con 0x7f13c40cf650 2023-05-17T12:26:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c99ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c40cd9e0 con 0x7f13c415d990 2023-05-17T12:26:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c99ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40cd800 con 0x7f13c40d1bb0 2023-05-17T12:26:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13bbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f13c40cf650 0x7f13c4160ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53608/0 (socket says 172.21.15.88:53608) 2023-05-17T12:26:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13bbfff700 1 -- 172.21.15.88:0/705085351 learned_addr learned my addr 172.21.15.88:0/705085351 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c2ffd700 1 --2- 172.21.15.88:0/705085351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c40d1bb0 0x7f13c40d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c27fc700 1 -- 172.21.15.88:0/705085351 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826207450 0 0) 0x7f13c41574f0 con 0x7f13c40cf650 2023-05-17T12:26:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c27fc700 1 -- 172.21.15.88:0/705085351 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b00035b0 con 0x7f13c40cf650 2023-05-17T12:26:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c27fc700 1 -- 172.21.15.88:0/705085351 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877515187 0 0) 0x7f13c40cd9e0 con 0x7f13c415d990 2023-05-17T12:26:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c2ffd700 1 -- 172.21.15.88:0/705085351 >> v1:172.21.15.187:6789/0 conn(0x7f13c415d990 legacy=0x7f13c406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c2ffd700 1 -- 172.21.15.88:0/705085351 >> v1:172.21.15.88:6789/0 conn(0x7f13c40cf650 legacy=0x7f13c4160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.272+0000 7f13c2ffd700 1 -- 172.21.15.88:0/705085351 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c40cdcc0 con 0x7f13c40d1bb0 2023-05-17T12:26:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.273+0000 7f13c2ffd700 1 --2- 172.21.15.88:0/705085351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c40d1bb0 0x7f13c40d1f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009870 tx=0x7f13b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21894f6a7554d856 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.273+0000 7f13c27fc700 1 -- 172.21.15.88:0/705085351 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4011830 con 0x7f13c40d1bb0 2023-05-17T12:26:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.273+0000 7f13c27fc700 1 -- 172.21.15.88:0/705085351 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b4011990 con 0x7f13c40d1bb0 2023-05-17T12:26:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.273+0000 7f13c27fc700 1 -- 172.21.15.88:0/705085351 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4011d20 con 0x7f13c40d1bb0 2023-05-17T12:26:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.274+0000 7f13c99ff700 1 -- 172.21.15.88:0/705085351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c40d1bb0 msgr2=0x7f13c40d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.274+0000 7f13c99ff700 1 --2- 172.21.15.88:0/705085351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c40d1bb0 0x7f13c40d1f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009870 tx=0x7f13b4009b80 comp rx=0 tx=0).stop 2023-05-17T12:26:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.274+0000 7f13c99ff700 1 -- 172.21.15.88:0/705085351 shutdown_connections 2023-05-17T12:26:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.274+0000 7f13c99ff700 1 --2- 172.21.15.88:0/705085351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c40d1bb0 0x7f13c40d1f80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.274+0000 7f13c99ff700 1 -- 172.21.15.88:0/705085351 >> 172.21.15.88:0/705085351 conn(0x7f13c40d3ed0 msgr2=0x7f13c40cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:24.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.274+0000 7f13c99ff700 1 -- 172.21.15.88:0/705085351 shutdown_connections 2023-05-17T12:26:24.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.274+0000 7f13c99ff700 1 -- 172.21.15.88:0/705085351 wait complete. 2023-05-17T12:26:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.275+0000 7f13c99ff700 1 Processor -- start 2023-05-17T12:26:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.276+0000 7f13c99ff700 1 -- start start 2023-05-17T12:26:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.276+0000 7f13c99ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40cf650 0x7f13c40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c99ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13c40d1bb0 0x7f13c4154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c99ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c415d990 0x7f13c41f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c99ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4154770 con 0x7f13c40cf650 2023-05-17T12:26:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c99ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40cbb70 con 0x7f13c40d1bb0 2023-05-17T12:26:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c99ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40cbe50 con 0x7f13c415d990 2023-05-17T12:26:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40cf650 0x7f13c40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40cf650 0x7f13c40ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54436/0 (socket says 172.21.15.88:54436) 2023-05-17T12:26:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c2ffd700 1 -- 172.21.15.88:0/2231936639 learned_addr learned my addr 172.21.15.88:0/2231936639 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13bbfff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13c40d1bb0 0x7f13c4154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c37fe700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c415d990 0x7f13c41f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c2ffd700 1 -- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c415d990 msgr2=0x7f13c41f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c2ffd700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c415d990 0x7f13c41f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c2ffd700 1 -- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13c40d1bb0 msgr2=0x7f13c4154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c2ffd700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13c40d1bb0 0x7f13c4154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c2ffd700 1 -- 172.21.15.88:0/2231936639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b40094a0 con 0x7f13c40cf650 2023-05-17T12:26:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13bbfff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13c40d1bb0 0x7f13c4154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c37fe700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c415d990 0x7f13c41f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.277+0000 7f13c2ffd700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40cf650 0x7f13c40ccc10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f13b40097c0 tx=0x7f13b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.278+0000 7f13c0ff9700 1 -- 172.21.15.88:0/2231936639 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b40036a0 con 0x7f13c40cf650 2023-05-17T12:26:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.278+0000 7f13c0ff9700 1 -- 172.21.15.88:0/2231936639 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b401f070 con 0x7f13c40cf650 2023-05-17T12:26:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.278+0000 7f13c0ff9700 1 -- 172.21.15.88:0/2231936639 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4003a40 con 0x7f13c40cf650 2023-05-17T12:26:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.278+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c415d470 con 0x7f13c40cf650 2023-05-17T12:26:24.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.278+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c415d190 con 0x7f13c40cf650 2023-05-17T12:26:24.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.279+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c40cdfa0 con 0x7f13c40cf650 2023-05-17T12:26:24.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.280+0000 7f13c0ff9700 1 -- 172.21.15.88:0/2231936639 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13b4003ba0 con 0x7f13c40cf650 2023-05-17T12:26:24.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.280+0000 7f13c0ff9700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f13a406ace0 0x7f13a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:24.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.281+0000 7f13c0ff9700 1 -- 172.21.15.88:0/2231936639 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f13b4021070 con 0x7f13c40cf650 2023-05-17T12:26:24.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.281+0000 7f13bbfff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f13a406ace0 0x7f13a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:24.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.282+0000 7f13bbfff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f13a406ace0 0x7f13a406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f13c41e6300 tx=0x7f13ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:24.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.285+0000 7f13c0ff9700 1 -- 172.21.15.88:0/2231936639 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f13b4055ef0 con 0x7f13c40cf650 2023-05-17T12:26:24.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:26:24.376 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:26:24.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.503+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f13c406b520 con 0x7f13c40cf650 2023-05-17T12:26:24.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.504+0000 7f13c0ff9700 1 -- 172.21.15.88:0/2231936639 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f13b4059510 con 0x7f13c40cf650 2023-05-17T12:26:24.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f13a406ace0 msgr2=0x7f13a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f13a406ace0 0x7f13a406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f13c41e6300 tx=0x7f13ac009040 comp rx=0 tx=0).stop 2023-05-17T12:26:24.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40cf650 msgr2=0x7f13c40ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40cf650 0x7f13c40ccc10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f13b40097c0 tx=0x7f13b4004750 comp rx=0 tx=0).stop 2023-05-17T12:26:24.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 shutdown_connections 2023-05-17T12:26:24.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f13a406ace0 0x7f13a406d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13c415d990 0x7f13c41f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13c40cf650 0x7f13c40ccc10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 --2- 172.21.15.88:0/2231936639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13c40d1bb0 0x7f13c4154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 >> 172.21.15.88:0/2231936639 conn(0x7f13c40d3ed0 msgr2=0x7f13c40b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:24.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 shutdown_connections 2023-05-17T12:26:24.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.506+0000 7f13c99ff700 1 -- 172.21.15.88:0/2231936639 wait complete. 2023-05-17T12:26:24.511 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:26:24.526 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-05-17T12:26:24.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:26:24.527 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-05-17T12:26:24.593 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T12:26:24.594 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T12:26:24.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:26:24.594 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-17T12:26:24.644 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:26:24.645 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:24.686 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:26:24.687 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:24.768 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:24.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.988+0000 7f62a65ff700 1 Processor -- start 2023-05-17T12:26:24.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.989+0000 7f62a65ff700 1 -- start start 2023-05-17T12:26:24.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f62a65ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a01595e0 0x7f62a0070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f62a65ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f62a00ce2a0 0x7f62a00ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f62a65ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a01599b0 con 0x7f62a0071370 2023-05-17T12:26:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f62a65ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a00717e0 con 0x7f62a00ce2a0 2023-05-17T12:26:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f62a65ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a015e000 con 0x7f62a01595e0 2023-05-17T12:26:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f6297fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f62a0071370 0x7f62a00cdb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53618/0 (socket says 172.21.15.88:53618) 2023-05-17T12:26:24.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f6297fff700 1 -- 172.21.15.88:0/833945992 learned_addr learned my addr 172.21.15.88:0/833945992 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:24.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f629ffff700 1 --2- 172.21.15.88:0/833945992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a01595e0 0x7f62a0070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:24.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f62a4b9c700 1 --2- 172.21.15.88:0/833945992 >> v2:172.21.15.187:3300/0 conn(0x7f62a00ce2a0 0x7f62a00ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:24.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.990+0000 7f629f7fe700 1 -- 172.21.15.88:0/833945992 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378383346 0 0) 0x7f62a01599b0 con 0x7f62a0071370 2023-05-17T12:26:24.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f629f7fe700 1 -- 172.21.15.88:0/833945992 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f628c0035b0 con 0x7f62a0071370 2023-05-17T12:26:24.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f629ffff700 1 -- 172.21.15.88:0/833945992 >> v2:172.21.15.187:3300/0 conn(0x7f62a00ce2a0 msgr2=0x7f62a00ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:24.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f629ffff700 1 --2- 172.21.15.88:0/833945992 >> v2:172.21.15.187:3300/0 conn(0x7f62a00ce2a0 0x7f62a00ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f629ffff700 1 -- 172.21.15.88:0/833945992 >> v1:172.21.15.88:6789/0 conn(0x7f62a0071370 legacy=0x7f62a00cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f629ffff700 1 -- 172.21.15.88:0/833945992 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a00cca80 con 0x7f62a01595e0 2023-05-17T12:26:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f62a4b9c700 1 --2- 172.21.15.88:0/833945992 >> v2:172.21.15.187:3300/0 conn(0x7f62a00ce2a0 0x7f62a00ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f629ffff700 1 --2- 172.21.15.88:0/833945992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a01595e0 0x7f62a0070e30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6290009840 tx=0x7f6290009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48a96a13b2433d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f629f7fe700 1 -- 172.21.15.88:0/833945992 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6290011830 con 0x7f62a01595e0 2023-05-17T12:26:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f629f7fe700 1 -- 172.21.15.88:0/833945992 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6290011990 con 0x7f62a01595e0 2023-05-17T12:26:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.991+0000 7f629f7fe700 1 -- 172.21.15.88:0/833945992 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6290011d20 con 0x7f62a01595e0 2023-05-17T12:26:24.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.992+0000 7f62a65ff700 1 -- 172.21.15.88:0/833945992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a01595e0 msgr2=0x7f62a0070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.992+0000 7f62a65ff700 1 --2- 172.21.15.88:0/833945992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a01595e0 0x7f62a0070e30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6290009840 tx=0x7f6290009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.992+0000 7f62a65ff700 1 -- 172.21.15.88:0/833945992 shutdown_connections 2023-05-17T12:26:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.992+0000 7f62a65ff700 1 --2- 172.21.15.88:0/833945992 >> v2:172.21.15.187:3300/0 conn(0x7f62a00ce2a0 0x7f62a00ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.992+0000 7f62a65ff700 1 --2- 172.21.15.88:0/833945992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a01595e0 0x7f62a0070e30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.992+0000 7f62a65ff700 1 -- 172.21.15.88:0/833945992 >> 172.21.15.88:0/833945992 conn(0x7f62a00ced10 msgr2=0x7f62a00cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.992+0000 7f62a65ff700 1 -- 172.21.15.88:0/833945992 shutdown_connections 2023-05-17T12:26:24.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.992+0000 7f62a65ff700 1 -- 172.21.15.88:0/833945992 wait complete. 2023-05-17T12:26:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.994+0000 7f62a65ff700 1 Processor -- start 2023-05-17T12:26:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.994+0000 7f62a65ff700 1 -- start start 2023-05-17T12:26:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f62a65ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a0071370 0x7f62a00c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f62a65ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a00ce2a0 0x7f62a00c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f62a65ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a01595e0 0x7f62a014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f62a65ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00c76f0 con 0x7f62a0071370 2023-05-17T12:26:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f62a65ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00c79d0 con 0x7f62a01595e0 2023-05-17T12:26:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f62a65ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00c7cb0 con 0x7f62a00ce2a0 2023-05-17T12:26:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f629ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a0071370 0x7f62a00c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f629ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a0071370 0x7f62a00c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54450/0 (socket says 172.21.15.88:54450) 2023-05-17T12:26:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f629ffff700 1 -- 172.21.15.88:0/2481519182 learned_addr learned my addr 172.21.15.88:0/2481519182 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:25.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f6297fff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a00ce2a0 0x7f62a00c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f62a4b9c700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a01595e0 0x7f62a014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f629ffff700 1 -- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a00ce2a0 msgr2=0x7f62a00c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f629ffff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a00ce2a0 0x7f62a00c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f629ffff700 1 -- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a01595e0 msgr2=0x7f62a014cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f629ffff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a01595e0 0x7f62a014cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f629ffff700 1 -- 172.21.15.88:0/2481519182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6298009a70 con 0x7f62a0071370 2023-05-17T12:26:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f6297fff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a00ce2a0 0x7f62a00c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:25.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.995+0000 7f629ffff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a0071370 0x7f62a00c8790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f62900090b0 tx=0x7f6290004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:25.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.996+0000 7f629d7fa700 1 -- 172.21.15.88:0/2481519182 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62900045d0 con 0x7f62a0071370 2023-05-17T12:26:25.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.996+0000 7f629d7fa700 1 -- 172.21.15.88:0/2481519182 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629001f070 con 0x7f62a0071370 2023-05-17T12:26:25.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.996+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62900094a0 con 0x7f62a0071370 2023-05-17T12:26:25.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.996+0000 7f629d7fa700 1 -- 172.21.15.88:0/2481519182 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62900038c0 con 0x7f62a0071370 2023-05-17T12:26:25.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.996+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a00cd040 con 0x7f62a0071370 2023-05-17T12:26:25.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.997+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a00ccd60 con 0x7f62a0071370 2023-05-17T12:26:25.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.998+0000 7f629d7fa700 1 -- 172.21.15.88:0/2481519182 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6290003a20 con 0x7f62a0071370 2023-05-17T12:26:25.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.999+0000 7f629d7fa700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f628006ace0 0x7f628006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.999+0000 7f629d7fa700 1 -- 172.21.15.88:0/2481519182 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6290021070 con 0x7f62a0071370 2023-05-17T12:26:25.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:24.999+0000 7f6297fff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f628006ace0 0x7f628006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.000+0000 7f6297fff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f628006ace0 0x7f628006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6288005910 tx=0x7f6288009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:25.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.003+0000 7f629d7fa700 1 -- 172.21.15.88:0/2481519182 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6290055d10 con 0x7f62a0071370 2023-05-17T12:26:25.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.198+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62a00cd320 con 0x7f62a0071370 2023-05-17T12:26:25.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.199+0000 7f629d7fa700 1 -- 172.21.15.88:0/2481519182 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f6290059330 con 0x7f62a0071370 2023-05-17T12:26:25.202 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:25.202 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:25.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f628006ace0 msgr2=0x7f628006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f628006ace0 0x7f628006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6288005910 tx=0x7f6288009040 comp rx=0 tx=0).stop 2023-05-17T12:26:25.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a0071370 msgr2=0x7f62a00c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a0071370 0x7f62a00c8790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f62900090b0 tx=0x7f6290004750 comp rx=0 tx=0).stop 2023-05-17T12:26:25.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 shutdown_connections 2023-05-17T12:26:25.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f628006ace0 0x7f628006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a01595e0 0x7f62a014cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62a0071370 0x7f62a00c8790 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 --2- 172.21.15.88:0/2481519182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a00ce2a0 0x7f62a00c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 >> 172.21.15.88:0/2481519182 conn(0x7f62a00ced10 msgr2=0x7f62a006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:25.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 shutdown_connections 2023-05-17T12:26:25.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.201+0000 7f62a65ff700 1 -- 172.21.15.88:0/2481519182 wait complete. 2023-05-17T12:26:25.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:25.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:25.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.406+0000 7faac79ff700 1 Processor -- start 2023-05-17T12:26:25.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.407+0000 7faac79ff700 1 -- start start 2023-05-17T12:26:25.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faac79ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faac006c760 0x7faac006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faac79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac00b23a0 0x7faac006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faac79ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac006b4a0 con 0x7faac00cf190 2023-05-17T12:26:25.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faac79ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac006a510 con 0x7faac006c760 2023-05-17T12:26:25.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faac79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac006d070 con 0x7faac00b23a0 2023-05-17T12:26:25.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faac5f9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faac00cf190 0x7faac0160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53626/0 (socket says 172.21.15.88:53626) 2023-05-17T12:26:25.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faac5f9c700 1 -- 172.21.15.88:0/3593156569 learned_addr learned my addr 172.21.15.88:0/3593156569 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:25.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faac579b700 1 --2- 172.21.15.88:0/3593156569 >> v2:172.21.15.187:3300/0 conn(0x7faac006c760 0x7faac006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faac4f9a700 1 --2- 172.21.15.88:0/3593156569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac00b23a0 0x7faac006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faab7fff700 1 -- 172.21.15.88:0/3593156569 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704743249 0 0) 0x7faab8001490 con 0x7faac00cf190 2023-05-17T12:26:25.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.408+0000 7faab7fff700 1 -- 172.21.15.88:0/3593156569 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaac0035b0 con 0x7faac00cf190 2023-05-17T12:26:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faac579b700 1 -- 172.21.15.88:0/3593156569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac00b23a0 msgr2=0x7faac006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faac579b700 1 --2- 172.21.15.88:0/3593156569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac00b23a0 0x7faac006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faac579b700 1 -- 172.21.15.88:0/3593156569 >> v1:172.21.15.88:6789/0 conn(0x7faac00cf190 legacy=0x7faac0160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faab7fff700 1 -- 172.21.15.88:0/3593156569 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 171582598 0 0) 0x7faaac0035b0 con 0x7faac00cf190 2023-05-17T12:26:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faac579b700 1 -- 172.21.15.88:0/3593156569 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00cd840 con 0x7faac006c760 2023-05-17T12:26:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faac4f9a700 1 --2- 172.21.15.88:0/3593156569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac00b23a0 0x7faac006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faac579b700 1 --2- 172.21.15.88:0/3593156569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac006c760 0x7faac006af60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faabc009840 tx=0x7faabc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365712af43bbf045 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faab7fff700 1 -- 172.21.15.88:0/3593156569 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8001b80 con 0x7faac006c760 2023-05-17T12:26:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faab7fff700 1 -- 172.21.15.88:0/3593156569 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc004030 con 0x7faac006c760 2023-05-17T12:26:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.409+0000 7faab7fff700 1 -- 172.21.15.88:0/3593156569 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc0043c0 con 0x7faac006c760 2023-05-17T12:26:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.410+0000 7faac79ff700 1 -- 172.21.15.88:0/3593156569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac006c760 msgr2=0x7faac006af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.410+0000 7faac79ff700 1 --2- 172.21.15.88:0/3593156569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac006c760 0x7faac006af60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faabc009840 tx=0x7faabc009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.410+0000 7faac79ff700 1 -- 172.21.15.88:0/3593156569 shutdown_connections 2023-05-17T12:26:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.410+0000 7faac79ff700 1 --2- 172.21.15.88:0/3593156569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac006c760 0x7faac006af60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.410+0000 7faac79ff700 1 --2- 172.21.15.88:0/3593156569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac00b23a0 0x7faac006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.410+0000 7faac79ff700 1 -- 172.21.15.88:0/3593156569 >> 172.21.15.88:0/3593156569 conn(0x7faac00d06f0 msgr2=0x7faac00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:25.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.410+0000 7faac79ff700 1 -- 172.21.15.88:0/3593156569 shutdown_connections 2023-05-17T12:26:25.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.410+0000 7faac79ff700 1 -- 172.21.15.88:0/3593156569 wait complete. 2023-05-17T12:26:25.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.412+0000 7faac79ff700 1 Processor -- start 2023-05-17T12:26:25.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.412+0000 7faac79ff700 1 -- start start 2023-05-17T12:26:25.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac006c760 0x7faac00cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faac00cf190 0x7faac00cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac01530e0 0x7faac00c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac0159940 con 0x7faac00cf190 2023-05-17T12:26:25.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00c7c70 con 0x7faac01530e0 2023-05-17T12:26:25.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac0159b50 con 0x7faac006c760 2023-05-17T12:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac4f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faac00cf190 0x7faac00cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac4f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faac00cf190 0x7faac00cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54458/0 (socket says 172.21.15.88:54458) 2023-05-17T12:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac4f9a700 1 -- 172.21.15.88:0/1274274926 learned_addr learned my addr 172.21.15.88:0/1274274926 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac5f9c700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac01530e0 0x7faac00c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac579b700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac006c760 0x7faac00cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac4f9a700 1 -- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac006c760 msgr2=0x7faac00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac4f9a700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac006c760 0x7faac00cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac4f9a700 1 -- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac01530e0 msgr2=0x7faac00c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac4f9a700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac01530e0 0x7faac00c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac4f9a700 1 -- 172.21.15.88:0/1274274926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab00094a0 con 0x7faac00cf190 2023-05-17T12:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac5f9c700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac01530e0 0x7faac00c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.413+0000 7faac4f9a700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faac00cf190 0x7faac00cce90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faab000ebe0 tx=0x7faab000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.414+0000 7faab5ffb700 1 -- 172.21.15.88:0/1274274926 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0009800 con 0x7faac00cf190 2023-05-17T12:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.414+0000 7faab5ffb700 1 -- 172.21.15.88:0/1274274926 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab000c910 con 0x7faac00cf190 2023-05-17T12:26:25.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.414+0000 7faab5ffb700 1 -- 172.21.15.88:0/1274274926 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000cc80 con 0x7faac00cf190 2023-05-17T12:26:25.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.414+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc0094a0 con 0x7faac00cf190 2023-05-17T12:26:25.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.414+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac006a760 con 0x7faac00cf190 2023-05-17T12:26:25.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.415+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac00cdb20 con 0x7faac00cf190 2023-05-17T12:26:25.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.416+0000 7faab5ffb700 1 -- 172.21.15.88:0/1274274926 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faab0013470 con 0x7faac00cf190 2023-05-17T12:26:25.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.417+0000 7faab5ffb700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faaa406ace0 0x7faaa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.417+0000 7faab5ffb700 1 -- 172.21.15.88:0/1274274926 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faab0089970 con 0x7faac00cf190 2023-05-17T12:26:25.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.417+0000 7faac579b700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faaa406ace0 0x7faaa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.418+0000 7faac579b700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faaa406ace0 0x7faaa406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faabc00a010 tx=0x7faabc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:25.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.422+0000 7faab5ffb700 1 -- 172.21.15.88:0/1274274926 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faab0058170 con 0x7faac00cf190 2023-05-17T12:26:25.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.616+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faac006aa40 con 0x7faac00cf190 2023-05-17T12:26:25.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.617+0000 7faab5ffb700 1 -- 172.21.15.88:0/1274274926 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7faab0057d00 con 0x7faac00cf190 2023-05-17T12:26:25.620 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faaa406ace0 msgr2=0x7faaa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faaa406ace0 0x7faaa406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faabc00a010 tx=0x7faabc008030 comp rx=0 tx=0).stop 2023-05-17T12:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faac00cf190 msgr2=0x7faac00cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faac00cf190 0x7faac00cce90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faab000ebe0 tx=0x7faab000eef0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 shutdown_connections 2023-05-17T12:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7faaa406ace0 0x7faaa406d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faac01530e0 0x7faac00c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faac006c760 0x7faac00cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 --2- 172.21.15.88:0/1274274926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faac00cf190 0x7faac00cce90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 >> 172.21.15.88:0/1274274926 conn(0x7faac00d06f0 msgr2=0x7faac00b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:25.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.619+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 shutdown_connections 2023-05-17T12:26:25.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.620+0000 7faac79ff700 1 -- 172.21.15.88:0/1274274926 wait complete. 2023-05-17T12:26:25.639 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:25.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.824+0000 7fd59a9ff700 1 Processor -- start 2023-05-17T12:26:25.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.825+0000 7fd59a9ff700 1 -- start start 2023-05-17T12:26:25.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.826+0000 7fd59a9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940b23a0 0x7fd59406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.826+0000 7fd59a9ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd5940cf190 0x7fd594160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.826+0000 7fd59a9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59406b4a0 con 0x7fd59406c760 2023-05-17T12:26:25.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.826+0000 7fd59a9ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59406a510 con 0x7fd5940cf190 2023-05-17T12:26:25.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.826+0000 7fd59a9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940cd840 con 0x7fd5940b23a0 2023-05-17T12:26:25.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.827+0000 7fd593fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd59406c760 0x7fd59406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53642/0 (socket says 172.21.15.88:53642) 2023-05-17T12:26:25.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.827+0000 7fd593fff700 1 -- 172.21.15.88:0/2810643476 learned_addr learned my addr 172.21.15.88:0/2810643476 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:25.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.827+0000 7fd5937fe700 1 --2- 172.21.15.88:0/2810643476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940b23a0 0x7fd59406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.827+0000 7fd598f9c700 1 --2- 172.21.15.88:0/2810643476 >> v2:172.21.15.187:3300/0 conn(0x7fd5940cf190 0x7fd594160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.828+0000 7fd592ffd700 1 -- 172.21.15.88:0/2810643476 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283240818 0 0) 0x7fd584001110 con 0x7fd59406c760 2023-05-17T12:26:25.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.828+0000 7fd5937fe700 1 -- 172.21.15.88:0/2810643476 >> v2:172.21.15.187:3300/0 conn(0x7fd5940cf190 msgr2=0x7fd594160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:25.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.828+0000 7fd5937fe700 1 --2- 172.21.15.88:0/2810643476 >> v2:172.21.15.187:3300/0 conn(0x7fd5940cf190 0x7fd594160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.828+0000 7fd5937fe700 1 -- 172.21.15.88:0/2810643476 >> v1:172.21.15.88:6789/0 conn(0x7fd59406c760 legacy=0x7fd59406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.828+0000 7fd5937fe700 1 -- 172.21.15.88:0/2810643476 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5940cdb20 con 0x7fd5940b23a0 2023-05-17T12:26:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.828+0000 7fd5937fe700 1 --2- 172.21.15.88:0/2810643476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940b23a0 0x7fd59406af60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd588009840 tx=0x7fd588009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed341766b90bfc93 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd592ffd700 1 -- 172.21.15.88:0/2810643476 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588011830 con 0x7fd5940b23a0 2023-05-17T12:26:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd592ffd700 1 -- 172.21.15.88:0/2810643476 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588011990 con 0x7fd5940b23a0 2023-05-17T12:26:25.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd592ffd700 1 -- 172.21.15.88:0/2810643476 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588011d20 con 0x7fd5940b23a0 2023-05-17T12:26:25.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2810643476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940b23a0 msgr2=0x7fd59406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd59a9ff700 1 --2- 172.21.15.88:0/2810643476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940b23a0 0x7fd59406af60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd588009840 tx=0x7fd588009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:25.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2810643476 shutdown_connections 2023-05-17T12:26:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd59a9ff700 1 --2- 172.21.15.88:0/2810643476 >> v2:172.21.15.187:3300/0 conn(0x7fd5940cf190 0x7fd594160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd59a9ff700 1 --2- 172.21.15.88:0/2810643476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940b23a0 0x7fd59406af60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2810643476 >> 172.21.15.88:0/2810643476 conn(0x7fd5940d06f0 msgr2=0x7fd5940d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.829+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2810643476 shutdown_connections 2023-05-17T12:26:25.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.830+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2810643476 wait complete. 2023-05-17T12:26:25.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.832+0000 7fd59a9ff700 1 Processor -- start 2023-05-17T12:26:25.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.832+0000 7fd59a9ff700 1 -- start start 2023-05-17T12:26:25.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.833+0000 7fd59a9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd59406c760 0x7fd5941530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.833+0000 7fd59a9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940cf190 0x7fd5940cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.833+0000 7fd59a9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5940b70f0 0x7fd5940b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.833+0000 7fd59a9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5941e8c50 con 0x7fd59406c760 2023-05-17T12:26:25.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.833+0000 7fd59a9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5941535e0 con 0x7fd5940b70f0 2023-05-17T12:26:25.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.833+0000 7fd59a9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940b75f0 con 0x7fd5940cf190 2023-05-17T12:26:25.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.833+0000 7fd593fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd59406c760 0x7fd5941530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd593fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd59406c760 0x7fd5941530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54460/0 (socket says 172.21.15.88:54460) 2023-05-17T12:26:25.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd593fff700 1 -- 172.21.15.88:0/2033000428 learned_addr learned my addr 172.21.15.88:0/2033000428 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:25.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd598f9c700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5940b70f0 0x7fd5940b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd5937fe700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940cf190 0x7fd5940cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd593fff700 1 -- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940cf190 msgr2=0x7fd5940cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd593fff700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940cf190 0x7fd5940cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd593fff700 1 -- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5940b70f0 msgr2=0x7fd5940b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:25.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd593fff700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5940b70f0 0x7fd5940b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:25.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd593fff700 1 -- 172.21.15.88:0/2033000428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880094a0 con 0x7fd59406c760 2023-05-17T12:26:25.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd5937fe700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940cf190 0x7fd5940cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:25.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd593fff700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd59406c760 0x7fd5941530a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c730 tx=0x7fd58400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:25.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd590ff9700 1 -- 172.21.15.88:0/2033000428 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584007560 con 0x7fd59406c760 2023-05-17T12:26:25.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.834+0000 7fd590ff9700 1 -- 172.21.15.88:0/2033000428 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5840076e0 con 0x7fd59406c760 2023-05-17T12:26:25.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.835+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59406aa40 con 0x7fd59406c760 2023-05-17T12:26:25.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.835+0000 7fd590ff9700 1 -- 172.21.15.88:0/2033000428 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584004ab0 con 0x7fd59406c760 2023-05-17T12:26:25.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.835+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59406a760 con 0x7fd59406c760 2023-05-17T12:26:25.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.836+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59415cb40 con 0x7fd59406c760 2023-05-17T12:26:25.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.837+0000 7fd590ff9700 1 -- 172.21.15.88:0/2033000428 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd584004c10 con 0x7fd59406c760 2023-05-17T12:26:25.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.838+0000 7fd590ff9700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd58006ace0 0x7fd58006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:25.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.838+0000 7fd590ff9700 1 -- 172.21.15.88:0/2033000428 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd584089310 con 0x7fd59406c760 2023-05-17T12:26:25.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.838+0000 7fd5937fe700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd58006ace0 0x7fd58006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:25.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.839+0000 7fd5937fe700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd58006ace0 0x7fd58006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd5880090b0 tx=0x7fd588008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:25.842+0000 7fd590ff9700 1 -- 172.21.15.88:0/2033000428 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd584054080 con 0x7fd59406c760 2023-05-17T12:26:26.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.035+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd594074530 con 0x7fd59406c760 2023-05-17T12:26:26.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.036+0000 7fd590ff9700 1 -- 172.21.15.88:0/2033000428 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5840576a0 con 0x7fd59406c760 2023-05-17T12:26:26.039 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:26.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd58006ace0 msgr2=0x7fd58006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd58006ace0 0x7fd58006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd5880090b0 tx=0x7fd588008030 comp rx=0 tx=0).stop 2023-05-17T12:26:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd59406c760 msgr2=0x7fd5941530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd59406c760 0x7fd5941530a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c730 tx=0x7fd58400ca40 comp rx=0 tx=0).stop 2023-05-17T12:26:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 shutdown_connections 2023-05-17T12:26:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd58006ace0 0x7fd58006d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5940b70f0 0x7fd5940b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd59406c760 0x7fd5941530a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 --2- 172.21.15.88:0/2033000428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5940cf190 0x7fd5940cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 >> 172.21.15.88:0/2033000428 conn(0x7fd5940d06f0 msgr2=0x7fd594158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:26.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 shutdown_connections 2023-05-17T12:26:26.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.038+0000 7fd59a9ff700 1 -- 172.21.15.88:0/2033000428 wait complete. 2023-05-17T12:26:26.058 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:26.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.242+0000 7fd7d8fff700 1 Processor -- start 2023-05-17T12:26:26.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.243+0000 7fd7d8fff700 1 -- start start 2023-05-17T12:26:26.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d8fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7d406c760 0x7fd7d406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d8fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd7d40cf190 0x7fd7d4160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d8fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d406b4a0 con 0x7fd7d40b23a0 2023-05-17T12:26:26.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d8fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d406a510 con 0x7fd7d406c760 2023-05-17T12:26:26.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d8fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d40cd840 con 0x7fd7d40cf190 2023-05-17T12:26:26.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7d406c760 0x7fd7d406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7d406c760 0x7fd7d406af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54466/0 (socket says 172.21.15.88:54466) 2023-05-17T12:26:26.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d259c700 1 -- 172.21.15.88:0/3728527402 learned_addr learned my addr 172.21.15.88:0/3728527402 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:26.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d2d9d700 1 --2- 172.21.15.88:0/3728527402 >> v2:172.21.15.187:3300/0 conn(0x7fd7d40cf190 0x7fd7d4160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d259c700 1 -- 172.21.15.88:0/3728527402 >> v2:172.21.15.187:3300/0 conn(0x7fd7d40cf190 msgr2=0x7fd7d4160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:26.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d259c700 1 --2- 172.21.15.88:0/3728527402 >> v2:172.21.15.187:3300/0 conn(0x7fd7d40cf190 0x7fd7d4160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d259c700 1 -- 172.21.15.88:0/3728527402 >> v1:172.21.15.187:6789/0 conn(0x7fd7d40b23a0 legacy=0x7fd7d406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.244+0000 7fd7d259c700 1 -- 172.21.15.88:0/3728527402 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40cdb20 con 0x7fd7d406c760 2023-05-17T12:26:26.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.245+0000 7fd7d259c700 1 --2- 172.21.15.88:0/3728527402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 0x7fd7d406af60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd7d408c360 tx=0x7fd7c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f99ad3dc63f8d3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.245+0000 7fd7d1d9b700 1 -- 172.21.15.88:0/3728527402 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c400b870 con 0x7fd7d406c760 2023-05-17T12:26:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.245+0000 7fd7d1d9b700 1 -- 172.21.15.88:0/3728527402 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c400b9d0 con 0x7fd7d406c760 2023-05-17T12:26:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.245+0000 7fd7d1d9b700 1 -- 172.21.15.88:0/3728527402 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c400bd60 con 0x7fd7d406c760 2023-05-17T12:26:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.245+0000 7fd7d8fff700 1 -- 172.21.15.88:0/3728527402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 msgr2=0x7fd7d406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.245+0000 7fd7d8fff700 1 --2- 172.21.15.88:0/3728527402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 0x7fd7d406af60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd7d408c360 tx=0x7fd7c4009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.246+0000 7fd7d8fff700 1 -- 172.21.15.88:0/3728527402 shutdown_connections 2023-05-17T12:26:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.246+0000 7fd7d8fff700 1 --2- 172.21.15.88:0/3728527402 >> v2:172.21.15.187:3300/0 conn(0x7fd7d40cf190 0x7fd7d4160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.246+0000 7fd7d8fff700 1 --2- 172.21.15.88:0/3728527402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 0x7fd7d406af60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.246+0000 7fd7d8fff700 1 -- 172.21.15.88:0/3728527402 >> 172.21.15.88:0/3728527402 conn(0x7fd7d40d06f0 msgr2=0x7fd7d40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.246+0000 7fd7d8fff700 1 -- 172.21.15.88:0/3728527402 shutdown_connections 2023-05-17T12:26:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.246+0000 7fd7d8fff700 1 -- 172.21.15.88:0/3728527402 wait complete. 2023-05-17T12:26:26.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.247+0000 7fd7d8fff700 1 Processor -- start 2023-05-17T12:26:26.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.247+0000 7fd7d8fff700 1 -- start start 2023-05-17T12:26:26.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.248+0000 7fd7d8fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 0x7fd7d41e6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.248+0000 7fd7d8fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d40cf190 0x7fd7d41f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.248+0000 7fd7d8fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d415bba0 0x7fd7d41e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.248+0000 7fd7d8fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d414fd60 con 0x7fd7d406c760 2023-05-17T12:26:26.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.248+0000 7fd7d8fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41e6e40 con 0x7fd7d40cf190 2023-05-17T12:26:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.248+0000 7fd7d8fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41f60b0 con 0x7fd7d415bba0 2023-05-17T12:26:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.248+0000 7fd7d259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 0x7fd7d41e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7d259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 0x7fd7d41e6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54476/0 (socket says 172.21.15.88:54476) 2023-05-17T12:26:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7d259c700 1 -- 172.21.15.88:0/1824806730 learned_addr learned my addr 172.21.15.88:0/1824806730 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7d259c700 1 -- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d415bba0 msgr2=0x7fd7d41e8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7d259c700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d415bba0 0x7fd7d41e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7d259c700 1 -- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d40cf190 msgr2=0x7fd7d41f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7d259c700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d40cf190 0x7fd7d41f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7d259c700 1 -- 172.21.15.88:0/1824806730 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c4009550 con 0x7fd7d406c760 2023-05-17T12:26:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7d259c700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 0x7fd7d41e6900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4000c00 tx=0x7fd7c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7caffd700 1 -- 172.21.15.88:0/1824806730 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4004540 con 0x7fd7d406c760 2023-05-17T12:26:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7caffd700 1 -- 172.21.15.88:0/1824806730 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c40036a0 con 0x7fd7d406c760 2023-05-17T12:26:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d406aa40 con 0x7fd7d406c760 2023-05-17T12:26:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.249+0000 7fd7caffd700 1 -- 172.21.15.88:0/1824806730 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4003a30 con 0x7fd7d406c760 2023-05-17T12:26:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.250+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d406a760 con 0x7fd7d406c760 2023-05-17T12:26:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.251+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d415cb40 con 0x7fd7d406c760 2023-05-17T12:26:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.251+0000 7fd7caffd700 1 -- 172.21.15.88:0/1824806730 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7c4021070 con 0x7fd7d406c760 2023-05-17T12:26:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.252+0000 7fd7caffd700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b406ad10 0x7fd7b406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.252+0000 7fd7caffd700 1 -- 172.21.15.88:0/1824806730 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd7c408ab60 con 0x7fd7d406c760 2023-05-17T12:26:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.253+0000 7fd7cbfff700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b406ad10 0x7fd7b406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.253+0000 7fd7cbfff700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b406ad10 0x7fd7b406d1c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000f60 tx=0x7fd7bc007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:26.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.256+0000 7fd7caffd700 1 -- 172.21.15.88:0/1824806730 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd7c4055970 con 0x7fd7d406c760 2023-05-17T12:26:26.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.448+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7d40cdd60 con 0x7fd7d406c760 2023-05-17T12:26:26.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.448+0000 7fd7caffd700 1 -- 172.21.15.88:0/1824806730 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7c4058f90 con 0x7fd7d406c760 2023-05-17T12:26:26.451 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:26.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b406ad10 msgr2=0x7fd7b406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b406ad10 0x7fd7b406d1c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc000f60 tx=0x7fd7bc007a40 comp rx=0 tx=0).stop 2023-05-17T12:26:26.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 msgr2=0x7fd7d41e6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 0x7fd7d41e6900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4000c00 tx=0x7fd7c4004750 comp rx=0 tx=0).stop 2023-05-17T12:26:26.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 shutdown_connections 2023-05-17T12:26:26.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b406ad10 0x7fd7b406d1c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d415bba0 0x7fd7d41e8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7d406c760 0x7fd7d41e6900 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 --2- 172.21.15.88:0/1824806730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d40cf190 0x7fd7d41f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 >> 172.21.15.88:0/1824806730 conn(0x7fd7d40d06f0 msgr2=0x7fd7d40d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:26.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 shutdown_connections 2023-05-17T12:26:26.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.450+0000 7fd7d8fff700 1 -- 172.21.15.88:0/1824806730 wait complete. 2023-05-17T12:26:26.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:26.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.655+0000 7fe6a27ff700 1 Processor -- start 2023-05-17T12:26:26.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.656+0000 7fe6a27ff700 1 -- start start 2023-05-17T12:26:26.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a27ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c06c760 0x7fe69c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a27ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe69c0cf190 0x7fe69c160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a27ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c06b4a0 con 0x7fe69c0b23a0 2023-05-17T12:26:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a27ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c06a510 con 0x7fe69c0cf190 2023-05-17T12:26:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a27ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0cd840 con 0x7fe69c06c760 2023-05-17T12:26:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a0d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe69c0cf190 0x7fe69c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe693fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe69c0b23a0 0x7fe69c06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53648/0 (socket says 172.21.15.88:53648) 2023-05-17T12:26:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe693fff700 1 -- 172.21.15.88:0/2808327652 learned_addr learned my addr 172.21.15.88:0/2808327652 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe69bfff700 1 --2- 172.21.15.88:0/2808327652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c06c760 0x7fe69c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a0d9c700 1 -- 172.21.15.88:0/2808327652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c06c760 msgr2=0x7fe69c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a0d9c700 1 --2- 172.21.15.88:0/2808327652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c06c760 0x7fe69c06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a0d9c700 1 -- 172.21.15.88:0/2808327652 >> v1:172.21.15.88:6789/0 conn(0x7fe69c0b23a0 legacy=0x7fe69c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe6a0d9c700 1 -- 172.21.15.88:0/2808327652 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0cdb20 con 0x7fe69c0cf190 2023-05-17T12:26:26.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.657+0000 7fe69b7fe700 1 -- 172.21.15.88:0/2808327652 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285858744 0 0) 0x7fe684001110 con 0x7fe69c0b23a0 2023-05-17T12:26:26.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.658+0000 7fe6a0d9c700 1 --2- 172.21.15.88:0/2808327652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 0x7fe69c160380 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe694009d90 tx=0x7fe69400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dd30fd0a02f27f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:26.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.658+0000 7fe69b7fe700 1 -- 172.21.15.88:0/2808327652 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69400e070 con 0x7fe69c0cf190 2023-05-17T12:26:26.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.658+0000 7fe69b7fe700 1 -- 172.21.15.88:0/2808327652 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69400bbd0 con 0x7fe69c0cf190 2023-05-17T12:26:26.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.658+0000 7fe69b7fe700 1 -- 172.21.15.88:0/2808327652 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694012430 con 0x7fe69c0cf190 2023-05-17T12:26:26.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.658+0000 7fe6a27ff700 1 -- 172.21.15.88:0/2808327652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 msgr2=0x7fe69c160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.658+0000 7fe6a27ff700 1 --2- 172.21.15.88:0/2808327652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 0x7fe69c160380 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe694009d90 tx=0x7fe69400b330 comp rx=0 tx=0).stop 2023-05-17T12:26:26.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.659+0000 7fe6a27ff700 1 -- 172.21.15.88:0/2808327652 shutdown_connections 2023-05-17T12:26:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.659+0000 7fe6a27ff700 1 --2- 172.21.15.88:0/2808327652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 0x7fe69c160380 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.659+0000 7fe6a27ff700 1 --2- 172.21.15.88:0/2808327652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c06c760 0x7fe69c06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.659+0000 7fe6a27ff700 1 -- 172.21.15.88:0/2808327652 >> 172.21.15.88:0/2808327652 conn(0x7fe69c0d06f0 msgr2=0x7fe69c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.659+0000 7fe6a27ff700 1 -- 172.21.15.88:0/2808327652 shutdown_connections 2023-05-17T12:26:26.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.659+0000 7fe6a27ff700 1 -- 172.21.15.88:0/2808327652 wait complete. 2023-05-17T12:26:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.660+0000 7fe6a27ff700 1 Processor -- start 2023-05-17T12:26:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.660+0000 7fe6a27ff700 1 -- start start 2023-05-17T12:26:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.661+0000 7fe6a27ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69c06c760 0x7fe69c153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.661+0000 7fe6a27ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 0x7fe69c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.661+0000 7fe6a27ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c0b29b0 0x7fe69c157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.661+0000 7fe6a27ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0b2eb0 con 0x7fe69c0cf190 2023-05-17T12:26:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.661+0000 7fe6a27ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0b3190 con 0x7fe69c06c760 2023-05-17T12:26:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.661+0000 7fe6a27ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0b3470 con 0x7fe69c0b29b0 2023-05-17T12:26:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe693fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 0x7fe69c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe693fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 0x7fe69c0cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54484/0 (socket says 172.21.15.88:54484) 2023-05-17T12:26:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe693fff700 1 -- 172.21.15.88:0/1685880367 learned_addr learned my addr 172.21.15.88:0/1685880367 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe69bfff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69c06c760 0x7fe69c153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe6a0d9c700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c0b29b0 0x7fe69c157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe693fff700 1 -- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c0b29b0 msgr2=0x7fe69c157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe693fff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c0b29b0 0x7fe69c157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe693fff700 1 -- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69c06c760 msgr2=0x7fe69c153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe693fff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69c06c760 0x7fe69c153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe693fff700 1 -- 172.21.15.88:0/1685880367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694009a70 con 0x7fe69c0cf190 2023-05-17T12:26:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe69bfff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69c06c760 0x7fe69c153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:26.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe6a0d9c700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c0b29b0 0x7fe69c157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe693fff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 0x7fe69c0cc190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c730 tx=0x7fe68400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe6997fa700 1 -- 172.21.15.88:0/1685880367 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684004c80 con 0x7fe69c0cf190 2023-05-17T12:26:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe6997fa700 1 -- 172.21.15.88:0/1685880367 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe684004e00 con 0x7fe69c0cf190 2023-05-17T12:26:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.662+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c06aa40 con 0x7fe69c0cf190 2023-05-17T12:26:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.663+0000 7fe6997fa700 1 -- 172.21.15.88:0/1685880367 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684007310 con 0x7fe69c0cf190 2023-05-17T12:26:26.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.663+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c06a760 con 0x7fe69c0cf190 2023-05-17T12:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.664+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c15cb40 con 0x7fe69c0cf190 2023-05-17T12:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.665+0000 7fe6997fa700 1 -- 172.21.15.88:0/1685880367 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe684007470 con 0x7fe69c0cf190 2023-05-17T12:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.666+0000 7fe6997fa700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe67c06ace0 0x7fe67c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:26.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.666+0000 7fe6997fa700 1 -- 172.21.15.88:0/1685880367 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe6840893d0 con 0x7fe69c0cf190 2023-05-17T12:26:26.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.667+0000 7fe69bfff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe67c06ace0 0x7fe67c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:26.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.668+0000 7fe69bfff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe67c06ace0 0x7fe67c06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009a00 tx=0x7fe68c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:26.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.670+0000 7fe6997fa700 1 -- 172.21.15.88:0/1685880367 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe684054150 con 0x7fe69c0cf190 2023-05-17T12:26:26.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.863+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe69c06b4a0 con 0x7fe69c0cf190 2023-05-17T12:26:26.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.863+0000 7fe6997fa700 1 -- 172.21.15.88:0/1685880367 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe69c06b4a0 con 0x7fe69c0cf190 2023-05-17T12:26:26.866 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:26.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe67c06ace0 msgr2=0x7fe67c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe67c06ace0 0x7fe67c06d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009a00 tx=0x7fe68c008040 comp rx=0 tx=0).stop 2023-05-17T12:26:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 msgr2=0x7fe69c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 0x7fe69c0cc190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c730 tx=0x7fe68400caf0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 shutdown_connections 2023-05-17T12:26:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe67c06ace0 0x7fe67c06d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe69c0b29b0 0x7fe69c157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69c06c760 0x7fe69c153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 --2- 172.21.15.88:0/1685880367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69c0cf190 0x7fe69c0cc190 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:26.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 >> 172.21.15.88:0/1685880367 conn(0x7fe69c0d06f0 msgr2=0x7fe69c15bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:26.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 shutdown_connections 2023-05-17T12:26:26.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:26.866+0000 7fe6a27ff700 1 -- 172.21.15.88:0/1685880367 wait complete. 2023-05-17T12:26:26.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.071+0000 7f873b1ff700 1 Processor -- start 2023-05-17T12:26:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.072+0000 7f873b1ff700 1 -- start start 2023-05-17T12:26:27.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.073+0000 7f873b1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873406c760 0x7f873406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.073+0000 7f873b1ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f87340cf190 0x7f8734160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.073+0000 7f873b1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873406b4a0 con 0x7f87340b23a0 2023-05-17T12:26:27.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.073+0000 7f873b1ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873406a510 con 0x7f87340cf190 2023-05-17T12:26:27.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.073+0000 7f873b1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87340cd840 con 0x7f873406c760 2023-05-17T12:26:27.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.073+0000 7f8733fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f87340b23a0 0x7f873406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53660/0 (socket says 172.21.15.88:53660) 2023-05-17T12:26:27.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.073+0000 7f8733fff700 1 -- 172.21.15.88:0/1756976176 learned_addr learned my addr 172.21.15.88:0/1756976176 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:27.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.073+0000 7f873979c700 1 --2- 172.21.15.88:0/1756976176 >> v2:172.21.15.187:3300/0 conn(0x7f87340cf190 0x7f8734160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.073+0000 7f8738f9b700 1 --2- 172.21.15.88:0/1756976176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873406c760 0x7f873406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f87337fe700 1 -- 172.21.15.88:0/1756976176 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439768945 0 0) 0x7f8720001110 con 0x7f87340b23a0 2023-05-17T12:26:27.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f87337fe700 1 -- 172.21.15.88:0/1756976176 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87240035b0 con 0x7f87340b23a0 2023-05-17T12:26:27.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f8738f9b700 1 -- 172.21.15.88:0/1756976176 >> v2:172.21.15.187:3300/0 conn(0x7f87340cf190 msgr2=0x7f8734160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:27.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f8738f9b700 1 --2- 172.21.15.88:0/1756976176 >> v2:172.21.15.187:3300/0 conn(0x7f87340cf190 0x7f8734160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f8738f9b700 1 -- 172.21.15.88:0/1756976176 >> v1:172.21.15.88:6789/0 conn(0x7f87340b23a0 legacy=0x7f873406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f8738f9b700 1 -- 172.21.15.88:0/1756976176 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87340cdb20 con 0x7f873406c760 2023-05-17T12:26:27.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f873979c700 1 --2- 172.21.15.88:0/1756976176 >> v2:172.21.15.187:3300/0 conn(0x7f87340cf190 0x7f8734160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:27.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f8738f9b700 1 --2- 172.21.15.88:0/1756976176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873406c760 0x7f873406af60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8728009840 tx=0x7f8728009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92121be1fd8316b4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:27.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f87337fe700 1 -- 172.21.15.88:0/1756976176 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011830 con 0x7f873406c760 2023-05-17T12:26:27.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f87337fe700 1 -- 172.21.15.88:0/1756976176 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728011990 con 0x7f873406c760 2023-05-17T12:26:27.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.074+0000 7f87337fe700 1 -- 172.21.15.88:0/1756976176 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011d20 con 0x7f873406c760 2023-05-17T12:26:27.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.075+0000 7f873b1ff700 1 -- 172.21.15.88:0/1756976176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873406c760 msgr2=0x7f873406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.075+0000 7f873b1ff700 1 --2- 172.21.15.88:0/1756976176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873406c760 0x7f873406af60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8728009840 tx=0x7f8728009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:27.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.075+0000 7f873b1ff700 1 -- 172.21.15.88:0/1756976176 shutdown_connections 2023-05-17T12:26:27.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.075+0000 7f873b1ff700 1 --2- 172.21.15.88:0/1756976176 >> v2:172.21.15.187:3300/0 conn(0x7f87340cf190 0x7f8734160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.075+0000 7f873b1ff700 1 --2- 172.21.15.88:0/1756976176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f873406c760 0x7f873406af60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.075+0000 7f873b1ff700 1 -- 172.21.15.88:0/1756976176 >> 172.21.15.88:0/1756976176 conn(0x7f87340d06f0 msgr2=0x7f87340d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:27.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.075+0000 7f873b1ff700 1 -- 172.21.15.88:0/1756976176 shutdown_connections 2023-05-17T12:26:27.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.075+0000 7f873b1ff700 1 -- 172.21.15.88:0/1756976176 wait complete. 2023-05-17T12:26:27.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.077+0000 7f873b1ff700 1 Processor -- start 2023-05-17T12:26:27.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.077+0000 7f873b1ff700 1 -- start start 2023-05-17T12:26:27.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f873b1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873406c760 0x7f8734154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f873b1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87340cf190 0x7f87340c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f873b1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87340c71e0 0x7f87340c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f873b1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8734155860 con 0x7f873406c760 2023-05-17T12:26:27.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f873b1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340c7660 con 0x7f87340cf190 2023-05-17T12:26:27.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f873b1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87341f29a0 con 0x7f87340c71e0 2023-05-17T12:26:27.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f8738f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873406c760 0x7f8734154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f8738f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873406c760 0x7f8734154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54492/0 (socket says 172.21.15.88:54492) 2023-05-17T12:26:27.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f8738f9b700 1 -- 172.21.15.88:0/622585122 learned_addr learned my addr 172.21.15.88:0/622585122 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:27.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f8733fff700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87340cf190 0x7f87340c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f873979c700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87340c71e0 0x7f87340c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f8738f9b700 1 -- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87340c71e0 msgr2=0x7f87340c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f8738f9b700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87340c71e0 0x7f87340c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f8738f9b700 1 -- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87340cf190 msgr2=0x7f87340c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f8738f9b700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87340cf190 0x7f87340c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.078+0000 7f8738f9b700 1 -- 172.21.15.88:0/622585122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009a70 con 0x7f873406c760 2023-05-17T12:26:27.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.079+0000 7f8738f9b700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873406c760 0x7f8734154ce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87280090b0 tx=0x7f8728004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:27.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.079+0000 7f87317fa700 1 -- 172.21.15.88:0/622585122 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280036a0 con 0x7f873406c760 2023-05-17T12:26:27.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.079+0000 7f87317fa700 1 -- 172.21.15.88:0/622585122 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872801f070 con 0x7f873406c760 2023-05-17T12:26:27.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.079+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87280094a0 con 0x7f873406c760 2023-05-17T12:26:27.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.079+0000 7f87317fa700 1 -- 172.21.15.88:0/622585122 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728003a40 con 0x7f873406c760 2023-05-17T12:26:27.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.079+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873406aa40 con 0x7f873406c760 2023-05-17T12:26:27.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.080+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873406a760 con 0x7f873406c760 2023-05-17T12:26:27.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.081+0000 7f87317fa700 1 -- 172.21.15.88:0/622585122 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8728003ba0 con 0x7f873406c760 2023-05-17T12:26:27.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.082+0000 7f87317fa700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f871806ad10 0x7f871806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.082+0000 7f87317fa700 1 -- 172.21.15.88:0/622585122 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8728021070 con 0x7f873406c760 2023-05-17T12:26:27.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.083+0000 7f8733fff700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f871806ad10 0x7f871806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.083+0000 7f8733fff700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f871806ad10 0x7f871806d1c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f87340ccd90 tx=0x7f8720009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:27.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.086+0000 7f87317fa700 1 -- 172.21.15.88:0/622585122 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8728055e60 con 0x7f873406c760 2023-05-17T12:26:27.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.280+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f873415cb40 con 0x7f873406c760 2023-05-17T12:26:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.280+0000 7f87317fa700 1 -- 172.21.15.88:0/622585122 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8728059480 con 0x7f873406c760 2023-05-17T12:26:27.283 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.282+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f871806ad10 msgr2=0x7f871806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.282+0000 7f873b1ff700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f871806ad10 0x7f871806d1c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f87340ccd90 tx=0x7f8720009040 comp rx=0 tx=0).stop 2023-05-17T12:26:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873406c760 msgr2=0x7f8734154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873406c760 0x7f8734154ce0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87280090b0 tx=0x7f8728004750 comp rx=0 tx=0).stop 2023-05-17T12:26:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 shutdown_connections 2023-05-17T12:26:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f871806ad10 0x7f871806d1c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87340c71e0 0x7f87340c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f873406c760 0x7f8734154ce0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 --2- 172.21.15.88:0/622585122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87340cf190 0x7f87340c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 >> 172.21.15.88:0/622585122 conn(0x7f87340d06f0 msgr2=0x7f87340d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:27.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 shutdown_connections 2023-05-17T12:26:27.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.283+0000 7f873b1ff700 1 -- 172.21.15.88:0/622585122 wait complete. 2023-05-17T12:26:27.303 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:26:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.486+0000 7fea2a3ff700 1 Processor -- start 2023-05-17T12:26:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.486+0000 7fea2a3ff700 1 -- start start 2023-05-17T12:26:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.487+0000 7fea2a3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea2406ddb0 0x7fea24070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.487+0000 7fea2a3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2406d080 con 0x7fea24159b70 2023-05-17T12:26:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.487+0000 7fea2a3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2406d920 con 0x7fea240714b0 2023-05-17T12:26:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.487+0000 7fea2a3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea24159f40 con 0x7fea2406ddb0 2023-05-17T12:26:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.487+0000 7fea23fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fea24159b70 0x7fea240cdf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53670/0 (socket says 172.21.15.88:53670) 2023-05-17T12:26:27.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.487+0000 7fea23fff700 1 -- 172.21.15.88:0/1144772989 learned_addr learned my addr 172.21.15.88:0/1144772989 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:27.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea237fe700 1 --2- 172.21.15.88:0/1144772989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea2406ddb0 0x7fea24070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea22ffd700 1 -- 172.21.15.88:0/1144772989 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646184614 0 0) 0x7fea2406d080 con 0x7fea24159b70 2023-05-17T12:26:27.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea22ffd700 1 -- 172.21.15.88:0/1144772989 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea0c0035b0 con 0x7fea24159b70 2023-05-17T12:26:27.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea22ffd700 1 -- 172.21.15.88:0/1144772989 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496064694 0 0) 0x7fea2406d920 con 0x7fea240714b0 2023-05-17T12:26:27.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea22ffd700 1 -- 172.21.15.88:0/1144772989 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea2406d080 con 0x7fea240714b0 2023-05-17T12:26:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea237fe700 1 -- 172.21.15.88:0/1144772989 >> v1:172.21.15.187:6789/0 conn(0x7fea240714b0 legacy=0x7fea240b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea237fe700 1 -- 172.21.15.88:0/1144772989 >> v1:172.21.15.88:6789/0 conn(0x7fea24159b70 legacy=0x7fea240cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea22ffd700 1 -- 172.21.15.88:0/1144772989 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3411279878 0 0) 0x7fea0c0035b0 con 0x7fea24159b70 2023-05-17T12:26:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea237fe700 1 -- 172.21.15.88:0/1144772989 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240ce930 con 0x7fea2406ddb0 2023-05-17T12:26:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.488+0000 7fea237fe700 1 --2- 172.21.15.88:0/1144772989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea2406ddb0 0x7fea24070f70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea18009870 tx=0x7fea18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e510e6f7dd1fdf3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea22ffd700 1 -- 172.21.15.88:0/1144772989 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14001670 con 0x7fea2406ddb0 2023-05-17T12:26:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea22ffd700 1 -- 172.21.15.88:0/1144772989 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea18004030 con 0x7fea2406ddb0 2023-05-17T12:26:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea22ffd700 1 -- 172.21.15.88:0/1144772989 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180043c0 con 0x7fea2406ddb0 2023-05-17T12:26:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea2a3ff700 1 -- 172.21.15.88:0/1144772989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea2406ddb0 msgr2=0x7fea24070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea2a3ff700 1 --2- 172.21.15.88:0/1144772989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea2406ddb0 0x7fea24070f70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea18009870 tx=0x7fea18009b80 comp rx=0 tx=0).stop 2023-05-17T12:26:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea2a3ff700 1 -- 172.21.15.88:0/1144772989 shutdown_connections 2023-05-17T12:26:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea2a3ff700 1 --2- 172.21.15.88:0/1144772989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea2406ddb0 0x7fea24070f70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea2a3ff700 1 -- 172.21.15.88:0/1144772989 >> 172.21.15.88:0/1144772989 conn(0x7fea240b1530 msgr2=0x7fea240ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea2a3ff700 1 -- 172.21.15.88:0/1144772989 shutdown_connections 2023-05-17T12:26:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.489+0000 7fea2a3ff700 1 -- 172.21.15.88:0/1144772989 wait complete. 2023-05-17T12:26:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.491+0000 7fea2a3ff700 1 Processor -- start 2023-05-17T12:26:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.491+0000 7fea2a3ff700 1 -- start start 2023-05-17T12:26:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea2a3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea2406ddb0 0x7fea241f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea2a3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea240714b0 0x7fea24156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea2a3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24159b70 0x7fea24157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea2a3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240c8cb0 con 0x7fea24159b70 2023-05-17T12:26:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea2a3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea241f5af0 con 0x7fea2406ddb0 2023-05-17T12:26:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea2a3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea240b3a30 con 0x7fea240714b0 2023-05-17T12:26:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea2899c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24159b70 0x7fea24157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea2899c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24159b70 0x7fea24157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54506/0 (socket says 172.21.15.88:54506) 2023-05-17T12:26:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea2899c700 1 -- 172.21.15.88:0/4137557312 learned_addr learned my addr 172.21.15.88:0/4137557312 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:27.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea23fff700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea2406ddb0 0x7fea241f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.492+0000 7fea237fe700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea240714b0 0x7fea24156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea2899c700 1 -- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea240714b0 msgr2=0x7fea24156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea2899c700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea240714b0 0x7fea24156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea2899c700 1 -- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea2406ddb0 msgr2=0x7fea241f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea2899c700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea2406ddb0 0x7fea241f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea2899c700 1 -- 172.21.15.88:0/4137557312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180094a0 con 0x7fea24159b70 2023-05-17T12:26:27.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea2899c700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24159b70 0x7fea24157480 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00cc20 tx=0x7fea1c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea20ff9700 1 -- 172.21.15.88:0/4137557312 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c003c00 con 0x7fea24159b70 2023-05-17T12:26:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea20ff9700 1 -- 172.21.15.88:0/4137557312 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c003d60 con 0x7fea24159b70 2023-05-17T12:26:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2406d5b0 con 0x7fea24159b70 2023-05-17T12:26:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea20ff9700 1 -- 172.21.15.88:0/4137557312 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c00aae0 con 0x7fea24159b70 2023-05-17T12:26:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.493+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2406d2d0 con 0x7fea24159b70 2023-05-17T12:26:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.495+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea240ce610 con 0x7fea24159b70 2023-05-17T12:26:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.495+0000 7fea20ff9700 1 -- 172.21.15.88:0/4137557312 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea1c00ac40 con 0x7fea24159b70 2023-05-17T12:26:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.496+0000 7fea20ff9700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fea1006ace0 0x7fea1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.496+0000 7fea20ff9700 1 -- 172.21.15.88:0/4137557312 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fea1c089780 con 0x7fea24159b70 2023-05-17T12:26:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.497+0000 7fea23fff700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fea1006ace0 0x7fea1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:27.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.497+0000 7fea23fff700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fea1006ace0 0x7fea1006d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f60 tx=0x7fea14001670 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.501+0000 7fea20ff9700 1 -- 172.21.15.88:0/4137557312 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fea1c054590 con 0x7fea24159b70 2023-05-17T12:26:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.711+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fea2415d390 con 0x7fea24159b70 2023-05-17T12:26:27.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.712+0000 7fea20ff9700 1 -- 172.21.15.88:0/4137557312 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fea1c057bb0 con 0x7fea24159b70 2023-05-17T12:26:27.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fea1006ace0 msgr2=0x7fea1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fea1006ace0 0x7fea1006d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f60 tx=0x7fea14001670 comp rx=0 tx=0).stop 2023-05-17T12:26:27.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24159b70 msgr2=0x7fea24157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:27.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24159b70 0x7fea24157480 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00cc20 tx=0x7fea1c00cf30 comp rx=0 tx=0).stop 2023-05-17T12:26:27.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 shutdown_connections 2023-05-17T12:26:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fea1006ace0 0x7fea1006d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea24159b70 0x7fea24157480 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea2406ddb0 0x7fea241f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 --2- 172.21.15.88:0/4137557312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea240714b0 0x7fea24156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 >> 172.21.15.88:0/4137557312 conn(0x7fea240b1530 msgr2=0x7fea240cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 shutdown_connections 2023-05-17T12:26:27.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.714+0000 7fea2a3ff700 1 -- 172.21.15.88:0/4137557312 wait complete. 2023-05-17T12:26:27.719 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:26:27.734 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:26:27.735 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:27.776 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:28.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.998+0000 7f43627ff700 1 Processor -- start 2023-05-17T12:26:28.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.998+0000 7f43627ff700 1 -- start start 2023-05-17T12:26:28.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.999+0000 7f43627ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f435c15c840 0x7f435c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:27.999+0000 7f43627ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f435c06c330 0x7f435c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f43627ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c0cd6b0 con 0x7f435c06b0b0 2023-05-17T12:26:28.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f43627ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0cdf50 con 0x7f435c06c330 2023-05-17T12:26:28.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f43627ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c06ccb0 con 0x7f435c15c840 2023-05-17T12:26:28.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f435b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f435c06b0b0 0x7f435c0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53678/0 (socket says 172.21.15.88:53678) 2023-05-17T12:26:28.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f435b7fe700 1 -- 172.21.15.88:0/1352449448 learned_addr learned my addr 172.21.15.88:0/1352449448 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:28.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f4360d9c700 1 --2- 172.21.15.88:0/1352449448 >> v2:172.21.15.88:3300/0 conn(0x7f435c06c330 0x7f435c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f435bfff700 1 --2- 172.21.15.88:0/1352449448 >> v2:172.21.15.187:3300/0 conn(0x7f435c15c840 0x7f435c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f435affd700 1 -- 172.21.15.88:0/1352449448 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241146260 0 0) 0x7f435c0cd6b0 con 0x7f435c06b0b0 2023-05-17T12:26:28.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f435affd700 1 -- 172.21.15.88:0/1352449448 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43440035b0 con 0x7f435c06b0b0 2023-05-17T12:26:28.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f4360d9c700 1 -- 172.21.15.88:0/1352449448 >> v2:172.21.15.187:3300/0 conn(0x7f435c15c840 msgr2=0x7f435c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:28.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f4360d9c700 1 --2- 172.21.15.88:0/1352449448 >> v2:172.21.15.187:3300/0 conn(0x7f435c15c840 0x7f435c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f4360d9c700 1 -- 172.21.15.88:0/1352449448 >> v1:172.21.15.88:6789/0 conn(0x7f435c06b0b0 legacy=0x7f435c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f4360d9c700 1 -- 172.21.15.88:0/1352449448 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0b2460 con 0x7f435c06c330 2023-05-17T12:26:28.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.000+0000 7f435bfff700 1 --2- 172.21.15.88:0/1352449448 >> v2:172.21.15.187:3300/0 conn(0x7f435c15c840 0x7f435c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:28.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.001+0000 7f4360d9c700 1 --2- 172.21.15.88:0/1352449448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 0x7f435c06c770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f435c0cfa40 tx=0x7f435400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcb56c896325c74 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:28.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.001+0000 7f435affd700 1 -- 172.21.15.88:0/1352449448 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435400e070 con 0x7f435c06c330 2023-05-17T12:26:28.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.001+0000 7f435affd700 1 -- 172.21.15.88:0/1352449448 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435400bb20 con 0x7f435c06c330 2023-05-17T12:26:28.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.001+0000 7f435affd700 1 -- 172.21.15.88:0/1352449448 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435400be90 con 0x7f435c06c330 2023-05-17T12:26:28.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.001+0000 7f43627ff700 1 -- 172.21.15.88:0/1352449448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 msgr2=0x7f435c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.001+0000 7f43627ff700 1 --2- 172.21.15.88:0/1352449448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 0x7f435c06c770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f435c0cfa40 tx=0x7f435400b330 comp rx=0 tx=0).stop 2023-05-17T12:26:28.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.001+0000 7f43627ff700 1 -- 172.21.15.88:0/1352449448 shutdown_connections 2023-05-17T12:26:28.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.001+0000 7f43627ff700 1 --2- 172.21.15.88:0/1352449448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 0x7f435c06c770 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.001+0000 7f43627ff700 1 --2- 172.21.15.88:0/1352449448 >> v2:172.21.15.187:3300/0 conn(0x7f435c15c840 0x7f435c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.002+0000 7f43627ff700 1 -- 172.21.15.88:0/1352449448 >> 172.21.15.88:0/1352449448 conn(0x7f435c0d3060 msgr2=0x7f435c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:28.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.002+0000 7f43627ff700 1 -- 172.21.15.88:0/1352449448 shutdown_connections 2023-05-17T12:26:28.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.002+0000 7f43627ff700 1 -- 172.21.15.88:0/1352449448 wait complete. 2023-05-17T12:26:28.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.003+0000 7f43627ff700 1 Processor -- start 2023-05-17T12:26:28.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.003+0000 7f43627ff700 1 -- start start 2023-05-17T12:26:28.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.004+0000 7f43627ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f435c06b0b0 0x7f435c1f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.004+0000 7f43627ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 0x7f435c1f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.004+0000 7f43627ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f435c15c840 0x7f435c0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.004+0000 7f43627ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c1f3af0 con 0x7f435c06c330 2023-05-17T12:26:28.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.004+0000 7f43627ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c1f3450 con 0x7f435c06b0b0 2023-05-17T12:26:28.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.004+0000 7f43627ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0b50f0 con 0x7f435c15c840 2023-05-17T12:26:28.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.004+0000 7f435b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 0x7f435c1f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f435b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 0x7f435c1f5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54530/0 (socket says 172.21.15.88:54530) 2023-05-17T12:26:28.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f435b7fe700 1 -- 172.21.15.88:0/708799166 learned_addr learned my addr 172.21.15.88:0/708799166 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:28.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f435bfff700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f435c06b0b0 0x7f435c1f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f4360d9c700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f435c15c840 0x7f435c0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f435b7fe700 1 -- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f435c15c840 msgr2=0x7f435c0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f435b7fe700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f435c15c840 0x7f435c0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f435b7fe700 1 -- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f435c06b0b0 msgr2=0x7f435c1f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f435b7fe700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f435c06b0b0 0x7f435c1f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f435b7fe700 1 -- 172.21.15.88:0/708799166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354009a70 con 0x7f435c06c330 2023-05-17T12:26:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f4360d9c700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f435c15c840 0x7f435c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f435b7fe700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 0x7f435c1f5c40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f435000c4d0 tx=0x7f435000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f4358ff9700 1 -- 172.21.15.88:0/708799166 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350005d70 con 0x7f435c06c330 2023-05-17T12:26:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f4358ff9700 1 -- 172.21.15.88:0/708799166 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43500070d0 con 0x7f435c06c330 2023-05-17T12:26:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c0cd900 con 0x7f435c06c330 2023-05-17T12:26:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.005+0000 7f4358ff9700 1 -- 172.21.15.88:0/708799166 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4350007440 con 0x7f435c06c330 2023-05-17T12:26:28.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.006+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c0b2740 con 0x7f435c06c330 2023-05-17T12:26:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.007+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c0cdbe0 con 0x7f435c06c330 2023-05-17T12:26:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.007+0000 7f4358ff9700 1 -- 172.21.15.88:0/708799166 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43500075a0 con 0x7f435c06c330 2023-05-17T12:26:28.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.009+0000 7f4358ff9700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f434806ace0 0x7f434806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.009+0000 7f4358ff9700 1 -- 172.21.15.88:0/708799166 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4350088b50 con 0x7f435c06c330 2023-05-17T12:26:28.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.009+0000 7f435bfff700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f434806ace0 0x7f434806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.010+0000 7f435bfff700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f434806ace0 0x7f434806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f434c00c940 tx=0x7f434c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:28.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.013+0000 7f4358ff9700 1 -- 172.21.15.88:0/708799166 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4350053970 con 0x7f435c06c330 2023-05-17T12:26:28.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.206+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f435c1f3c30 con 0x7f435c06c330 2023-05-17T12:26:28.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.207+0000 7f4358ff9700 1 -- 172.21.15.88:0/708799166 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f4350056f90 con 0x7f435c06c330 2023-05-17T12:26:28.210 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:28.210 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:28.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f434806ace0 msgr2=0x7f434806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f434806ace0 0x7f434806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f434c00c940 tx=0x7f434c008040 comp rx=0 tx=0).stop 2023-05-17T12:26:28.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 msgr2=0x7f435c1f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 0x7f435c1f5c40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f435000c4d0 tx=0x7f435000c7e0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 shutdown_connections 2023-05-17T12:26:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f434806ace0 0x7f434806d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f435c15c840 0x7f435c0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f435c06b0b0 0x7f435c1f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 --2- 172.21.15.88:0/708799166 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f435c06c330 0x7f435c1f5c40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 >> 172.21.15.88:0/708799166 conn(0x7f435c0d3060 msgr2=0x7f435c0b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:28.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 shutdown_connections 2023-05-17T12:26:28.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.209+0000 7f43627ff700 1 -- 172.21.15.88:0/708799166 wait complete. 2023-05-17T12:26:28.229 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:28.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:28.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.414+0000 7fa1bc7ff700 1 Processor -- start 2023-05-17T12:26:28.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.414+0000 7fa1bc7ff700 1 -- start start 2023-05-17T12:26:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.415+0000 7fa1bc7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 0x7fa1b406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.415+0000 7fa1bc7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1b40b23a0 0x7fa1b406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.415+0000 7fa1bc7ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b406b4a0 con 0x7fa1b40cf190 2023-05-17T12:26:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.415+0000 7fa1bc7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b406a510 con 0x7fa1b40b23a0 2023-05-17T12:26:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.415+0000 7fa1bc7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b406d070 con 0x7fa1b406c760 2023-05-17T12:26:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.415+0000 7fa1b9d9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1b40b23a0 0x7fa1b406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9d9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa1b40b23a0 0x7fa1b406cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54538/0 (socket says 172.21.15.88:54538) 2023-05-17T12:26:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9d9a700 1 -- 172.21.15.88:0/1650139577 learned_addr learned my addr 172.21.15.88:0/1650139577 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1ba59b700 1 --2- 172.21.15.88:0/1650139577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 0x7fa1b406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9d9a700 1 -- 172.21.15.88:0/1650139577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 msgr2=0x7fa1b406af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9d9a700 1 --2- 172.21.15.88:0/1650139577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 0x7fa1b406af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9d9a700 1 -- 172.21.15.88:0/1650139577 >> v1:172.21.15.187:6789/0 conn(0x7fa1b40cf190 legacy=0x7fa1b4160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9d9a700 1 -- 172.21.15.88:0/1650139577 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40cd840 con 0x7fa1b40b23a0 2023-05-17T12:26:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9d9a700 1 --2- 172.21.15.88:0/1650139577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40b23a0 0x7fa1b406cb30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40098f0 tx=0x7fa1a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761eddd0706f912d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9599700 1 -- 172.21.15.88:0/1650139577 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4004230 con 0x7fa1b40b23a0 2023-05-17T12:26:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9599700 1 -- 172.21.15.88:0/1650139577 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a4004390 con 0x7fa1b40b23a0 2023-05-17T12:26:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.416+0000 7fa1b9599700 1 -- 172.21.15.88:0/1650139577 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40036a0 con 0x7fa1b40b23a0 2023-05-17T12:26:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.417+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/1650139577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40b23a0 msgr2=0x7fa1b406cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.417+0000 7fa1bc7ff700 1 --2- 172.21.15.88:0/1650139577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40b23a0 0x7fa1b406cb30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40098f0 tx=0x7fa1a4009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.417+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/1650139577 shutdown_connections 2023-05-17T12:26:28.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.417+0000 7fa1bc7ff700 1 --2- 172.21.15.88:0/1650139577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 0x7fa1b406af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.417+0000 7fa1bc7ff700 1 --2- 172.21.15.88:0/1650139577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40b23a0 0x7fa1b406cb30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.417+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/1650139577 >> 172.21.15.88:0/1650139577 conn(0x7fa1b40d06f0 msgr2=0x7fa1b40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.417+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/1650139577 shutdown_connections 2023-05-17T12:26:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.417+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/1650139577 wait complete. 2023-05-17T12:26:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.419+0000 7fa1bc7ff700 1 Processor -- start 2023-05-17T12:26:28.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.419+0000 7fa1bc7ff700 1 -- start start 2023-05-17T12:26:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1bc7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 0x7fa1b40b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1bc7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40cf190 0x7fa1b40ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1bc7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1b40b6ed0 0x7fa1b40ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1bc7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40b8030 con 0x7fa1b40cf190 2023-05-17T12:26:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1bc7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40b7420 con 0x7fa1b40b6ed0 2023-05-17T12:26:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1bc7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40b7700 con 0x7fa1b406c760 2023-05-17T12:26:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1b9d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40cf190 0x7fa1b40ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1b9d9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40cf190 0x7fa1b40ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54542/0 (socket says 172.21.15.88:54542) 2023-05-17T12:26:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1b9d9a700 1 -- 172.21.15.88:0/3128075337 learned_addr learned my addr 172.21.15.88:0/3128075337 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1ba59b700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 0x7fa1b40b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.420+0000 7fa1bad9c700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1b40b6ed0 0x7fa1b40ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1b9d9a700 1 -- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 msgr2=0x7fa1b40b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1b9d9a700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 0x7fa1b40b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1b9d9a700 1 -- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1b40b6ed0 msgr2=0x7fa1b40ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1b9d9a700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1b40b6ed0 0x7fa1b40ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1b9d9a700 1 -- 172.21.15.88:0/3128075337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a4009550 con 0x7fa1b40cf190 2023-05-17T12:26:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1b9d9a700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40cf190 0x7fa1b40ccd60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009130 tx=0x7fa1a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1aaffd700 1 -- 172.21.15.88:0/3128075337 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4003aa0 con 0x7fa1b40cf190 2023-05-17T12:26:28.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1aaffd700 1 -- 172.21.15.88:0/3128075337 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a401f070 con 0x7fa1b40cf190 2023-05-17T12:26:28.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1aaffd700 1 -- 172.21.15.88:0/3128075337 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4003e40 con 0x7fa1b40cf190 2023-05-17T12:26:28.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b406a760 con 0x7fa1b40cf190 2023-05-17T12:26:28.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.421+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b40cdb20 con 0x7fa1b40cf190 2023-05-17T12:26:28.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.422+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b406aa40 con 0x7fa1b40cf190 2023-05-17T12:26:28.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.423+0000 7fa1aaffd700 1 -- 172.21.15.88:0/3128075337 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1a4021030 con 0x7fa1b40cf190 2023-05-17T12:26:28.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.424+0000 7fa1aaffd700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa19806ace0 0x7fa19806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.424+0000 7fa1aaffd700 1 -- 172.21.15.88:0/3128075337 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa1a408abe0 con 0x7fa1b40cf190 2023-05-17T12:26:28.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.425+0000 7fa1ba59b700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa19806ace0 0x7fa19806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.425+0000 7fa1ba59b700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa19806ace0 0x7fa19806d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0006b20 tx=0x7fa1b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:28.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.428+0000 7fa1aaffd700 1 -- 172.21.15.88:0/3128075337 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa1a40558c0 con 0x7fa1b40cf190 2023-05-17T12:26:28.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.619+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1b406b4a0 con 0x7fa1b40cf190 2023-05-17T12:26:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.620+0000 7fa1aaffd700 1 -- 172.21.15.88:0/3128075337 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1b406b4a0 con 0x7fa1b40cf190 2023-05-17T12:26:28.623 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa19806ace0 msgr2=0x7fa19806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa19806ace0 0x7fa19806d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0006b20 tx=0x7fa1b0008040 comp rx=0 tx=0).stop 2023-05-17T12:26:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40cf190 msgr2=0x7fa1b40ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40cf190 0x7fa1b40ccd60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009130 tx=0x7fa1a4004750 comp rx=0 tx=0).stop 2023-05-17T12:26:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 shutdown_connections 2023-05-17T12:26:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa19806ace0 0x7fa19806d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1b40b6ed0 0x7fa1b40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1b406c760 0x7fa1b40b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 --2- 172.21.15.88:0/3128075337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1b40cf190 0x7fa1b40ccd60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 >> 172.21.15.88:0/3128075337 conn(0x7fa1b40d06f0 msgr2=0x7fa1b40d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.622+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 shutdown_connections 2023-05-17T12:26:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.623+0000 7fa1bc7ff700 1 -- 172.21.15.88:0/3128075337 wait complete. 2023-05-17T12:26:28.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:28.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.827+0000 7fa20cdff700 1 Processor -- start 2023-05-17T12:26:28.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.827+0000 7fa20cdff700 1 -- start start 2023-05-17T12:26:28.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.828+0000 7fa20cdff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa20806c760 0x7fa20806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.828+0000 7fa20cdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080cf190 0x7fa208160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa20cdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20806b4a0 con 0x7fa2080b23a0 2023-05-17T12:26:28.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa20cdff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20806a510 con 0x7fa20806c760 2023-05-17T12:26:28.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa20cdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080cd840 con 0x7fa2080cf190 2023-05-17T12:26:28.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa1fffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa2080b23a0 0x7fa20806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53686/0 (socket says 172.21.15.88:53686) 2023-05-17T12:26:28.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa1fffff700 1 -- 172.21.15.88:0/40809022 learned_addr learned my addr 172.21.15.88:0/40809022 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:28.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa20659c700 1 --2- 172.21.15.88:0/40809022 >> v2:172.21.15.187:3300/0 conn(0x7fa20806c760 0x7fa20806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa206d9d700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080cf190 0x7fa208160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332326719 0 0) 0x7fa1f0001110 con 0x7fa2080b23a0 2023-05-17T12:26:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f40035b0 con 0x7fa2080b23a0 2023-05-17T12:26:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 21883766 0 0) 0x7fa1f40035b0 con 0x7fa2080b23a0 2023-05-17T12:26:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080cf190 msgr2=0x7fa208160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa205d9b700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080cf190 0x7fa208160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 >> v2:172.21.15.187:3300/0 conn(0x7fa20806c760 msgr2=0x7fa20806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa205d9b700 1 --2- 172.21.15.88:0/40809022 >> v2:172.21.15.187:3300/0 conn(0x7fa20806c760 0x7fa20806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2080cdb20 con 0x7fa2080b23a0 2023-05-17T12:26:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.829+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7fa1f0001800 con 0x7fa2080b23a0 2023-05-17T12:26:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 >> v1:172.21.15.88:6789/0 conn(0x7fa2080b23a0 legacy=0x7fa20806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa205d9b700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080cf190 0x7fa1f4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa205d9b700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4003f80 0x7fa1f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa205d9b700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa1f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20806a510 con 0x7fa1f4004d90 2023-05-17T12:26:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080cd840 con 0x7fa1f4003f80 2023-05-17T12:26:28.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f400ba10 con 0x7fa2080cf190 2023-05-17T12:26:28.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa20659c700 1 --2- 172.21.15.88:0/40809022 >> v2:172.21.15.187:3300/0 conn(0x7fa20806c760 0x7fa20806af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:28.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa206d9d700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa1f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa1fffff700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4003f80 0x7fa1f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa20659c700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080cf190 0x7fa1f4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa206d9d700 1 -- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080cf190 msgr2=0x7fa1f4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:28.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa206d9d700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080cf190 0x7fa1f4003a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa206d9d700 1 -- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4003f80 msgr2=0x7fa1f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa206d9d700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4003f80 0x7fa1f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa206d9d700 1 -- 172.21.15.88:0/40809022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40035b0 con 0x7fa1f4004d90 2023-05-17T12:26:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.830+0000 7fa206d9d700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa1f4005200 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa200009fc0 tx=0x7fa1f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2ccac364b56a16 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20000ec30 con 0x7fa1f4004d90 2023-05-17T12:26:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20000f040 con 0x7fa1f4004d90 2023-05-17T12:26:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa205d9b700 1 -- 172.21.15.88:0/40809022 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200014480 con 0x7fa1f4004d90 2023-05-17T12:26:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa20cdff700 1 -- 172.21.15.88:0/40809022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 msgr2=0x7fa1f4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa20cdff700 1 --2- 172.21.15.88:0/40809022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa1f4005200 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa200009fc0 tx=0x7fa1f4005880 comp rx=0 tx=0).stop 2023-05-17T12:26:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa206d9d700 1 -- 172.21.15.88:0/40809022 reap_dead start 2023-05-17T12:26:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa20cdff700 1 -- 172.21.15.88:0/40809022 shutdown_connections 2023-05-17T12:26:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa20cdff700 1 -- 172.21.15.88:0/40809022 >> 172.21.15.88:0/40809022 conn(0x7fa2080d06f0 msgr2=0x7fa2080d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa20cdff700 1 -- 172.21.15.88:0/40809022 shutdown_connections 2023-05-17T12:26:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.831+0000 7fa20cdff700 1 -- 172.21.15.88:0/40809022 wait complete. 2023-05-17T12:26:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.833+0000 7fa20cdff700 1 Processor -- start 2023-05-17T12:26:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.833+0000 7fa20cdff700 1 -- start start 2023-05-17T12:26:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.834+0000 7fa20cdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa2080cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.834+0000 7fa20cdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa208149450 0x7fa2080b7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.834+0000 7fa20cdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080b7b70 0x7fa2080cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.834+0000 7fa20cdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080b7fe0 con 0x7fa1f4004d90 2023-05-17T12:26:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.834+0000 7fa20cdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080cc9e0 con 0x7fa208149450 2023-05-17T12:26:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.834+0000 7fa20cdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080ca8a0 con 0x7fa2080b7b70 2023-05-17T12:26:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.834+0000 7fa20659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa2080cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.834+0000 7fa20659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa2080cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54572/0 (socket says 172.21.15.88:54572) 2023-05-17T12:26:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.834+0000 7fa20659c700 1 -- 172.21.15.88:0/252387969 learned_addr learned my addr 172.21.15.88:0/252387969 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa1fffff700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa208149450 0x7fa2080b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa206d9d700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080b7b70 0x7fa2080cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa20659c700 1 -- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080b7b70 msgr2=0x7fa2080cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa20659c700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080b7b70 0x7fa2080cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa20659c700 1 -- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa208149450 msgr2=0x7fa2080b7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa20659c700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa208149450 0x7fa2080b7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:28.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa20659c700 1 -- 172.21.15.88:0/252387969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20806aa40 con 0x7fa1f4004d90 2023-05-17T12:26:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa20659c700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa2080cad30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8010c60 tx=0x7fa1f800e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa1feffd700 1 -- 172.21.15.88:0/252387969 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f800ec60 con 0x7fa1f4004d90 2023-05-17T12:26:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa1feffd700 1 -- 172.21.15.88:0/252387969 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f800edc0 con 0x7fa1f4004d90 2023-05-17T12:26:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa1feffd700 1 -- 172.21.15.88:0/252387969 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f801c600 con 0x7fa1f4004d90 2023-05-17T12:26:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20806a760 con 0x7fa1f4004d90 2023-05-17T12:26:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.835+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20815cb40 con 0x7fa1f4004d90 2023-05-17T12:26:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.836+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa208074530 con 0x7fa1f4004d90 2023-05-17T12:26:28.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.837+0000 7fa1feffd700 1 -- 172.21.15.88:0/252387969 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1f80143f0 con 0x7fa1f4004d90 2023-05-17T12:26:28.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.838+0000 7fa1feffd700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa1e806ace0 0x7fa1e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:28.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.839+0000 7fa1feffd700 1 -- 172.21.15.88:0/252387969 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa1f8089a30 con 0x7fa1f4004d90 2023-05-17T12:26:28.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.839+0000 7fa1fffff700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa1e806ace0 0x7fa1e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.839+0000 7fa1fffff700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa1e806ace0 0x7fa1e806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0001050 tx=0x7fa1f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:28.843+0000 7fa1feffd700 1 -- 172.21.15.88:0/252387969 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa1f80547a0 con 0x7fa1f4004d90 2023-05-17T12:26:29.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.036+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa20806b7c0 con 0x7fa1f4004d90 2023-05-17T12:26:29.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.037+0000 7fa1feffd700 1 -- 172.21.15.88:0/252387969 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa1f8057dc0 con 0x7fa1f4004d90 2023-05-17T12:26:29.040 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:29.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa1e806ace0 msgr2=0x7fa1e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa1e806ace0 0x7fa1e806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0001050 tx=0x7fa1f0009040 comp rx=0 tx=0).stop 2023-05-17T12:26:29.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 msgr2=0x7fa2080cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa2080cad30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8010c60 tx=0x7fa1f800e450 comp rx=0 tx=0).stop 2023-05-17T12:26:29.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 shutdown_connections 2023-05-17T12:26:29.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa1e806ace0 0x7fa1e806d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2080b7b70 0x7fa2080cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa1f4004d90 0x7fa2080cad30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 --2- 172.21.15.88:0/252387969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa208149450 0x7fa2080b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 >> 172.21.15.88:0/252387969 conn(0x7fa2080d06f0 msgr2=0x7fa2080b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:29.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 shutdown_connections 2023-05-17T12:26:29.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.039+0000 7fa20cdff700 1 -- 172.21.15.88:0/252387969 wait complete. 2023-05-17T12:26:29.059 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:29.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.244+0000 7f89063ff700 1 Processor -- start 2023-05-17T12:26:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.245+0000 7f89063ff700 1 -- start start 2023-05-17T12:26:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.246+0000 7f89063ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f89000c9370 0x7f89000c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.246+0000 7f89063ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f890006b430 con 0x7f890006a510 2023-05-17T12:26:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.246+0000 7f89063ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f890015ef70 con 0x7f89000b4750 2023-05-17T12:26:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.246+0000 7f89063ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89000c9c80 con 0x7f89000c9370 2023-05-17T12:26:29.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.246+0000 7f88ff7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f890006a510 0x7f890015e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53688/0 (socket says 172.21.15.88:53688) 2023-05-17T12:26:29.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.246+0000 7f88ff7fe700 1 -- 172.21.15.88:0/3864804423 learned_addr learned my addr 172.21.15.88:0/3864804423 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.246+0000 7f88fffff700 1 --2- 172.21.15.88:0/3864804423 >> v2:172.21.15.88:3300/0 conn(0x7f89000c9370 0x7f89000c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.247+0000 7f88fffff700 1 -- 172.21.15.88:0/3864804423 >> v1:172.21.15.187:6789/0 conn(0x7f89000b4750 legacy=0x7f890015e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.247+0000 7f88fffff700 1 -- 172.21.15.88:0/3864804423 >> v1:172.21.15.88:6789/0 conn(0x7f890006a510 legacy=0x7f890015e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.247+0000 7f88fffff700 1 -- 172.21.15.88:0/3864804423 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890006b680 con 0x7f89000c9370 2023-05-17T12:26:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.247+0000 7f88fffff700 1 --2- 172.21.15.88:0/3864804423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89000c9370 0x7f89000c9740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009840 tx=0x7f88f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaff661c1f2c1f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.247+0000 7f88feffd700 1 -- 172.21.15.88:0/3864804423 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0011830 con 0x7f89000c9370 2023-05-17T12:26:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.247+0000 7f88feffd700 1 -- 172.21.15.88:0/3864804423 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0011990 con 0x7f89000c9370 2023-05-17T12:26:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.247+0000 7f88feffd700 1 -- 172.21.15.88:0/3864804423 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0011d20 con 0x7f89000c9370 2023-05-17T12:26:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.248+0000 7f89063ff700 1 -- 172.21.15.88:0/3864804423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89000c9370 msgr2=0x7f89000c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.248+0000 7f89063ff700 1 --2- 172.21.15.88:0/3864804423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89000c9370 0x7f89000c9740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009840 tx=0x7f88f0009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.248+0000 7f89063ff700 1 -- 172.21.15.88:0/3864804423 shutdown_connections 2023-05-17T12:26:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.248+0000 7f89063ff700 1 --2- 172.21.15.88:0/3864804423 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89000c9370 0x7f89000c9740 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.248+0000 7f89063ff700 1 -- 172.21.15.88:0/3864804423 >> 172.21.15.88:0/3864804423 conn(0x7f89000cf970 msgr2=0x7f89000cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.248+0000 7f89063ff700 1 -- 172.21.15.88:0/3864804423 shutdown_connections 2023-05-17T12:26:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.248+0000 7f89063ff700 1 -- 172.21.15.88:0/3864804423 wait complete. 2023-05-17T12:26:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.249+0000 7f89063ff700 1 Processor -- start 2023-05-17T12:26:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.250+0000 7f89063ff700 1 -- start start 2023-05-17T12:26:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.250+0000 7f89063ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f890006a510 0x7f89001e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.250+0000 7f89063ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89000b4750 0x7f89001e5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.250+0000 7f89063ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89000c9370 0x7f890014c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.250+0000 7f89063ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89001e5280 con 0x7f890006a510 2023-05-17T12:26:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.250+0000 7f89063ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89001e61e0 con 0x7f89000c9370 2023-05-17T12:26:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.250+0000 7f89063ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890014ca30 con 0x7f89000b4750 2023-05-17T12:26:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88fffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f890006a510 0x7f89001e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88fffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f890006a510 0x7f89001e3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54600/0 (socket says 172.21.15.88:54600) 2023-05-17T12:26:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88fffff700 1 -- 172.21.15.88:0/2040208128 learned_addr learned my addr 172.21.15.88:0/2040208128 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88ff7fe700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89000b4750 0x7f89001e5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f890499c700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89000c9370 0x7f890014c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88fffff700 1 -- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89000b4750 msgr2=0x7f89001e5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88fffff700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89000b4750 0x7f89001e5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88fffff700 1 -- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89000c9370 msgr2=0x7f890014c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88fffff700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89000c9370 0x7f890014c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88fffff700 1 -- 172.21.15.88:0/2040208128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f00094a0 con 0x7f890006a510 2023-05-17T12:26:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.251+0000 7f88fffff700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f890006a510 0x7f89001e3f90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88f00090b0 tx=0x7f88f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.252+0000 7f88fcff9700 1 -- 172.21.15.88:0/2040208128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f00036a0 con 0x7f890006a510 2023-05-17T12:26:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.252+0000 7f88fcff9700 1 -- 172.21.15.88:0/2040208128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f001e070 con 0x7f890006a510 2023-05-17T12:26:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.252+0000 7f88fcff9700 1 -- 172.21.15.88:0/2040208128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0003a60 con 0x7f890006a510 2023-05-17T12:26:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.252+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890006bc40 con 0x7f890006a510 2023-05-17T12:26:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.252+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890006b960 con 0x7f890006a510 2023-05-17T12:26:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.253+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890015a8e0 con 0x7f890006a510 2023-05-17T12:26:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.254+0000 7f88fcff9700 1 -- 172.21.15.88:0/2040208128 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88f0003bc0 con 0x7f890006a510 2023-05-17T12:26:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.255+0000 7f88fcff9700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f88ec06ace0 0x7f88ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.255+0000 7f88fcff9700 1 -- 172.21.15.88:0/2040208128 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f88f008a820 con 0x7f890006a510 2023-05-17T12:26:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.255+0000 7f88ff7fe700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f88ec06ace0 0x7f88ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.256+0000 7f88ff7fe700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f88ec06ace0 0x7f88ec06d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8900152fa0 tx=0x7f88f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.259+0000 7f88fcff9700 1 -- 172.21.15.88:0/2040208128 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f88f0055590 con 0x7f890006a510 2023-05-17T12:26:29.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.456+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8900074530 con 0x7f890006a510 2023-05-17T12:26:29.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.456+0000 7f88fcff9700 1 -- 172.21.15.88:0/2040208128 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88f0058bb0 con 0x7f890006a510 2023-05-17T12:26:29.460 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f88ec06ace0 msgr2=0x7f88ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f88ec06ace0 0x7f88ec06d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8900152fa0 tx=0x7f88f4009040 comp rx=0 tx=0).stop 2023-05-17T12:26:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f890006a510 msgr2=0x7f89001e3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f890006a510 0x7f89001e3f90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f88f00090b0 tx=0x7f88f0004750 comp rx=0 tx=0).stop 2023-05-17T12:26:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 shutdown_connections 2023-05-17T12:26:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f88ec06ace0 0x7f88ec06d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89000c9370 0x7f890014c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f890006a510 0x7f89001e3f90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 --2- 172.21.15.88:0/2040208128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89000b4750 0x7f89001e5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 >> 172.21.15.88:0/2040208128 conn(0x7f89000cf970 msgr2=0x7f89000b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 shutdown_connections 2023-05-17T12:26:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.459+0000 7f89063ff700 1 -- 172.21.15.88:0/2040208128 wait complete. 2023-05-17T12:26:29.479 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.663+0000 7f05065ff700 1 Processor -- start 2023-05-17T12:26:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.663+0000 7f05065ff700 1 -- start start 2023-05-17T12:26:29.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.664+0000 7f05065ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05000b89e0 0x7f05000cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.664+0000 7f05065ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0500160d10 0x7f050006c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.664+0000 7f05065ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f050006c720 0x7f050006a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.664+0000 7f05065ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05000b28d0 con 0x7f0500160d10 2023-05-17T12:26:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.664+0000 7f05065ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050006cb70 con 0x7f050006c720 2023-05-17T12:26:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.664+0000 7f05065ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000d0c30 con 0x7f05000b89e0 2023-05-17T12:26:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04ff7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0500160d10 0x7f050006c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04ff7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0500160d10 0x7f050006c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54606/0 (socket says 172.21.15.88:54606) 2023-05-17T12:26:29.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04ff7fe700 1 -- 172.21.15.88:0/2137672111 learned_addr learned my addr 172.21.15.88:0/2137672111 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:29.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f0504b9c700 1 --2- 172.21.15.88:0/2137672111 >> v2:172.21.15.187:3300/0 conn(0x7f050006c720 0x7f050006a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04fffff700 1 --2- 172.21.15.88:0/2137672111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05000b89e0 0x7f05000cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04ff7fe700 1 -- 172.21.15.88:0/2137672111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05000b89e0 msgr2=0x7f05000cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:29.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04ff7fe700 1 --2- 172.21.15.88:0/2137672111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05000b89e0 0x7f05000cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04ff7fe700 1 -- 172.21.15.88:0/2137672111 >> v2:172.21.15.187:3300/0 conn(0x7f050006c720 msgr2=0x7f050006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:29.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04ff7fe700 1 --2- 172.21.15.88:0/2137672111 >> v2:172.21.15.187:3300/0 conn(0x7f050006c720 0x7f050006a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04ff7fe700 1 -- 172.21.15.88:0/2137672111 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500161180 con 0x7f0500160d10 2023-05-17T12:26:29.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04ff7fe700 1 --2- 172.21.15.88:0/2137672111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0500160d10 0x7f050006c1e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05000b1f50 tx=0x7f04f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d389348b5b8ffc4c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:29.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.665+0000 7f04feffd700 1 -- 172.21.15.88:0/2137672111 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f400b870 con 0x7f0500160d10 2023-05-17T12:26:29.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f04feffd700 1 -- 172.21.15.88:0/2137672111 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f400b9d0 con 0x7f0500160d10 2023-05-17T12:26:29.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f04feffd700 1 -- 172.21.15.88:0/2137672111 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f400bd60 con 0x7f0500160d10 2023-05-17T12:26:29.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f05065ff700 1 -- 172.21.15.88:0/2137672111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0500160d10 msgr2=0x7f050006c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f05065ff700 1 --2- 172.21.15.88:0/2137672111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0500160d10 0x7f050006c1e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05000b1f50 tx=0x7f04f4009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f05065ff700 1 -- 172.21.15.88:0/2137672111 shutdown_connections 2023-05-17T12:26:29.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f05065ff700 1 --2- 172.21.15.88:0/2137672111 >> v2:172.21.15.187:3300/0 conn(0x7f050006c720 0x7f050006a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f05065ff700 1 --2- 172.21.15.88:0/2137672111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05000b89e0 0x7f05000cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f05065ff700 1 --2- 172.21.15.88:0/2137672111 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0500160d10 0x7f050006c1e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f05065ff700 1 -- 172.21.15.88:0/2137672111 >> 172.21.15.88:0/2137672111 conn(0x7f05000d05c0 msgr2=0x7f05000d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:29.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f05065ff700 1 -- 172.21.15.88:0/2137672111 shutdown_connections 2023-05-17T12:26:29.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.666+0000 7f05065ff700 1 -- 172.21.15.88:0/2137672111 wait complete. 2023-05-17T12:26:29.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.668+0000 7f05065ff700 1 Processor -- start 2023-05-17T12:26:29.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.668+0000 7f05065ff700 1 -- start start 2023-05-17T12:26:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f05065ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006c720 0x7f050015d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f05065ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05000b89e0 0x7f05001f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f05065ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0500160d10 0x7f05000d1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f05065ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05001f2f60 con 0x7f05000b89e0 2023-05-17T12:26:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f05065ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050015fc80 con 0x7f0500160d10 2023-05-17T12:26:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f05065ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000c7d70 con 0x7f050006c720 2023-05-17T12:26:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f04ff7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05000b89e0 0x7f05001f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f04ff7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05000b89e0 0x7f05001f2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54610/0 (socket says 172.21.15.88:54610) 2023-05-17T12:26:29.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f04ff7fe700 1 -- 172.21.15.88:0/1876699984 learned_addr learned my addr 172.21.15.88:0/1876699984 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:29.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f0504b9c700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0500160d10 0x7f05000d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f04fffff700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006c720 0x7f050015d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f04ff7fe700 1 -- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006c720 msgr2=0x7f050015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f04ff7fe700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006c720 0x7f050015d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f04ff7fe700 1 -- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0500160d10 msgr2=0x7f05000d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f04ff7fe700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0500160d10 0x7f05000d1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.669+0000 7f04ff7fe700 1 -- 172.21.15.88:0/1876699984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f4009550 con 0x7f05000b89e0 2023-05-17T12:26:29.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.670+0000 7f04ff7fe700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05000b89e0 0x7f05001f2a20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f04f4014040 tx=0x7f04f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:29.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.670+0000 7f04fcff9700 1 -- 172.21.15.88:0/1876699984 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4004520 con 0x7f05000b89e0 2023-05-17T12:26:29.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.670+0000 7f04fcff9700 1 -- 172.21.15.88:0/1876699984 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f401e070 con 0x7f05000b89e0 2023-05-17T12:26:29.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.670+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05000cda30 con 0x7f05000b89e0 2023-05-17T12:26:29.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.670+0000 7f04fcff9700 1 -- 172.21.15.88:0/1876699984 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f40038c0 con 0x7f05000b89e0 2023-05-17T12:26:29.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.670+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05000cd750 con 0x7f05000b89e0 2023-05-17T12:26:29.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.671+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05000cdd10 con 0x7f05000b89e0 2023-05-17T12:26:29.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.672+0000 7f04fcff9700 1 -- 172.21.15.88:0/1876699984 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04f4003a20 con 0x7f05000b89e0 2023-05-17T12:26:29.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.673+0000 7f04fcff9700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f04ec06ace0 0x7f04ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:29.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.673+0000 7f04fcff9700 1 -- 172.21.15.88:0/1876699984 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f04f4020070 con 0x7f05000b89e0 2023-05-17T12:26:29.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.674+0000 7f04fffff700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f04ec06ace0 0x7f04ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:29.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.674+0000 7f04fffff700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f04ec06ace0 0x7f04ec06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f05000b4ab0 tx=0x7f04f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:29.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.678+0000 7f04fcff9700 1 -- 172.21.15.88:0/1876699984 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f04f4055ac0 con 0x7f05000b89e0 2023-05-17T12:26:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.873+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0500074530 con 0x7f05000b89e0 2023-05-17T12:26:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.873+0000 7f04fcff9700 1 -- 172.21.15.88:0/1876699984 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04f40150a0 con 0x7f05000b89e0 2023-05-17T12:26:29.877 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:29.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f04ec06ace0 msgr2=0x7f04ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f04ec06ace0 0x7f04ec06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f05000b4ab0 tx=0x7f04f0008040 comp rx=0 tx=0).stop 2023-05-17T12:26:29.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05000b89e0 msgr2=0x7f05001f2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:29.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05000b89e0 0x7f05001f2a20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f04f4014040 tx=0x7f04f4004750 comp rx=0 tx=0).stop 2023-05-17T12:26:29.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 shutdown_connections 2023-05-17T12:26:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f04ec06ace0 0x7f04ec06d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0500160d10 0x7f05000d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f050006c720 0x7f050015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 --2- 172.21.15.88:0/1876699984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05000b89e0 0x7f05001f2a20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:29.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 >> 172.21.15.88:0/1876699984 conn(0x7f05000d05c0 msgr2=0x7f050006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:29.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 shutdown_connections 2023-05-17T12:26:29.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:29.876+0000 7f05065ff700 1 -- 172.21.15.88:0/1876699984 wait complete. 2023-05-17T12:26:29.896 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:30.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.080+0000 7ff8df3ff700 1 Processor -- start 2023-05-17T12:26:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.081+0000 7ff8df3ff700 1 -- start start 2023-05-17T12:26:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.082+0000 7ff8df3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8d815c9c0 0x7ff8d80b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.082+0000 7ff8df3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d80ceb80 0x7ff8d80cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.082+0000 7ff8df3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d80cf520 con 0x7ff8d8160e80 2023-05-17T12:26:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.082+0000 7ff8df3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d815cd90 con 0x7ff8d815c9c0 2023-05-17T12:26:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.082+0000 7ff8df3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80b37c0 con 0x7ff8d80ceb80 2023-05-17T12:26:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.082+0000 7ff8dd99c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d80ceb80 0x7ff8d80cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.082+0000 7ff8dd19b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8d815c9c0 0x7ff8d80b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.082+0000 7ff8dc99a700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ff8d8160e80 0x7ff8d80cb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:59500/0 (socket says 172.21.15.88:59500) 2023-05-17T12:26:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.082+0000 7ff8dc99a700 1 -- 172.21.15.88:0/4124512091 learned_addr learned my addr 172.21.15.88:0/4124512091 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.083+0000 7ff8cffff700 1 -- 172.21.15.88:0/4124512091 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206911527 0 0) 0x7ff8d80cf520 con 0x7ff8d8160e80 2023-05-17T12:26:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.083+0000 7ff8cffff700 1 -- 172.21.15.88:0/4124512091 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c40035b0 con 0x7ff8d8160e80 2023-05-17T12:26:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.083+0000 7ff8dd19b700 1 -- 172.21.15.88:0/4124512091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d80ceb80 msgr2=0x7ff8d80cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:30.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.083+0000 7ff8dd19b700 1 --2- 172.21.15.88:0/4124512091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d80ceb80 0x7ff8d80cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.083+0000 7ff8dd19b700 1 -- 172.21.15.88:0/4124512091 >> v1:172.21.15.187:6789/0 conn(0x7ff8d8160e80 legacy=0x7ff8d80cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.083+0000 7ff8dd19b700 1 -- 172.21.15.88:0/4124512091 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80b39d0 con 0x7ff8d815c9c0 2023-05-17T12:26:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.083+0000 7ff8dd19b700 1 --2- 172.21.15.88:0/4124512091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d815c9c0 0x7ff8d80b3280 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009840 tx=0x7ff8d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2762ab176012e558 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.083+0000 7ff8cffff700 1 -- 172.21.15.88:0/4124512091 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4011830 con 0x7ff8d815c9c0 2023-05-17T12:26:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8cffff700 1 -- 172.21.15.88:0/4124512091 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d4011990 con 0x7ff8d815c9c0 2023-05-17T12:26:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8cffff700 1 -- 172.21.15.88:0/4124512091 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4011d20 con 0x7ff8d815c9c0 2023-05-17T12:26:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8df3ff700 1 -- 172.21.15.88:0/4124512091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d815c9c0 msgr2=0x7ff8d80b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8df3ff700 1 --2- 172.21.15.88:0/4124512091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d815c9c0 0x7ff8d80b3280 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009840 tx=0x7ff8d4009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8df3ff700 1 -- 172.21.15.88:0/4124512091 shutdown_connections 2023-05-17T12:26:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8df3ff700 1 --2- 172.21.15.88:0/4124512091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d80ceb80 0x7ff8d80cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8df3ff700 1 --2- 172.21.15.88:0/4124512091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d815c9c0 0x7ff8d80b3280 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8df3ff700 1 -- 172.21.15.88:0/4124512091 >> 172.21.15.88:0/4124512091 conn(0x7ff8d80d1c40 msgr2=0x7ff8d80b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8df3ff700 1 -- 172.21.15.88:0/4124512091 shutdown_connections 2023-05-17T12:26:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.084+0000 7ff8df3ff700 1 -- 172.21.15.88:0/4124512091 wait complete. 2023-05-17T12:26:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.086+0000 7ff8df3ff700 1 Processor -- start 2023-05-17T12:26:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.086+0000 7ff8df3ff700 1 -- start start 2023-05-17T12:26:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8df3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d80ceb80 0x7ff8d815df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8df3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8d815c9c0 0x7ff8d8152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8df3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d8160e80 0x7ff8d80b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8df3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d815e5c0 con 0x7ff8d815c9c0 2023-05-17T12:26:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8df3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d815e8a0 con 0x7ff8d80ceb80 2023-05-17T12:26:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8df3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d815eb80 con 0x7ff8d8160e80 2023-05-17T12:26:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8dc99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8d815c9c0 0x7ff8d8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8dc99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8d815c9c0 0x7ff8d8152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54612/0 (socket says 172.21.15.88:54612) 2023-05-17T12:26:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8dc99a700 1 -- 172.21.15.88:0/3014317445 learned_addr learned my addr 172.21.15.88:0/3014317445 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8dd19b700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d80ceb80 0x7ff8d815df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.087+0000 7ff8dd99c700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d8160e80 0x7ff8d80b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8dc99a700 1 -- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d8160e80 msgr2=0x7ff8d80b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8dc99a700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d8160e80 0x7ff8d80b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8dc99a700 1 -- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d80ceb80 msgr2=0x7ff8d815df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8dc99a700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d80ceb80 0x7ff8d815df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8dc99a700 1 -- 172.21.15.88:0/3014317445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d40094a0 con 0x7ff8d815c9c0 2023-05-17T12:26:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8dc99a700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8d815c9c0 0x7ff8d8152560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c700 tx=0x7ff8c800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8cdffb700 1 -- 172.21.15.88:0/3014317445 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8005d70 con 0x7ff8d815c9c0 2023-05-17T12:26:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8cdffb700 1 -- 172.21.15.88:0/3014317445 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c80070d0 con 0x7ff8d815c9c0 2023-05-17T12:26:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8cdffb700 1 -- 172.21.15.88:0/3014317445 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8007460 con 0x7ff8d815c9c0 2023-05-17T12:26:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d806c1f0 con 0x7ff8d815c9c0 2023-05-17T12:26:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.088+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d80cbd10 con 0x7ff8d815c9c0 2023-05-17T12:26:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.089+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d806c4d0 con 0x7ff8d815c9c0 2023-05-17T12:26:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.090+0000 7ff8cdffb700 1 -- 172.21.15.88:0/3014317445 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8c80075c0 con 0x7ff8d815c9c0 2023-05-17T12:26:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.091+0000 7ff8cdffb700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8bc06ace0 0x7ff8bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.091+0000 7ff8cdffb700 1 -- 172.21.15.88:0/3014317445 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff8c8088c40 con 0x7ff8d815c9c0 2023-05-17T12:26:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.092+0000 7ff8dd19b700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8bc06ace0 0x7ff8bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.092+0000 7ff8dd19b700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8bc06ace0 0x7ff8bc06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4000c00 tx=0x7ff8d401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.096+0000 7ff8cdffb700 1 -- 172.21.15.88:0/3014317445 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff8c80539b0 con 0x7ff8d815c9c0 2023-05-17T12:26:30.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.291+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff8d80cf800 con 0x7ff8d815c9c0 2023-05-17T12:26:30.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.292+0000 7ff8cdffb700 1 -- 172.21.15.88:0/3014317445 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff8c80170a0 con 0x7ff8d815c9c0 2023-05-17T12:26:30.295 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8bc06ace0 msgr2=0x7ff8bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8bc06ace0 0x7ff8bc06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4000c00 tx=0x7ff8d401c040 comp rx=0 tx=0).stop 2023-05-17T12:26:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8d815c9c0 msgr2=0x7ff8d8152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8d815c9c0 0x7ff8d8152560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c700 tx=0x7ff8c800ca10 comp rx=0 tx=0).stop 2023-05-17T12:26:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 shutdown_connections 2023-05-17T12:26:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff8bc06ace0 0x7ff8bc06d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8d8160e80 0x7ff8d80b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d80ceb80 0x7ff8d815df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 --2- 172.21.15.88:0/3014317445 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff8d815c9c0 0x7ff8d8152560 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 >> 172.21.15.88:0/3014317445 conn(0x7ff8d80d1c40 msgr2=0x7ff8d80b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:30.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 shutdown_connections 2023-05-17T12:26:30.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.294+0000 7ff8df3ff700 1 -- 172.21.15.88:0/3014317445 wait complete. 2023-05-17T12:26:30.315 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:26:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.498+0000 7f6474fff700 1 Processor -- start 2023-05-17T12:26:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.498+0000 7f6474fff700 1 -- start start 2023-05-17T12:26:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.499+0000 7f6474fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 0x7f64700cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.499+0000 7f6474fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6470160f90 0x7f647006c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.499+0000 7f6474fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f647006ca50 0x7f647006a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.499+0000 7f6474fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647006ced0 con 0x7f6470160f90 2023-05-17T12:26:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.499+0000 7f6474fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64700cde90 con 0x7f647006ca50 2023-05-17T12:26:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.499+0000 7f6474fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647015d270 con 0x7f647015ca90 2023-05-17T12:26:30.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.499+0000 7f646dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6470160f90 0x7f647006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6470160f90 0x7f647006c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54624/0 (socket says 172.21.15.88:54624) 2023-05-17T12:26:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646dd9b700 1 -- 172.21.15.88:0/2749823359 learned_addr learned my addr 172.21.15.88:0/2749823359 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646e59c700 1 --2- 172.21.15.88:0/2749823359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 0x7f64700cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646ed9d700 1 --2- 172.21.15.88:0/2749823359 >> v2:172.21.15.187:3300/0 conn(0x7f647006ca50 0x7f647006a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646dd9b700 1 -- 172.21.15.88:0/2749823359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 msgr2=0x7f64700cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:30.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646dd9b700 1 --2- 172.21.15.88:0/2749823359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 0x7f64700cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646dd9b700 1 -- 172.21.15.88:0/2749823359 >> v2:172.21.15.187:3300/0 conn(0x7f647006ca50 msgr2=0x7f647006a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:30.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646dd9b700 1 --2- 172.21.15.88:0/2749823359 >> v2:172.21.15.187:3300/0 conn(0x7f647006ca50 0x7f647006a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646dd9b700 1 -- 172.21.15.88:0/2749823359 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647015d550 con 0x7f6470160f90 2023-05-17T12:26:30.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646dd9b700 1 --2- 172.21.15.88:0/2749823359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 0x7f647006c510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f64700cfc60 tx=0x7f6464009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f4431bdef40c8d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:30.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646d59a700 1 -- 172.21.15.88:0/2749823359 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464011830 con 0x7f6470160f90 2023-05-17T12:26:30.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.500+0000 7f646d59a700 1 -- 172.21.15.88:0/2749823359 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6464011990 con 0x7f6470160f90 2023-05-17T12:26:30.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f646d59a700 1 -- 172.21.15.88:0/2749823359 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464011d20 con 0x7f6470160f90 2023-05-17T12:26:30.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f6474fff700 1 -- 172.21.15.88:0/2749823359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 msgr2=0x7f647006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f6474fff700 1 --2- 172.21.15.88:0/2749823359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 0x7f647006c510 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f64700cfc60 tx=0x7f6464009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f6474fff700 1 -- 172.21.15.88:0/2749823359 shutdown_connections 2023-05-17T12:26:30.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f6474fff700 1 --2- 172.21.15.88:0/2749823359 >> v2:172.21.15.187:3300/0 conn(0x7f647006ca50 0x7f647006a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f6474fff700 1 --2- 172.21.15.88:0/2749823359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 0x7f64700cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f6474fff700 1 --2- 172.21.15.88:0/2749823359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 0x7f647006c510 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f6474fff700 1 -- 172.21.15.88:0/2749823359 >> 172.21.15.88:0/2749823359 conn(0x7f64700d3ed0 msgr2=0x7f64700cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:30.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f6474fff700 1 -- 172.21.15.88:0/2749823359 shutdown_connections 2023-05-17T12:26:30.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.501+0000 7f6474fff700 1 -- 172.21.15.88:0/2749823359 wait complete. 2023-05-17T12:26:30.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.503+0000 7f6474fff700 1 Processor -- start 2023-05-17T12:26:30.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.503+0000 7f6474fff700 1 -- start start 2023-05-17T12:26:30.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f6474fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647006ca50 0x7f64700c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f6474fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 0x7f64701f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f6474fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 0x7f64701f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f6474fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64700c8650 con 0x7f6470160f90 2023-05-17T12:26:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f6474fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64700c9680 con 0x7f647006ca50 2023-05-17T12:26:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f6474fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64701f21e0 con 0x7f647015ca90 2023-05-17T12:26:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f646ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 0x7f64701f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f646ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 0x7f64701f58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54634/0 (socket says 172.21.15.88:54634) 2023-05-17T12:26:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f646ed9d700 1 -- 172.21.15.88:0/1323947240 learned_addr learned my addr 172.21.15.88:0/1323947240 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f646e59c700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647006ca50 0x7f64700c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.504+0000 7f646dd9b700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 0x7f64701f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f646ed9d700 1 -- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 msgr2=0x7f64701f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f646ed9d700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 0x7f64701f1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f646ed9d700 1 -- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647006ca50 msgr2=0x7f64700c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f646ed9d700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647006ca50 0x7f64700c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f646ed9d700 1 -- 172.21.15.88:0/1323947240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464009550 con 0x7f6470160f90 2023-05-17T12:26:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f646e59c700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647006ca50 0x7f64700c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f646ed9d700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 0x7f64701f58d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f646800eed0 tx=0x7f646800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:30.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f645effd700 1 -- 172.21.15.88:0/1323947240 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468010040 con 0x7f6470160f90 2023-05-17T12:26:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f645effd700 1 -- 172.21.15.88:0/1323947240 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646800bd30 con 0x7f6470160f90 2023-05-17T12:26:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6470161400 con 0x7f6470160f90 2023-05-17T12:26:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f645effd700 1 -- 172.21.15.88:0/1323947240 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468009ea0 con 0x7f6470160f90 2023-05-17T12:26:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.505+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647015d830 con 0x7f6470160f90 2023-05-17T12:26:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.506+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647015dd50 con 0x7f6470160f90 2023-05-17T12:26:30.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.507+0000 7f645effd700 1 -- 172.21.15.88:0/1323947240 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6468014640 con 0x7f6470160f90 2023-05-17T12:26:30.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.508+0000 7f645effd700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f645006ace0 0x7f645006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:30.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.508+0000 7f645effd700 1 -- 172.21.15.88:0/1323947240 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f646808a0a0 con 0x7f6470160f90 2023-05-17T12:26:30.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.508+0000 7f646e59c700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f645006ace0 0x7f645006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:30.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.509+0000 7f646e59c700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f645006ace0 0x7f645006d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6460009b60 tx=0x7f6460008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:30.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.512+0000 7f645effd700 1 -- 172.21.15.88:0/1323947240 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6468054e10 con 0x7f6470160f90 2023-05-17T12:26:30.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.720+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6470074530 con 0x7f6470160f90 2023-05-17T12:26:30.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.720+0000 7f645effd700 1 -- 172.21.15.88:0/1323947240 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6468058430 con 0x7f6470160f90 2023-05-17T12:26:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f645006ace0 msgr2=0x7f645006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f645006ace0 0x7f645006d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6460009b60 tx=0x7f6460008040 comp rx=0 tx=0).stop 2023-05-17T12:26:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 msgr2=0x7f64701f58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 0x7f64701f58d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f646800eed0 tx=0x7f646800b390 comp rx=0 tx=0).stop 2023-05-17T12:26:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 shutdown_connections 2023-05-17T12:26:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f645006ace0 0x7f645006d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6470160f90 0x7f64701f58d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f647006ca50 0x7f64700c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 --2- 172.21.15.88:0/1323947240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f647015ca90 0x7f64701f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:30.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 >> 172.21.15.88:0/1323947240 conn(0x7f64700d3ed0 msgr2=0x7f647015e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:30.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 shutdown_connections 2023-05-17T12:26:30.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:30.722+0000 7f6474fff700 1 -- 172.21.15.88:0/1323947240 wait complete. 2023-05-17T12:26:30.727 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:26:30.742 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-05-17T12:26:30.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:26:30.743 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-05-17T12:26:30.804 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T12:26:30.805 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T12:26:30.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:26:30.805 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-17T12:26:30.847 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:26:30.848 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:30.894 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:26:30.895 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:30.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:31.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.161+0000 7f87a2bff700 1 Processor -- start 2023-05-17T12:26:31.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.161+0000 7f87a2bff700 1 -- start start 2023-05-17T12:26:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.162+0000 7f87a2bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c15c840 0x7f879c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.162+0000 7f87a2bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f879c06b0b0 0x7f879c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.162+0000 7f87a2bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c0cd6b0 con 0x7f879c06c330 2023-05-17T12:26:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.162+0000 7f87a2bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c0cdf50 con 0x7f879c06b0b0 2023-05-17T12:26:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.162+0000 7f87a2bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0cf860 con 0x7f879c15c840 2023-05-17T12:26:31.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.162+0000 7f879bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f879c06b0b0 0x7f879c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.162+0000 7f879bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f879c06b0b0 0x7f879c0cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48628/0 (socket says 172.21.15.88:48628) 2023-05-17T12:26:31.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.162+0000 7f879bfff700 1 -- 172.21.15.88:0/170436924 learned_addr learned my addr 172.21.15.88:0/170436924 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:31.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.163+0000 7f87a099b700 1 --2- 172.21.15.88:0/170436924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c15c840 0x7f879c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.163+0000 7f879bfff700 1 -- 172.21.15.88:0/170436924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c15c840 msgr2=0x7f879c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:31.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.163+0000 7f879bfff700 1 --2- 172.21.15.88:0/170436924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c15c840 0x7f879c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.163+0000 7f879bfff700 1 -- 172.21.15.88:0/170436924 >> v1:172.21.15.187:6789/0 conn(0x7f879c06c330 legacy=0x7f879c160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:31.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.163+0000 7f879bfff700 1 -- 172.21.15.88:0/170436924 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c0b2460 con 0x7f879c06b0b0 2023-05-17T12:26:31.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.163+0000 7f879bfff700 1 --2- 172.21.15.88:0/170436924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c06b0b0 0x7f879c0cf320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f87880098f0 tx=0x7f8788009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64750357ea8a6d14 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:31.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.163+0000 7f879b7fe700 1 -- 172.21.15.88:0/170436924 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800b8a0 con 0x7f879c06b0b0 2023-05-17T12:26:31.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.163+0000 7f879b7fe700 1 -- 172.21.15.88:0/170436924 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878800ba00 con 0x7f879c06b0b0 2023-05-17T12:26:31.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.163+0000 7f879b7fe700 1 -- 172.21.15.88:0/170436924 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800bd90 con 0x7f879c06b0b0 2023-05-17T12:26:31.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.164+0000 7f87a2bff700 1 -- 172.21.15.88:0/170436924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c06b0b0 msgr2=0x7f879c0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.164+0000 7f87a2bff700 1 --2- 172.21.15.88:0/170436924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c06b0b0 0x7f879c0cf320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f87880098f0 tx=0x7f8788009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.164+0000 7f87a2bff700 1 -- 172.21.15.88:0/170436924 shutdown_connections 2023-05-17T12:26:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.164+0000 7f87a2bff700 1 --2- 172.21.15.88:0/170436924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c15c840 0x7f879c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.164+0000 7f87a2bff700 1 --2- 172.21.15.88:0/170436924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c06b0b0 0x7f879c0cf320 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.164+0000 7f87a2bff700 1 -- 172.21.15.88:0/170436924 >> 172.21.15.88:0/170436924 conn(0x7f879c0d3060 msgr2=0x7f879c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.164+0000 7f87a2bff700 1 -- 172.21.15.88:0/170436924 shutdown_connections 2023-05-17T12:26:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.164+0000 7f87a2bff700 1 -- 172.21.15.88:0/170436924 wait complete. 2023-05-17T12:26:31.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.166+0000 7f87a2bff700 1 Processor -- start 2023-05-17T12:26:31.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.166+0000 7f87a2bff700 1 -- start start 2023-05-17T12:26:31.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a2bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f879c06b0b0 0x7f879c155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a2bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c06c330 0x7f879c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a2bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c15c840 0x7f879c15ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a2bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c155580 con 0x7f879c15c840 2023-05-17T12:26:31.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a2bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0b48d0 con 0x7f879c06b0b0 2023-05-17T12:26:31.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a2bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0b3cc0 con 0x7f879c06c330 2023-05-17T12:26:31.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a119c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c15c840 0x7f879c15ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a119c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c15c840 0x7f879c15ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48632/0 (socket says 172.21.15.88:48632) 2023-05-17T12:26:31.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a119c700 1 -- 172.21.15.88:0/155697924 learned_addr learned my addr 172.21.15.88:0/155697924 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a099b700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f879c06b0b0 0x7f879c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f879bfff700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c06c330 0x7f879c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a119c700 1 -- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c06c330 msgr2=0x7f879c0b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a119c700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c06c330 0x7f879c0b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a119c700 1 -- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f879c06b0b0 msgr2=0x7f879c155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a119c700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f879c06b0b0 0x7f879c155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.167+0000 7f87a119c700 1 -- 172.21.15.88:0/155697924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8788009550 con 0x7f879c15c840 2023-05-17T12:26:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.168+0000 7f87a119c700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c15c840 0x7f879c15ede0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f879400cc50 tx=0x7f879400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.168+0000 7f87997fa700 1 -- 172.21.15.88:0/155697924 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400ad80 con 0x7f879c15c840 2023-05-17T12:26:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.168+0000 7f87997fa700 1 -- 172.21.15.88:0/155697924 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879400ce50 con 0x7f879c15c840 2023-05-17T12:26:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.168+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c0cd900 con 0x7f879c15c840 2023-05-17T12:26:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.168+0000 7f87997fa700 1 -- 172.21.15.88:0/155697924 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794003c40 con 0x7f879c15c840 2023-05-17T12:26:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.168+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c0b2740 con 0x7f879c15c840 2023-05-17T12:26:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.169+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c0cdbe0 con 0x7f879c15c840 2023-05-17T12:26:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.170+0000 7f87997fa700 1 -- 172.21.15.88:0/155697924 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87940050d0 con 0x7f879c15c840 2023-05-17T12:26:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.171+0000 7f87997fa700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f878006ace0 0x7f878006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.171+0000 7f87997fa700 1 -- 172.21.15.88:0/155697924 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87940898d0 con 0x7f879c15c840 2023-05-17T12:26:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.172+0000 7f87a099b700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f878006ace0 0x7f878006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.172+0000 7f87a099b700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f878006ace0 0x7f878006d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f879000b9b0 tx=0x7f8790008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:31.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.175+0000 7f87997fa700 1 -- 172.21.15.88:0/155697924 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8794054640 con 0x7f879c15c840 2023-05-17T12:26:31.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.369+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f879c074530 con 0x7f879c15c840 2023-05-17T12:26:31.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.370+0000 7f87997fa700 1 -- 172.21.15.88:0/155697924 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f8794057c60 con 0x7f879c15c840 2023-05-17T12:26:31.373 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:31.373 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:31.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f878006ace0 msgr2=0x7f878006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f878006ace0 0x7f878006d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f879000b9b0 tx=0x7f8790008040 comp rx=0 tx=0).stop 2023-05-17T12:26:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c15c840 msgr2=0x7f879c15ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c15c840 0x7f879c15ede0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f879400cc50 tx=0x7f879400a340 comp rx=0 tx=0).stop 2023-05-17T12:26:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 shutdown_connections 2023-05-17T12:26:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f878006ace0 0x7f878006d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f879c15c840 0x7f879c15ede0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f879c06b0b0 0x7f879c155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 --2- 172.21.15.88:0/155697924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f879c06c330 0x7f879c0b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 >> 172.21.15.88:0/155697924 conn(0x7f879c0d3060 msgr2=0x7f879c0cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 shutdown_connections 2023-05-17T12:26:31.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.372+0000 7f87a2bff700 1 -- 172.21.15.88:0/155697924 wait complete. 2023-05-17T12:26:31.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:31.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:31.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.580+0000 7f18095ff700 1 Processor -- start 2023-05-17T12:26:31.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.581+0000 7f18095ff700 1 -- start start 2023-05-17T12:26:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.582+0000 7f18095ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18040b23a0 0x7f180406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.582+0000 7f18095ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180406b4a0 con 0x7f18040cf190 2023-05-17T12:26:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.582+0000 7f18095ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180406a510 con 0x7f180406c760 2023-05-17T12:26:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.582+0000 7f18095ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18040cd840 con 0x7f18040b23a0 2023-05-17T12:26:31.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.582+0000 7f18037fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f18040cf190 0x7f1804160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57660/0 (socket says 172.21.15.88:57660) 2023-05-17T12:26:31.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.582+0000 7f18037fe700 1 -- 172.21.15.88:0/1783347273 learned_addr learned my addr 172.21.15.88:0/1783347273 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:31.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.583+0000 7f17fbfff700 1 --2- 172.21.15.88:0/1783347273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18040b23a0 0x7f180406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.583+0000 7f18027fc700 1 -- 172.21.15.88:0/1783347273 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522959948 0 0) 0x7f17fc001490 con 0x7f18040cf190 2023-05-17T12:26:31.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.583+0000 7f18027fc700 1 -- 172.21.15.88:0/1783347273 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f00035b0 con 0x7f18040cf190 2023-05-17T12:26:31.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.583+0000 7f18027fc700 1 -- 172.21.15.88:0/1783347273 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837257215 0 0) 0x7f180406a510 con 0x7f180406c760 2023-05-17T12:26:31.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.583+0000 7f18027fc700 1 -- 172.21.15.88:0/1783347273 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17fc001490 con 0x7f180406c760 2023-05-17T12:26:31.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.583+0000 7f17fbfff700 1 -- 172.21.15.88:0/1783347273 >> v1:172.21.15.187:6789/0 conn(0x7f180406c760 legacy=0x7f180406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.583+0000 7f17fbfff700 1 -- 172.21.15.88:0/1783347273 >> v1:172.21.15.88:6789/0 conn(0x7f18040cf190 legacy=0x7f1804160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.583+0000 7f17fbfff700 1 -- 172.21.15.88:0/1783347273 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040cdb20 con 0x7f18040b23a0 2023-05-17T12:26:31.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.583+0000 7f17fbfff700 1 --2- 172.21.15.88:0/1783347273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18040b23a0 0x7f180406af60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009870 tx=0x7f17ec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fb20fd7a79639bb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:31.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18027fc700 1 -- 172.21.15.88:0/1783347273 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec011830 con 0x7f18040b23a0 2023-05-17T12:26:31.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18027fc700 1 -- 172.21.15.88:0/1783347273 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec011990 con 0x7f18040b23a0 2023-05-17T12:26:31.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18027fc700 1 -- 172.21.15.88:0/1783347273 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec011d20 con 0x7f18040b23a0 2023-05-17T12:26:31.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18095ff700 1 -- 172.21.15.88:0/1783347273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18040b23a0 msgr2=0x7f180406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18095ff700 1 --2- 172.21.15.88:0/1783347273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18040b23a0 0x7f180406af60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009870 tx=0x7f17ec009b80 comp rx=0 tx=0).stop 2023-05-17T12:26:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18095ff700 1 -- 172.21.15.88:0/1783347273 shutdown_connections 2023-05-17T12:26:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18095ff700 1 --2- 172.21.15.88:0/1783347273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18040b23a0 0x7f180406af60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18095ff700 1 -- 172.21.15.88:0/1783347273 >> 172.21.15.88:0/1783347273 conn(0x7f18040d06f0 msgr2=0x7f18040d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18095ff700 1 -- 172.21.15.88:0/1783347273 shutdown_connections 2023-05-17T12:26:31.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.584+0000 7f18095ff700 1 -- 172.21.15.88:0/1783347273 wait complete. 2023-05-17T12:26:31.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.586+0000 7f18095ff700 1 Processor -- start 2023-05-17T12:26:31.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.586+0000 7f18095ff700 1 -- start start 2023-05-17T12:26:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f18095ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180406c760 0x7f18040b8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f18095ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18040cf190 0x7f1804156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f18095ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1804156b50 0x7f1804153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f18095ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180415bd50 con 0x7f18040cf190 2023-05-17T12:26:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f18095ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18041591a0 con 0x7f180406c760 2023-05-17T12:26:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f18095ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180415b0d0 con 0x7f1804156b50 2023-05-17T12:26:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f17fbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18040cf190 0x7f1804156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f17fbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18040cf190 0x7f1804156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48644/0 (socket says 172.21.15.88:48644) 2023-05-17T12:26:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f17fbfff700 1 -- 172.21.15.88:0/1146719577 learned_addr learned my addr 172.21.15.88:0/1146719577 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.587+0000 7f1802ffd700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180406c760 0x7f18040b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f18037fe700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1804156b50 0x7f1804153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f17fbfff700 1 -- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1804156b50 msgr2=0x7f1804153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f17fbfff700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1804156b50 0x7f1804153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f17fbfff700 1 -- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180406c760 msgr2=0x7f18040b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f17fbfff700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180406c760 0x7f18040b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f17fbfff700 1 -- 172.21.15.88:0/1146719577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec0094a0 con 0x7f18040cf190 2023-05-17T12:26:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f18037fe700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1804156b50 0x7f1804153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f17fbfff700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18040cf190 0x7f1804156610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0090b0 tx=0x7f17ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f17fb7fe700 1 -- 172.21.15.88:0/1146719577 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec01a760 con 0x7f18040cf190 2023-05-17T12:26:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f17fb7fe700 1 -- 172.21.15.88:0/1146719577 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec01a8c0 con 0x7f18040cf190 2023-05-17T12:26:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180406aa40 con 0x7f18040cf190 2023-05-17T12:26:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f17fb7fe700 1 -- 172.21.15.88:0/1146719577 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec01ac30 con 0x7f18040cf190 2023-05-17T12:26:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.588+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180406a760 con 0x7f18040cf190 2023-05-17T12:26:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.589+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180415cb40 con 0x7f18040cf190 2023-05-17T12:26:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.590+0000 7f17fb7fe700 1 -- 172.21.15.88:0/1146719577 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17ec022070 con 0x7f18040cf190 2023-05-17T12:26:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.592+0000 7f17fb7fe700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f17e406ad10 0x7f17e406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.592+0000 7f17fb7fe700 1 -- 172.21.15.88:0/1146719577 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f17ec08a480 con 0x7f18040cf190 2023-05-17T12:26:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.592+0000 7f1802ffd700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f17e406ad10 0x7f17e406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.593+0000 7f1802ffd700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f17e406ad10 0x7f17e406d1c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f17f40011e0 tx=0x7f17f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.596+0000 7f17fb7fe700 1 -- 172.21.15.88:0/1146719577 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f17ec055210 con 0x7f18040cf190 2023-05-17T12:26:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.792+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1804074530 con 0x7f18040cf190 2023-05-17T12:26:31.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.792+0000 7f17fb7fe700 1 -- 172.21.15.88:0/1146719577 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17ec0150a0 con 0x7f18040cf190 2023-05-17T12:26:31.795 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:31.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.794+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f17e406ad10 msgr2=0x7f17e406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.794+0000 7f18095ff700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f17e406ad10 0x7f17e406d1c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f17f40011e0 tx=0x7f17f4009040 comp rx=0 tx=0).stop 2023-05-17T12:26:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.794+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18040cf190 msgr2=0x7f1804156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.794+0000 7f18095ff700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18040cf190 0x7f1804156610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0090b0 tx=0x7f17ec004750 comp rx=0 tx=0).stop 2023-05-17T12:26:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.795+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 shutdown_connections 2023-05-17T12:26:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.795+0000 7f18095ff700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f17e406ad10 0x7f17e406d1c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.795+0000 7f18095ff700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1804156b50 0x7f1804153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.795+0000 7f18095ff700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f180406c760 0x7f18040b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.795+0000 7f18095ff700 1 --2- 172.21.15.88:0/1146719577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18040cf190 0x7f1804156610 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.795+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 >> 172.21.15.88:0/1146719577 conn(0x7f18040d06f0 msgr2=0x7f18040b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.795+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 shutdown_connections 2023-05-17T12:26:31.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:31.795+0000 7f18095ff700 1 -- 172.21.15.88:0/1146719577 wait complete. 2023-05-17T12:26:31.815 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:32.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.000+0000 7f0888dff700 1 Processor -- start 2023-05-17T12:26:32.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.000+0000 7f0888dff700 1 -- start start 2023-05-17T12:26:32.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.001+0000 7f0888dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f088406c760 0x7f088406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.001+0000 7f0888dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b23a0 0x7f088406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.001+0000 7f0888dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088406b4a0 con 0x7f08840cf190 2023-05-17T12:26:32.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.001+0000 7f0888dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088406a510 con 0x7f088406c760 2023-05-17T12:26:32.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.001+0000 7f0888dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088406d070 con 0x7f08840b23a0 2023-05-17T12:26:32.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f0882d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f08840cf190 0x7f0884160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57666/0 (socket says 172.21.15.88:57666) 2023-05-17T12:26:32.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f088259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f088406c760 0x7f088406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f0882d9d700 1 -- 172.21.15.88:0/4089181299 learned_addr learned my addr 172.21.15.88:0/4089181299 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:32.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f087bfff700 1 --2- 172.21.15.88:0/4089181299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b23a0 0x7f088406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f088259c700 1 -- 172.21.15.88:0/4089181299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b23a0 msgr2=0x7f088406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:32.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f088259c700 1 --2- 172.21.15.88:0/4089181299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b23a0 0x7f088406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f088259c700 1 -- 172.21.15.88:0/4089181299 >> v1:172.21.15.88:6789/0 conn(0x7f08840cf190 legacy=0x7f0884160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f088259c700 1 -- 172.21.15.88:0/4089181299 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08840cd840 con 0x7f088406c760 2023-05-17T12:26:32.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f087bfff700 1 --2- 172.21.15.88:0/4089181299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b23a0 0x7f088406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:32.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f0881d9b700 1 -- 172.21.15.88:0/4089181299 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344541368 0 0) 0x7f087c001490 con 0x7f08840cf190 2023-05-17T12:26:32.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.002+0000 7f088259c700 1 --2- 172.21.15.88:0/4089181299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 0x7f088406af60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0874009840 tx=0x7f0874009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d781f465cd6a2b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:32.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0881d9b700 1 -- 172.21.15.88:0/4089181299 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874011830 con 0x7f088406c760 2023-05-17T12:26:32.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0881d9b700 1 -- 172.21.15.88:0/4089181299 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874011990 con 0x7f088406c760 2023-05-17T12:26:32.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0881d9b700 1 -- 172.21.15.88:0/4089181299 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874011d20 con 0x7f088406c760 2023-05-17T12:26:32.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0888dff700 1 -- 172.21.15.88:0/4089181299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 msgr2=0x7f088406af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0888dff700 1 --2- 172.21.15.88:0/4089181299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 0x7f088406af60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0874009840 tx=0x7f0874009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:32.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0888dff700 1 -- 172.21.15.88:0/4089181299 shutdown_connections 2023-05-17T12:26:32.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0888dff700 1 --2- 172.21.15.88:0/4089181299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 0x7f088406af60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0888dff700 1 --2- 172.21.15.88:0/4089181299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b23a0 0x7f088406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0888dff700 1 -- 172.21.15.88:0/4089181299 >> 172.21.15.88:0/4089181299 conn(0x7f08840d06f0 msgr2=0x7f08840d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:32.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0888dff700 1 -- 172.21.15.88:0/4089181299 shutdown_connections 2023-05-17T12:26:32.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.003+0000 7f0888dff700 1 -- 172.21.15.88:0/4089181299 wait complete. 2023-05-17T12:26:32.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.005+0000 7f0888dff700 1 Processor -- start 2023-05-17T12:26:32.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.005+0000 7f0888dff700 1 -- start start 2023-05-17T12:26:32.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f0888dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 0x7f08840ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f0888dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08840cf190 0x7f0884157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f0888dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f088414e290 0x7f08840cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f0888dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840c79f0 con 0x7f088406c760 2023-05-17T12:26:32.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f0888dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840ca970 con 0x7f08840cf190 2023-05-17T12:26:32.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f0888dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08840cac50 con 0x7f088414e290 2023-05-17T12:26:32.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f088259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 0x7f08840ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f088259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 0x7f08840ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48662/0 (socket says 172.21.15.88:48662) 2023-05-17T12:26:32.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f088259c700 1 -- 172.21.15.88:0/2612123674 learned_addr learned my addr 172.21.15.88:0/2612123674 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:32.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.006+0000 7f087bfff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08840cf190 0x7f0884157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f0882d9d700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f088414e290 0x7f08840cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f088259c700 1 -- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f088414e290 msgr2=0x7f08840cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f088259c700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f088414e290 0x7f08840cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f088259c700 1 -- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08840cf190 msgr2=0x7f0884157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f088259c700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08840cf190 0x7f0884157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f088259c700 1 -- 172.21.15.88:0/2612123674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740094a0 con 0x7f088406c760 2023-05-17T12:26:32.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f087bfff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08840cf190 0x7f0884157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:32.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f0882d9d700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f088414e290 0x7f08840cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:32.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f088259c700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 0x7f08840ca120 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0874014040 tx=0x7f0874004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:32.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f087affd700 1 -- 172.21.15.88:0/2612123674 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740038a0 con 0x7f088406c760 2023-05-17T12:26:32.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f087affd700 1 -- 172.21.15.88:0/2612123674 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087401e070 con 0x7f088406c760 2023-05-17T12:26:32.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088406a760 con 0x7f088406c760 2023-05-17T12:26:32.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.007+0000 7f087affd700 1 -- 172.21.15.88:0/2612123674 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874003c20 con 0x7f088406c760 2023-05-17T12:26:32.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.008+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08840cdb20 con 0x7f088406c760 2023-05-17T12:26:32.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.008+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088406aa40 con 0x7f088406c760 2023-05-17T12:26:32.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.009+0000 7f087affd700 1 -- 172.21.15.88:0/2612123674 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f087402d450 con 0x7f088406c760 2023-05-17T12:26:32.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.010+0000 7f087affd700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f086406ace0 0x7f086406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.010+0000 7f087affd700 1 -- 172.21.15.88:0/2612123674 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f087408a8e0 con 0x7f088406c760 2023-05-17T12:26:32.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.011+0000 7f087bfff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f086406ace0 0x7f086406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.011+0000 7f087bfff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f086406ace0 0x7f086406d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f088414ec70 tx=0x7f086c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:32.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.015+0000 7f087affd700 1 -- 172.21.15.88:0/2612123674 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0874055650 con 0x7f088406c760 2023-05-17T12:26:32.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.206+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0884074530 con 0x7f088406c760 2023-05-17T12:26:32.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.207+0000 7f087affd700 1 -- 172.21.15.88:0/2612123674 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0874020020 con 0x7f088406c760 2023-05-17T12:26:32.210 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:32.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f086406ace0 msgr2=0x7f086406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f086406ace0 0x7f086406d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f088414ec70 tx=0x7f086c008040 comp rx=0 tx=0).stop 2023-05-17T12:26:32.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 msgr2=0x7f08840ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 0x7f08840ca120 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0874014040 tx=0x7f0874004750 comp rx=0 tx=0).stop 2023-05-17T12:26:32.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 shutdown_connections 2023-05-17T12:26:32.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f086406ace0 0x7f086406d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f088414e290 0x7f08840cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f088406c760 0x7f08840ca120 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 --2- 172.21.15.88:0/2612123674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08840cf190 0x7f0884157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 >> 172.21.15.88:0/2612123674 conn(0x7f08840d06f0 msgr2=0x7f08840d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.209+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 shutdown_connections 2023-05-17T12:26:32.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.210+0000 7f0888dff700 1 -- 172.21.15.88:0/2612123674 wait complete. 2023-05-17T12:26:32.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:32.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.415+0000 7fa2c29ff700 1 Processor -- start 2023-05-17T12:26:32.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.415+0000 7fa2c29ff700 1 -- start start 2023-05-17T12:26:32.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.416+0000 7fa2c29ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc15c700 0x7fa2bc160370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.416+0000 7fa2c29ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc06c710 con 0x7fa2bc0b03d0 2023-05-17T12:26:32.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.416+0000 7fa2c29ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc06beb0 con 0x7fa2bc0d0070 2023-05-17T12:26:32.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.416+0000 7fa2c29ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0d0f80 con 0x7fa2bc15c700 2023-05-17T12:26:32.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.416+0000 7fa2bb7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa2bc0b03d0 0x7fa2bc1608b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57670/0 (socket says 172.21.15.88:57670) 2023-05-17T12:26:32.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.416+0000 7fa2bb7fe700 1 -- 172.21.15.88:0/1799268581 learned_addr learned my addr 172.21.15.88:0/1799268581 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:32.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.416+0000 7fa2bbfff700 1 --2- 172.21.15.88:0/1799268581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc15c700 0x7fa2bc160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.417+0000 7fa2baffd700 1 -- 172.21.15.88:0/1799268581 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804805 0 0) 0x7fa2bc06c710 con 0x7fa2bc0b03d0 2023-05-17T12:26:32.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.417+0000 7fa2baffd700 1 -- 172.21.15.88:0/1799268581 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a40035b0 con 0x7fa2bc0b03d0 2023-05-17T12:26:32.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.417+0000 7fa2baffd700 1 -- 172.21.15.88:0/1799268581 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660606595 0 0) 0x7fa2bc06beb0 con 0x7fa2bc0d0070 2023-05-17T12:26:32.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.417+0000 7fa2baffd700 1 -- 172.21.15.88:0/1799268581 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2bc06c710 con 0x7fa2bc0d0070 2023-05-17T12:26:32.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.417+0000 7fa2bbfff700 1 -- 172.21.15.88:0/1799268581 >> v1:172.21.15.187:6789/0 conn(0x7fa2bc0d0070 legacy=0x7fa2bc0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.417+0000 7fa2bbfff700 1 -- 172.21.15.88:0/1799268581 >> v1:172.21.15.88:6789/0 conn(0x7fa2bc0b03d0 legacy=0x7fa2bc1608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.417+0000 7fa2bbfff700 1 -- 172.21.15.88:0/1799268581 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc161180 con 0x7fa2bc15c700 2023-05-17T12:26:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.417+0000 7fa2bbfff700 1 --2- 172.21.15.88:0/1799268581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc15c700 0x7fa2bc160370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009870 tx=0x7fa2ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35432576c1d1f86 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2baffd700 1 -- 172.21.15.88:0/1799268581 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011830 con 0x7fa2bc15c700 2023-05-17T12:26:32.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2baffd700 1 -- 172.21.15.88:0/1799268581 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac011990 con 0x7fa2bc15c700 2023-05-17T12:26:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2baffd700 1 -- 172.21.15.88:0/1799268581 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011d20 con 0x7fa2bc15c700 2023-05-17T12:26:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2c29ff700 1 -- 172.21.15.88:0/1799268581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc15c700 msgr2=0x7fa2bc160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2c29ff700 1 --2- 172.21.15.88:0/1799268581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc15c700 0x7fa2bc160370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009870 tx=0x7fa2ac009b80 comp rx=0 tx=0).stop 2023-05-17T12:26:32.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2c29ff700 1 -- 172.21.15.88:0/1799268581 shutdown_connections 2023-05-17T12:26:32.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2c29ff700 1 --2- 172.21.15.88:0/1799268581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc15c700 0x7fa2bc160370 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2c29ff700 1 -- 172.21.15.88:0/1799268581 >> 172.21.15.88:0/1799268581 conn(0x7fa2bc070bd0 msgr2=0x7fa2bc070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:32.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2c29ff700 1 -- 172.21.15.88:0/1799268581 shutdown_connections 2023-05-17T12:26:32.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.418+0000 7fa2c29ff700 1 -- 172.21.15.88:0/1799268581 wait complete. 2023-05-17T12:26:32.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.421+0000 7fa2c29ff700 1 Processor -- start 2023-05-17T12:26:32.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.421+0000 7fa2c29ff700 1 -- start start 2023-05-17T12:26:32.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2c29ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc0b03d0 0x7fa2bc1e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2c29ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2bc0d0070 0x7fa2bc155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2c29ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2bc15c700 0x7fa2bc0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2c29ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0c6d70 con 0x7fa2bc15c700 2023-05-17T12:26:32.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2c29ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc1e8040 con 0x7fa2bc0d0070 2023-05-17T12:26:32.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2c29ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc155d90 con 0x7fa2bc0b03d0 2023-05-17T12:26:32.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2c0f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2bc15c700 0x7fa2bc0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2c0f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2bc15c700 0x7fa2bc0c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48664/0 (socket says 172.21.15.88:48664) 2023-05-17T12:26:32.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2c0f9c700 1 -- 172.21.15.88:0/2756146514 learned_addr learned my addr 172.21.15.88:0/2756146514 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:32.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2bbfff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc0b03d0 0x7fa2bc1e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.422+0000 7fa2bb7fe700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2bc0d0070 0x7fa2bc155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2c0f9c700 1 -- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc0b03d0 msgr2=0x7fa2bc1e7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2c0f9c700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc0b03d0 0x7fa2bc1e7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2c0f9c700 1 -- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2bc0d0070 msgr2=0x7fa2bc155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2c0f9c700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2bc0d0070 0x7fa2bc155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2c0f9c700 1 -- 172.21.15.88:0/2756146514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0094a0 con 0x7fa2bc15c700 2023-05-17T12:26:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2bbfff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc0b03d0 0x7fa2bc1e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2bb7fe700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2bc0d0070 0x7fa2bc155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2c0f9c700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2bc15c700 0x7fa2bc0c6540 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400cc20 tx=0x7fa2b400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2b8ff9700 1 -- 172.21.15.88:0/2756146514 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400ac20 con 0x7fa2bc15c700 2023-05-17T12:26:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2b8ff9700 1 -- 172.21.15.88:0/2756146514 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b400ad80 con 0x7fa2bc15c700 2023-05-17T12:26:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc06c430 con 0x7fa2bc15c700 2023-05-17T12:26:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2b8ff9700 1 -- 172.21.15.88:0/2756146514 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4003c20 con 0x7fa2bc15c700 2023-05-17T12:26:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.423+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc06c150 con 0x7fa2bc15c700 2023-05-17T12:26:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.424+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc15cad0 con 0x7fa2bc15c700 2023-05-17T12:26:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.425+0000 7fa2b8ff9700 1 -- 172.21.15.88:0/2756146514 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa2b40050d0 con 0x7fa2bc15c700 2023-05-17T12:26:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.426+0000 7fa2b8ff9700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2a806ace0 0x7fa2a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.426+0000 7fa2b8ff9700 1 -- 172.21.15.88:0/2756146514 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa2b4089a00 con 0x7fa2bc15c700 2023-05-17T12:26:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.426+0000 7fa2bbfff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2a806ace0 0x7fa2a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.427+0000 7fa2bbfff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2a806ace0 0x7fa2a806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0090b0 tx=0x7fa2ac01c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:32.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.430+0000 7fa2b8ff9700 1 -- 172.21.15.88:0/2756146514 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa2b40546f0 con 0x7fa2bc15c700 2023-05-17T12:26:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.622+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2bc074530 con 0x7fa2bc15c700 2023-05-17T12:26:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.623+0000 7fa2b8ff9700 1 -- 172.21.15.88:0/2756146514 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2b4057d10 con 0x7fa2bc15c700 2023-05-17T12:26:32.627 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2a806ace0 msgr2=0x7fa2a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2a806ace0 0x7fa2a806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0090b0 tx=0x7fa2ac01c040 comp rx=0 tx=0).stop 2023-05-17T12:26:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2bc15c700 msgr2=0x7fa2bc0c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2bc15c700 0x7fa2bc0c6540 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400cc20 tx=0x7fa2b400a060 comp rx=0 tx=0).stop 2023-05-17T12:26:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 shutdown_connections 2023-05-17T12:26:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa2a806ace0 0x7fa2a806d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2bc15c700 0x7fa2bc0c6540 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2bc0b03d0 0x7fa2bc1e7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 --2- 172.21.15.88:0/2756146514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2bc0d0070 0x7fa2bc155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 >> 172.21.15.88:0/2756146514 conn(0x7fa2bc070bd0 msgr2=0x7fa2bc159340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:32.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.625+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 shutdown_connections 2023-05-17T12:26:32.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.626+0000 7fa2c29ff700 1 -- 172.21.15.88:0/2756146514 wait complete. 2023-05-17T12:26:32.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.830+0000 7f1a2cdff700 1 Processor -- start 2023-05-17T12:26:32.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.830+0000 7f1a2cdff700 1 -- start start 2023-05-17T12:26:32.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.831+0000 7f1a2cdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a2806af60 0x7f1a28160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.831+0000 7f1a2cdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2806a510 con 0x7f1a2806c760 2023-05-17T12:26:32.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.831+0000 7f1a2cdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280cf8a0 con 0x7f1a280b23a0 2023-05-17T12:26:32.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.831+0000 7f1a2cdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280cd840 con 0x7f1a2806af60 2023-05-17T12:26:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2659c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1a2806c760 0x7f1a2806cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57674/0 (socket says 172.21.15.88:57674) 2023-05-17T12:26:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2659c700 1 -- 172.21.15.88:0/4012992271 learned_addr learned my addr 172.21.15.88:0/4012992271 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:32.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a26d9d700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a2806af60 0x7f1a28160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257549279 0 0) 0x7f1a2806a510 con 0x7f1a2806c760 2023-05-17T12:26:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a100035b0 con 0x7f1a2806c760 2023-05-17T12:26:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165652050 0 0) 0x7f1a280cf8a0 con 0x7f1a280b23a0 2023-05-17T12:26:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a2806a510 con 0x7f1a280b23a0 2023-05-17T12:26:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2577571585 0 0) 0x7f1a100035b0 con 0x7f1a2806c760 2023-05-17T12:26:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a2806af60 msgr2=0x7f1a28160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a2806af60 0x7f1a28160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 >> v1:172.21.15.187:6789/0 conn(0x7f1a280b23a0 legacy=0x7f1a280cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a280cdb20 con 0x7f1a2806c760 2023-05-17T12:26:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f1a18001670 con 0x7f1a2806c760 2023-05-17T12:26:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 >> v1:172.21.15.88:6789/0 conn(0x7f1a2806c760 legacy=0x7f1a2806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.832+0000 7f1a2559a700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a2806af60 0x7f1a10003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a2559a700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004120 0x7f1a10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a2559a700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a10004d90 0x7f1a10005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280cd840 con 0x7f1a10004d90 2023-05-17T12:26:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1000bac0 con 0x7f1a10004120 2023-05-17T12:26:32.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1000bc80 con 0x7f1a2806af60 2023-05-17T12:26:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a26d9d700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a10004d90 0x7f1a10005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a2659c700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a2806af60 0x7f1a10003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a25d9b700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004120 0x7f1a10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a26d9d700 1 -- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a2806af60 msgr2=0x7f1a10003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a26d9d700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a2806af60 0x7f1a10003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a26d9d700 1 -- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004120 msgr2=0x7f1a10004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a26d9d700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004120 0x7f1a10004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a26d9d700 1 -- 172.21.15.88:0/4012992271 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100035b0 con 0x7f1a10004d90 2023-05-17T12:26:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.833+0000 7f1a26d9d700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a10004d90 0x7f1a10005200 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009f90 tx=0x7f1a10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b1017a46ee2ad0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000ec30 con 0x7f1a10004d90 2023-05-17T12:26:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2000f040 con 0x7f1a10004d90 2023-05-17T12:26:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a2559a700 1 -- 172.21.15.88:0/4012992271 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20014480 con 0x7f1a10004d90 2023-05-17T12:26:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a2cdff700 1 -- 172.21.15.88:0/4012992271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a10004d90 msgr2=0x7f1a10005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a2cdff700 1 --2- 172.21.15.88:0/4012992271 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a10004d90 0x7f1a10005200 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009f90 tx=0x7f1a10005880 comp rx=0 tx=0).stop 2023-05-17T12:26:32.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a26d9d700 1 -- 172.21.15.88:0/4012992271 reap_dead start 2023-05-17T12:26:32.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a2cdff700 1 -- 172.21.15.88:0/4012992271 shutdown_connections 2023-05-17T12:26:32.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a2cdff700 1 -- 172.21.15.88:0/4012992271 >> 172.21.15.88:0/4012992271 conn(0x7f1a280d06f0 msgr2=0x7f1a280d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:32.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a2cdff700 1 -- 172.21.15.88:0/4012992271 shutdown_connections 2023-05-17T12:26:32.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.834+0000 7f1a2cdff700 1 -- 172.21.15.88:0/4012992271 wait complete. 2023-05-17T12:26:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.836+0000 7f1a2cdff700 1 Processor -- start 2023-05-17T12:26:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.836+0000 7f1a2cdff700 1 -- start start 2023-05-17T12:26:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a2cdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004d90 0x7f1a281f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a2cdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a28150770 0x7f1a28156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a2cdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a281538f0 0x7f1a28153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a2cdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a281542b0 con 0x7f1a281538f0 2023-05-17T12:26:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a2cdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280c6b80 con 0x7f1a10004d90 2023-05-17T12:26:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a2cdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280c6e60 con 0x7f1a28150770 2023-05-17T12:26:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a26d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a281538f0 0x7f1a28153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a26d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a281538f0 0x7f1a28153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48680/0 (socket says 172.21.15.88:48680) 2023-05-17T12:26:32.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a26d9d700 1 -- 172.21.15.88:0/1204852713 learned_addr learned my addr 172.21.15.88:0/1204852713 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a2659c700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004d90 0x7f1a281f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.837+0000 7f1a25d9b700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a28150770 0x7f1a28156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a26d9d700 1 -- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a28150770 msgr2=0x7f1a28156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a26d9d700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a28150770 0x7f1a28156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a26d9d700 1 -- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004d90 msgr2=0x7f1a281f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a26d9d700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004d90 0x7f1a281f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a26d9d700 1 -- 172.21.15.88:0/1204852713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2806aa40 con 0x7f1a281538f0 2023-05-17T12:26:32.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a2659c700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004d90 0x7f1a281f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a26d9d700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a281538f0 0x7f1a28153d70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1a100047d0 tx=0x7f1a20009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a16ffd700 1 -- 172.21.15.88:0/1204852713 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20014d20 con 0x7f1a281538f0 2023-05-17T12:26:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a16ffd700 1 -- 172.21.15.88:0/1204852713 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a20009410 con 0x7f1a281538f0 2023-05-17T12:26:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a16ffd700 1 -- 172.21.15.88:0/1204852713 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20014ea0 con 0x7f1a281538f0 2023-05-17T12:26:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2806a760 con 0x7f1a281538f0 2023-05-17T12:26:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.838+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2806b3c0 con 0x7f1a281538f0 2023-05-17T12:26:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.839+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a28074530 con 0x7f1a281538f0 2023-05-17T12:26:32.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.840+0000 7f1a16ffd700 1 -- 172.21.15.88:0/1204852713 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a20023070 con 0x7f1a281538f0 2023-05-17T12:26:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.841+0000 7f1a16ffd700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a0806ad10 0x7f1a0806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.841+0000 7f1a16ffd700 1 -- 172.21.15.88:0/1204852713 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a2008a980 con 0x7f1a281538f0 2023-05-17T12:26:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.841+0000 7f1a2659c700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a0806ad10 0x7f1a0806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.842+0000 7f1a2659c700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a0806ad10 0x7f1a0806d1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1a280c9ca0 tx=0x7f1a18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:32.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:32.845+0000 7f1a16ffd700 1 -- 172.21.15.88:0/1204852713 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1a20055810 con 0x7f1a281538f0 2023-05-17T12:26:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.036+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a280c6890 con 0x7f1a281538f0 2023-05-17T12:26:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.036+0000 7f1a16ffd700 1 -- 172.21.15.88:0/1204852713 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a20058e30 con 0x7f1a281538f0 2023-05-17T12:26:33.039 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:33.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.038+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a0806ad10 msgr2=0x7f1a0806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.038+0000 7f1a2cdff700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a0806ad10 0x7f1a0806d1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1a280c9ca0 tx=0x7f1a18009040 comp rx=0 tx=0).stop 2023-05-17T12:26:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.038+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a281538f0 msgr2=0x7f1a28153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.038+0000 7f1a2cdff700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a281538f0 0x7f1a28153d70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1a100047d0 tx=0x7f1a20009750 comp rx=0 tx=0).stop 2023-05-17T12:26:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.039+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 shutdown_connections 2023-05-17T12:26:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.039+0000 7f1a2cdff700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1a0806ad10 0x7f1a0806d1c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.039+0000 7f1a2cdff700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a281538f0 0x7f1a28153d70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.039+0000 7f1a2cdff700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a10004d90 0x7f1a281f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.039+0000 7f1a2cdff700 1 --2- 172.21.15.88:0/1204852713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a28150770 0x7f1a28156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.039+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 >> 172.21.15.88:0/1204852713 conn(0x7f1a280d06f0 msgr2=0x7f1a280cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:33.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.039+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 shutdown_connections 2023-05-17T12:26:33.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.039+0000 7f1a2cdff700 1 -- 172.21.15.88:0/1204852713 wait complete. 2023-05-17T12:26:33.059 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:33.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.243+0000 7f0c413ff700 1 Processor -- start 2023-05-17T12:26:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.244+0000 7f0c413ff700 1 -- start start 2023-05-17T12:26:33.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.245+0000 7f0c413ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0c3c0b23a0 0x7f0c3c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.245+0000 7f0c413ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c06b4a0 con 0x7f0c3c0cf190 2023-05-17T12:26:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.245+0000 7f0c413ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c06a510 con 0x7f0c3c06c760 2023-05-17T12:26:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.245+0000 7f0c413ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c0cd840 con 0x7f0c3c0b23a0 2023-05-17T12:26:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.245+0000 7f0c3b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0c3c0cf190 0x7f0c3c160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57688/0 (socket says 172.21.15.88:57688) 2023-05-17T12:26:33.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.245+0000 7f0c3b7fe700 1 -- 172.21.15.88:0/3734504617 learned_addr learned my addr 172.21.15.88:0/3734504617 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.245+0000 7f0c33fff700 1 --2- 172.21.15.88:0/3734504617 >> v2:172.21.15.187:3300/0 conn(0x7f0c3c0b23a0 0x7f0c3c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.245+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193291092 0 0) 0x7f0c34001490 con 0x7f0c3c0cf190 2023-05-17T12:26:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c280035b0 con 0x7f0c3c0cf190 2023-05-17T12:26:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825860886 0 0) 0x7f0c3c06a510 con 0x7f0c3c06c760 2023-05-17T12:26:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c34001490 con 0x7f0c3c06c760 2023-05-17T12:26:33.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 493649882 0 0) 0x7f0c280035b0 con 0x7f0c3c0cf190 2023-05-17T12:26:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 >> v2:172.21.15.187:3300/0 conn(0x7f0c3c0b23a0 msgr2=0x7f0c3c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 --2- 172.21.15.88:0/3734504617 >> v2:172.21.15.187:3300/0 conn(0x7f0c3c0b23a0 0x7f0c3c06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 >> v1:172.21.15.187:6789/0 conn(0x7f0c3c06c760 legacy=0x7f0c3c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0cdb20 con 0x7f0c3c0cf190 2023-05-17T12:26:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f0c34001b80 con 0x7f0c3c0cf190 2023-05-17T12:26:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 >> v1:172.21.15.88:6789/0 conn(0x7f0c3c0cf190 legacy=0x7f0c3c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c28003b90 0x7f0c28003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c28004850 0x7f0c28004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c28005200 0x7f0c2800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0cd840 con 0x7f0c28004850 2023-05-17T12:26:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2800c060 con 0x7f0c28005200 2023-05-17T12:26:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2800c220 con 0x7f0c28003b90 2023-05-17T12:26:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c33fff700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c28004850 0x7f0c28004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3b7fe700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c28005200 0x7f0c2800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.246+0000 7f0c3affd700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c28003b90 0x7f0c28003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c33fff700 1 -- 172.21.15.88:0/3734504617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c28003b90 msgr2=0x7f0c28003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c33fff700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c28003b90 0x7f0c28003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c33fff700 1 -- 172.21.15.88:0/3734504617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c28005200 msgr2=0x7f0c2800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c33fff700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c28005200 0x7f0c2800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c33fff700 1 -- 172.21.15.88:0/3734504617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c280035b0 con 0x7f0c28004850 2023-05-17T12:26:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c3b7fe700 1 -- 172.21.15.88:0/3734504617 reap_dead start 2023-05-17T12:26:33.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c33fff700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c28004850 0x7f0c28004cc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009b60 tx=0x7f0c28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ce71de25f2304d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400e6c0 con 0x7f0c28004850 2023-05-17T12:26:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2400e820 con 0x7f0c28004850 2023-05-17T12:26:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.247+0000 7f0c3a7fc700 1 -- 172.21.15.88:0/3734504617 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400eb90 con 0x7f0c28004850 2023-05-17T12:26:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.248+0000 7f0c413ff700 1 -- 172.21.15.88:0/3734504617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c28004850 msgr2=0x7f0c28004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.248+0000 7f0c413ff700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c28004850 0x7f0c28004cc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009b60 tx=0x7f0c28005880 comp rx=0 tx=0).stop 2023-05-17T12:26:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.248+0000 7f0c413ff700 1 -- 172.21.15.88:0/3734504617 shutdown_connections 2023-05-17T12:26:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.248+0000 7f0c413ff700 1 --2- 172.21.15.88:0/3734504617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c28004850 0x7f0c28004cc0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.248+0000 7f0c413ff700 1 -- 172.21.15.88:0/3734504617 >> 172.21.15.88:0/3734504617 conn(0x7f0c3c0d06f0 msgr2=0x7f0c3c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.248+0000 7f0c413ff700 1 -- 172.21.15.88:0/3734504617 shutdown_connections 2023-05-17T12:26:33.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.248+0000 7f0c413ff700 1 -- 172.21.15.88:0/3734504617 wait complete. 2023-05-17T12:26:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.250+0000 7f0c413ff700 1 Processor -- start 2023-05-17T12:26:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.250+0000 7f0c413ff700 1 -- start start 2023-05-17T12:26:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c413ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c28004850 0x7f0c3c0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c413ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c0cc800 0x7f0c3c1f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c413ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c3c0ccc70 0x7f0c3c1f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c413ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0c7590 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c413ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0c83f0 con 0x7f0c28004850 2023-05-17T12:26:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c413ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0c8880 con 0x7f0c3c0cc800 2023-05-17T12:26:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c3c0ccc70 0x7f0c3c1f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c3c0ccc70 0x7f0c3c1f65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48694/0 (socket says 172.21.15.88:48694) 2023-05-17T12:26:33.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3b7fe700 1 -- 172.21.15.88:0/643945085 learned_addr learned my addr 172.21.15.88:0/643945085 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c33fff700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c0cc800 0x7f0c3c1f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3affd700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c28004850 0x7f0c3c0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3b7fe700 1 -- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c0cc800 msgr2=0x7f0c3c1f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3b7fe700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c0cc800 0x7f0c3c1f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3b7fe700 1 -- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c28004850 msgr2=0x7f0c3c0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3b7fe700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c28004850 0x7f0c3c0c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3b7fe700 1 -- 172.21.15.88:0/643945085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c06aa40 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c33fff700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c0cc800 0x7f0c3c1f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:33.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.252+0000 7f0c3b7fe700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c3c0ccc70 0x7f0c3c1f65f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0c34000f80 tx=0x7f0c34007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:33.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.253+0000 7f0c337fe700 1 -- 172.21.15.88:0/643945085 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34001270 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.253+0000 7f0c337fe700 1 -- 172.21.15.88:0/643945085 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340133f0 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.253+0000 7f0c337fe700 1 -- 172.21.15.88:0/643945085 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34013780 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.253+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c06a760 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.253+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c15cb40 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.254+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c074530 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.255+0000 7f0c337fe700 1 -- 172.21.15.88:0/643945085 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c340138e0 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.255+0000 7f0c337fe700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0c1c06ace0 0x7f0c1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.256+0000 7f0c337fe700 1 -- 172.21.15.88:0/643945085 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0c3408a1f0 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.256+0000 7f0c3affd700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0c1c06ace0 0x7f0c1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.256+0000 7f0c3affd700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0c1c06ace0 0x7f0c1c06d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c069de0 tx=0x7f0c2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:33.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.260+0000 7f0c337fe700 1 -- 172.21.15.88:0/643945085 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0c34054ed0 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.455+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0c3c06b4a0 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.455+0000 7f0c337fe700 1 -- 172.21.15.88:0/643945085 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0c3c06b4a0 con 0x7f0c3c0ccc70 2023-05-17T12:26:33.458 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.457+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0c1c06ace0 msgr2=0x7f0c1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.457+0000 7f0c413ff700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0c1c06ace0 0x7f0c1c06d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c069de0 tx=0x7f0c2c009040 comp rx=0 tx=0).stop 2023-05-17T12:26:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.457+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c3c0ccc70 msgr2=0x7f0c3c1f65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.457+0000 7f0c413ff700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c3c0ccc70 0x7f0c3c1f65f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0c34000f80 tx=0x7f0c34007340 comp rx=0 tx=0).stop 2023-05-17T12:26:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.458+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 shutdown_connections 2023-05-17T12:26:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.458+0000 7f0c413ff700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0c1c06ace0 0x7f0c1c06d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.458+0000 7f0c413ff700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c3c0ccc70 0x7f0c3c1f65f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.458+0000 7f0c413ff700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c28004850 0x7f0c3c0c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.458+0000 7f0c413ff700 1 --2- 172.21.15.88:0/643945085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c0cc800 0x7f0c3c1f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.458+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 >> 172.21.15.88:0/643945085 conn(0x7f0c3c0d06f0 msgr2=0x7f0c3c157100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:33.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.458+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 shutdown_connections 2023-05-17T12:26:33.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.458+0000 7f0c413ff700 1 -- 172.21.15.88:0/643945085 wait complete. 2023-05-17T12:26:33.478 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:26:33.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.664+0000 7f8f9e1ff700 1 Processor -- start 2023-05-17T12:26:33.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.664+0000 7f8f9e1ff700 1 -- start start 2023-05-17T12:26:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.665+0000 7f8f9e1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f980c6d20 0x7f8f9806c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.665+0000 7f8f9e1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f980cdac0 con 0x7f8f9806c980 2023-05-17T12:26:33.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f9e1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9806a510 con 0x7f8f9815fd10 2023-05-17T12:26:33.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f9e1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9806ce00 con 0x7f8f980c6d20 2023-05-17T12:26:33.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f97fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8f9806c980 0x7f8f98160810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57690/0 (socket says 172.21.15.88:57690) 2023-05-17T12:26:33.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f97fff700 1 -- 172.21.15.88:0/824264122 learned_addr learned my addr 172.21.15.88:0/824264122 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:33.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105864617 0 0) 0x7f8f980cdac0 con 0x7f8f9806c980 2023-05-17T12:26:33.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f840035b0 con 0x7f8f9806c980 2023-05-17T12:26:33.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f8ffff700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f980c6d20 0x7f8f9806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2004541532 0 0) 0x7f8f840035b0 con 0x7f8f9806c980 2023-05-17T12:26:33.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f980c6d20 msgr2=0x7f8f9806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:33.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f96ffd700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f980c6d20 0x7f8f9806c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 >> v1:172.21.15.187:6789/0 conn(0x7f8f9815fd10 legacy=0x7f8f980cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9806a7f0 con 0x7f8f9806c980 2023-05-17T12:26:33.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f8f900019f0 con 0x7f8f9806c980 2023-05-17T12:26:33.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.666+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 >> v1:172.21.15.88:6789/0 conn(0x7f8f9806c980 legacy=0x7f8f98160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f96ffd700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f980c6d20 0x7f8f84003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f96ffd700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f84003fb0 0x7f8f84004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f96ffd700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f84004d90 0x7f8f84005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9806ce00 con 0x7f8f84003fb0 2023-05-17T12:26:33.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8400bba0 con 0x7f8f84004d90 2023-05-17T12:26:33.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8400bd60 con 0x7f8f980c6d20 2023-05-17T12:26:33.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f977fe700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f980c6d20 0x7f8f84003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f8ffff700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f84003fb0 0x7f8f84004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f97fff700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f84004d90 0x7f8f84005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f8ffff700 1 -- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f980c6d20 msgr2=0x7f8f84003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:33.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f8ffff700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f980c6d20 0x7f8f84003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f8ffff700 1 -- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f84004d90 msgr2=0x7f8f84005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:33.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f8ffff700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f84004d90 0x7f8f84005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.667+0000 7f8f8ffff700 1 -- 172.21.15.88:0/824264122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840035b0 con 0x7f8f84003fb0 2023-05-17T12:26:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f8ffff700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f84003fb0 0x7f8f84004850 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009b30 tx=0x7f8f84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272fbfabc2e2d591 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000e6c0 con 0x7f8f84003fb0 2023-05-17T12:26:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8000e820 con 0x7f8f84003fb0 2023-05-17T12:26:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f96ffd700 1 -- 172.21.15.88:0/824264122 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000eb90 con 0x7f8f84003fb0 2023-05-17T12:26:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/824264122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f84003fb0 msgr2=0x7f8f84004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f9e1ff700 1 --2- 172.21.15.88:0/824264122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f84003fb0 0x7f8f84004850 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009b30 tx=0x7f8f84005880 comp rx=0 tx=0).stop 2023-05-17T12:26:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f97fff700 1 -- 172.21.15.88:0/824264122 reap_dead start 2023-05-17T12:26:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/824264122 shutdown_connections 2023-05-17T12:26:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/824264122 >> 172.21.15.88:0/824264122 conn(0x7f8f980d07b0 msgr2=0x7f8f980d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/824264122 shutdown_connections 2023-05-17T12:26:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.668+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/824264122 wait complete. 2023-05-17T12:26:33.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.670+0000 7f8f9e1ff700 1 Processor -- start 2023-05-17T12:26:33.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.670+0000 7f8f9e1ff700 1 -- start start 2023-05-17T12:26:33.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f9e1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f84003fb0 0x7f8f9814d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f9e1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f98147110 0x7f8f980cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f9e1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f981f54f0 0x7f8f981491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f9e1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98147580 con 0x7f8f981f54f0 2023-05-17T12:26:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f9e1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980ca420 con 0x7f8f98147110 2023-05-17T12:26:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f9e1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980cd060 con 0x7f8f84003fb0 2023-05-17T12:26:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f97fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f981f54f0 0x7f8f981491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f97fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f981f54f0 0x7f8f981491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48708/0 (socket says 172.21.15.88:48708) 2023-05-17T12:26:33.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f97fff700 1 -- 172.21.15.88:0/4174674375 learned_addr learned my addr 172.21.15.88:0/4174674375 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:33.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f8ffff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f98147110 0x7f8f980cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.671+0000 7f8f977fe700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f84003fb0 0x7f8f9814d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f97fff700 1 -- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f84003fb0 msgr2=0x7f8f9814d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f97fff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f84003fb0 0x7f8f9814d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f97fff700 1 -- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f98147110 msgr2=0x7f8f980cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f97fff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f98147110 0x7f8f980cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f97fff700 1 -- 172.21.15.88:0/4174674375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9806adb0 con 0x7f8f981f54f0 2023-05-17T12:26:33.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f977fe700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f84003fb0 0x7f8f9814d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:33.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f97fff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f981f54f0 0x7f8f981491a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8f9808c170 tx=0x7f8f9000a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:33.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f94ff9700 1 -- 172.21.15.88:0/4174674375 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9000ad60 con 0x7f8f981f54f0 2023-05-17T12:26:33.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f94ff9700 1 -- 172.21.15.88:0/4174674375 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f900133f0 con 0x7f8f981f54f0 2023-05-17T12:26:33.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f94ff9700 1 -- 172.21.15.88:0/4174674375 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f900137a0 con 0x7f8f981f54f0 2023-05-17T12:26:33.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9806aad0 con 0x7f8f981f54f0 2023-05-17T12:26:33.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.672+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9806b090 con 0x7f8f981f54f0 2023-05-17T12:26:33.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.673+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9815f500 con 0x7f8f981f54f0 2023-05-17T12:26:33.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.674+0000 7f8f94ff9700 1 -- 172.21.15.88:0/4174674375 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8f90013900 con 0x7f8f981f54f0 2023-05-17T12:26:33.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.675+0000 7f8f94ff9700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f7806ace0 0x7f8f7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:33.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.675+0000 7f8f94ff9700 1 -- 172.21.15.88:0/4174674375 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8f9008a2a0 con 0x7f8f981f54f0 2023-05-17T12:26:33.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.676+0000 7f8f977fe700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f7806ace0 0x7f8f7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:33.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.676+0000 7f8f977fe700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f7806ace0 0x7f8f7806d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f88007fd0 tx=0x7f8f88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:33.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.679+0000 7f8f94ff9700 1 -- 172.21.15.88:0/4174674375 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8f90055010 con 0x7f8f981f54f0 2023-05-17T12:26:33.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.893+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f98074530 con 0x7f8f981f54f0 2023-05-17T12:26:33.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.894+0000 7f8f94ff9700 1 -- 172.21.15.88:0/4174674375 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f90017020 con 0x7f8f981f54f0 2023-05-17T12:26:33.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f7806ace0 msgr2=0x7f8f7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f7806ace0 0x7f8f7806d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f88007fd0 tx=0x7f8f88009040 comp rx=0 tx=0).stop 2023-05-17T12:26:33.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f981f54f0 msgr2=0x7f8f981491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:33.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f981f54f0 0x7f8f981491a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8f9808c170 tx=0x7f8f9000a5f0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 shutdown_connections 2023-05-17T12:26:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8f7806ace0 0x7f8f7806d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f981f54f0 0x7f8f981491a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f84003fb0 0x7f8f9814d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 --2- 172.21.15.88:0/4174674375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f98147110 0x7f8f980cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:33.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 >> 172.21.15.88:0/4174674375 conn(0x7f8f980d07b0 msgr2=0x7f8f980b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:33.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 shutdown_connections 2023-05-17T12:26:33.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:33.896+0000 7f8f9e1ff700 1 -- 172.21.15.88:0/4174674375 wait complete. 2023-05-17T12:26:33.901 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:26:33.917 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T12:26:33.917 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T12:26:33.963 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:34.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.145+0000 7f2f2d7ff700 1 Processor -- start 2023-05-17T12:26:34.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.145+0000 7f2f2d7ff700 1 -- start start 2023-05-17T12:26:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.146+0000 7f2f2d7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2f2806b0b0 0x7f2f2806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.146+0000 7f2f2d7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f280cd6b0 con 0x7f2f2806c330 2023-05-17T12:26:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.146+0000 7f2f2d7ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f280b2460 con 0x7f2f2815c840 2023-05-17T12:26:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.146+0000 7f2f2d7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f280cdf50 con 0x7f2f2806b0b0 2023-05-17T12:26:34.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.147+0000 7f2f267fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2f2806b0b0 0x7f2f2806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.147+0000 7f2f277fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2f2806c330 0x7f2f28160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57704/0 (socket says 172.21.15.88:57704) 2023-05-17T12:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.147+0000 7f2f277fe700 1 -- 172.21.15.88:0/3424523980 learned_addr learned my addr 172.21.15.88:0/3424523980 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.147+0000 7f2f25ffb700 1 -- 172.21.15.88:0/3424523980 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853179207 0 0) 0x7f2f280cd6b0 con 0x7f2f2806c330 2023-05-17T12:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.147+0000 7f2f267fc700 1 -- 172.21.15.88:0/3424523980 >> v1:172.21.15.187:6789/0 conn(0x7f2f2815c840 legacy=0x7f2f280cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.147+0000 7f2f267fc700 1 -- 172.21.15.88:0/3424523980 >> v1:172.21.15.88:6789/0 conn(0x7f2f2806c330 legacy=0x7f2f28160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.147+0000 7f2f267fc700 1 -- 172.21.15.88:0/3424523980 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280b2740 con 0x7f2f2806b0b0 2023-05-17T12:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.147+0000 7f2f267fc700 1 --2- 172.21.15.88:0/3424523980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806b0b0 0x7f2f2806b940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009840 tx=0x7f2f1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ee9812d0cb6ca1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:34.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f25ffb700 1 -- 172.21.15.88:0/3424523980 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c011830 con 0x7f2f2806b0b0 2023-05-17T12:26:34.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f25ffb700 1 -- 172.21.15.88:0/3424523980 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c011990 con 0x7f2f2806b0b0 2023-05-17T12:26:34.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f25ffb700 1 -- 172.21.15.88:0/3424523980 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c011d20 con 0x7f2f2806b0b0 2023-05-17T12:26:34.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/3424523980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806b0b0 msgr2=0x7f2f2806b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f2d7ff700 1 --2- 172.21.15.88:0/3424523980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806b0b0 0x7f2f2806b940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009840 tx=0x7f2f1c009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/3424523980 shutdown_connections 2023-05-17T12:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f2d7ff700 1 --2- 172.21.15.88:0/3424523980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806b0b0 0x7f2f2806b940 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/3424523980 >> 172.21.15.88:0/3424523980 conn(0x7f2f280d3060 msgr2=0x7f2f280d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/3424523980 shutdown_connections 2023-05-17T12:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.148+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/3424523980 wait complete. 2023-05-17T12:26:34.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.150+0000 7f2f2d7ff700 1 Processor -- start 2023-05-17T12:26:34.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.150+0000 7f2f2d7ff700 1 -- start start 2023-05-17T12:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f2d7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f2806b0b0 0x7f2f28144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f2d7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806c330 0x7f2f2815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f2d7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f2815c840 0x7f2f281f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f2d7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f281f65c0 con 0x7f2f2806c330 2023-05-17T12:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f2d7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2815d020 con 0x7f2f2815c840 2023-05-17T12:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f2d7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2815d300 con 0x7f2f2806b0b0 2023-05-17T12:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f267fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806c330 0x7f2f2815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f267fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806c330 0x7f2f2815bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48722/0 (socket says 172.21.15.88:48722) 2023-05-17T12:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f267fc700 1 -- 172.21.15.88:0/2540113174 learned_addr learned my addr 172.21.15.88:0/2540113174 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f277fe700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f2815c840 0x7f2f281f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f26ffd700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f2806b0b0 0x7f2f28144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f267fc700 1 -- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f2806b0b0 msgr2=0x7f2f28144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.151+0000 7f2f267fc700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f2806b0b0 0x7f2f28144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f267fc700 1 -- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f2815c840 msgr2=0x7f2f281f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f267fc700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f2815c840 0x7f2f281f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f267fc700 1 -- 172.21.15.88:0/2540113174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c0094a0 con 0x7f2f2806c330 2023-05-17T12:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f277fe700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f2815c840 0x7f2f281f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:34.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f267fc700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806c330 0x7f2f2815bb80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c014040 tx=0x7f2f1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f0f7fe700 1 -- 172.21.15.88:0/2540113174 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c01a900 con 0x7f2f2806c330 2023-05-17T12:26:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f0f7fe700 1 -- 172.21.15.88:0/2540113174 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c01aa60 con 0x7f2f2806c330 2023-05-17T12:26:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f280cdbe0 con 0x7f2f2806c330 2023-05-17T12:26:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f0f7fe700 1 -- 172.21.15.88:0/2540113174 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c01add0 con 0x7f2f2806c330 2023-05-17T12:26:34.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.152+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f280cd900 con 0x7f2f2806c330 2023-05-17T12:26:34.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.153+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2815cc10 con 0x7f2f2806c330 2023-05-17T12:26:34.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.154+0000 7f2f0f7fe700 1 -- 172.21.15.88:0/2540113174 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f1c022070 con 0x7f2f2806c330 2023-05-17T12:26:34.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.155+0000 7f2f0f7fe700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2f1406ace0 0x7f2f1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.155+0000 7f2f0f7fe700 1 -- 172.21.15.88:0/2540113174 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2f1c08a680 con 0x7f2f2806c330 2023-05-17T12:26:34.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.155+0000 7f2f26ffd700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2f1406ace0 0x7f2f1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.156+0000 7f2f26ffd700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2f1406ace0 0x7f2f1406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2f18000f60 tx=0x7f2f18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:34.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.159+0000 7f2f0f7fe700 1 -- 172.21.15.88:0/2540113174 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2f1c0554a0 con 0x7f2f2806c330 2023-05-17T12:26:34.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.355+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f28074530 con 0x7f2f2806c330 2023-05-17T12:26:34.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.356+0000 7f2f0f7fe700 1 -- 172.21.15.88:0/2540113174 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f2f1c058ac0 con 0x7f2f2806c330 2023-05-17T12:26:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:34.360 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2f1406ace0 msgr2=0x7f2f1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2f1406ace0 0x7f2f1406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2f18000f60 tx=0x7f2f18009040 comp rx=0 tx=0).stop 2023-05-17T12:26:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806c330 msgr2=0x7f2f2815bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806c330 0x7f2f2815bb80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c014040 tx=0x7f2f1c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 shutdown_connections 2023-05-17T12:26:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2f1406ace0 0x7f2f1406d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f2815c840 0x7f2f281f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f2806b0b0 0x7f2f28144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 --2- 172.21.15.88:0/2540113174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f2806c330 0x7f2f2815bb80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 >> 172.21.15.88:0/2540113174 conn(0x7f2f280d3060 msgr2=0x7f2f280b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 shutdown_connections 2023-05-17T12:26:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.359+0000 7f2f2d7ff700 1 -- 172.21.15.88:0/2540113174 wait complete. 2023-05-17T12:26:34.379 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:34.380 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:34.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.565+0000 7f27947ff700 1 Processor -- start 2023-05-17T12:26:34.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.565+0000 7f27947ff700 1 -- start start 2023-05-17T12:26:34.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.566+0000 7f27947ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f278c06c760 0x7f278c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.566+0000 7f27947ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c06b4a0 con 0x7f278c0b23a0 2023-05-17T12:26:34.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.566+0000 7f27947ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c06a510 con 0x7f278c0cf190 2023-05-17T12:26:34.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.566+0000 7f27947ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278c0cd840 con 0x7f278c06c760 2023-05-17T12:26:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.566+0000 7f2791d9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f278c0b23a0 0x7f278c06cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57710/0 (socket says 172.21.15.88:57710) 2023-05-17T12:26:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.566+0000 7f2791d9a700 1 -- 172.21.15.88:0/2268284051 learned_addr learned my addr 172.21.15.88:0/2268284051 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f279259b700 1 --2- 172.21.15.88:0/2268284051 >> v2:172.21.15.187:3300/0 conn(0x7f278c06c760 0x7f278c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244686508 0 0) 0x7f277c001110 con 0x7f278c0b23a0 2023-05-17T12:26:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27780035b0 con 0x7f278c0b23a0 2023-05-17T12:26:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87673274 0 0) 0x7f27780035b0 con 0x7f278c0b23a0 2023-05-17T12:26:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 >> v2:172.21.15.187:3300/0 conn(0x7f278c06c760 msgr2=0x7f278c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 --2- 172.21.15.88:0/2268284051 >> v2:172.21.15.187:3300/0 conn(0x7f278c06c760 0x7f278c06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 >> v1:172.21.15.187:6789/0 conn(0x7f278c0cf190 legacy=0x7f278c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0cdb20 con 0x7f278c0b23a0 2023-05-17T12:26:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f277c001800 con 0x7f278c0b23a0 2023-05-17T12:26:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 >> v1:172.21.15.88:6789/0 conn(0x7f278c0b23a0 legacy=0x7f278c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2778003a00 0x7f2778003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2778004850 0x7f2778004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778005200 0x7f277800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0cd840 con 0x7f2778003a00 2023-05-17T12:26:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277800c080 con 0x7f2778005200 2023-05-17T12:26:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.567+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277800c240 con 0x7f2778004850 2023-05-17T12:26:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f279259b700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2778003a00 0x7f2778003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f2791d9a700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2778004850 0x7f2778004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f2792d9c700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778005200 0x7f277800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f279259b700 1 -- 172.21.15.88:0/2268284051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2778004850 msgr2=0x7f2778004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f279259b700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2778004850 0x7f2778004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f279259b700 1 -- 172.21.15.88:0/2268284051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778005200 msgr2=0x7f277800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f279259b700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778005200 0x7f277800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f279259b700 1 -- 172.21.15.88:0/2268284051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780035b0 con 0x7f2778003a00 2023-05-17T12:26:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f2792d9c700 1 -- 172.21.15.88:0/2268284051 reap_dead start 2023-05-17T12:26:34.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.568+0000 7f279259b700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2778003a00 0x7f2778003e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2788009b60 tx=0x7f2778005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d298ad8180eed471 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278800e6c0 con 0x7f2778003a00 2023-05-17T12:26:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278800e820 con 0x7f2778003a00 2023-05-17T12:26:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f2791599700 1 -- 172.21.15.88:0/2268284051 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278800eb90 con 0x7f2778003a00 2023-05-17T12:26:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f27947ff700 1 -- 172.21.15.88:0/2268284051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2778003a00 msgr2=0x7f2778003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f27947ff700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2778003a00 0x7f2778003e10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2788009b60 tx=0x7f2778005880 comp rx=0 tx=0).stop 2023-05-17T12:26:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f27947ff700 1 -- 172.21.15.88:0/2268284051 shutdown_connections 2023-05-17T12:26:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f27947ff700 1 --2- 172.21.15.88:0/2268284051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2778003a00 0x7f2778003e10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f27947ff700 1 -- 172.21.15.88:0/2268284051 >> 172.21.15.88:0/2268284051 conn(0x7f278c0d06f0 msgr2=0x7f278c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f27947ff700 1 -- 172.21.15.88:0/2268284051 shutdown_connections 2023-05-17T12:26:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.569+0000 7f27947ff700 1 -- 172.21.15.88:0/2268284051 wait complete. 2023-05-17T12:26:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.571+0000 7f27947ff700 1 Processor -- start 2023-05-17T12:26:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.571+0000 7f27947ff700 1 -- start start 2023-05-17T12:26:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f27947ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2778003a00 0x7f278c1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f27947ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f278c155700 0x7f278c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f27947ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c0ccd70 0x7f278c0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f27947ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0cd2f0 con 0x7f278c0ccd70 2023-05-17T12:26:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f27947ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0c7a10 con 0x7f278c155700 2023-05-17T12:26:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f27947ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0c7cf0 con 0x7f2778003a00 2023-05-17T12:26:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f2792d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c0ccd70 0x7f278c0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f2792d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c0ccd70 0x7f278c0ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48754/0 (socket says 172.21.15.88:48754) 2023-05-17T12:26:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f2792d9c700 1 -- 172.21.15.88:0/407338101 learned_addr learned my addr 172.21.15.88:0/407338101 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f279259b700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2778003a00 0x7f278c1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.572+0000 7f2791d9a700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f278c155700 0x7f278c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f2792d9c700 1 -- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2778003a00 msgr2=0x7f278c1482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f2792d9c700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2778003a00 0x7f278c1482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f2792d9c700 1 -- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f278c155700 msgr2=0x7f278c0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f2792d9c700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f278c155700 0x7f278c0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f2792d9c700 1 -- 172.21.15.88:0/407338101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c06aa40 con 0x7f278c0ccd70 2023-05-17T12:26:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f2792d9c700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c0ccd70 0x7f278c0ca9a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f278c0b1c90 tx=0x7f27840021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f2782ffd700 1 -- 172.21.15.88:0/407338101 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784003cd0 con 0x7f278c0ccd70 2023-05-17T12:26:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f2782ffd700 1 -- 172.21.15.88:0/407338101 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2784003e30 con 0x7f278c0ccd70 2023-05-17T12:26:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f2782ffd700 1 -- 172.21.15.88:0/407338101 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784005310 con 0x7f278c0ccd70 2023-05-17T12:26:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c06a760 con 0x7f278c0ccd70 2023-05-17T12:26:34.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.573+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c15cb40 con 0x7f278c0ccd70 2023-05-17T12:26:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.574+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c074530 con 0x7f278c0ccd70 2023-05-17T12:26:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.575+0000 7f2782ffd700 1 -- 172.21.15.88:0/407338101 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2784005470 con 0x7f278c0ccd70 2023-05-17T12:26:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.576+0000 7f2782ffd700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f277006ace0 0x7f277006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.576+0000 7f2782ffd700 1 -- 172.21.15.88:0/407338101 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2784089a70 con 0x7f278c0ccd70 2023-05-17T12:26:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.577+0000 7f279259b700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f277006ace0 0x7f277006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.577+0000 7f279259b700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f277006ace0 0x7f277006d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f27880090b0 tx=0x7f278801e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:34.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.580+0000 7f2782ffd700 1 -- 172.21.15.88:0/407338101 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f27840546c0 con 0x7f278c0ccd70 2023-05-17T12:26:34.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.772+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f278c15c160 con 0x7f278c0ccd70 2023-05-17T12:26:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.772+0000 7f2782ffd700 1 -- 172.21.15.88:0/407338101 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2784057ce0 con 0x7f278c0ccd70 2023-05-17T12:26:34.775 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:34.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f277006ace0 msgr2=0x7f277006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f277006ace0 0x7f277006d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f27880090b0 tx=0x7f278801e040 comp rx=0 tx=0).stop 2023-05-17T12:26:34.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c0ccd70 msgr2=0x7f278c0ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c0ccd70 0x7f278c0ca9a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f278c0b1c90 tx=0x7f27840021e0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 shutdown_connections 2023-05-17T12:26:34.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f277006ace0 0x7f277006d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f278c0ccd70 0x7f278c0ca9a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2778003a00 0x7f278c1482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 --2- 172.21.15.88:0/407338101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f278c155700 0x7f278c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 >> 172.21.15.88:0/407338101 conn(0x7f278c0d06f0 msgr2=0x7f278c0b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:34.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 shutdown_connections 2023-05-17T12:26:34.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.774+0000 7f27947ff700 1 -- 172.21.15.88:0/407338101 wait complete. 2023-05-17T12:26:34.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.979+0000 7f7d139ff700 1 Processor -- start 2023-05-17T12:26:34.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.979+0000 7f7d139ff700 1 -- start start 2023-05-17T12:26:34.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.980+0000 7f7d139ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d0c0b23a0 0x7f7d0c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.980+0000 7f7d139ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7d0c0cf190 0x7f7d0c160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.980+0000 7f7d139ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c06b4a0 con 0x7f7d0c06c760 2023-05-17T12:26:34.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.980+0000 7f7d139ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c06a510 con 0x7f7d0c0b23a0 2023-05-17T12:26:34.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.980+0000 7f7d139ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0cd840 con 0x7f7d0c0cf190 2023-05-17T12:26:34.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.981+0000 7f7d10f9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d0c0b23a0 0x7f7d0c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.981+0000 7f7d10f9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d0c0b23a0 0x7f7d0c06af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48770/0 (socket says 172.21.15.88:48770) 2023-05-17T12:26:34.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.981+0000 7f7d10f9a700 1 -- 172.21.15.88:0/2657455175 learned_addr learned my addr 172.21.15.88:0/2657455175 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:34.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.981+0000 7f7d11f9c700 1 --2- 172.21.15.88:0/2657455175 >> v2:172.21.15.187:3300/0 conn(0x7f7d0c0cf190 0x7f7d0c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.981+0000 7f7d10f9a700 1 -- 172.21.15.88:0/2657455175 >> v2:172.21.15.187:3300/0 conn(0x7f7d0c0cf190 msgr2=0x7f7d0c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.981+0000 7f7d10f9a700 1 --2- 172.21.15.88:0/2657455175 >> v2:172.21.15.187:3300/0 conn(0x7f7d0c0cf190 0x7f7d0c160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.981+0000 7f7d10f9a700 1 -- 172.21.15.88:0/2657455175 >> v1:172.21.15.187:6789/0 conn(0x7f7d0c06c760 legacy=0x7f7d0c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.981+0000 7f7d10f9a700 1 -- 172.21.15.88:0/2657455175 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0cdb20 con 0x7f7d0c0b23a0 2023-05-17T12:26:34.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.981+0000 7f7d10f9a700 1 --2- 172.21.15.88:0/2657455175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0b23a0 0x7f7d0c06af60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c08c360 tx=0x7f7cfc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e444d6bf35cd8c7e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d03fff700 1 -- 172.21.15.88:0/2657455175 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc004230 con 0x7f7d0c0b23a0 2023-05-17T12:26:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d03fff700 1 -- 172.21.15.88:0/2657455175 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc004390 con 0x7f7d0c0b23a0 2023-05-17T12:26:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d03fff700 1 -- 172.21.15.88:0/2657455175 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0036a0 con 0x7f7d0c0b23a0 2023-05-17T12:26:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d139ff700 1 -- 172.21.15.88:0/2657455175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0b23a0 msgr2=0x7f7d0c06af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d139ff700 1 --2- 172.21.15.88:0/2657455175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0b23a0 0x7f7d0c06af60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c08c360 tx=0x7f7cfc009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d139ff700 1 -- 172.21.15.88:0/2657455175 shutdown_connections 2023-05-17T12:26:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d139ff700 1 --2- 172.21.15.88:0/2657455175 >> v2:172.21.15.187:3300/0 conn(0x7f7d0c0cf190 0x7f7d0c160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d139ff700 1 --2- 172.21.15.88:0/2657455175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0b23a0 0x7f7d0c06af60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d139ff700 1 -- 172.21.15.88:0/2657455175 >> 172.21.15.88:0/2657455175 conn(0x7f7d0c0d06f0 msgr2=0x7f7d0c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:34.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d139ff700 1 -- 172.21.15.88:0/2657455175 shutdown_connections 2023-05-17T12:26:34.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.982+0000 7f7d139ff700 1 -- 172.21.15.88:0/2657455175 wait complete. 2023-05-17T12:26:34.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.984+0000 7f7d139ff700 1 Processor -- start 2023-05-17T12:26:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.984+0000 7f7d139ff700 1 -- start start 2023-05-17T12:26:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d139ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d0c06c760 0x7f7d0c0b8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d139ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0cf190 0x7f7d0c152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d139ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d0c0cccf0 0x7f7d0c1e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d139ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0b8d50 con 0x7f7d0c0cf190 2023-05-17T12:26:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d139ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c152bb0 con 0x7f7d0c06c760 2023-05-17T12:26:34.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d139ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1e7340 con 0x7f7d0c0cccf0 2023-05-17T12:26:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d10f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0cf190 0x7f7d0c152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d10f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0cf190 0x7f7d0c152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48786/0 (socket says 172.21.15.88:48786) 2023-05-17T12:26:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d10f9a700 1 -- 172.21.15.88:0/935220879 learned_addr learned my addr 172.21.15.88:0/935220879 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d11f9c700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d0c0cccf0 0x7f7d0c1e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.985+0000 7f7d1179b700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d0c06c760 0x7f7d0c0b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d10f9a700 1 -- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d0c0cccf0 msgr2=0x7f7d0c1e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d10f9a700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d0c0cccf0 0x7f7d0c1e83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d10f9a700 1 -- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d0c06c760 msgr2=0x7f7d0c0b8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d10f9a700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d0c06c760 0x7f7d0c0b8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d10f9a700 1 -- 172.21.15.88:0/935220879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc009550 con 0x7f7d0c0cf190 2023-05-17T12:26:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d10f9a700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0cf190 0x7f7d0c152670 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009130 tx=0x7f7cfc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d01ffb700 1 -- 172.21.15.88:0/935220879 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc003d40 con 0x7f7d0c0cf190 2023-05-17T12:26:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d01ffb700 1 -- 172.21.15.88:0/935220879 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc01f070 con 0x7f7d0c0cf190 2023-05-17T12:26:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c06aa40 con 0x7f7d0c0cf190 2023-05-17T12:26:34.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d01ffb700 1 -- 172.21.15.88:0/935220879 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc011870 con 0x7f7d0c0cf190 2023-05-17T12:26:34.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.986+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c06a760 con 0x7f7d0c0cf190 2023-05-17T12:26:34.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.987+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c15cb40 con 0x7f7d0c0cf190 2023-05-17T12:26:34.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.988+0000 7f7d01ffb700 1 -- 172.21.15.88:0/935220879 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7cfc021030 con 0x7f7d0c0cf190 2023-05-17T12:26:34.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.989+0000 7f7d01ffb700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7cf006ad30 0x7f7cf006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:34.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.989+0000 7f7d01ffb700 1 -- 172.21.15.88:0/935220879 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7cfc08ab80 con 0x7f7d0c0cf190 2023-05-17T12:26:34.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.990+0000 7f7d1179b700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7cf006ad30 0x7f7cf006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:34.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.990+0000 7f7d1179b700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7cf006ad30 0x7f7cf006d1e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7d08004f30 tx=0x7f7d08009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:34.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:34.993+0000 7f7d01ffb700 1 -- 172.21.15.88:0/935220879 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7cfc055970 con 0x7f7d0c0cf190 2023-05-17T12:26:35.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.187+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d0c074530 con 0x7f7d0c0cf190 2023-05-17T12:26:35.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.187+0000 7f7d01ffb700 1 -- 172.21.15.88:0/935220879 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7cfc058f90 con 0x7f7d0c0cf190 2023-05-17T12:26:35.190 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:35.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7cf006ad30 msgr2=0x7f7cf006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7cf006ad30 0x7f7cf006d1e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7d08004f30 tx=0x7f7d08009040 comp rx=0 tx=0).stop 2023-05-17T12:26:35.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0cf190 msgr2=0x7f7d0c152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0cf190 0x7f7d0c152670 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009130 tx=0x7f7cfc004750 comp rx=0 tx=0).stop 2023-05-17T12:26:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 shutdown_connections 2023-05-17T12:26:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7cf006ad30 0x7f7cf006d1e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d0c0cccf0 0x7f7d0c1e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d0c06c760 0x7f7d0c0b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 --2- 172.21.15.88:0/935220879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d0c0cf190 0x7f7d0c152670 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 >> 172.21.15.88:0/935220879 conn(0x7f7d0c0d06f0 msgr2=0x7f7d0c0d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 shutdown_connections 2023-05-17T12:26:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.190+0000 7f7d139ff700 1 -- 172.21.15.88:0/935220879 wait complete. 2023-05-17T12:26:35.209 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:35.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.394+0000 7f3f2e5ff700 1 Processor -- start 2023-05-17T12:26:35.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.394+0000 7f3f2e5ff700 1 -- start start 2023-05-17T12:26:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.395+0000 7f3f2e5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280cdf60 0x7f3f280cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.395+0000 7f3f2e5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f28159ed0 con 0x7f3f280cdb10 2023-05-17T12:26:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.395+0000 7f3f2e5ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2815a1b0 con 0x7f3f28153d60 2023-05-17T12:26:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.395+0000 7f3f2e5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815a490 con 0x7f3f280cdf60 2023-05-17T12:26:35.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.395+0000 7f3f277fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3f280cdb10 0x7f3f280ca660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57726/0 (socket says 172.21.15.88:57726) 2023-05-17T12:26:35.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.395+0000 7f3f277fe700 1 -- 172.21.15.88:0/3474915948 learned_addr learned my addr 172.21.15.88:0/3474915948 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f2cb9c700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280cdf60 0x7f3f280cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101432891 0 0) 0x7f3f28159ed0 con 0x7f3f280cdb10 2023-05-17T12:26:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f100057c0 con 0x7f3f280cdb10 2023-05-17T12:26:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570448663 0 0) 0x7f3f2815a1b0 con 0x7f3f28153d60 2023-05-17T12:26:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f28159ed0 con 0x7f3f28153d60 2023-05-17T12:26:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3887343381 0 0) 0x7f3f100057c0 con 0x7f3f280cdb10 2023-05-17T12:26:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280cdf60 msgr2=0x7f3f280cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280cdf60 0x7f3f280cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 >> v1:172.21.15.187:6789/0 conn(0x7f3f28153d60 legacy=0x7f3f2815daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2815a770 con 0x7f3f280cdb10 2023-05-17T12:26:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f3f1c001670 con 0x7f3f280cdb10 2023-05-17T12:26:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 >> v1:172.21.15.88:6789/0 conn(0x7f3f280cdb10 legacy=0x7f3f280ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280cdf60 0x7f3f10005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f10006330 0x7f3f10006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f10006fa0 0x7f3f10007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815a490 con 0x7f3f10006330 2023-05-17T12:26:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1000dcd0 con 0x7f3f10006fa0 2023-05-17T12:26:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.396+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1000de90 con 0x7f3f280cdf60 2023-05-17T12:26:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f277fe700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f10006330 0x7f3f10006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f27fff700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280cdf60 0x7f3f10005dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f2cb9c700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f10006fa0 0x7f3f10007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f277fe700 1 -- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280cdf60 msgr2=0x7f3f10005dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f277fe700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280cdf60 0x7f3f10005dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f277fe700 1 -- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f10006fa0 msgr2=0x7f3f10007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f277fe700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f10006fa0 0x7f3f10007410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f277fe700 1 -- 172.21.15.88:0/3474915948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f100057c0 con 0x7f3f10006330 2023-05-17T12:26:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f277fe700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f10006330 0x7f3f10006a60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c001eb0 tx=0x7f3f10007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e90d58b736e9b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:35.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00cd80 con 0x7f3f10006330 2023-05-17T12:26:35.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c001af0 con 0x7f3f10006330 2023-05-17T12:26:35.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.397+0000 7f3f26ffd700 1 -- 172.21.15.88:0/3474915948 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c005ba0 con 0x7f3f10006330 2023-05-17T12:26:35.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.398+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/3474915948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f10006330 msgr2=0x7f3f10006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.398+0000 7f3f2e5ff700 1 --2- 172.21.15.88:0/3474915948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f10006330 0x7f3f10006a60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c001eb0 tx=0x7f3f10007a90 comp rx=0 tx=0).stop 2023-05-17T12:26:35.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.398+0000 7f3f2cb9c700 1 -- 172.21.15.88:0/3474915948 reap_dead start 2023-05-17T12:26:35.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.398+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/3474915948 shutdown_connections 2023-05-17T12:26:35.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.398+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/3474915948 >> 172.21.15.88:0/3474915948 conn(0x7f3f280cf970 msgr2=0x7f3f280cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:35.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.398+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/3474915948 shutdown_connections 2023-05-17T12:26:35.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.398+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/3474915948 wait complete. 2023-05-17T12:26:35.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.400+0000 7f3f2e5ff700 1 Processor -- start 2023-05-17T12:26:35.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.401+0000 7f3f2e5ff700 1 -- start start 2023-05-17T12:26:35.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2e5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f10006330 0x7f3f28147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2e5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f280b1cb0 0x7f3f280b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2e5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f280b46b0 0x7f3f2814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2e5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280b4b50 con 0x7f3f280b46b0 2023-05-17T12:26:35.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2e5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815b5b0 con 0x7f3f280b1cb0 2023-05-17T12:26:35.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2e5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815ac80 con 0x7f3f10006330 2023-05-17T12:26:35.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2cb9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f280b46b0 0x7f3f2814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2cb9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f280b46b0 0x7f3f2814a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48802/0 (socket says 172.21.15.88:48802) 2023-05-17T12:26:35.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2cb9c700 1 -- 172.21.15.88:0/2003916017 learned_addr learned my addr 172.21.15.88:0/2003916017 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:35.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f277fe700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f280b1cb0 0x7f3f280b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f27fff700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f10006330 0x7f3f28147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2cb9c700 1 -- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f10006330 msgr2=0x7f3f28147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2cb9c700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f10006330 0x7f3f28147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2cb9c700 1 -- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f280b1cb0 msgr2=0x7f3f280b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2cb9c700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f280b1cb0 0x7f3f280b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f2cb9c700 1 -- 172.21.15.88:0/2003916017 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280ce3c0 con 0x7f3f280b46b0 2023-05-17T12:26:35.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.402+0000 7f3f277fe700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f280b1cb0 0x7f3f280b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:35.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.403+0000 7f3f2cb9c700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f280b46b0 0x7f3f2814a680 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3f2806ece0 tx=0x7f3f200114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:35.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.403+0000 7f3f24ff9700 1 -- 172.21.15.88:0/2003916017 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2000e070 con 0x7f3f280b46b0 2023-05-17T12:26:35.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.403+0000 7f3f24ff9700 1 -- 172.21.15.88:0/2003916017 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f20003c30 con 0x7f3f280b46b0 2023-05-17T12:26:35.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.403+0000 7f3f24ff9700 1 -- 172.21.15.88:0/2003916017 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20003e20 con 0x7f3f280b46b0 2023-05-17T12:26:35.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.403+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2815aa50 con 0x7f3f280b46b0 2023-05-17T12:26:35.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.403+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f280cc0d0 con 0x7f3f280b46b0 2023-05-17T12:26:35.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.404+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f28074530 con 0x7f3f280b46b0 2023-05-17T12:26:35.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.405+0000 7f3f24ff9700 1 -- 172.21.15.88:0/2003916017 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f20011a10 con 0x7f3f280b46b0 2023-05-17T12:26:35.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.406+0000 7f3f24ff9700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f1406ace0 0x7f3f1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.406+0000 7f3f24ff9700 1 -- 172.21.15.88:0/2003916017 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3f20089ce0 con 0x7f3f280b46b0 2023-05-17T12:26:35.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.406+0000 7f3f27fff700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f1406ace0 0x7f3f1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.407+0000 7f3f27fff700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f1406ace0 0x7f3f1406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007b70 tx=0x7f3f18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:35.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.410+0000 7f3f24ff9700 1 -- 172.21.15.88:0/2003916017 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3f20054a50 con 0x7f3f280b46b0 2023-05-17T12:26:35.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.605+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f2815b6f0 con 0x7f3f280b46b0 2023-05-17T12:26:35.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.605+0000 7f3f24ff9700 1 -- 172.21.15.88:0/2003916017 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f20058070 con 0x7f3f280b46b0 2023-05-17T12:26:35.609 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:35.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f1406ace0 msgr2=0x7f3f1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f1406ace0 0x7f3f1406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3f18007b70 tx=0x7f3f18009040 comp rx=0 tx=0).stop 2023-05-17T12:26:35.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f280b46b0 msgr2=0x7f3f2814a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f280b46b0 0x7f3f2814a680 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3f2806ece0 tx=0x7f3f200114b0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 shutdown_connections 2023-05-17T12:26:35.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f3f1406ace0 0x7f3f1406d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f280b46b0 0x7f3f2814a680 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f10006330 0x7f3f28147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 --2- 172.21.15.88:0/2003916017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f280b1cb0 0x7f3f280b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 >> 172.21.15.88:0/2003916017 conn(0x7f3f280cf970 msgr2=0x7f3f28151160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:35.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 shutdown_connections 2023-05-17T12:26:35.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.608+0000 7f3f2e5ff700 1 -- 172.21.15.88:0/2003916017 wait complete. 2023-05-17T12:26:35.627 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:35.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.812+0000 7fc7e67ff700 1 Processor -- start 2023-05-17T12:26:35.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.812+0000 7fc7e67ff700 1 -- start start 2023-05-17T12:26:35.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.813+0000 7fc7e67ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7e015c9c0 0x7fc7e00b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.813+0000 7fc7e67ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc7e00ceb80 0x7fc7e00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.813+0000 7fc7e67ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00b39d0 con 0x7fc7e0160e80 2023-05-17T12:26:35.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.813+0000 7fc7e67ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e015cd90 con 0x7fc7e015c9c0 2023-05-17T12:26:35.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.813+0000 7fc7e67ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e00b37c0 con 0x7fc7e00ceb80 2023-05-17T12:26:35.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.814+0000 7fc7dffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7e015c9c0 0x7fc7e00b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.814+0000 7fc7dffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7e015c9c0 0x7fc7e00b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48804/0 (socket says 172.21.15.88:48804) 2023-05-17T12:26:35.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.814+0000 7fc7dffff700 1 -- 172.21.15.88:0/4180489555 learned_addr learned my addr 172.21.15.88:0/4180489555 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:35.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.814+0000 7fc7e4d9c700 1 --2- 172.21.15.88:0/4180489555 >> v2:172.21.15.187:3300/0 conn(0x7fc7e00ceb80 0x7fc7e00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.814+0000 7fc7dffff700 1 -- 172.21.15.88:0/4180489555 >> v2:172.21.15.187:3300/0 conn(0x7fc7e00ceb80 msgr2=0x7fc7e00cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:35.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.814+0000 7fc7dffff700 1 --2- 172.21.15.88:0/4180489555 >> v2:172.21.15.187:3300/0 conn(0x7fc7e00ceb80 0x7fc7e00cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.814+0000 7fc7dffff700 1 -- 172.21.15.88:0/4180489555 >> v1:172.21.15.187:6789/0 conn(0x7fc7e0160e80 legacy=0x7fc7e00cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:35.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.814+0000 7fc7dffff700 1 -- 172.21.15.88:0/4180489555 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e00cf4e0 con 0x7fc7e015c9c0 2023-05-17T12:26:35.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7dffff700 1 --2- 172.21.15.88:0/4180489555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 0x7fc7e00b3280 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00b01c0 tx=0x7fc7d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc5cba3fe649734 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:35.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7deffd700 1 -- 172.21.15.88:0/4180489555 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000b870 con 0x7fc7e015c9c0 2023-05-17T12:26:35.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7deffd700 1 -- 172.21.15.88:0/4180489555 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d000b9d0 con 0x7fc7e015c9c0 2023-05-17T12:26:35.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7deffd700 1 -- 172.21.15.88:0/4180489555 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000bd60 con 0x7fc7e015c9c0 2023-05-17T12:26:35.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7e67ff700 1 -- 172.21.15.88:0/4180489555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 msgr2=0x7fc7e00b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7e67ff700 1 --2- 172.21.15.88:0/4180489555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 0x7fc7e00b3280 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00b01c0 tx=0x7fc7d0009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7e67ff700 1 -- 172.21.15.88:0/4180489555 shutdown_connections 2023-05-17T12:26:35.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7e67ff700 1 --2- 172.21.15.88:0/4180489555 >> v2:172.21.15.187:3300/0 conn(0x7fc7e00ceb80 0x7fc7e00cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7e67ff700 1 --2- 172.21.15.88:0/4180489555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 0x7fc7e00b3280 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7e67ff700 1 -- 172.21.15.88:0/4180489555 >> 172.21.15.88:0/4180489555 conn(0x7fc7e00d1c40 msgr2=0x7fc7e00b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:35.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7e67ff700 1 -- 172.21.15.88:0/4180489555 shutdown_connections 2023-05-17T12:26:35.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.815+0000 7fc7e67ff700 1 -- 172.21.15.88:0/4180489555 wait complete. 2023-05-17T12:26:35.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.817+0000 7fc7e67ff700 1 Processor -- start 2023-05-17T12:26:35.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.817+0000 7fc7e67ff700 1 -- start start 2023-05-17T12:26:35.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7e67ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e00ceb80 0x7fc7e015ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7e67ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 0x7fc7e00ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7e67ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0160e80 0x7fc7e00b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7e67ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e015e970 con 0x7fc7e015c9c0 2023-05-17T12:26:35.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7e67ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e015e060 con 0x7fc7e0160e80 2023-05-17T12:26:35.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7e67ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e01f3190 con 0x7fc7e00ceb80 2023-05-17T12:26:35.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7df7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 0x7fc7e00ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7df7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 0x7fc7e00ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48812/0 (socket says 172.21.15.88:48812) 2023-05-17T12:26:35.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7df7fe700 1 -- 172.21.15.88:0/3875491258 learned_addr learned my addr 172.21.15.88:0/3875491258 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:35.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7e4d9c700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0160e80 0x7fc7e00b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.818+0000 7fc7dffff700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e00ceb80 0x7fc7e015ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7df7fe700 1 -- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e00ceb80 msgr2=0x7fc7e015ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7df7fe700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e00ceb80 0x7fc7e015ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7df7fe700 1 -- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0160e80 msgr2=0x7fc7e00b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:35.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7df7fe700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0160e80 0x7fc7e00b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:35.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7df7fe700 1 -- 172.21.15.88:0/3875491258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0009550 con 0x7fc7e015c9c0 2023-05-17T12:26:35.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7e4d9c700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0160e80 0x7fc7e00b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:35.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7df7fe700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 0x7fc7e00ca740 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c4e0 tx=0x7fc7d400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:35.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7dcff9700 1 -- 172.21.15.88:0/3875491258 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40052d0 con 0x7fc7e015c9c0 2023-05-17T12:26:35.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7dcff9700 1 -- 172.21.15.88:0/3875491258 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d4005430 con 0x7fc7e015c9c0 2023-05-17T12:26:35.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e006c1f0 con 0x7fc7e015c9c0 2023-05-17T12:26:35.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7dcff9700 1 -- 172.21.15.88:0/3875491258 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40038c0 con 0x7fc7e015c9c0 2023-05-17T12:26:35.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.819+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00cbd10 con 0x7fc7e015c9c0 2023-05-17T12:26:35.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.820+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e015f340 con 0x7fc7e015c9c0 2023-05-17T12:26:35.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.822+0000 7fc7dcff9700 1 -- 172.21.15.88:0/3875491258 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7d4003a20 con 0x7fc7e015c9c0 2023-05-17T12:26:35.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.823+0000 7fc7dcff9700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc7cc06ace0 0x7fc7cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:35.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.823+0000 7fc7dcff9700 1 -- 172.21.15.88:0/3875491258 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc7d40890d0 con 0x7fc7e015c9c0 2023-05-17T12:26:35.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.823+0000 7fc7dffff700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc7cc06ace0 0x7fc7cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:35.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.824+0000 7fc7dffff700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc7cc06ace0 0x7fc7cc06d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0000c00 tx=0x7fc7d0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:35.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:35.826+0000 7fc7dcff9700 1 -- 172.21.15.88:0/3875491258 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc7d4053e30 con 0x7fc7e015c9c0 2023-05-17T12:26:36.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.019+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7e006c4d0 con 0x7fc7e015c9c0 2023-05-17T12:26:36.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.019+0000 7fc7dcff9700 1 -- 172.21.15.88:0/3875491258 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7d4017020 con 0x7fc7e015c9c0 2023-05-17T12:26:36.023 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc7cc06ace0 msgr2=0x7fc7cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc7cc06ace0 0x7fc7cc06d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0000c00 tx=0x7fc7d0008030 comp rx=0 tx=0).stop 2023-05-17T12:26:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 msgr2=0x7fc7e00ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 0x7fc7e00ca740 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c4e0 tx=0x7fc7d400c7f0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 shutdown_connections 2023-05-17T12:26:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc7cc06ace0 0x7fc7cc06d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0160e80 0x7fc7e00b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7e00ceb80 0x7fc7e015ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 --2- 172.21.15.88:0/3875491258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e015c9c0 0x7fc7e00ca740 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 >> 172.21.15.88:0/3875491258 conn(0x7fc7e00d1c40 msgr2=0x7fc7e00b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 shutdown_connections 2023-05-17T12:26:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.022+0000 7fc7e67ff700 1 -- 172.21.15.88:0/3875491258 wait complete. 2023-05-17T12:26:36.042 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:36.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.227+0000 7ff1a39ff700 1 Processor -- start 2023-05-17T12:26:36.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.227+0000 7ff1a39ff700 1 -- start start 2023-05-17T12:26:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.228+0000 7ff1a39ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff19c0b2510 0x7ff19c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.228+0000 7ff1a39ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c06b770 con 0x7ff19c0b0840 2023-05-17T12:26:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.228+0000 7ff1a39ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c06d810 con 0x7ff19c15cd80 2023-05-17T12:26:36.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.228+0000 7ff1a39ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19c0b0cc0 con 0x7ff19c0b2510 2023-05-17T12:26:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.228+0000 7ff1a1f9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff19c0b0840 0x7ff19c06bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57730/0 (socket says 172.21.15.88:57730) 2023-05-17T12:26:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.228+0000 7ff1a1f9c700 1 -- 172.21.15.88:0/1307165503 learned_addr learned my addr 172.21.15.88:0/1307165503 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:36.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.229+0000 7ff1a0f9a700 1 --2- 172.21.15.88:0/1307165503 >> v2:172.21.15.187:3300/0 conn(0x7ff19c0b2510 0x7ff19c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.229+0000 7ff193fff700 1 -- 172.21.15.88:0/1307165503 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214866320 0 0) 0x7ff19c06b770 con 0x7ff19c0b0840 2023-05-17T12:26:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.229+0000 7ff193fff700 1 -- 172.21.15.88:0/1307165503 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1880035b0 con 0x7ff19c0b0840 2023-05-17T12:26:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.229+0000 7ff1a0f9a700 1 -- 172.21.15.88:0/1307165503 >> v1:172.21.15.187:6789/0 conn(0x7ff19c15cd80 legacy=0x7ff19c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.229+0000 7ff1a0f9a700 1 -- 172.21.15.88:0/1307165503 >> v1:172.21.15.88:6789/0 conn(0x7ff19c0b0840 legacy=0x7ff19c06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.229+0000 7ff1a0f9a700 1 -- 172.21.15.88:0/1307165503 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c06ae40 con 0x7ff19c0b2510 2023-05-17T12:26:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.229+0000 7ff1a0f9a700 1 --2- 172.21.15.88:0/1307165503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff19c0b2510 0x7ff19c0b0300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009840 tx=0x7ff18c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fa2c8bfb1c90c13 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:36.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff193fff700 1 -- 172.21.15.88:0/1307165503 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c011830 con 0x7ff19c0b2510 2023-05-17T12:26:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff193fff700 1 -- 172.21.15.88:0/1307165503 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c011990 con 0x7ff19c0b2510 2023-05-17T12:26:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff193fff700 1 -- 172.21.15.88:0/1307165503 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c011d00 con 0x7ff19c0b2510 2023-05-17T12:26:36.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff1a39ff700 1 -- 172.21.15.88:0/1307165503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff19c0b2510 msgr2=0x7ff19c0b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff1a39ff700 1 --2- 172.21.15.88:0/1307165503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff19c0b2510 0x7ff19c0b0300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009840 tx=0x7ff18c009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff1a39ff700 1 -- 172.21.15.88:0/1307165503 shutdown_connections 2023-05-17T12:26:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff1a39ff700 1 --2- 172.21.15.88:0/1307165503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff19c0b2510 0x7ff19c0b0300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff1a39ff700 1 -- 172.21.15.88:0/1307165503 >> 172.21.15.88:0/1307165503 conn(0x7ff19c0b2de0 msgr2=0x7ff19c0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff1a39ff700 1 -- 172.21.15.88:0/1307165503 shutdown_connections 2023-05-17T12:26:36.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.230+0000 7ff1a39ff700 1 -- 172.21.15.88:0/1307165503 wait complete. 2023-05-17T12:26:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.233+0000 7ff1a39ff700 1 Processor -- start 2023-05-17T12:26:36.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.233+0000 7ff1a39ff700 1 -- start start 2023-05-17T12:26:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a39ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff19c0b0840 0x7ff19c14f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a39ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c0b2510 0x7ff19c099b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a39ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff19c15cd80 0x7ff19c15f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a39ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c09a430 con 0x7ff19c0b2510 2023-05-17T12:26:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a39ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c09a710 con 0x7ff19c0b0840 2023-05-17T12:26:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a39ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c09a9f0 con 0x7ff19c15cd80 2023-05-17T12:26:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a0f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c0b2510 0x7ff19c099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a0f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c0b2510 0x7ff19c099b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48826/0 (socket says 172.21.15.88:48826) 2023-05-17T12:26:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a0f9a700 1 -- 172.21.15.88:0/2793752427 learned_addr learned my addr 172.21.15.88:0/2793752427 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a1f9c700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff19c15cd80 0x7ff19c15f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.234+0000 7ff1a179b700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff19c0b0840 0x7ff19c14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff1a0f9a700 1 -- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff19c15cd80 msgr2=0x7ff19c15f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff1a0f9a700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff19c15cd80 0x7ff19c15f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff1a0f9a700 1 -- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff19c0b0840 msgr2=0x7ff19c14f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff1a0f9a700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff19c0b0840 0x7ff19c14f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff1a0f9a700 1 -- 172.21.15.88:0/2793752427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0094a0 con 0x7ff19c0b2510 2023-05-17T12:26:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff1a0f9a700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c0b2510 0x7ff19c099b90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0090b0 tx=0x7ff18c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:36.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff191ffb700 1 -- 172.21.15.88:0/2793752427 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0036a0 con 0x7ff19c0b2510 2023-05-17T12:26:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff191ffb700 1 -- 172.21.15.88:0/2793752427 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c01f070 con 0x7ff19c0b2510 2023-05-17T12:26:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c06b400 con 0x7ff19c0b2510 2023-05-17T12:26:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff191ffb700 1 -- 172.21.15.88:0/2793752427 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c003a20 con 0x7ff19c0b2510 2023-05-17T12:26:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.235+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c06b120 con 0x7ff19c0b2510 2023-05-17T12:26:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.236+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c0ce3b0 con 0x7ff19c0b2510 2023-05-17T12:26:36.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.238+0000 7ff191ffb700 1 -- 172.21.15.88:0/2793752427 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff18c003b80 con 0x7ff19c0b2510 2023-05-17T12:26:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.238+0000 7ff191ffb700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff18006ace0 0x7ff18006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.239+0000 7ff191ffb700 1 -- 172.21.15.88:0/2793752427 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff18c021070 con 0x7ff19c0b2510 2023-05-17T12:26:36.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.239+0000 7ff1a179b700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff18006ace0 0x7ff18006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.239+0000 7ff1a179b700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff18006ace0 0x7ff18006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff198000f60 tx=0x7ff198009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:36.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.243+0000 7ff191ffb700 1 -- 172.21.15.88:0/2793752427 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff18c055f30 con 0x7ff19c0b2510 2023-05-17T12:26:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.436+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff19c15d150 con 0x7ff19c0b2510 2023-05-17T12:26:36.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.436+0000 7ff191ffb700 1 -- 172.21.15.88:0/2793752427 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff19c15d150 con 0x7ff19c0b2510 2023-05-17T12:26:36.440 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:36.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff18006ace0 msgr2=0x7ff18006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff18006ace0 0x7ff18006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff198000f60 tx=0x7ff198009040 comp rx=0 tx=0).stop 2023-05-17T12:26:36.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c0b2510 msgr2=0x7ff19c099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c0b2510 0x7ff19c099b90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0090b0 tx=0x7ff18c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:36.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 shutdown_connections 2023-05-17T12:26:36.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff18006ace0 0x7ff18006d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff19c15cd80 0x7ff19c15f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff19c0b0840 0x7ff19c14f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 --2- 172.21.15.88:0/2793752427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff19c0b2510 0x7ff19c099b90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 >> 172.21.15.88:0/2793752427 conn(0x7ff19c0b2de0 msgr2=0x7ff19c0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:36.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 shutdown_connections 2023-05-17T12:26:36.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.439+0000 7ff1a39ff700 1 -- 172.21.15.88:0/2793752427 wait complete. 2023-05-17T12:26:36.459 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-17T12:26:36.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.642+0000 7f29ab1ff700 1 Processor -- start 2023-05-17T12:26:36.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.642+0000 7f29ab1ff700 1 -- start start 2023-05-17T12:26:36.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.643+0000 7f29ab1ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f29a415ca90 0x7f29a40cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.643+0000 7f29ab1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29a4160f90 0x7f29a406c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.643+0000 7f29ab1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a406ca50 0x7f29a406a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.643+0000 7f29ab1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a406ced0 con 0x7f29a4160f90 2023-05-17T12:26:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.643+0000 7f29ab1ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a4161410 con 0x7f29a415ca90 2023-05-17T12:26:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.643+0000 7f29ab1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a40cde90 con 0x7f29a406ca50 2023-05-17T12:26:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29a4160f90 0x7f29a406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29a4160f90 0x7f29a406c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48842/0 (socket says 172.21.15.88:48842) 2023-05-17T12:26:36.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a3fff700 1 -- 172.21.15.88:0/3466544705 learned_addr learned my addr 172.21.15.88:0/3466544705 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a8f9b700 1 --2- 172.21.15.88:0/3466544705 >> v2:172.21.15.187:3300/0 conn(0x7f29a415ca90 0x7f29a40cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a3fff700 1 -- 172.21.15.88:0/3466544705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a406ca50 msgr2=0x7f29a406a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:36.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a979c700 1 --2- 172.21.15.88:0/3466544705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a406ca50 0x7f29a406a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a3fff700 1 --2- 172.21.15.88:0/3466544705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a406ca50 0x7f29a406a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a3fff700 1 -- 172.21.15.88:0/3466544705 >> v2:172.21.15.187:3300/0 conn(0x7f29a415ca90 msgr2=0x7f29a40cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a3fff700 1 --2- 172.21.15.88:0/3466544705 >> v2:172.21.15.187:3300/0 conn(0x7f29a415ca90 0x7f29a40cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a3fff700 1 -- 172.21.15.88:0/3466544705 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a415d270 con 0x7f29a4160f90 2023-05-17T12:26:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a8f9b700 1 --2- 172.21.15.88:0/3466544705 >> v2:172.21.15.187:3300/0 conn(0x7f29a415ca90 0x7f29a40cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a979c700 1 --2- 172.21.15.88:0/3466544705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a406ca50 0x7f29a406a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:36.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.644+0000 7f29a3fff700 1 --2- 172.21.15.88:0/3466544705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a4160f90 0x7f29a406c510 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f29a406be00 tx=0x7f2990009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83061263fb636e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29a37fe700 1 -- 172.21.15.88:0/3466544705 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299000b870 con 0x7f29a4160f90 2023-05-17T12:26:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29a37fe700 1 -- 172.21.15.88:0/3466544705 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299000b9d0 con 0x7f29a4160f90 2023-05-17T12:26:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29a37fe700 1 -- 172.21.15.88:0/3466544705 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299000bd60 con 0x7f29a4160f90 2023-05-17T12:26:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29ab1ff700 1 -- 172.21.15.88:0/3466544705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a4160f90 msgr2=0x7f29a406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/3466544705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a4160f90 0x7f29a406c510 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f29a406be00 tx=0x7f2990009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29ab1ff700 1 -- 172.21.15.88:0/3466544705 shutdown_connections 2023-05-17T12:26:36.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/3466544705 >> v2:172.21.15.187:3300/0 conn(0x7f29a415ca90 0x7f29a40cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/3466544705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a406ca50 0x7f29a406a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/3466544705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a4160f90 0x7f29a406c510 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29ab1ff700 1 -- 172.21.15.88:0/3466544705 >> 172.21.15.88:0/3466544705 conn(0x7f29a40d3ed0 msgr2=0x7f29a40cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29ab1ff700 1 -- 172.21.15.88:0/3466544705 shutdown_connections 2023-05-17T12:26:36.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.645+0000 7f29ab1ff700 1 -- 172.21.15.88:0/3466544705 wait complete. 2023-05-17T12:26:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.647+0000 7f29ab1ff700 1 Processor -- start 2023-05-17T12:26:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.647+0000 7f29ab1ff700 1 -- start start 2023-05-17T12:26:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.648+0000 7f29ab1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a406ca50 0x7f29a4152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.648+0000 7f29ab1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a415ca90 0x7f29a4158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.648+0000 7f29ab1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a4160f90 0x7f29a4159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.648+0000 7f29ab1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a4152c80 con 0x7f29a415ca90 2023-05-17T12:26:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.648+0000 7f29ab1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a40cc190 con 0x7f29a406ca50 2023-05-17T12:26:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.648+0000 7f29ab1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a40cc470 con 0x7f29a4160f90 2023-05-17T12:26:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.648+0000 7f29a3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a415ca90 0x7f29a4158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a415ca90 0x7f29a4158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48852/0 (socket says 172.21.15.88:48852) 2023-05-17T12:26:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a3fff700 1 -- 172.21.15.88:0/1040177023 learned_addr learned my addr 172.21.15.88:0/1040177023 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a8f9b700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a406ca50 0x7f29a4152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a979c700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a4160f90 0x7f29a4159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a3fff700 1 -- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a4160f90 msgr2=0x7f29a4159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a3fff700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a4160f90 0x7f29a4159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a3fff700 1 -- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a406ca50 msgr2=0x7f29a4152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a3fff700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a406ca50 0x7f29a4152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a3fff700 1 -- 172.21.15.88:0/1040177023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990009550 con 0x7f29a415ca90 2023-05-17T12:26:36.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.649+0000 7f29a3fff700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a415ca90 0x7f29a4158ee0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2990014040 tx=0x7f2990004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.650+0000 7f29a17fa700 1 -- 172.21.15.88:0/1040177023 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990004310 con 0x7f29a415ca90 2023-05-17T12:26:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.650+0000 7f29a17fa700 1 -- 172.21.15.88:0/1040177023 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299001f070 con 0x7f29a415ca90 2023-05-17T12:26:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.650+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a415d830 con 0x7f29a415ca90 2023-05-17T12:26:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.650+0000 7f29a17fa700 1 -- 172.21.15.88:0/1040177023 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900036a0 con 0x7f29a415ca90 2023-05-17T12:26:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.650+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a415d550 con 0x7f29a415ca90 2023-05-17T12:26:36.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.651+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a415dd50 con 0x7f29a415ca90 2023-05-17T12:26:36.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.652+0000 7f29a17fa700 1 -- 172.21.15.88:0/1040177023 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2990021030 con 0x7f29a415ca90 2023-05-17T12:26:36.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.653+0000 7f29a17fa700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f298806ace0 0x7f298806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:36.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.653+0000 7f29a17fa700 1 -- 172.21.15.88:0/1040177023 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f299008aa00 con 0x7f29a415ca90 2023-05-17T12:26:36.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.653+0000 7f29a8f9b700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f298806ace0 0x7f298806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:36.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.654+0000 7f29a8f9b700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f298806ace0 0x7f298806d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2998006fd0 tx=0x7f2998008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:36.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.657+0000 7f29a17fa700 1 -- 172.21.15.88:0/1040177023 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2990055790 con 0x7f29a415ca90 2023-05-17T12:26:36.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.866+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f29a4074530 con 0x7f29a415ca90 2023-05-17T12:26:36.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.866+0000 7f29a17fa700 1 -- 172.21.15.88:0/1040177023 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2990058db0 con 0x7f29a415ca90 2023-05-17T12:26:36.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.868+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f298806ace0 msgr2=0x7f298806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.868+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f298806ace0 0x7f298806d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2998006fd0 tx=0x7f2998008040 comp rx=0 tx=0).stop 2023-05-17T12:26:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.868+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a415ca90 msgr2=0x7f29a4158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.868+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a415ca90 0x7f29a4158ee0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2990014040 tx=0x7f2990004750 comp rx=0 tx=0).stop 2023-05-17T12:26:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.869+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 shutdown_connections 2023-05-17T12:26:36.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.869+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f298806ace0 0x7f298806d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.869+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29a4160f90 0x7f29a4159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.869+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29a406ca50 0x7f29a4152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.869+0000 7f29ab1ff700 1 --2- 172.21.15.88:0/1040177023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29a415ca90 0x7f29a4158ee0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:36.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.869+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 >> 172.21.15.88:0/1040177023 conn(0x7f29a40d3ed0 msgr2=0x7f29a40b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:36.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.869+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 shutdown_connections 2023-05-17T12:26:36.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:36.869+0000 7f29ab1ff700 1 -- 172.21.15.88:0/1040177023 wait complete. 2023-05-17T12:26:36.874 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-05-17T12:26:36.889 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-05-17T12:26:36.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:26:36.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-05-17T12:26:36.959 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T12:26:36.960 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T12:26:36.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:26:36.960 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-17T12:26:37.004 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-17T12:26:37.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:26:37.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.186+0000 7fd7dd7ff700 1 Processor -- start 2023-05-17T12:26:37.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.186+0000 7fd7dd7ff700 1 -- start start 2023-05-17T12:26:37.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.187+0000 7fd7dd7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d815c840 0x7fd7d806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.187+0000 7fd7dd7ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd7d806b0b0 0x7fd7d80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.187+0000 7fd7dd7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d80cd6b0 con 0x7fd7d806c330 2023-05-17T12:26:37.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7dd7ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d80cdf50 con 0x7fd7d806b0b0 2023-05-17T12:26:37.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7dd7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80cf860 con 0x7fd7d815c840 2023-05-17T12:26:37.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7d77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd7d806c330 0x7fd7d8160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57740/0 (socket says 172.21.15.88:57740) 2023-05-17T12:26:37.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7d77fe700 1 -- 172.21.15.88:0/1949375387 learned_addr learned my addr 172.21.15.88:0/1949375387 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:37.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7cffff700 1 --2- 172.21.15.88:0/1949375387 >> v2:172.21.15.187:3300/0 conn(0x7fd7d806b0b0 0x7fd7d80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7d6ffd700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d815c840 0x7fd7d806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656847346 0 0) 0x7fd7d80cd6b0 con 0x7fd7d806c330 2023-05-17T12:26:37.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c40035b0 con 0x7fd7d806c330 2023-05-17T12:26:37.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3986711135 0 0) 0x7fd7c40035b0 con 0x7fd7d806c330 2023-05-17T12:26:37.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d815c840 msgr2=0x7fd7d806b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:37.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.188+0000 7fd7d67fc700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d815c840 0x7fd7d806b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 >> v2:172.21.15.187:3300/0 conn(0x7fd7d806b0b0 msgr2=0x7fd7d80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:37.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 --2- 172.21.15.88:0/1949375387 >> v2:172.21.15.187:3300/0 conn(0x7fd7d806b0b0 0x7fd7d80cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d80b2460 con 0x7fd7d806c330 2023-05-17T12:26:37.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7fd7d00019f0 con 0x7fd7d806c330 2023-05-17T12:26:37.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 >> v1:172.21.15.88:6789/0 conn(0x7fd7d806c330 legacy=0x7fd7d8160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7c4003a00 0x7fd7c4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7c40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d815c840 0x7fd7c4005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80cf860 con 0x7fd7c4004430 2023-05-17T12:26:37.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c400ba10 con 0x7fd7c4003a00 2023-05-17T12:26:37.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c400bb50 con 0x7fd7d815c840 2023-05-17T12:26:37.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7cffff700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7c40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d6ffd700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7c4003a00 0x7fd7c4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7d77fe700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d815c840 0x7fd7c4005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7cffff700 1 -- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d815c840 msgr2=0x7fd7c4005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:37.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7cffff700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d815c840 0x7fd7c4005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7cffff700 1 -- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7c4003a00 msgr2=0x7fd7c4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:37.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7cffff700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7c4003a00 0x7fd7c4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7cffff700 1 -- 172.21.15.88:0/1949375387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c40035b0 con 0x7fd7c4004430 2023-05-17T12:26:37.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.189+0000 7fd7cffff700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7c40048f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009b90 tx=0x7fd7c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b0da5d72df67e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:37.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c000e6c0 con 0x7fd7c4004430 2023-05-17T12:26:37.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c000e820 con 0x7fd7c4004430 2023-05-17T12:26:37.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7d67fc700 1 -- 172.21.15.88:0/1949375387 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c000eb90 con 0x7fd7c4004430 2023-05-17T12:26:37.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1949375387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 msgr2=0x7fd7c40048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7dd7ff700 1 --2- 172.21.15.88:0/1949375387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7c40048f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009b90 tx=0x7fd7c4005880 comp rx=0 tx=0).stop 2023-05-17T12:26:37.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7d77fe700 1 -- 172.21.15.88:0/1949375387 reap_dead start 2023-05-17T12:26:37.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1949375387 shutdown_connections 2023-05-17T12:26:37.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1949375387 >> 172.21.15.88:0/1949375387 conn(0x7fd7d80d3060 msgr2=0x7fd7d80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:37.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1949375387 shutdown_connections 2023-05-17T12:26:37.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.190+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1949375387 wait complete. 2023-05-17T12:26:37.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.193+0000 7fd7dd7ff700 1 Processor -- start 2023-05-17T12:26:37.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.193+0000 7fd7dd7ff700 1 -- start start 2023-05-17T12:26:37.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.194+0000 7fd7dd7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7d815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.194+0000 7fd7dd7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d8150080 0x7fd7d8158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.194+0000 7fd7dd7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d80cb390 0x7fd7d80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.194+0000 7fd7dd7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d81596f0 con 0x7fd7c4004430 2023-05-17T12:26:37.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.194+0000 7fd7dd7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80cbd40 con 0x7fd7d8150080 2023-05-17T12:26:37.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.194+0000 7fd7dd7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d81504d0 con 0x7fd7d80cb390 2023-05-17T12:26:37.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.194+0000 7fd7d6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7d815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.194+0000 7fd7d6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7d815bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48876/0 (socket says 172.21.15.88:48876) 2023-05-17T12:26:37.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.194+0000 7fd7d6ffd700 1 -- 172.21.15.88:0/1706665550 learned_addr learned my addr 172.21.15.88:0/1706665550 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:37.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7cffff700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d8150080 0x7fd7d8158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7d77fe700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d80cb390 0x7fd7d80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7d6ffd700 1 -- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d80cb390 msgr2=0x7fd7d80cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7d6ffd700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d80cb390 0x7fd7d80cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7d6ffd700 1 -- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d8150080 msgr2=0x7fd7d8158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7d6ffd700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d8150080 0x7fd7d8158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7d6ffd700 1 -- 172.21.15.88:0/1706665550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d80cd900 con 0x7fd7c4004430 2023-05-17T12:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7d6ffd700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7d815bdc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8011ad0 tx=0x7fd7c8011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:37.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7cf7fe700 1 -- 172.21.15.88:0/1706665550 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c800f940 con 0x7fd7c4004430 2023-05-17T12:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7cf7fe700 1 -- 172.21.15.88:0/1706665550 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c800faa0 con 0x7fd7c4004430 2023-05-17T12:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7cf7fe700 1 -- 172.21.15.88:0/1706665550 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c800fe50 con 0x7fd7c4004430 2023-05-17T12:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.195+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d80b2740 con 0x7fd7c4004430 2023-05-17T12:26:37.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.196+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d80cdbe0 con 0x7fd7c4004430 2023-05-17T12:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.196+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d815ed50 con 0x7fd7c4004430 2023-05-17T12:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.197+0000 7fd7cf7fe700 1 -- 172.21.15.88:0/1706665550 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7c8014440 con 0x7fd7c4004430 2023-05-17T12:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.199+0000 7fd7cf7fe700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b806ace0 0x7fd7b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.199+0000 7fd7cf7fe700 1 -- 172.21.15.88:0/1706665550 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd7c8089d20 con 0x7fd7c4004430 2023-05-17T12:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.199+0000 7fd7cffff700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b806ace0 0x7fd7b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.200+0000 7fd7cffff700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b806ace0 0x7fd7b806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00090b0 tx=0x7fd7c0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:37.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.203+0000 7fd7cf7fe700 1 -- 172.21.15.88:0/1706665550 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd7c8054b50 con 0x7fd7c4004430 2023-05-17T12:26:37.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.440+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7d8074530 con 0x7fd7c4004430 2023-05-17T12:26:37.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.440+0000 7fd7cf7fe700 1 -- 172.21.15.88:0/1706665550 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fd7c8022090 con 0x7fd7c4004430 2023-05-17T12:26:37.443 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:37.444 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:30.331217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T12:26:37.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b806ace0 msgr2=0x7fd7b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b806ace0 0x7fd7b806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00090b0 tx=0x7fd7c0008030 comp rx=0 tx=0).stop 2023-05-17T12:26:37.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 msgr2=0x7fd7d815bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7d815bdc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8011ad0 tx=0x7fd7c8011de0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 shutdown_connections 2023-05-17T12:26:37.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd7b806ace0 0x7fd7b806d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d80cb390 0x7fd7d80cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c4004430 0x7fd7d815bdc0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 --2- 172.21.15.88:0/1706665550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d8150080 0x7fd7d8158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 >> 172.21.15.88:0/1706665550 conn(0x7fd7d80d3060 msgr2=0x7fd7d80d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:37.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 shutdown_connections 2023-05-17T12:26:37.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.443+0000 7fd7dd7ff700 1 -- 172.21.15.88:0/1706665550 wait complete. 2023-05-17T12:26:37.448 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-05-17T12:26:37.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:37.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.645+0000 7f1cea3ff700 1 Processor -- start 2023-05-17T12:26:37.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.645+0000 7f1cea3ff700 1 -- start start 2023-05-17T12:26:37.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.646+0000 7f1cea3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ce415c840 0x7f1ce406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.646+0000 7f1cea3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ce406b0b0 0x7f1ce40cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.646+0000 7f1cea3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce40cd6b0 con 0x7f1ce406c330 2023-05-17T12:26:37.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.646+0000 7f1cea3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce40cdf50 con 0x7f1ce406b0b0 2023-05-17T12:26:37.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.646+0000 7f1cea3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40cf860 con 0x7f1ce415c840 2023-05-17T12:26:37.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.647+0000 7f1ce37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ce406b0b0 0x7f1ce40cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.647+0000 7f1ce37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ce406b0b0 0x7f1ce40cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48888/0 (socket says 172.21.15.88:48888) 2023-05-17T12:26:37.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.647+0000 7f1ce37fe700 1 -- 172.21.15.88:0/3014529997 learned_addr learned my addr 172.21.15.88:0/3014529997 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:37.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.647+0000 7f1ce37fe700 1 -- 172.21.15.88:0/3014529997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ce415c840 msgr2=0x7f1ce406b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:37.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.647+0000 7f1ce37fe700 1 --2- 172.21.15.88:0/3014529997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ce415c840 0x7f1ce406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.647+0000 7f1ce37fe700 1 -- 172.21.15.88:0/3014529997 >> v1:172.21.15.187:6789/0 conn(0x7f1ce406c330 legacy=0x7f1ce4160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:37.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.647+0000 7f1ce37fe700 1 -- 172.21.15.88:0/3014529997 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce40b2460 con 0x7f1ce406b0b0 2023-05-17T12:26:37.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.647+0000 7f1ce37fe700 1 --2- 172.21.15.88:0/3014529997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce406b0b0 0x7f1ce40cf320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80098f0 tx=0x7f1cd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da582314379640f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:37.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1ce2ffd700 1 -- 172.21.15.88:0/3014529997 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8004230 con 0x7f1ce406b0b0 2023-05-17T12:26:37.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1ce2ffd700 1 -- 172.21.15.88:0/3014529997 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8004390 con 0x7f1ce406b0b0 2023-05-17T12:26:37.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1ce2ffd700 1 -- 172.21.15.88:0/3014529997 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80036a0 con 0x7f1ce406b0b0 2023-05-17T12:26:37.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1cea3ff700 1 -- 172.21.15.88:0/3014529997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce406b0b0 msgr2=0x7f1ce40cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1cea3ff700 1 --2- 172.21.15.88:0/3014529997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce406b0b0 0x7f1ce40cf320 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80098f0 tx=0x7f1cd8009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:37.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1cea3ff700 1 -- 172.21.15.88:0/3014529997 shutdown_connections 2023-05-17T12:26:37.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1cea3ff700 1 --2- 172.21.15.88:0/3014529997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ce415c840 0x7f1ce406b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1cea3ff700 1 --2- 172.21.15.88:0/3014529997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce406b0b0 0x7f1ce40cf320 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1cea3ff700 1 -- 172.21.15.88:0/3014529997 >> 172.21.15.88:0/3014529997 conn(0x7f1ce40d3060 msgr2=0x7f1ce40d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:37.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1cea3ff700 1 -- 172.21.15.88:0/3014529997 shutdown_connections 2023-05-17T12:26:37.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.648+0000 7f1cea3ff700 1 -- 172.21.15.88:0/3014529997 wait complete. 2023-05-17T12:26:37.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.650+0000 7f1cea3ff700 1 Processor -- start 2023-05-17T12:26:37.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.650+0000 7f1cea3ff700 1 -- start start 2023-05-17T12:26:37.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.651+0000 7f1cea3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ce406b0b0 0x7f1ce40c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.651+0000 7f1cea3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ce406c330 0x7f1ce41482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.651+0000 7f1cea3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415c840 0x7f1ce41487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.651+0000 7f1cea3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce415a5c0 con 0x7f1ce415c840 2023-05-17T12:26:37.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.651+0000 7f1cea3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4159d50 con 0x7f1ce406c330 2023-05-17T12:26:37.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.651+0000 7f1cea3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40c9cc0 con 0x7f1ce406b0b0 2023-05-17T12:26:37.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.651+0000 7f1ce899c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415c840 0x7f1ce41487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce899c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415c840 0x7f1ce41487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48904/0 (socket says 172.21.15.88:48904) 2023-05-17T12:26:37.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce899c700 1 -- 172.21.15.88:0/2921738039 learned_addr learned my addr 172.21.15.88:0/2921738039 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:37.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.651+0000 7f1ce3fff700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ce406b0b0 0x7f1ce40c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce37fe700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ce406c330 0x7f1ce41482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce899c700 1 -- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ce406b0b0 msgr2=0x7f1ce40c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce899c700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ce406b0b0 0x7f1ce40c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce899c700 1 -- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ce406c330 msgr2=0x7f1ce41482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce899c700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ce406c330 0x7f1ce41482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce899c700 1 -- 172.21.15.88:0/2921738039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8009550 con 0x7f1ce415c840 2023-05-17T12:26:37.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce899c700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415c840 0x7f1ce41487f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00cc10 tx=0x7f1cdc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:37.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce0ff9700 1 -- 172.21.15.88:0/2921738039 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00aa60 con 0x7f1ce415c840 2023-05-17T12:26:37.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce0ff9700 1 -- 172.21.15.88:0/2921738039 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc00abc0 con 0x7f1ce415c840 2023-05-17T12:26:37.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce40cd900 con 0x7f1ce415c840 2023-05-17T12:26:37.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.652+0000 7f1ce0ff9700 1 -- 172.21.15.88:0/2921738039 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc012420 con 0x7f1ce415c840 2023-05-17T12:26:37.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.653+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce40b2740 con 0x7f1ce415c840 2023-05-17T12:26:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.654+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce40cdbe0 con 0x7f1ce415c840 2023-05-17T12:26:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.654+0000 7f1ce0ff9700 1 -- 172.21.15.88:0/2921738039 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cdc012580 con 0x7f1ce415c840 2023-05-17T12:26:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.656+0000 7f1ce0ff9700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1cd006ace0 0x7f1cd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.656+0000 7f1ce0ff9700 1 -- 172.21.15.88:0/2921738039 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1cdc089af0 con 0x7f1ce415c840 2023-05-17T12:26:37.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.656+0000 7f1ce3fff700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1cd006ace0 0x7f1cd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:37.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.657+0000 7f1ce3fff700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1cd006ace0 0x7f1cd006d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009970 tx=0x7f1cd4009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:37.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.660+0000 7f1ce0ff9700 1 -- 172.21.15.88:0/2921738039 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1cdc0547e0 con 0x7f1ce415c840 2023-05-17T12:26:37.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.858+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ce4074530 con 0x7f1ce415c840 2023-05-17T12:26:37.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.859+0000 7f1ce0ff9700 1 -- 172.21.15.88:0/2921738039 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f1cdc057e00 con 0x7f1ce415c840 2023-05-17T12:26:37.862 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:37.863 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1cd006ace0 msgr2=0x7f1cd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1cd006ace0 0x7f1cd006d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009970 tx=0x7f1cd4009110 comp rx=0 tx=0).stop 2023-05-17T12:26:37.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415c840 msgr2=0x7f1ce41487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:37.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415c840 0x7f1ce41487f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00cc10 tx=0x7f1cdc00cf20 comp rx=0 tx=0).stop 2023-05-17T12:26:37.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 shutdown_connections 2023-05-17T12:26:37.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f1cd006ace0 0x7f1cd006d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415c840 0x7f1ce41487f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ce406b0b0 0x7f1ce40c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 --2- 172.21.15.88:0/2921738039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ce406c330 0x7f1ce41482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 >> 172.21.15.88:0/2921738039 conn(0x7f1ce40d3060 msgr2=0x7f1ce40cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:37.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 shutdown_connections 2023-05-17T12:26:37.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:37.861+0000 7f1cea3ff700 1 -- 172.21.15.88:0/2921738039 wait complete. 2023-05-17T12:26:37.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-17T12:24:59.594133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-17T12:25:00.736046+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-17T12:25:03.830500+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-17T12:26:37.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:38.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.066+0000 7fbddc9fe700 1 Processor -- start 2023-05-17T12:26:38.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.067+0000 7fbddc9fe700 1 -- start start 2023-05-17T12:26:38.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.068+0000 7fbddc9fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbdd815c730 0x7fbdd80cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.068+0000 7fbddc9fe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd80d14f0 con 0x7fbdd806b5d0 2023-05-17T12:26:38.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.068+0000 7fbddc9fe700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd80b6340 con 0x7fbdd806c210 2023-05-17T12:26:38.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.068+0000 7fbddc9fe700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80cd560 con 0x7fbdd815c730 2023-05-17T12:26:38.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.068+0000 7fbdd6d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbdd815c730 0x7fbdd80cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.068+0000 7fbdcffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbdd806b5d0 0x7fbdd80b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57756/0 (socket says 172.21.15.88:57756) 2023-05-17T12:26:38.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.068+0000 7fbdcffff700 1 -- 172.21.15.88:0/3609382077 learned_addr learned my addr 172.21.15.88:0/3609382077 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:38.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbdd6d9d700 1 -- 172.21.15.88:0/3609382077 >> v1:172.21.15.187:6789/0 conn(0x7fbdd806c210 legacy=0x7fbdd806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbdd6d9d700 1 -- 172.21.15.88:0/3609382077 >> v1:172.21.15.88:6789/0 conn(0x7fbdd806b5d0 legacy=0x7fbdd80b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbdd6d9d700 1 -- 172.21.15.88:0/3609382077 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80cd840 con 0x7fbdd815c730 2023-05-17T12:26:38.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbdd659c700 1 -- 172.21.15.88:0/3609382077 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969512057 0 0) 0x7fbdd80d14f0 con 0x7fbdd806b5d0 2023-05-17T12:26:38.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbdd6d9d700 1 --2- 172.21.15.88:0/3609382077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd815c730 0x7fbdd80cf030 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009840 tx=0x7fbdc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b367401f31ab2b2c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:38.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbdd659c700 1 -- 172.21.15.88:0/3609382077 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8011830 con 0x7fbdd815c730 2023-05-17T12:26:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbdd659c700 1 -- 172.21.15.88:0/3609382077 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8011990 con 0x7fbdd815c730 2023-05-17T12:26:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbdd659c700 1 -- 172.21.15.88:0/3609382077 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8011d20 con 0x7fbdd815c730 2023-05-17T12:26:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbddc9fe700 1 -- 172.21.15.88:0/3609382077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd815c730 msgr2=0x7fbdd80cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.069+0000 7fbddc9fe700 1 --2- 172.21.15.88:0/3609382077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd815c730 0x7fbdd80cf030 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009840 tx=0x7fbdc8009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.070+0000 7fbddc9fe700 1 -- 172.21.15.88:0/3609382077 shutdown_connections 2023-05-17T12:26:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.070+0000 7fbddc9fe700 1 --2- 172.21.15.88:0/3609382077 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd815c730 0x7fbdd80cf030 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.070+0000 7fbddc9fe700 1 -- 172.21.15.88:0/3609382077 >> 172.21.15.88:0/3609382077 conn(0x7fbdd80d04f0 msgr2=0x7fbdd80d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:38.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.070+0000 7fbddc9fe700 1 -- 172.21.15.88:0/3609382077 shutdown_connections 2023-05-17T12:26:38.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.070+0000 7fbddc9fe700 1 -- 172.21.15.88:0/3609382077 wait complete. 2023-05-17T12:26:38.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.072+0000 7fbddc9fe700 1 Processor -- start 2023-05-17T12:26:38.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.072+0000 7fbddc9fe700 1 -- start start 2023-05-17T12:26:38.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.073+0000 7fbddc9fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd806b5d0 0x7fbdd8144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.073+0000 7fbddc9fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdd806c210 0x7fbdd8157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.073+0000 7fbddc9fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbdd8158570 0x7fbdd80c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.073+0000 7fbddc9fe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd81583c0 con 0x7fbdd806b5d0 2023-05-17T12:26:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.073+0000 7fbddc9fe700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80cd240 con 0x7fbdd8158570 2023-05-17T12:26:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.073+0000 7fbddc9fe700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80ccf60 con 0x7fbdd806c210 2023-05-17T12:26:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd6d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd806b5d0 0x7fbdd8144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd6d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd806b5d0 0x7fbdd8144460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48922/0 (socket says 172.21.15.88:48922) 2023-05-17T12:26:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd6d9d700 1 -- 172.21.15.88:0/2564400294 learned_addr learned my addr 172.21.15.88:0/2564400294 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:38.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdcffff700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdd806c210 0x7fbdd8157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd759e700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbdd8158570 0x7fbdd80c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd6d9d700 1 -- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdd806c210 msgr2=0x7fbdd8157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd6d9d700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdd806c210 0x7fbdd8157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd6d9d700 1 -- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbdd8158570 msgr2=0x7fbdd80c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd6d9d700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbdd8158570 0x7fbdd80c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd6d9d700 1 -- 172.21.15.88:0/2564400294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80094a0 con 0x7fbdd806b5d0 2023-05-17T12:26:38.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.074+0000 7fbdd6d9d700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd806b5d0 0x7fbdd8144460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80090b0 tx=0x7fbdc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:38.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.075+0000 7fbdcf7fe700 1 -- 172.21.15.88:0/2564400294 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc801a7e0 con 0x7fbdd806b5d0 2023-05-17T12:26:38.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.075+0000 7fbdcf7fe700 1 -- 172.21.15.88:0/2564400294 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc801a940 con 0x7fbdd806b5d0 2023-05-17T12:26:38.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.075+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd80cdb20 con 0x7fbdd806b5d0 2023-05-17T12:26:38.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.075+0000 7fbdcf7fe700 1 -- 172.21.15.88:0/2564400294 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc801acb0 con 0x7fbdd806b5d0 2023-05-17T12:26:38.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.075+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd80d1790 con 0x7fbdd806b5d0 2023-05-17T12:26:38.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.076+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd80b2560 con 0x7fbdd806b5d0 2023-05-17T12:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.077+0000 7fbdcf7fe700 1 -- 172.21.15.88:0/2564400294 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbdc8022070 con 0x7fbdd806b5d0 2023-05-17T12:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.077+0000 7fbdcf7fe700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbdb806ace0 0x7fbdb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.078+0000 7fbdcf7fe700 1 -- 172.21.15.88:0/2564400294 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbdc808a8c0 con 0x7fbdd806b5d0 2023-05-17T12:26:38.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.078+0000 7fbdcffff700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbdb806ace0 0x7fbdb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.079+0000 7fbdcffff700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbdb806ace0 0x7fbdb806d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0007c40 tx=0x7fbdc0007b90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:38.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.082+0000 7fbdcf7fe700 1 -- 172.21.15.88:0/2564400294 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbdc80556e0 con 0x7fbdd806b5d0 2023-05-17T12:26:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.272+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbdd8073d30 con 0x7fbdd806b5d0 2023-05-17T12:26:38.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.273+0000 7fbdcf7fe700 1 -- 172.21.15.88:0/2564400294 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbdc8015020 con 0x7fbdd806b5d0 2023-05-17T12:26:38.276 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:38.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbdb806ace0 msgr2=0x7fbdb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbdb806ace0 0x7fbdb806d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0007c40 tx=0x7fbdc0007b90 comp rx=0 tx=0).stop 2023-05-17T12:26:38.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd806b5d0 msgr2=0x7fbdd8144460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd806b5d0 0x7fbdd8144460 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80090b0 tx=0x7fbdc8004750 comp rx=0 tx=0).stop 2023-05-17T12:26:38.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 shutdown_connections 2023-05-17T12:26:38.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fbdb806ace0 0x7fbdb806d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbdd8158570 0x7fbdd80c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdd806b5d0 0x7fbdd8144460 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 --2- 172.21.15.88:0/2564400294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbdd806c210 0x7fbdd8157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 >> 172.21.15.88:0/2564400294 conn(0x7fbdd80d04f0 msgr2=0x7fbdd80b8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 shutdown_connections 2023-05-17T12:26:38.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.275+0000 7fbddc9fe700 1 -- 172.21.15.88:0/2564400294 wait complete. 2023-05-17T12:26:38.294 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:38.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.479+0000 7fc890dff700 1 Processor -- start 2023-05-17T12:26:38.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.479+0000 7fc890dff700 1 -- start start 2023-05-17T12:26:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc890dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc88c153d60 0x7fc88c15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc890dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc88c0cdb10 0x7fc88c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc890dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88c0ce4a0 con 0x7fc88c0cc8f0 2023-05-17T12:26:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc890dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88c15e030 con 0x7fc88c0cdb10 2023-05-17T12:26:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc890dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88c159ed0 con 0x7fc88c153d60 2023-05-17T12:26:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc88ad9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc88c0cc8f0 0x7fc88c0ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57766/0 (socket says 172.21.15.88:57766) 2023-05-17T12:26:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc88ad9d700 1 -- 172.21.15.88:0/1963036583 learned_addr learned my addr 172.21.15.88:0/1963036583 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc883fff700 1 --2- 172.21.15.88:0/1963036583 >> v2:172.21.15.88:3300/0 conn(0x7fc88c0cdb10 0x7fc88c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc88a59c700 1 --2- 172.21.15.88:0/1963036583 >> v2:172.21.15.187:3300/0 conn(0x7fc88c153d60 0x7fc88c15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.481+0000 7fc889d9b700 1 -- 172.21.15.88:0/1963036583 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675214336 0 0) 0x7fc884001490 con 0x7fc88c0cc8f0 2023-05-17T12:26:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc883fff700 1 -- 172.21.15.88:0/1963036583 >> v2:172.21.15.187:3300/0 conn(0x7fc88c153d60 msgr2=0x7fc88c15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc883fff700 1 --2- 172.21.15.88:0/1963036583 >> v2:172.21.15.187:3300/0 conn(0x7fc88c153d60 0x7fc88c15daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc883fff700 1 -- 172.21.15.88:0/1963036583 >> v1:172.21.15.88:6789/0 conn(0x7fc88c0cc8f0 legacy=0x7fc88c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc883fff700 1 -- 172.21.15.88:0/1963036583 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c15a1b0 con 0x7fc88c0cdb10 2023-05-17T12:26:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc883fff700 1 --2- 172.21.15.88:0/1963036583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c0cdb10 0x7fc88c0cdf60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0675b0 tx=0x7fc874009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bf78b2661fa3d server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc889d9b700 1 -- 172.21.15.88:0/1963036583 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87400f8a0 con 0x7fc88c0cdb10 2023-05-17T12:26:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc889d9b700 1 -- 172.21.15.88:0/1963036583 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87400fa00 con 0x7fc88c0cdb10 2023-05-17T12:26:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc889d9b700 1 -- 172.21.15.88:0/1963036583 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87400fd90 con 0x7fc88c0cdb10 2023-05-17T12:26:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc890dff700 1 -- 172.21.15.88:0/1963036583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c0cdb10 msgr2=0x7fc88c0cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.482+0000 7fc890dff700 1 --2- 172.21.15.88:0/1963036583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c0cdb10 0x7fc88c0cdf60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0675b0 tx=0x7fc874009b20 comp rx=0 tx=0).stop 2023-05-17T12:26:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.483+0000 7fc890dff700 1 -- 172.21.15.88:0/1963036583 shutdown_connections 2023-05-17T12:26:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.483+0000 7fc890dff700 1 --2- 172.21.15.88:0/1963036583 >> v2:172.21.15.187:3300/0 conn(0x7fc88c153d60 0x7fc88c15daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.483+0000 7fc890dff700 1 --2- 172.21.15.88:0/1963036583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c0cdb10 0x7fc88c0cdf60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.483+0000 7fc890dff700 1 -- 172.21.15.88:0/1963036583 >> 172.21.15.88:0/1963036583 conn(0x7fc88c0cf970 msgr2=0x7fc88c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.483+0000 7fc890dff700 1 -- 172.21.15.88:0/1963036583 shutdown_connections 2023-05-17T12:26:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.483+0000 7fc890dff700 1 -- 172.21.15.88:0/1963036583 wait complete. 2023-05-17T12:26:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.484+0000 7fc890dff700 1 Processor -- start 2023-05-17T12:26:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.484+0000 7fc890dff700 1 -- start start 2023-05-17T12:26:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.485+0000 7fc890dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc88c0cc8f0 0x7fc88c1519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.485+0000 7fc890dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc88c0cdb10 0x7fc88c1f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.485+0000 7fc890dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c153d60 0x7fc88c1f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.485+0000 7fc890dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0b3d50 con 0x7fc88c153d60 2023-05-17T12:26:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.485+0000 7fc890dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c1f3de0 con 0x7fc88c0cdb10 2023-05-17T12:26:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.485+0000 7fc890dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c1f2cc0 con 0x7fc88c0cc8f0 2023-05-17T12:26:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c153d60 0x7fc88c1f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c153d60 0x7fc88c1f2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48934/0 (socket says 172.21.15.88:48934) 2023-05-17T12:26:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88ad9d700 1 -- 172.21.15.88:0/2721165535 learned_addr learned my addr 172.21.15.88:0/2721165535 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88a59c700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc88c0cc8f0 0x7fc88c1519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc883fff700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc88c0cdb10 0x7fc88c1f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88ad9d700 1 -- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc88c0cc8f0 msgr2=0x7fc88c1519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88ad9d700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc88c0cc8f0 0x7fc88c1519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88ad9d700 1 -- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc88c0cdb10 msgr2=0x7fc88c1f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88ad9d700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc88c0cdb10 0x7fc88c1f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88ad9d700 1 -- 172.21.15.88:0/2721165535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740094a0 con 0x7fc88c153d60 2023-05-17T12:26:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc883fff700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc88c0cdb10 0x7fc88c1f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.486+0000 7fc88ad9d700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c153d60 0x7fc88c1f2780 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc88400ccd0 tx=0x7fc88400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.487+0000 7fc882ffd700 1 -- 172.21.15.88:0/2721165535 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88400ad40 con 0x7fc88c153d60 2023-05-17T12:26:38.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.487+0000 7fc882ffd700 1 -- 172.21.15.88:0/2721165535 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8840070d0 con 0x7fc88c153d60 2023-05-17T12:26:38.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.487+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88c15a770 con 0x7fc88c153d60 2023-05-17T12:26:38.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.487+0000 7fc882ffd700 1 -- 172.21.15.88:0/2721165535 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884007480 con 0x7fc88c153d60 2023-05-17T12:26:38.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.487+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88c15a490 con 0x7fc88c153d60 2023-05-17T12:26:38.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.488+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88c15aa50 con 0x7fc88c153d60 2023-05-17T12:26:38.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.489+0000 7fc882ffd700 1 -- 172.21.15.88:0/2721165535 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8840075e0 con 0x7fc88c153d60 2023-05-17T12:26:38.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.489+0000 7fc882ffd700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc86c06ace0 0x7fc86c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.490+0000 7fc882ffd700 1 -- 172.21.15.88:0/2721165535 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc884089540 con 0x7fc88c153d60 2023-05-17T12:26:38.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.490+0000 7fc88a59c700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc86c06ace0 0x7fc86c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.491+0000 7fc88a59c700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc86c06ace0 0x7fc86c06d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc88c1522d0 tx=0x7fc87c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:38.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.494+0000 7fc882ffd700 1 -- 172.21.15.88:0/2721165535 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc8840542b0 con 0x7fc88c153d60 2023-05-17T12:26:38.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.686+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc88c0ce4a0 con 0x7fc88c153d60 2023-05-17T12:26:38.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.687+0000 7fc882ffd700 1 -- 172.21.15.88:0/2721165535 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc88c0ce4a0 con 0x7fc88c153d60 2023-05-17T12:26:38.690 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:38.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc86c06ace0 msgr2=0x7fc86c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc86c06ace0 0x7fc86c06d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc88c1522d0 tx=0x7fc87c008040 comp rx=0 tx=0).stop 2023-05-17T12:26:38.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c153d60 msgr2=0x7fc88c1f2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c153d60 0x7fc88c1f2780 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc88400ccd0 tx=0x7fc88400a340 comp rx=0 tx=0).stop 2023-05-17T12:26:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 shutdown_connections 2023-05-17T12:26:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc86c06ace0 0x7fc86c06d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc88c153d60 0x7fc88c1f2780 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc88c0cc8f0 0x7fc88c1519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 --2- 172.21.15.88:0/2721165535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc88c0cdb10 0x7fc88c1f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 >> 172.21.15.88:0/2721165535 conn(0x7fc88c0cf970 msgr2=0x7fc88c06d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:38.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 shutdown_connections 2023-05-17T12:26:38.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.689+0000 7fc890dff700 1 -- 172.21.15.88:0/2721165535 wait complete. 2023-05-17T12:26:38.709 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-17T12:26:38.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.892+0000 7fc321dff700 1 Processor -- start 2023-05-17T12:26:38.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.892+0000 7fc321dff700 1 -- start start 2023-05-17T12:26:38.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.893+0000 7fc321dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 0x7fc31c160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.893+0000 7fc321dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c06a510 con 0x7fc31c0b23a0 2023-05-17T12:26:38.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.893+0000 7fc321dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0cf8a0 con 0x7fc31c06c760 2023-05-17T12:26:38.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.893+0000 7fc321dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0cd840 con 0x7fc31c06af60 2023-05-17T12:26:38.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.893+0000 7fc31affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc31c0b23a0 0x7fc31c0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57782/0 (socket says 172.21.15.88:57782) 2023-05-17T12:26:38.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.893+0000 7fc31affd700 1 -- 172.21.15.88:0/3794721027 learned_addr learned my addr 172.21.15.88:0/3794721027 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:38.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31bfff700 1 --2- 172.21.15.88:0/3794721027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 0x7fc31c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31a7fc700 1 -- 172.21.15.88:0/3794721027 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339900494 0 0) 0x7fc31c06a510 con 0x7fc31c0b23a0 2023-05-17T12:26:38.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31a7fc700 1 -- 172.21.15.88:0/3794721027 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3040035b0 con 0x7fc31c0b23a0 2023-05-17T12:26:38.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31a7fc700 1 -- 172.21.15.88:0/3794721027 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846829175 0 0) 0x7fc31c0cf8a0 con 0x7fc31c06c760 2023-05-17T12:26:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31a7fc700 1 -- 172.21.15.88:0/3794721027 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc31c06a510 con 0x7fc31c06c760 2023-05-17T12:26:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31bfff700 1 -- 172.21.15.88:0/3794721027 >> v1:172.21.15.187:6789/0 conn(0x7fc31c06c760 legacy=0x7fc31c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31bfff700 1 -- 172.21.15.88:0/3794721027 >> v1:172.21.15.88:6789/0 conn(0x7fc31c0b23a0 legacy=0x7fc31c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31a7fc700 1 -- 172.21.15.88:0/3794721027 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154109613 0 0) 0x7fc3040035b0 con 0x7fc31c0b23a0 2023-05-17T12:26:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31bfff700 1 -- 172.21.15.88:0/3794721027 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c0cdb20 con 0x7fc31c06af60 2023-05-17T12:26:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.894+0000 7fc31bfff700 1 --2- 172.21.15.88:0/3794721027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 0x7fc31c160380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc314009dc0 tx=0x7fc31400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aeaefa1c08af128 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:38.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc31a7fc700 1 -- 172.21.15.88:0/3794721027 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31400e070 con 0x7fc31c06af60 2023-05-17T12:26:38.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc31a7fc700 1 -- 172.21.15.88:0/3794721027 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc314003a20 con 0x7fc31c06af60 2023-05-17T12:26:38.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc31a7fc700 1 -- 172.21.15.88:0/3794721027 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310001670 con 0x7fc31c06af60 2023-05-17T12:26:38.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc321dff700 1 -- 172.21.15.88:0/3794721027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 msgr2=0x7fc31c160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc321dff700 1 --2- 172.21.15.88:0/3794721027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 0x7fc31c160380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc314009dc0 tx=0x7fc31400b330 comp rx=0 tx=0).stop 2023-05-17T12:26:38.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc321dff700 1 -- 172.21.15.88:0/3794721027 shutdown_connections 2023-05-17T12:26:38.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc321dff700 1 --2- 172.21.15.88:0/3794721027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 0x7fc31c160380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc321dff700 1 -- 172.21.15.88:0/3794721027 >> 172.21.15.88:0/3794721027 conn(0x7fc31c0d06f0 msgr2=0x7fc31c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:38.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc321dff700 1 -- 172.21.15.88:0/3794721027 shutdown_connections 2023-05-17T12:26:38.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.895+0000 7fc321dff700 1 -- 172.21.15.88:0/3794721027 wait complete. 2023-05-17T12:26:38.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.897+0000 7fc321dff700 1 Processor -- start 2023-05-17T12:26:38.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.897+0000 7fc321dff700 1 -- start start 2023-05-17T12:26:38.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.898+0000 7fc321dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 0x7fc31c14a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.898+0000 7fc321dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc31c06c760 0x7fc31c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.898+0000 7fc321dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc31c0b7650 0x7fc31c155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.898+0000 7fc321dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0b8770 con 0x7fc31c06c760 2023-05-17T12:26:38.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.898+0000 7fc321dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c14a6e0 con 0x7fc31c0b7650 2023-05-17T12:26:38.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.898+0000 7fc321dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0b7b60 con 0x7fc31c06af60 2023-05-17T12:26:38.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.898+0000 7fc31affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc31c06c760 0x7fc31c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.898+0000 7fc31affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc31c06c760 0x7fc31c0b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48948/0 (socket says 172.21.15.88:48948) 2023-05-17T12:26:38.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.898+0000 7fc31affd700 1 -- 172.21.15.88:0/4107110910 learned_addr learned my addr 172.21.15.88:0/4107110910 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:38.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc31b7fe700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 0x7fc31c14a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc31bfff700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc31c0b7650 0x7fc31c155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc31affd700 1 -- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 msgr2=0x7fc31c14a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc31affd700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 0x7fc31c14a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc31affd700 1 -- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc31c0b7650 msgr2=0x7fc31c155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:38.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc31affd700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc31c0b7650 0x7fc31c155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:38.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc31affd700 1 -- 172.21.15.88:0/4107110910 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314009a70 con 0x7fc31c06c760 2023-05-17T12:26:38.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc31affd700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc31c06c760 0x7fc31c0b7110 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c700 tx=0x7fc31000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:38.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc303fff700 1 -- 172.21.15.88:0/4107110910 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310004c80 con 0x7fc31c06c760 2023-05-17T12:26:38.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc303fff700 1 -- 172.21.15.88:0/4107110910 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc310004e00 con 0x7fc31c06c760 2023-05-17T12:26:38.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c06aa40 con 0x7fc31c06c760 2023-05-17T12:26:38.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.899+0000 7fc303fff700 1 -- 172.21.15.88:0/4107110910 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310007310 con 0x7fc31c06c760 2023-05-17T12:26:38.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.900+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c06a760 con 0x7fc31c06c760 2023-05-17T12:26:38.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.901+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c06b3c0 con 0x7fc31c06c760 2023-05-17T12:26:38.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.902+0000 7fc303fff700 1 -- 172.21.15.88:0/4107110910 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc310007470 con 0x7fc31c06c760 2023-05-17T12:26:38.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.902+0000 7fc303fff700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc30806ace0 0x7fc30806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:38.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.903+0000 7fc303fff700 1 -- 172.21.15.88:0/4107110910 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc310089430 con 0x7fc31c06c760 2023-05-17T12:26:38.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.903+0000 7fc31b7fe700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc30806ace0 0x7fc30806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:38.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.903+0000 7fc31b7fe700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc30806ace0 0x7fc30806d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc30c001220 tx=0x7fc30c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:38.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:38.907+0000 7fc303fff700 1 -- 172.21.15.88:0/4107110910 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc3100541b0 con 0x7fc31c06c760 2023-05-17T12:26:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.101+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc31c074530 con 0x7fc31c06c760 2023-05-17T12:26:39.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.101+0000 7fc303fff700 1 -- 172.21.15.88:0/4107110910 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3100577d0 con 0x7fc31c06c760 2023-05-17T12:26:39.105 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc30806ace0 msgr2=0x7fc30806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc30806ace0 0x7fc30806d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc30c001220 tx=0x7fc30c009040 comp rx=0 tx=0).stop 2023-05-17T12:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc31c06c760 msgr2=0x7fc31c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc31c06c760 0x7fc31c0b7110 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c700 tx=0x7fc31000ca10 comp rx=0 tx=0).stop 2023-05-17T12:26:39.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 shutdown_connections 2023-05-17T12:26:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc30806ace0 0x7fc30806d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc31c0b7650 0x7fc31c155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc31c06af60 0x7fc31c14a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 --2- 172.21.15.88:0/4107110910 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc31c06c760 0x7fc31c0b7110 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 >> 172.21.15.88:0/4107110910 conn(0x7fc31c0d06f0 msgr2=0x7fc31c158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:39.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 shutdown_connections 2023-05-17T12:26:39.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.104+0000 7fc321dff700 1 -- 172.21.15.88:0/4107110910 wait complete. 2023-05-17T12:26:39.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-17T12:26:39.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.308+0000 7fd6367ff700 1 Processor -- start 2023-05-17T12:26:39.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.308+0000 7fd6367ff700 1 -- start start 2023-05-17T12:26:39.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.309+0000 7fd6367ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 0x7fd63006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.309+0000 7fd6367ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6300cf190 0x7fd630160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.309+0000 7fd6367ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63006b4a0 con 0x7fd6300b23a0 2023-05-17T12:26:39.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.309+0000 7fd6367ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63006a510 con 0x7fd6300cf190 2023-05-17T12:26:39.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.309+0000 7fd6367ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6300cd840 con 0x7fd63006c760 2023-05-17T12:26:39.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.310+0000 7fd634d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6300cf190 0x7fd630160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.310+0000 7fd62f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6300b23a0 0x7fd63006cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57794/0 (socket says 172.21.15.88:57794) 2023-05-17T12:26:39.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.310+0000 7fd62f7fe700 1 -- 172.21.15.88:0/4290639282 learned_addr learned my addr 172.21.15.88:0/4290639282 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:39.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.310+0000 7fd62ffff700 1 --2- 172.21.15.88:0/4290639282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 0x7fd63006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.310+0000 7fd634d9c700 1 -- 172.21.15.88:0/4290639282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 msgr2=0x7fd63006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:39.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.310+0000 7fd634d9c700 1 --2- 172.21.15.88:0/4290639282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 0x7fd63006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.310+0000 7fd634d9c700 1 -- 172.21.15.88:0/4290639282 >> v1:172.21.15.88:6789/0 conn(0x7fd6300b23a0 legacy=0x7fd63006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.310+0000 7fd634d9c700 1 -- 172.21.15.88:0/4290639282 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6300cdb20 con 0x7fd6300cf190 2023-05-17T12:26:39.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.310+0000 7fd634d9c700 1 --2- 172.21.15.88:0/4290639282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 0x7fd630160380 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd628009d90 tx=0x7fd62800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d6735f970b076f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.314+0000 7fd62effd700 1 -- 172.21.15.88:0/4290639282 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62800e070 con 0x7fd6300cf190 2023-05-17T12:26:39.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.314+0000 7fd62effd700 1 -- 172.21.15.88:0/4290639282 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62800bb20 con 0x7fd6300cf190 2023-05-17T12:26:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.314+0000 7fd62effd700 1 -- 172.21.15.88:0/4290639282 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628012430 con 0x7fd6300cf190 2023-05-17T12:26:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.314+0000 7fd6367ff700 1 -- 172.21.15.88:0/4290639282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 msgr2=0x7fd630160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.314+0000 7fd6367ff700 1 --2- 172.21.15.88:0/4290639282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 0x7fd630160380 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd628009d90 tx=0x7fd62800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.314+0000 7fd6367ff700 1 -- 172.21.15.88:0/4290639282 shutdown_connections 2023-05-17T12:26:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.314+0000 7fd6367ff700 1 --2- 172.21.15.88:0/4290639282 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 0x7fd630160380 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.314+0000 7fd6367ff700 1 --2- 172.21.15.88:0/4290639282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 0x7fd63006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.314+0000 7fd6367ff700 1 -- 172.21.15.88:0/4290639282 >> 172.21.15.88:0/4290639282 conn(0x7fd6300d06f0 msgr2=0x7fd6300d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.315+0000 7fd6367ff700 1 -- 172.21.15.88:0/4290639282 shutdown_connections 2023-05-17T12:26:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.315+0000 7fd6367ff700 1 -- 172.21.15.88:0/4290639282 wait complete. 2023-05-17T12:26:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.316+0000 7fd6367ff700 1 Processor -- start 2023-05-17T12:26:39.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.316+0000 7fd6367ff700 1 -- start start 2023-05-17T12:26:39.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.317+0000 7fd6367ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 0x7fd6300c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.317+0000 7fd6367ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 0x7fd630159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.317+0000 7fd6367ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd630159540 0x7fd630144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.317+0000 7fd6367ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6300c95c0 con 0x7fd6300cf190 2023-05-17T12:26:39.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.317+0000 7fd6367ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6301434a0 con 0x7fd630159540 2023-05-17T12:26:39.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.317+0000 7fd6367ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd630155960 con 0x7fd63006c760 2023-05-17T12:26:39.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 0x7fd630159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 0x7fd630159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48978/0 (socket says 172.21.15.88:48978) 2023-05-17T12:26:39.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62f7fe700 1 -- 172.21.15.88:0/1737397552 learned_addr learned my addr 172.21.15.88:0/1737397552 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:39.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62ffff700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 0x7fd6300c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd634d9c700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd630159540 0x7fd630144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62f7fe700 1 -- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 msgr2=0x7fd6300c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62f7fe700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 0x7fd6300c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62f7fe700 1 -- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd630159540 msgr2=0x7fd630144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62f7fe700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd630159540 0x7fd630144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62f7fe700 1 -- 172.21.15.88:0/1737397552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd628009a70 con 0x7fd6300cf190 2023-05-17T12:26:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd634d9c700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd630159540 0x7fd630144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:39.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62f7fe700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 0x7fd630159e50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd62400c550 tx=0x7fd62400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62cff9700 1 -- 172.21.15.88:0/1737397552 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624005d70 con 0x7fd6300cf190 2023-05-17T12:26:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62cff9700 1 -- 172.21.15.88:0/1737397552 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6240070d0 con 0x7fd6300cf190 2023-05-17T12:26:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63006aa40 con 0x7fd6300cf190 2023-05-17T12:26:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.318+0000 7fd62cff9700 1 -- 172.21.15.88:0/1737397552 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624007440 con 0x7fd6300cf190 2023-05-17T12:26:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.319+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63006a760 con 0x7fd6300cf190 2023-05-17T12:26:39.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.320+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63015cb40 con 0x7fd6300cf190 2023-05-17T12:26:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.321+0000 7fd62cff9700 1 -- 172.21.15.88:0/1737397552 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6240075a0 con 0x7fd6300cf190 2023-05-17T12:26:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.322+0000 7fd62cff9700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd61c06ace0 0x7fd61c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.322+0000 7fd62cff9700 1 -- 172.21.15.88:0/1737397552 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd624088950 con 0x7fd6300cf190 2023-05-17T12:26:39.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.322+0000 7fd62ffff700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd61c06ace0 0x7fd61c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.323+0000 7fd62ffff700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd61c06ace0 0x7fd61c06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd620009b40 tx=0x7fd620009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:39.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.327+0000 7fd62cff9700 1 -- 172.21.15.88:0/1737397552 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd6240536e0 con 0x7fd6300cf190 2023-05-17T12:26:39.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.520+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd63006b4a0 con 0x7fd6300cf190 2023-05-17T12:26:39.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.521+0000 7fd62cff9700 1 -- 172.21.15.88:0/1737397552 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd63006b4a0 con 0x7fd6300cf190 2023-05-17T12:26:39.524 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-05-17T12:26:39.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd61c06ace0 msgr2=0x7fd61c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd61c06ace0 0x7fd61c06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd620009b40 tx=0x7fd620009210 comp rx=0 tx=0).stop 2023-05-17T12:26:39.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 msgr2=0x7fd630159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 0x7fd630159e50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd62400c550 tx=0x7fd62400c860 comp rx=0 tx=0).stop 2023-05-17T12:26:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 shutdown_connections 2023-05-17T12:26:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd61c06ace0 0x7fd61c06d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd630159540 0x7fd630144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd63006c760 0x7fd6300c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 --2- 172.21.15.88:0/1737397552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6300cf190 0x7fd630159e50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 >> 172.21.15.88:0/1737397552 conn(0x7fd6300d06f0 msgr2=0x7fd6300d2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:39.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 shutdown_connections 2023-05-17T12:26:39.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.523+0000 7fd6367ff700 1 -- 172.21.15.88:0/1737397552 wait complete. 2023-05-17T12:26:39.543 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-17T12:26:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.729+0000 7f866dbff700 1 Processor -- start 2023-05-17T12:26:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.730+0000 7f866dbff700 1 -- start start 2023-05-17T12:26:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f866dbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86680c9370 0x7f86680c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f866dbff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f86680b4750 0x7f866815e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f866dbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866806b430 con 0x7f866806a510 2023-05-17T12:26:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f866dbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86680c9c80 con 0x7f86680c9370 2023-05-17T12:26:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f866dbff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866806b680 con 0x7f86680b4750 2023-05-17T12:26:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f86677fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86680c9370 0x7f86680c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f86677fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86680c9370 0x7f86680c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48994/0 (socket says 172.21.15.88:48994) 2023-05-17T12:26:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f86677fe700 1 -- 172.21.15.88:0/3527723938 learned_addr learned my addr 172.21.15.88:0/3527723938 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f8667fff700 1 --2- 172.21.15.88:0/3527723938 >> v2:172.21.15.187:3300/0 conn(0x7f86680b4750 0x7f866815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f86677fe700 1 -- 172.21.15.88:0/3527723938 >> v2:172.21.15.187:3300/0 conn(0x7f86680b4750 msgr2=0x7f866815e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f86677fe700 1 --2- 172.21.15.88:0/3527723938 >> v2:172.21.15.187:3300/0 conn(0x7f86680b4750 0x7f866815e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.731+0000 7f86677fe700 1 -- 172.21.15.88:0/3527723938 >> v1:172.21.15.187:6789/0 conn(0x7f866806a510 legacy=0x7f866815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.732+0000 7f86677fe700 1 -- 172.21.15.88:0/3527723938 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866806b960 con 0x7f86680c9370 2023-05-17T12:26:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.732+0000 7f86677fe700 1 --2- 172.21.15.88:0/3527723938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680c9370 0x7f86680c9740 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f86680cc870 tx=0x7f8658009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d867d6f5b1c7c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.732+0000 7f86667fc700 1 -- 172.21.15.88:0/3527723938 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800b870 con 0x7f86680c9370 2023-05-17T12:26:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.732+0000 7f86667fc700 1 -- 172.21.15.88:0/3527723938 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865800b9d0 con 0x7f86680c9370 2023-05-17T12:26:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.732+0000 7f86667fc700 1 -- 172.21.15.88:0/3527723938 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800bd60 con 0x7f86680c9370 2023-05-17T12:26:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.732+0000 7f866dbff700 1 -- 172.21.15.88:0/3527723938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680c9370 msgr2=0x7f86680c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.732+0000 7f866dbff700 1 --2- 172.21.15.88:0/3527723938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680c9370 0x7f86680c9740 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f86680cc870 tx=0x7f8658009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.733+0000 7f866dbff700 1 -- 172.21.15.88:0/3527723938 shutdown_connections 2023-05-17T12:26:39.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.733+0000 7f866dbff700 1 --2- 172.21.15.88:0/3527723938 >> v2:172.21.15.187:3300/0 conn(0x7f86680b4750 0x7f866815e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.733+0000 7f866dbff700 1 --2- 172.21.15.88:0/3527723938 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680c9370 0x7f86680c9740 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.733+0000 7f866dbff700 1 -- 172.21.15.88:0/3527723938 >> 172.21.15.88:0/3527723938 conn(0x7f86680cf970 msgr2=0x7f86680cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:39.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.733+0000 7f866dbff700 1 -- 172.21.15.88:0/3527723938 shutdown_connections 2023-05-17T12:26:39.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.733+0000 7f866dbff700 1 -- 172.21.15.88:0/3527723938 wait complete. 2023-05-17T12:26:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.734+0000 7f866dbff700 1 Processor -- start 2023-05-17T12:26:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.734+0000 7f866dbff700 1 -- start start 2023-05-17T12:26:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.735+0000 7f866dbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866806a510 0x7f86680c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.735+0000 7f866dbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680b4750 0x7f86681f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.735+0000 7f866dbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86680c9370 0x7f866814b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.735+0000 7f866dbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680c4030 con 0x7f86680b4750 2023-05-17T12:26:39.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.735+0000 7f866dbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86680c8450 con 0x7f86680c9370 2023-05-17T12:26:39.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.735+0000 7f866dbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86680c8730 con 0x7f866806a510 2023-05-17T12:26:39.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f8666ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680b4750 0x7f86681f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f8666ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680b4750 0x7f86681f04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48998/0 (socket says 172.21.15.88:48998) 2023-05-17T12:26:39.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f8666ffd700 1 -- 172.21.15.88:0/1118421210 learned_addr learned my addr 172.21.15.88:0/1118421210 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:39.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f8666ffd700 1 -- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866806a510 msgr2=0x7f86680c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f8666ffd700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866806a510 0x7f86680c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f8666ffd700 1 -- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86680c9370 msgr2=0x7f866814b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f8666ffd700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86680c9370 0x7f866814b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f8666ffd700 1 -- 172.21.15.88:0/1118421210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658009550 con 0x7f86680b4750 2023-05-17T12:26:39.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f8666ffd700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680b4750 0x7f86681f04f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c4e0 tx=0x7f865c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:39.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f864ffff700 1 -- 172.21.15.88:0/1118421210 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0052d0 con 0x7f86680b4750 2023-05-17T12:26:39.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f864ffff700 1 -- 172.21.15.88:0/1118421210 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c005430 con 0x7f86680b4750 2023-05-17T12:26:39.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866815a8e0 con 0x7f86680b4750 2023-05-17T12:26:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.736+0000 7f864ffff700 1 -- 172.21.15.88:0/1118421210 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0038c0 con 0x7f86680b4750 2023-05-17T12:26:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.737+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866806bc40 con 0x7f86680b4750 2023-05-17T12:26:39.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.738+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8668071f30 con 0x7f86680b4750 2023-05-17T12:26:39.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.738+0000 7f864ffff700 1 -- 172.21.15.88:0/1118421210 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f865c003a20 con 0x7f86680b4750 2023-05-17T12:26:39.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.739+0000 7f864ffff700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865406ace0 0x7f865406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:39.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.739+0000 7f864ffff700 1 -- 172.21.15.88:0/1118421210 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f865c088c60 con 0x7f86680b4750 2023-05-17T12:26:39.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.740+0000 7f86677fe700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865406ace0 0x7f865406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:39.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.740+0000 7f86677fe700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865406ace0 0x7f865406d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86680c9ae0 tx=0x7f8658010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:39.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.743+0000 7f864ffff700 1 -- 172.21.15.88:0/1118421210 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f865c053a50 con 0x7f86680b4750 2023-05-17T12:26:39.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.935+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f86680c4170 con 0x7f86680b4750 2023-05-17T12:26:39.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.935+0000 7f864ffff700 1 -- 172.21.15.88:0/1118421210 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f865c017020 con 0x7f86680b4750 2023-05-17T12:26:39.938 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-05-17T12:26:39.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865406ace0 msgr2=0x7f865406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865406ace0 0x7f865406d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86680c9ae0 tx=0x7f8658010000 comp rx=0 tx=0).stop 2023-05-17T12:26:39.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680b4750 msgr2=0x7f86681f04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:39.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680b4750 0x7f86681f04f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c4e0 tx=0x7f865c00c8a0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 shutdown_connections 2023-05-17T12:26:39.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865406ace0 0x7f865406d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86680c9370 0x7f866814b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866806a510 0x7f86680c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 --2- 172.21.15.88:0/1118421210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86680b4750 0x7f86681f04f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:39.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 >> 172.21.15.88:0/1118421210 conn(0x7f86680cf970 msgr2=0x7f86680cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:39.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 shutdown_connections 2023-05-17T12:26:39.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:39.938+0000 7f866dbff700 1 -- 172.21.15.88:0/1118421210 wait complete. 2023-05-17T12:26:39.958 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:26:40.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.139+0000 7fd82d7ff700 1 Processor -- start 2023-05-17T12:26:40.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.139+0000 7fd82d7ff700 1 -- start start 2023-05-17T12:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.140+0000 7fd82d7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd82806ca40 0x7fd82806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.140+0000 7fd82d7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280cd6b0 con 0x7fd82806b0b0 2023-05-17T12:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.140+0000 7fd82d7ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280b2460 con 0x7fd82815c840 2023-05-17T12:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.140+0000 7fd82d7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8280cdf50 con 0x7fd82806ca40 2023-05-17T12:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.140+0000 7fd8267fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd82806b0b0 0x7fd82806c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57808/0 (socket says 172.21.15.88:57808) 2023-05-17T12:26:40.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.141+0000 7fd8267fc700 1 -- 172.21.15.88:0/172589187 learned_addr learned my addr 172.21.15.88:0/172589187 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:40.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.141+0000 7fd8277fe700 1 --2- 172.21.15.88:0/172589187 >> v2:172.21.15.88:3300/0 conn(0x7fd82806ca40 0x7fd82806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.141+0000 7fd825ffb700 1 -- 172.21.15.88:0/172589187 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621032680 0 0) 0x7fd8280cd6b0 con 0x7fd82806b0b0 2023-05-17T12:26:40.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.141+0000 7fd825ffb700 1 -- 172.21.15.88:0/172589187 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8100035b0 con 0x7fd82806b0b0 2023-05-17T12:26:40.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.141+0000 7fd8277fe700 1 -- 172.21.15.88:0/172589187 >> v1:172.21.15.187:6789/0 conn(0x7fd82815c840 legacy=0x7fd8280cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.141+0000 7fd8277fe700 1 -- 172.21.15.88:0/172589187 >> v1:172.21.15.88:6789/0 conn(0x7fd82806b0b0 legacy=0x7fd82806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.141+0000 7fd8277fe700 1 -- 172.21.15.88:0/172589187 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280b2740 con 0x7fd82806ca40 2023-05-17T12:26:40.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.141+0000 7fd8277fe700 1 --2- 172.21.15.88:0/172589187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806ca40 0x7fd82806b940 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd820009d90 tx=0x7fd82000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a363eb515c57e54 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:40.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd825ffb700 1 -- 172.21.15.88:0/172589187 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000e070 con 0x7fd82806ca40 2023-05-17T12:26:40.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd825ffb700 1 -- 172.21.15.88:0/172589187 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000bb20 con 0x7fd82806ca40 2023-05-17T12:26:40.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd825ffb700 1 -- 172.21.15.88:0/172589187 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820012430 con 0x7fd82806ca40 2023-05-17T12:26:40.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd82d7ff700 1 -- 172.21.15.88:0/172589187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806ca40 msgr2=0x7fd82806b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd82d7ff700 1 --2- 172.21.15.88:0/172589187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806ca40 0x7fd82806b940 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd820009d90 tx=0x7fd82000b330 comp rx=0 tx=0).stop 2023-05-17T12:26:40.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd82d7ff700 1 -- 172.21.15.88:0/172589187 shutdown_connections 2023-05-17T12:26:40.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd82d7ff700 1 --2- 172.21.15.88:0/172589187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806ca40 0x7fd82806b940 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd82d7ff700 1 -- 172.21.15.88:0/172589187 >> 172.21.15.88:0/172589187 conn(0x7fd8280d3060 msgr2=0x7fd8280d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:40.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd82d7ff700 1 -- 172.21.15.88:0/172589187 shutdown_connections 2023-05-17T12:26:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.142+0000 7fd82d7ff700 1 -- 172.21.15.88:0/172589187 wait complete. 2023-05-17T12:26:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.144+0000 7fd82d7ff700 1 Processor -- start 2023-05-17T12:26:40.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.144+0000 7fd82d7ff700 1 -- start start 2023-05-17T12:26:40.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.145+0000 7fd82d7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806b0b0 0x7fd82815e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.145+0000 7fd82d7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd82806ca40 0x7fd8281570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.145+0000 7fd82d7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd82815c840 0x7fd82815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.145+0000 7fd82d7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828158ce0 con 0x7fd82806b0b0 2023-05-17T12:26:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.145+0000 7fd82d7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828159510 con 0x7fd82815c840 2023-05-17T12:26:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.145+0000 7fd82d7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82815b290 con 0x7fd82806ca40 2023-05-17T12:26:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.145+0000 7fd826ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806b0b0 0x7fd82815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.145+0000 7fd826ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806b0b0 0x7fd82815e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49006/0 (socket says 172.21.15.88:49006) 2023-05-17T12:26:40.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.145+0000 7fd826ffd700 1 -- 172.21.15.88:0/3065843558 learned_addr learned my addr 172.21.15.88:0/3065843558 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:40.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd8277fe700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd82815c840 0x7fd82815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd8267fc700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd82806ca40 0x7fd8281570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd826ffd700 1 -- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd82806ca40 msgr2=0x7fd8281570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd826ffd700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd82806ca40 0x7fd8281570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd826ffd700 1 -- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd82815c840 msgr2=0x7fd82815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd826ffd700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd82815c840 0x7fd82815ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd826ffd700 1 -- 172.21.15.88:0/3065843558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd820009a70 con 0x7fd82806b0b0 2023-05-17T12:26:40.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd8277fe700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd82815c840 0x7fd82815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:40.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd826ffd700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806b0b0 0x7fd82815e660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd81800c4e0 tx=0x7fd81800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:40.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd80f7fe700 1 -- 172.21.15.88:0/3065843558 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180052d0 con 0x7fd82806b0b0 2023-05-17T12:26:40.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd80f7fe700 1 -- 172.21.15.88:0/3065843558 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd818005430 con 0x7fd82806b0b0 2023-05-17T12:26:40.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd80f7fe700 1 -- 172.21.15.88:0/3065843558 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180038c0 con 0x7fd82806b0b0 2023-05-17T12:26:40.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.146+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8280cdbe0 con 0x7fd82806b0b0 2023-05-17T12:26:40.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.147+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8280cd900 con 0x7fd82806b0b0 2023-05-17T12:26:40.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.147+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82815cc10 con 0x7fd82806b0b0 2023-05-17T12:26:40.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.148+0000 7fd80f7fe700 1 -- 172.21.15.88:0/3065843558 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd818003a20 con 0x7fd82806b0b0 2023-05-17T12:26:40.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.149+0000 7fd80f7fe700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd81406ace0 0x7fd81406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.149+0000 7fd80f7fe700 1 -- 172.21.15.88:0/3065843558 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd818088ce0 con 0x7fd82806b0b0 2023-05-17T12:26:40.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.150+0000 7fd8267fc700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd81406ace0 0x7fd81406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.151+0000 7fd8267fc700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd81406ace0 0x7fd81406d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd8280b59c0 tx=0x7fd81c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:40.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.154+0000 7fd80f7fe700 1 -- 172.21.15.88:0/3065843558 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd818053a50 con 0x7fd82806b0b0 2023-05-17T12:26:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.395+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd828074530 con 0x7fd82806b0b0 2023-05-17T12:26:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.396+0000 7fd80f7fe700 1 -- 172.21.15.88:0/3065843558 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fd818057070 con 0x7fd82806b0b0 2023-05-17T12:26:40.399 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:40.399 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:30.331217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T12:26:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd81406ace0 msgr2=0x7fd81406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd81406ace0 0x7fd81406d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd8280b59c0 tx=0x7fd81c009040 comp rx=0 tx=0).stop 2023-05-17T12:26:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806b0b0 msgr2=0x7fd82815e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806b0b0 0x7fd82815e660 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd81800c4e0 tx=0x7fd81800c8a0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 shutdown_connections 2023-05-17T12:26:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd81406ace0 0x7fd81406d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd82815c840 0x7fd82815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd82806b0b0 0x7fd82815e660 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 --2- 172.21.15.88:0/3065843558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd82806ca40 0x7fd8281570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 >> 172.21.15.88:0/3065843558 conn(0x7fd8280d3060 msgr2=0x7fd8280d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 shutdown_connections 2023-05-17T12:26:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.398+0000 7fd82d7ff700 1 -- 172.21.15.88:0/3065843558 wait complete. 2023-05-17T12:26:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-05-17T12:26:40.418 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:40.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.600+0000 7fcf45fff700 1 Processor -- start 2023-05-17T12:26:40.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.600+0000 7fcf45fff700 1 -- start start 2023-05-17T12:26:40.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.601+0000 7fcf45fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf400ce2a0 0x7fcf40164480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.601+0000 7fcf45fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf401599b0 con 0x7fcf40071540 2023-05-17T12:26:40.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.601+0000 7fcf45fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4015e000 con 0x7fcf401595e0 2023-05-17T12:26:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.601+0000 7fcf45fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf400cca80 con 0x7fcf400ce2a0 2023-05-17T12:26:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf36ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf40071540 0x7fcf400cdb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57812/0 (socket says 172.21.15.88:57812) 2023-05-17T12:26:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf36ffd700 1 -- 172.21.15.88:0/4237396458 learned_addr learned my addr 172.21.15.88:0/4237396458 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3ffff700 1 --2- 172.21.15.88:0/4237396458 >> v2:172.21.15.187:3300/0 conn(0x7fcf400ce2a0 0x7fcf40164480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059027207 0 0) 0x7fcf401599b0 con 0x7fcf40071540 2023-05-17T12:26:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf2c0057c0 con 0x7fcf40071540 2023-05-17T12:26:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1935654914 0 0) 0x7fcf2c0057c0 con 0x7fcf40071540 2023-05-17T12:26:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 >> v2:172.21.15.187:3300/0 conn(0x7fcf400ce2a0 msgr2=0x7fcf40164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:40.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 --2- 172.21.15.88:0/4237396458 >> v2:172.21.15.187:3300/0 conn(0x7fcf400ce2a0 0x7fcf40164480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 >> v1:172.21.15.187:6789/0 conn(0x7fcf401595e0 legacy=0x7fcf40070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400ccd60 con 0x7fcf40071540 2023-05-17T12:26:40.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7fcf28001670 con 0x7fcf40071540 2023-05-17T12:26:40.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 >> v1:172.21.15.88:6789/0 conn(0x7fcf40071540 legacy=0x7fcf400cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.602+0000 7fcf3effd700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c005c10 0x7fcf2c006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3effd700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c006a60 0x7fcf2c006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3effd700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2c007410 0x7fcf2c00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400cca80 con 0x7fcf2c007410 2023-05-17T12:26:40.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c00e290 con 0x7fcf2c006a60 2023-05-17T12:26:40.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c00e450 con 0x7fcf2c005c10 2023-05-17T12:26:40.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3ffff700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2c007410 0x7fcf2c00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3f7fe700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c005c10 0x7fcf2c006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf36ffd700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c006a60 0x7fcf2c006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3ffff700 1 -- 172.21.15.88:0/4237396458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c005c10 msgr2=0x7fcf2c006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3ffff700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c005c10 0x7fcf2c006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3ffff700 1 -- 172.21.15.88:0/4237396458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c006a60 msgr2=0x7fcf2c006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3ffff700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c006a60 0x7fcf2c006ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3ffff700 1 -- 172.21.15.88:0/4237396458 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0057c0 con 0x7fcf2c007410 2023-05-17T12:26:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3ffff700 1 -- 172.21.15.88:0/4237396458 reap_dead start 2023-05-17T12:26:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.603+0000 7fcf3ffff700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2c007410 0x7fcf2c00dc20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fcf400ce6a0 tx=0x7fcf2c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3760c0108440b25f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38018070 con 0x7fcf2c007410 2023-05-17T12:26:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3800f040 con 0x7fcf2c007410 2023-05-17T12:26:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf3effd700 1 -- 172.21.15.88:0/4237396458 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800ebe0 con 0x7fcf2c007410 2023-05-17T12:26:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf45fff700 1 -- 172.21.15.88:0/4237396458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2c007410 msgr2=0x7fcf2c00dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf45fff700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2c007410 0x7fcf2c00dc20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fcf400ce6a0 tx=0x7fcf2c007a90 comp rx=0 tx=0).stop 2023-05-17T12:26:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf45fff700 1 -- 172.21.15.88:0/4237396458 shutdown_connections 2023-05-17T12:26:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf45fff700 1 --2- 172.21.15.88:0/4237396458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2c007410 0x7fcf2c00dc20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf45fff700 1 -- 172.21.15.88:0/4237396458 >> 172.21.15.88:0/4237396458 conn(0x7fcf400ced10 msgr2=0x7fcf400cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf45fff700 1 -- 172.21.15.88:0/4237396458 shutdown_connections 2023-05-17T12:26:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.604+0000 7fcf45fff700 1 -- 172.21.15.88:0/4237396458 wait complete. 2023-05-17T12:26:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.606+0000 7fcf45fff700 1 Processor -- start 2023-05-17T12:26:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.606+0000 7fcf45fff700 1 -- start start 2023-05-17T12:26:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf45fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c007410 0x7fcf400c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf45fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf400c2d60 0x7fcf400c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf45fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf400c4ca0 0x7fcf400c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf45fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400c31d0 con 0x7fcf400c4ca0 2023-05-17T12:26:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf45fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400b4560 con 0x7fcf400c2d60 2023-05-17T12:26:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf45fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400c5680 con 0x7fcf2c007410 2023-05-17T12:26:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf400c4ca0 0x7fcf400c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf400c4ca0 0x7fcf400c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49034/0 (socket says 172.21.15.88:49034) 2023-05-17T12:26:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf3ffff700 1 -- 172.21.15.88:0/2911051731 learned_addr learned my addr 172.21.15.88:0/2911051731 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf3f7fe700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c007410 0x7fcf400c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.607+0000 7fcf36ffd700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf400c2d60 0x7fcf400c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf3ffff700 1 -- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c007410 msgr2=0x7fcf400c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf3ffff700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c007410 0x7fcf400c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf3ffff700 1 -- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf400c2d60 msgr2=0x7fcf400c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf3ffff700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf400c2d60 0x7fcf400c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf3ffff700 1 -- 172.21.15.88:0/2911051731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400cd320 con 0x7fcf400c4ca0 2023-05-17T12:26:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf3ffff700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf400c4ca0 0x7fcf400c5140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcf40070de0 tx=0x7fcf38009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf3cff9700 1 -- 172.21.15.88:0/2911051731 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38018040 con 0x7fcf400c4ca0 2023-05-17T12:26:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf3cff9700 1 -- 172.21.15.88:0/2911051731 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38004450 con 0x7fcf400c4ca0 2023-05-17T12:26:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf3cff9700 1 -- 172.21.15.88:0/2911051731 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38007000 con 0x7fcf400c4ca0 2023-05-17T12:26:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf400cd040 con 0x7fcf400c4ca0 2023-05-17T12:26:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.608+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf400cd840 con 0x7fcf400c4ca0 2023-05-17T12:26:40.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.609+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf400c9020 con 0x7fcf400c4ca0 2023-05-17T12:26:40.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.610+0000 7fcf3cff9700 1 -- 172.21.15.88:0/2911051731 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf38004800 con 0x7fcf400c4ca0 2023-05-17T12:26:40.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.611+0000 7fcf3cff9700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcf2006ace0 0x7fcf2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:40.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.611+0000 7fcf3cff9700 1 -- 172.21.15.88:0/2911051731 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcf3808ab00 con 0x7fcf400c4ca0 2023-05-17T12:26:40.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.612+0000 7fcf3f7fe700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcf2006ace0 0x7fcf2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:40.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.612+0000 7fcf3f7fe700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcf2006ace0 0x7fcf2006d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcf30007fd0 tx=0x7fcf30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:40.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.615+0000 7fcf3cff9700 1 -- 172.21.15.88:0/2911051731 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fcf3808ce60 con 0x7fcf400c4ca0 2023-05-17T12:26:40.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.812+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf40074530 con 0x7fcf400c4ca0 2023-05-17T12:26:40.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.813+0000 7fcf3cff9700 1 -- 172.21.15.88:0/2911051731 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fcf38059420 con 0x7fcf400c4ca0 2023-05-17T12:26:40.816 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:40.816 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:40.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.815+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcf2006ace0 msgr2=0x7fcf2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.815+0000 7fcf45fff700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcf2006ace0 0x7fcf2006d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcf30007fd0 tx=0x7fcf30009040 comp rx=0 tx=0).stop 2023-05-17T12:26:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.815+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf400c4ca0 msgr2=0x7fcf400c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.815+0000 7fcf45fff700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf400c4ca0 0x7fcf400c5140 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcf40070de0 tx=0x7fcf38009750 comp rx=0 tx=0).stop 2023-05-17T12:26:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.816+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 shutdown_connections 2023-05-17T12:26:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.816+0000 7fcf45fff700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fcf2006ace0 0x7fcf2006d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.816+0000 7fcf45fff700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf400c4ca0 0x7fcf400c5140 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.816+0000 7fcf45fff700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c007410 0x7fcf400c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.816+0000 7fcf45fff700 1 --2- 172.21.15.88:0/2911051731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf400c2d60 0x7fcf400c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:40.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.816+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 >> 172.21.15.88:0/2911051731 conn(0x7fcf400ced10 msgr2=0x7fcf40071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:40.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.816+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 shutdown_connections 2023-05-17T12:26:40.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:40.816+0000 7fcf45fff700 1 -- 172.21.15.88:0/2911051731 wait complete. 2023-05-17T12:26:40.837 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-17T12:26:40.838 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:26:41.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.019+0000 7f7f627ff700 1 Processor -- start 2023-05-17T12:26:41.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.019+0000 7f7f627ff700 1 -- start start 2023-05-17T12:26:41.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.020+0000 7f7f627ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7f5c15a580 0x7f7f5c0c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.020+0000 7f7f627ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f5c071540 0x7f7f5c0ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.020+0000 7f7f627ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5c15ec80 con 0x7f7f5c15a950 2023-05-17T12:26:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.020+0000 7f7f627ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c15f110 con 0x7f7f5c071540 2023-05-17T12:26:41.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.020+0000 7f7f627ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c15e350 con 0x7f7f5c15a580 2023-05-17T12:26:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.020+0000 7f7f53fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7f5c15a950 0x7f7f5c070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36406/0 (socket says 172.21.15.88:36406) 2023-05-17T12:26:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.020+0000 7f7f53fff700 1 -- 172.21.15.88:0/1191281832 learned_addr learned my addr 172.21.15.88:0/1191281832 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.020+0000 7f7f60d9c700 1 --2- 172.21.15.88:0/1191281832 >> v2:172.21.15.88:3300/0 conn(0x7f7f5c071540 0x7f7f5c0ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.020+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/1191281832 >> v2:172.21.15.187:3300/0 conn(0x7f7f5c15a580 0x7f7f5c0c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f5b7fe700 1 -- 172.21.15.88:0/1191281832 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562854402 0 0) 0x7f7f5c15ec80 con 0x7f7f5c15a950 2023-05-17T12:26:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f5b7fe700 1 -- 172.21.15.88:0/1191281832 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f480035b0 con 0x7f7f5c15a950 2023-05-17T12:26:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f60d9c700 1 -- 172.21.15.88:0/1191281832 >> v2:172.21.15.187:3300/0 conn(0x7f7f5c15a580 msgr2=0x7f7f5c0c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f60d9c700 1 --2- 172.21.15.88:0/1191281832 >> v2:172.21.15.187:3300/0 conn(0x7f7f5c15a580 0x7f7f5c0c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f60d9c700 1 -- 172.21.15.88:0/1191281832 >> v1:172.21.15.88:6789/0 conn(0x7f7f5c15a950 legacy=0x7f7f5c070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f60d9c700 1 -- 172.21.15.88:0/1191281832 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c15e630 con 0x7f7f5c071540 2023-05-17T12:26:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f60d9c700 1 --2- 172.21.15.88:0/1191281832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 0x7f7f5c0ccdf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0cf9c0 tx=0x7f7f5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94aa45d59af6d440 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f5b7fe700 1 -- 172.21.15.88:0/1191281832 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5400e070 con 0x7f7f5c071540 2023-05-17T12:26:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f5b7fe700 1 -- 172.21.15.88:0/1191281832 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5400bb20 con 0x7f7f5c071540 2023-05-17T12:26:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.021+0000 7f7f5b7fe700 1 -- 172.21.15.88:0/1191281832 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54012430 con 0x7f7f5c071540 2023-05-17T12:26:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.022+0000 7f7f627ff700 1 -- 172.21.15.88:0/1191281832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 msgr2=0x7f7f5c0ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.022+0000 7f7f627ff700 1 --2- 172.21.15.88:0/1191281832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 0x7f7f5c0ccdf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0cf9c0 tx=0x7f7f5400b330 comp rx=0 tx=0).stop 2023-05-17T12:26:41.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.022+0000 7f7f627ff700 1 -- 172.21.15.88:0/1191281832 shutdown_connections 2023-05-17T12:26:41.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.022+0000 7f7f627ff700 1 --2- 172.21.15.88:0/1191281832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 0x7f7f5c0ccdf0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.022+0000 7f7f627ff700 1 --2- 172.21.15.88:0/1191281832 >> v2:172.21.15.187:3300/0 conn(0x7f7f5c15a580 0x7f7f5c0c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.022+0000 7f7f627ff700 1 -- 172.21.15.88:0/1191281832 >> 172.21.15.88:0/1191281832 conn(0x7f7f5c0ced10 msgr2=0x7f7f5c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:41.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.022+0000 7f7f627ff700 1 -- 172.21.15.88:0/1191281832 shutdown_connections 2023-05-17T12:26:41.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.022+0000 7f7f627ff700 1 -- 172.21.15.88:0/1191281832 wait complete. 2023-05-17T12:26:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.024+0000 7f7f627ff700 1 Processor -- start 2023-05-17T12:26:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.024+0000 7f7f627ff700 1 -- start start 2023-05-17T12:26:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f627ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 0x7f7f5c0c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f627ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f5c15a580 0x7f7f5c1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f627ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f5c15a950 0x7f7f5c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f627ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c158da0 con 0x7f7f5c071540 2023-05-17T12:26:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f627ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c7a10 con 0x7f7f5c15a950 2023-05-17T12:26:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f627ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c7cf0 con 0x7f7f5c15a580 2023-05-17T12:26:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f5bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 0x7f7f5c0c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f5bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 0x7f7f5c0c4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50218/0 (socket says 172.21.15.88:50218) 2023-05-17T12:26:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f5bfff700 1 -- 172.21.15.88:0/3635693134 learned_addr learned my addr 172.21.15.88:0/3635693134 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f5bfff700 1 -- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f5c15a580 msgr2=0x7f7f5c1569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f5c15a580 0x7f7f5c1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f5bfff700 1 -- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f5c15a950 msgr2=0x7f7f5c156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f5c15a950 0x7f7f5c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.025+0000 7f7f5bfff700 1 -- 172.21.15.88:0/3635693134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f54009a70 con 0x7f7f5c071540 2023-05-17T12:26:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.026+0000 7f7f5bfff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 0x7f7f5c0c4c30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00e9b0 tx=0x7f7f4c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.026+0000 7f7f597fa700 1 -- 172.21.15.88:0/3635693134 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c009710 con 0x7f7f5c071540 2023-05-17T12:26:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.026+0000 7f7f597fa700 1 -- 172.21.15.88:0/3635693134 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c00c850 con 0x7f7f5c071540 2023-05-17T12:26:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.026+0000 7f7f597fa700 1 -- 172.21.15.88:0/3635693134 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00cbc0 con 0x7f7f5c071540 2023-05-17T12:26:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.026+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c0cea60 con 0x7f7f5c071540 2023-05-17T12:26:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.026+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c15e910 con 0x7f7f5c071540 2023-05-17T12:26:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.027+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c0c9e00 con 0x7f7f5c071540 2023-05-17T12:26:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.028+0000 7f7f597fa700 1 -- 172.21.15.88:0/3635693134 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f4c00cd20 con 0x7f7f5c071540 2023-05-17T12:26:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.029+0000 7f7f597fa700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7f3c06ace0 0x7f7f3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.029+0000 7f7f597fa700 1 -- 172.21.15.88:0/3635693134 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7f4c0899f0 con 0x7f7f5c071540 2023-05-17T12:26:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.029+0000 7f7f53fff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7f3c06ace0 0x7f7f3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.030+0000 7f7f53fff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7f3c06ace0 0x7f7f3c06d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c1f4170 tx=0x7f7f440079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:41.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.033+0000 7f7f597fa700 1 -- 172.21.15.88:0/3635693134 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7f4c0580d0 con 0x7f7f5c071540 2023-05-17T12:26:41.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.273+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f5c1539f0 con 0x7f7f5c071540 2023-05-17T12:26:41.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.273+0000 7f7f597fa700 1 -- 172.21.15.88:0/3635693134 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f7f4c017090 con 0x7f7f5c071540 2023-05-17T12:26:41.277 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:41.278 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:30.331217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T12:26:41.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7f3c06ace0 msgr2=0x7f7f3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7f3c06ace0 0x7f7f3c06d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c1f4170 tx=0x7f7f440079c0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 msgr2=0x7f7f5c0c4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 0x7f7f5c0c4c30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00e9b0 tx=0x7f7f4c00ed70 comp rx=0 tx=0).stop 2023-05-17T12:26:41.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 shutdown_connections 2023-05-17T12:26:41.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f7f3c06ace0 0x7f7f3c06d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f5c15a950 0x7f7f5c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f5c071540 0x7f7f5c0c4c30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 --2- 172.21.15.88:0/3635693134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f5c15a580 0x7f7f5c1569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 >> 172.21.15.88:0/3635693134 conn(0x7f7f5c0ced10 msgr2=0x7f7f5c0b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:41.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 shutdown_connections 2023-05-17T12:26:41.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.276+0000 7f7f627ff700 1 -- 172.21.15.88:0/3635693134 wait complete. 2023-05-17T12:26:41.280 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-05-17T12:26:41.295 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:26:41.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.477+0000 7feac79ff700 1 Processor -- start 2023-05-17T12:26:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.477+0000 7feac79ff700 1 -- start start 2023-05-17T12:26:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.478+0000 7feac79ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feac015c840 0x7feac006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.478+0000 7feac79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac006c330 0x7feac006c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.478+0000 7feac79ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac00cd6b0 con 0x7feac006b0b0 2023-05-17T12:26:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.478+0000 7feac79ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac00cdf50 con 0x7feac015c840 2023-05-17T12:26:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.478+0000 7feac79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac006ccf0 con 0x7feac006c330 2023-05-17T12:26:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.478+0000 7feac579b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feac015c840 0x7feac006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.478+0000 7feac579b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feac015c840 0x7feac006b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50224/0 (socket says 172.21.15.88:50224) 2023-05-17T12:26:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.478+0000 7feac579b700 1 -- 172.21.15.88:0/2743772547 learned_addr learned my addr 172.21.15.88:0/2743772547 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feac5f9c700 1 --2- 172.21.15.88:0/2743772547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac006c330 0x7feac006c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feac579b700 1 -- 172.21.15.88:0/2743772547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac006c330 msgr2=0x7feac006c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:41.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feac579b700 1 --2- 172.21.15.88:0/2743772547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac006c330 0x7feac006c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feac579b700 1 -- 172.21.15.88:0/2743772547 >> v1:172.21.15.187:6789/0 conn(0x7feac006b0b0 legacy=0x7feac00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:41.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feac579b700 1 -- 172.21.15.88:0/2743772547 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac00b2460 con 0x7feac015c840 2023-05-17T12:26:41.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feac5f9c700 1 --2- 172.21.15.88:0/2743772547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac006c330 0x7feac006c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:41.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feac579b700 1 --2- 172.21.15.88:0/2743772547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac015c840 0x7feac006b940 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feabc0098f0 tx=0x7feabc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8025942e49502c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:41.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feab7fff700 1 -- 172.21.15.88:0/2743772547 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc004230 con 0x7feac015c840 2023-05-17T12:26:41.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feab7fff700 1 -- 172.21.15.88:0/2743772547 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc004390 con 0x7feac015c840 2023-05-17T12:26:41.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.479+0000 7feab7fff700 1 -- 172.21.15.88:0/2743772547 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0036a0 con 0x7feac015c840 2023-05-17T12:26:41.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.480+0000 7feac79ff700 1 -- 172.21.15.88:0/2743772547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac015c840 msgr2=0x7feac006b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.480+0000 7feac79ff700 1 --2- 172.21.15.88:0/2743772547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac015c840 0x7feac006b940 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feabc0098f0 tx=0x7feabc009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:41.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.480+0000 7feac79ff700 1 -- 172.21.15.88:0/2743772547 shutdown_connections 2023-05-17T12:26:41.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.480+0000 7feac79ff700 1 --2- 172.21.15.88:0/2743772547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac006c330 0x7feac006c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.480+0000 7feac79ff700 1 --2- 172.21.15.88:0/2743772547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac015c840 0x7feac006b940 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.480+0000 7feac79ff700 1 -- 172.21.15.88:0/2743772547 >> 172.21.15.88:0/2743772547 conn(0x7feac00d3060 msgr2=0x7feac00d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:41.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.480+0000 7feac79ff700 1 -- 172.21.15.88:0/2743772547 shutdown_connections 2023-05-17T12:26:41.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.480+0000 7feac79ff700 1 -- 172.21.15.88:0/2743772547 wait complete. 2023-05-17T12:26:41.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.482+0000 7feac79ff700 1 Processor -- start 2023-05-17T12:26:41.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.482+0000 7feac79ff700 1 -- start start 2023-05-17T12:26:41.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac006b0b0 0x7feac0157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac006c330 0x7feac01e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac015c840 0x7feac015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac01e4430 con 0x7feac006c330 2023-05-17T12:26:41.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac01e3820 con 0x7feac006b0b0 2023-05-17T12:26:41.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac01e3b00 con 0x7feac015c840 2023-05-17T12:26:41.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac4f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac006c330 0x7feac01e2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac4f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac006c330 0x7feac01e2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50232/0 (socket says 172.21.15.88:50232) 2023-05-17T12:26:41.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac4f9a700 1 -- 172.21.15.88:0/4211285602 learned_addr learned my addr 172.21.15.88:0/4211285602 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:41.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac5f9c700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac015c840 0x7feac015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac579b700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac006b0b0 0x7feac0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac4f9a700 1 -- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac015c840 msgr2=0x7feac015a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac4f9a700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac015c840 0x7feac015a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac4f9a700 1 -- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac006b0b0 msgr2=0x7feac0157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.483+0000 7feac4f9a700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac006b0b0 0x7feac0157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.484+0000 7feac4f9a700 1 -- 172.21.15.88:0/4211285602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc009550 con 0x7feac006c330 2023-05-17T12:26:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.484+0000 7feac4f9a700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac006c330 0x7feac01e2d40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7feab000c4d0 tx=0x7feab000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.484+0000 7feab5ffb700 1 -- 172.21.15.88:0/4211285602 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0011790 con 0x7feac006c330 2023-05-17T12:26:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.484+0000 7feab5ffb700 1 -- 172.21.15.88:0/4211285602 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab00118f0 con 0x7feac006c330 2023-05-17T12:26:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.484+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac00cd900 con 0x7feac006c330 2023-05-17T12:26:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.484+0000 7feab5ffb700 1 -- 172.21.15.88:0/4211285602 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0011ca0 con 0x7feac006c330 2023-05-17T12:26:41.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.484+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac00b2740 con 0x7feac006c330 2023-05-17T12:26:41.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.485+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac00cdbe0 con 0x7feac006c330 2023-05-17T12:26:41.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.486+0000 7feab5ffb700 1 -- 172.21.15.88:0/4211285602 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feab001c460 con 0x7feac006c330 2023-05-17T12:26:41.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.487+0000 7feab5ffb700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7feaa406ace0 0x7feaa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.487+0000 7feab5ffb700 1 -- 172.21.15.88:0/4211285602 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feab0089400 con 0x7feac006c330 2023-05-17T12:26:41.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.487+0000 7feac579b700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7feaa406ace0 0x7feaa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.488+0000 7feac579b700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7feaa406ace0 0x7feaa406d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7feabc009130 tx=0x7feabc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:41.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.491+0000 7feab5ffb700 1 -- 172.21.15.88:0/4211285602 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7feab0054210 con 0x7feac006c330 2023-05-17T12:26:41.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.731+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feac0074530 con 0x7feac006c330 2023-05-17T12:26:41.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.731+0000 7feab5ffb700 1 -- 172.21.15.88:0/4211285602 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7feab0057830 con 0x7feac006c330 2023-05-17T12:26:41.736 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:41.736 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/2009196865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2009196865},{"type":"v1","addr":"172.21.15.187:6836","nonce":2009196865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/3692981222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3692981222},{"type":"v1","addr":"172.21.15.88:6834","nonce":3692981222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4302,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/3555357484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":3555357484},{"type":"v1","addr":"172.21.15.88:6835","nonce":3555357484}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:25:01.775684+0000","modified":"2023-05-17T12:25:30.331217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6837/1857408255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":1857408255},{"type":"v1","addr":"172.21.15.187:6837","nonce":1857408255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-17T12:26:41.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7feaa406ace0 msgr2=0x7feaa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7feaa406ace0 0x7feaa406d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7feabc009130 tx=0x7feabc008030 comp rx=0 tx=0).stop 2023-05-17T12:26:41.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac006c330 msgr2=0x7feac01e2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac006c330 0x7feac01e2d40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7feab000c4d0 tx=0x7feab000c7e0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 shutdown_connections 2023-05-17T12:26:41.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7feaa406ace0 0x7feaa406d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feac015c840 0x7feac015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac006b0b0 0x7feac0157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 --2- 172.21.15.88:0/4211285602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feac006c330 0x7feac01e2d40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 >> 172.21.15.88:0/4211285602 conn(0x7feac00d3060 msgr2=0x7feac00b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:41.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 shutdown_connections 2023-05-17T12:26:41.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.734+0000 7feac79ff700 1 -- 172.21.15.88:0/4211285602 wait complete. 2023-05-17T12:26:41.741 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-05-17T12:26:41.755 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:41.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.938+0000 7fe4603ff700 1 Processor -- start 2023-05-17T12:26:41.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.939+0000 7fe4603ff700 1 -- start start 2023-05-17T12:26:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.940+0000 7fe4603ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4580b1cd0 0x7fe4580ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.940+0000 7fe4603ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe458161020 con 0x7fe45815a3a0 2023-05-17T12:26:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.940+0000 7fe4603ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe458160450 con 0x7fe4580b1850 2023-05-17T12:26:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.940+0000 7fe4603ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4581606f0 con 0x7fe4580b1cd0 2023-05-17T12:26:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.941+0000 7fe45e19b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe45815a3a0 0x7fe4580cb1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36410/0 (socket says 172.21.15.88:36410) 2023-05-17T12:26:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.941+0000 7fe45e19b700 1 -- 172.21.15.88:0/457283624 learned_addr learned my addr 172.21.15.88:0/457283624 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.941+0000 7fe45e99c700 1 --2- 172.21.15.88:0/457283624 >> v2:172.21.15.88:3300/0 conn(0x7fe4580b1cd0 0x7fe4580ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.941+0000 7fe45d199700 1 -- 172.21.15.88:0/457283624 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664320721 0 0) 0x7fe458161020 con 0x7fe45815a3a0 2023-05-17T12:26:41.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.941+0000 7fe45d199700 1 -- 172.21.15.88:0/457283624 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4440035b0 con 0x7fe45815a3a0 2023-05-17T12:26:41.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.941+0000 7fe45e99c700 1 -- 172.21.15.88:0/457283624 >> v1:172.21.15.187:6789/0 conn(0x7fe4580b1850 legacy=0x7fe4580ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:41.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.941+0000 7fe45e99c700 1 -- 172.21.15.88:0/457283624 >> v1:172.21.15.88:6789/0 conn(0x7fe45815a3a0 legacy=0x7fe4580cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.941+0000 7fe45e99c700 1 -- 172.21.15.88:0/457283624 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4581609d0 con 0x7fe4580b1cd0 2023-05-17T12:26:41.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe45e99c700 1 --2- 172.21.15.88:0/457283624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 0x7fe4580ced60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe450009d90 tx=0x7fe45000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7235bcc88717cb server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:41.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe45d199700 1 -- 172.21.15.88:0/457283624 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000e070 con 0x7fe4580b1cd0 2023-05-17T12:26:41.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe45d199700 1 -- 172.21.15.88:0/457283624 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45000bb20 con 0x7fe4580b1cd0 2023-05-17T12:26:41.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe45d199700 1 -- 172.21.15.88:0/457283624 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000be90 con 0x7fe4580b1cd0 2023-05-17T12:26:41.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe4603ff700 1 -- 172.21.15.88:0/457283624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 msgr2=0x7fe4580ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe4603ff700 1 --2- 172.21.15.88:0/457283624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 0x7fe4580ced60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe450009d90 tx=0x7fe45000b330 comp rx=0 tx=0).stop 2023-05-17T12:26:41.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe4603ff700 1 -- 172.21.15.88:0/457283624 shutdown_connections 2023-05-17T12:26:41.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe4603ff700 1 --2- 172.21.15.88:0/457283624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 0x7fe4580ced60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe4603ff700 1 -- 172.21.15.88:0/457283624 >> 172.21.15.88:0/457283624 conn(0x7fe4580cc850 msgr2=0x7fe4580ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:41.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe4603ff700 1 -- 172.21.15.88:0/457283624 shutdown_connections 2023-05-17T12:26:41.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.942+0000 7fe4603ff700 1 -- 172.21.15.88:0/457283624 wait complete. 2023-05-17T12:26:41.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.944+0000 7fe4603ff700 1 Processor -- start 2023-05-17T12:26:41.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.945+0000 7fe4603ff700 1 -- start start 2023-05-17T12:26:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe4603ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4580b1850 0x7fe4581f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe4603ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 0x7fe45815df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe4603ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe45815a3a0 0x7fe45815e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe4603ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4581f32b0 con 0x7fe4580b1cd0 2023-05-17T12:26:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe4603ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580c9d00 con 0x7fe45815a3a0 2023-05-17T12:26:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe4603ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4581f2940 con 0x7fe4580b1850 2023-05-17T12:26:41.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45d99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 0x7fe45815df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45d99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 0x7fe45815df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50254/0 (socket says 172.21.15.88:50254) 2023-05-17T12:26:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45d99a700 1 -- 172.21.15.88:0/3153704118 learned_addr learned my addr 172.21.15.88:0/3153704118 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45e19b700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4580b1850 0x7fe4581f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45e99c700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe45815a3a0 0x7fe45815e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45d99a700 1 -- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4580b1850 msgr2=0x7fe4581f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45d99a700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4580b1850 0x7fe4581f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45d99a700 1 -- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe45815a3a0 msgr2=0x7fe45815e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45d99a700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe45815a3a0 0x7fe45815e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.946+0000 7fe45d99a700 1 -- 172.21.15.88:0/3153704118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450009a70 con 0x7fe4580b1cd0 2023-05-17T12:26:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.947+0000 7fe45e99c700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe45815a3a0 0x7fe45815e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.947+0000 7fe45d99a700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 0x7fe45815df60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe44800c510 tx=0x7fe44800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.947+0000 7fe44effd700 1 -- 172.21.15.88:0/3153704118 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480052d0 con 0x7fe4580b1cd0 2023-05-17T12:26:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.947+0000 7fe44effd700 1 -- 172.21.15.88:0/3153704118 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe448005430 con 0x7fe4580b1cd0 2023-05-17T12:26:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.947+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4580b2130 con 0x7fe4580b1cd0 2023-05-17T12:26:41.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.947+0000 7fe44effd700 1 -- 172.21.15.88:0/3153704118 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480038c0 con 0x7fe4580b1cd0 2023-05-17T12:26:41.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.947+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe458160cb0 con 0x7fe4580b1cd0 2023-05-17T12:26:41.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.948+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45815a770 con 0x7fe4580b1cd0 2023-05-17T12:26:41.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.949+0000 7fe44effd700 1 -- 172.21.15.88:0/3153704118 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe448003a20 con 0x7fe4580b1cd0 2023-05-17T12:26:41.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.951+0000 7fe44effd700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe43c06ace0 0x7fe43c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:41.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.951+0000 7fe44effd700 1 -- 172.21.15.88:0/3153704118 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe448088c80 con 0x7fe4580b1cd0 2023-05-17T12:26:41.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.951+0000 7fe45e19b700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe43c06ace0 0x7fe43c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:41.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.952+0000 7fe45e19b700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe43c06ace0 0x7fe43c06d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe4540011e0 tx=0x7fe454009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:41.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:41.955+0000 7fe44effd700 1 -- 172.21.15.88:0/3153704118 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe448053a00 con 0x7fe4580b1cd0 2023-05-17T12:26:42.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.149+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4580cdf60 con 0x7fe4580b1cd0 2023-05-17T12:26:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.151+0000 7fe44effd700 1 -- 172.21.15.88:0/3153704118 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fe448057020 con 0x7fe4580b1cd0 2023-05-17T12:26:42.155 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:42.155 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:25:43.403602+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:24:59.594133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-17T12:25:00.736046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-17T12:25:03.830500+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.24","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:42.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe43c06ace0 msgr2=0x7fe43c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe43c06ace0 0x7fe43c06d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe4540011e0 tx=0x7fe454009040 comp rx=0 tx=0).stop 2023-05-17T12:26:42.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 msgr2=0x7fe45815df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 0x7fe45815df60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe44800c510 tx=0x7fe44800c8d0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 shutdown_connections 2023-05-17T12:26:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe43c06ace0 0x7fe43c06d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe45815a3a0 0x7fe45815e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4580b1850 0x7fe4581f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 --2- 172.21.15.88:0/3153704118 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4580b1cd0 0x7fe45815df60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 >> 172.21.15.88:0/3153704118 conn(0x7fe4580cc850 msgr2=0x7fe4580b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 shutdown_connections 2023-05-17T12:26:42.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.153+0000 7fe4603ff700 1 -- 172.21.15.88:0/3153704118 wait complete. 2023-05-17T12:26:42.174 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-17T12:26:42.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.357+0000 7fc4f37ff700 1 Processor -- start 2023-05-17T12:26:42.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.357+0000 7fc4f37ff700 1 -- start start 2023-05-17T12:26:42.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.358+0000 7fc4f37ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4ec0d1bb0 0x7fc4ec0d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.358+0000 7fc4f37ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc4ec0cf650 0x7fc4ec160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.358+0000 7fc4f37ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec1574f0 con 0x7fc4ec15d990 2023-05-17T12:26:42.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.358+0000 7fc4f37ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec0cd800 con 0x7fc4ec0d1bb0 2023-05-17T12:26:42.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.358+0000 7fc4f37ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec161530 con 0x7fc4ec0cf650 2023-05-17T12:26:42.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f159b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4ec0d1bb0 0x7fc4ec0d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f1d9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc4ec15d990 0x7fc4ec06c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36420/0 (socket says 172.21.15.88:36420) 2023-05-17T12:26:42.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f159b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4ec0d1bb0 0x7fc4ec0d1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50258/0 (socket says 172.21.15.88:50258) 2023-05-17T12:26:42.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f1d9c700 1 -- 172.21.15.88:0/1367596732 learned_addr learned my addr 172.21.15.88:0/1367596732 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:42.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f0d9a700 1 --2- 172.21.15.88:0/1367596732 >> v2:172.21.15.187:3300/0 conn(0x7fc4ec0cf650 0x7fc4ec160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f159b700 1 -- 172.21.15.88:0/1367596732 >> v2:172.21.15.187:3300/0 conn(0x7fc4ec0cf650 msgr2=0x7fc4ec160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:42.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f159b700 1 --2- 172.21.15.88:0/1367596732 >> v2:172.21.15.187:3300/0 conn(0x7fc4ec0cf650 0x7fc4ec160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f159b700 1 -- 172.21.15.88:0/1367596732 >> v1:172.21.15.88:6789/0 conn(0x7fc4ec15d990 legacy=0x7fc4ec06c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f159b700 1 -- 172.21.15.88:0/1367596732 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0cd9e0 con 0x7fc4ec0d1bb0 2023-05-17T12:26:42.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f0d9a700 1 --2- 172.21.15.88:0/1367596732 >> v2:172.21.15.187:3300/0 conn(0x7fc4ec0cf650 0x7fc4ec160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:42.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4e3fff700 1 -- 172.21.15.88:0/1367596732 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266429562 0 0) 0x7fc4ec1574f0 con 0x7fc4ec15d990 2023-05-17T12:26:42.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.359+0000 7fc4f159b700 1 --2- 172.21.15.88:0/1367596732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0d1bb0 0x7fc4ec0d1f80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0cefe0 tx=0x7fc4e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4f9aa895294ab3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:42.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4e3fff700 1 -- 172.21.15.88:0/1367596732 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8011830 con 0x7fc4ec0d1bb0 2023-05-17T12:26:42.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4e3fff700 1 -- 172.21.15.88:0/1367596732 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e8011990 con 0x7fc4ec0d1bb0 2023-05-17T12:26:42.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4e3fff700 1 -- 172.21.15.88:0/1367596732 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8011d20 con 0x7fc4ec0d1bb0 2023-05-17T12:26:42.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4f37ff700 1 -- 172.21.15.88:0/1367596732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0d1bb0 msgr2=0x7fc4ec0d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4f37ff700 1 --2- 172.21.15.88:0/1367596732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0d1bb0 0x7fc4ec0d1f80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0cefe0 tx=0x7fc4e8009b20 comp rx=0 tx=0).stop 2023-05-17T12:26:42.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4f37ff700 1 -- 172.21.15.88:0/1367596732 shutdown_connections 2023-05-17T12:26:42.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4f37ff700 1 --2- 172.21.15.88:0/1367596732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0d1bb0 0x7fc4ec0d1f80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4f37ff700 1 --2- 172.21.15.88:0/1367596732 >> v2:172.21.15.187:3300/0 conn(0x7fc4ec0cf650 0x7fc4ec160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4f37ff700 1 -- 172.21.15.88:0/1367596732 >> 172.21.15.88:0/1367596732 conn(0x7fc4ec0d3ed0 msgr2=0x7fc4ec0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:42.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4f37ff700 1 -- 172.21.15.88:0/1367596732 shutdown_connections 2023-05-17T12:26:42.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.360+0000 7fc4f37ff700 1 -- 172.21.15.88:0/1367596732 wait complete. 2023-05-17T12:26:42.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.363+0000 7fc4f37ff700 1 Processor -- start 2023-05-17T12:26:42.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.363+0000 7fc4f37ff700 1 -- start start 2023-05-17T12:26:42.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f37ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0cf650 0x7fc4ec0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f37ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4ec0d1bb0 0x7fc4ec0cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f37ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4ec15d990 0x7fc4ec1f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f37ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec15c3d0 con 0x7fc4ec0cf650 2023-05-17T12:26:42.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f37ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec1f3470 con 0x7fc4ec0d1bb0 2023-05-17T12:26:42.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f37ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec1f3d10 con 0x7fc4ec15d990 2023-05-17T12:26:42.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f159b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0cf650 0x7fc4ec0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f159b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0cf650 0x7fc4ec0cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50266/0 (socket says 172.21.15.88:50266) 2023-05-17T12:26:42.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f159b700 1 -- 172.21.15.88:0/3875185495 learned_addr learned my addr 172.21.15.88:0/3875185495 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:42.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.364+0000 7fc4f0d9a700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4ec0d1bb0 0x7fc4ec0cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4f1d9c700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4ec15d990 0x7fc4ec1f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4f159b700 1 -- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4ec15d990 msgr2=0x7fc4ec1f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4f159b700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4ec15d990 0x7fc4ec1f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4f159b700 1 -- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4ec0d1bb0 msgr2=0x7fc4ec0cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4f159b700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4ec0d1bb0 0x7fc4ec0cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4f159b700 1 -- 172.21.15.88:0/3875185495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e80094a0 con 0x7fc4ec0cf650 2023-05-17T12:26:42.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4f159b700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0cf650 0x7fc4ec0cb170 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec06d400 tx=0x7fc4e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:42.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4e1ffb700 1 -- 172.21.15.88:0/3875185495 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80036a0 con 0x7fc4ec0cf650 2023-05-17T12:26:42.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4e1ffb700 1 -- 172.21.15.88:0/3875185495 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e801f070 con 0x7fc4ec0cf650 2023-05-17T12:26:42.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec15d190 con 0x7fc4ec0cf650 2023-05-17T12:26:42.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.365+0000 7fc4e1ffb700 1 -- 172.21.15.88:0/3875185495 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8003a60 con 0x7fc4ec0cf650 2023-05-17T12:26:42.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.366+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec0cdcc0 con 0x7fc4ec0cf650 2023-05-17T12:26:42.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.367+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec15d470 con 0x7fc4ec0cf650 2023-05-17T12:26:42.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.367+0000 7fc4e1ffb700 1 -- 172.21.15.88:0/3875185495 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4e8003bc0 con 0x7fc4ec0cf650 2023-05-17T12:26:42.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.368+0000 7fc4e1ffb700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4d006ace0 0x7fc4d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.368+0000 7fc4e1ffb700 1 -- 172.21.15.88:0/3875185495 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc4e8021070 con 0x7fc4ec0cf650 2023-05-17T12:26:42.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.369+0000 7fc4f0d9a700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4d006ace0 0x7fc4d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.369+0000 7fc4f0d9a700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4d006ace0 0x7fc4d006d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec1f5800 tx=0x7fc4dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:42.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.372+0000 7fc4e1ffb700 1 -- 172.21.15.88:0/3875185495 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc4e8055d70 con 0x7fc4ec0cf650 2023-05-17T12:26:42.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.606+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc4ec074530 con 0x7fc4ec0cf650 2023-05-17T12:26:42.672 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-05-17T12:26:42.668+0000 7fd3b73f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-17T12:26:42.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.678+0000 7fc4e1ffb700 1 -- 172.21.15.88:0/3875185495 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc4e8059390 con 0x7fc4ec0cf650 2023-05-17T12:26:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4d006ace0 msgr2=0x7fc4d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4d006ace0 0x7fc4d006d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec1f5800 tx=0x7fc4dc008040 comp rx=0 tx=0).stop 2023-05-17T12:26:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0cf650 msgr2=0x7fc4ec0cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0cf650 0x7fc4ec0cb170 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec06d400 tx=0x7fc4e8004750 comp rx=0 tx=0).stop 2023-05-17T12:26:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 shutdown_connections 2023-05-17T12:26:42.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4d006ace0 0x7fc4d006d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4ec15d990 0x7fc4ec1f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4ec0cf650 0x7fc4ec0cb170 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 --2- 172.21.15.88:0/3875185495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4ec0d1bb0 0x7fc4ec0cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 >> 172.21.15.88:0/3875185495 conn(0x7fc4ec0d3ed0 msgr2=0x7fc4ec06c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:42.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 shutdown_connections 2023-05-17T12:26:42.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.681+0000 7fc4f37ff700 1 -- 172.21.15.88:0/3875185495 wait complete. 2023-05-17T12:26:42.688 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-17T12:26:42.693 INFO:tasks.ceph.mds.d.smithi187.stderr: -6276> 2023-05-17T12:25:06.939+0000 7f23893f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T12:26:42.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-17T12:26:42.746 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-05-17T12:26:42.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.885+0000 7fe1c7fff700 1 Processor -- start 2023-05-17T12:26:42.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.886+0000 7fe1c7fff700 1 -- start start 2023-05-17T12:26:42.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.887+0000 7fe1c7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 0x7fe1c0160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.887+0000 7fe1c7fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c006a510 con 0x7fe1c00b23a0 2023-05-17T12:26:42.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.887+0000 7fe1c7fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c00cf8a0 con 0x7fe1c006c760 2023-05-17T12:26:42.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.887+0000 7fe1c7fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00cd840 con 0x7fe1c006af60 2023-05-17T12:26:42.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.887+0000 7fe1c559a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe1c00b23a0 0x7fe1c00cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36424/0 (socket says 172.21.15.88:36424) 2023-05-17T12:26:42.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.887+0000 7fe1c559a700 1 -- 172.21.15.88:0/2440252213 learned_addr learned my addr 172.21.15.88:0/2440252213 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:42.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.887+0000 7fe1c659c700 1 --2- 172.21.15.88:0/2440252213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 0x7fe1c0160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.887+0000 7fe1c4d99700 1 -- 172.21.15.88:0/2440252213 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684995025 0 0) 0x7fe1c006a510 con 0x7fe1c00b23a0 2023-05-17T12:26:42.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c4d99700 1 -- 172.21.15.88:0/2440252213 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1ac0035b0 con 0x7fe1c00b23a0 2023-05-17T12:26:42.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c4d99700 1 -- 172.21.15.88:0/2440252213 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632853700 0 0) 0x7fe1c00cf8a0 con 0x7fe1c006c760 2023-05-17T12:26:42.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c4d99700 1 -- 172.21.15.88:0/2440252213 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c006a510 con 0x7fe1c006c760 2023-05-17T12:26:42.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c659c700 1 -- 172.21.15.88:0/2440252213 >> v1:172.21.15.187:6789/0 conn(0x7fe1c006c760 legacy=0x7fe1c006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c659c700 1 -- 172.21.15.88:0/2440252213 >> v1:172.21.15.88:6789/0 conn(0x7fe1c00b23a0 legacy=0x7fe1c00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c659c700 1 -- 172.21.15.88:0/2440252213 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c00cdb20 con 0x7fe1c006af60 2023-05-17T12:26:42.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c659c700 1 --2- 172.21.15.88:0/2440252213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 0x7fe1c0160380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009dc0 tx=0x7fe1b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81026132826f3ff9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:42.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c4d99700 1 -- 172.21.15.88:0/2440252213 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b800e070 con 0x7fe1c006af60 2023-05-17T12:26:42.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c4d99700 1 -- 172.21.15.88:0/2440252213 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b800bb20 con 0x7fe1c006af60 2023-05-17T12:26:42.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.888+0000 7fe1c4d99700 1 -- 172.21.15.88:0/2440252213 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8012430 con 0x7fe1c006af60 2023-05-17T12:26:42.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.889+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2440252213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 msgr2=0x7fe1c0160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.889+0000 7fe1c7fff700 1 --2- 172.21.15.88:0/2440252213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 0x7fe1c0160380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009dc0 tx=0x7fe1b800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:42.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.889+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2440252213 shutdown_connections 2023-05-17T12:26:42.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.889+0000 7fe1c7fff700 1 --2- 172.21.15.88:0/2440252213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 0x7fe1c0160380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.889+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2440252213 >> 172.21.15.88:0/2440252213 conn(0x7fe1c00d06f0 msgr2=0x7fe1c00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:42.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.889+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2440252213 shutdown_connections 2023-05-17T12:26:42.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.889+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2440252213 wait complete. 2023-05-17T12:26:42.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.891+0000 7fe1c7fff700 1 Processor -- start 2023-05-17T12:26:42.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.891+0000 7fe1c7fff700 1 -- start start 2023-05-17T12:26:42.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.891+0000 7fe1c7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 0x7fe1c015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c006c760 0x7fe1c00b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c014f010 0x7fe1c014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c7fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c014c6d0 con 0x7fe1c006c760 2023-05-17T12:26:42.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c7fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c015b170 con 0x7fe1c014f010 2023-05-17T12:26:42.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c7fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c015b450 con 0x7fe1c006af60 2023-05-17T12:26:42.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c559a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c006c760 0x7fe1c00b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c559a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c006c760 0x7fe1c00b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50270/0 (socket says 172.21.15.88:50270) 2023-05-17T12:26:42.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c559a700 1 -- 172.21.15.88:0/2426221027 learned_addr learned my addr 172.21.15.88:0/2426221027 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:42.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c659c700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c014f010 0x7fe1c014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c5d9b700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 0x7fe1c015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c559a700 1 -- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 msgr2=0x7fe1c015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c559a700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 0x7fe1c015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c559a700 1 -- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c014f010 msgr2=0x7fe1c014e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:42.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c559a700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c014f010 0x7fe1c014e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:42.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.892+0000 7fe1c559a700 1 -- 172.21.15.88:0/2426221027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8009a70 con 0x7fe1c006c760 2023-05-17T12:26:42.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.893+0000 7fe1c559a700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c006c760 0x7fe1c00b11f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0001eb0 tx=0x7fe1b000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:42.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.893+0000 7fe1b67fc700 1 -- 172.21.15.88:0/2426221027 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0005d70 con 0x7fe1c006c760 2023-05-17T12:26:42.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.893+0000 7fe1b67fc700 1 -- 172.21.15.88:0/2426221027 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b00070d0 con 0x7fe1c006c760 2023-05-17T12:26:42.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.893+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c006aa40 con 0x7fe1c006c760 2023-05-17T12:26:42.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.893+0000 7fe1b67fc700 1 -- 172.21.15.88:0/2426221027 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0007460 con 0x7fe1c006c760 2023-05-17T12:26:42.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.893+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c006a760 con 0x7fe1c006c760 2023-05-17T12:26:42.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.894+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c006b3c0 con 0x7fe1c006c760 2023-05-17T12:26:42.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.895+0000 7fe1b67fc700 1 -- 172.21.15.88:0/2426221027 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1b00075c0 con 0x7fe1c006c760 2023-05-17T12:26:42.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.896+0000 7fe1b67fc700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe1a406ace0 0x7fe1a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:42.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.896+0000 7fe1b67fc700 1 -- 172.21.15.88:0/2426221027 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fe1b0088d20 con 0x7fe1c006c760 2023-05-17T12:26:42.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.896+0000 7fe1c5d9b700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe1a406ace0 0x7fe1a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:42.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.897+0000 7fe1c5d9b700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe1a406ace0 0x7fe1a406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc001220 tx=0x7fe1bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:42.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:42.900+0000 7fe1b67fc700 1 -- 172.21.15.88:0/2426221027 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe1b00539b0 con 0x7fe1c006c760 2023-05-17T12:26:43.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.135+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe1c0074530 con 0x7fe1c006c760 2023-05-17T12:26:43.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.680+0000 7fe1b67fc700 1 -- 172.21.15.88:0/2426221027 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1b0056fd0 con 0x7fe1c006c760 2023-05-17T12:26:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe1a406ace0 msgr2=0x7fe1a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe1a406ace0 0x7fe1a406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc001220 tx=0x7fe1bc009040 comp rx=0 tx=0).stop 2023-05-17T12:26:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c006c760 msgr2=0x7fe1c00b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c006c760 0x7fe1c00b11f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0001eb0 tx=0x7fe1b000c7b0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 shutdown_connections 2023-05-17T12:26:43.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fe1a406ace0 0x7fe1a406d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c014f010 0x7fe1c014e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1c006af60 0x7fe1c015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 --2- 172.21.15.88:0/2426221027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1c006c760 0x7fe1c00b11f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 >> 172.21.15.88:0/2426221027 conn(0x7fe1c00d06f0 msgr2=0x7fe1c00b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:43.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 shutdown_connections 2023-05-17T12:26:43.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.683+0000 7fe1c7fff700 1 -- 172.21.15.88:0/2426221027 wait complete. 2023-05-17T12:26:43.705 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-17T12:26:43.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.890+0000 7f83a1dff700 1 Processor -- start 2023-05-17T12:26:43.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.890+0000 7f83a1dff700 1 -- start start 2023-05-17T12:26:43.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.891+0000 7f83a1dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f839c14fea0 0x7f839c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:43.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.891+0000 7f83a1dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839c0717b0 0x7f839c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:43.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.891+0000 7f83a1dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839c072140 con 0x7f839c1591c0 2023-05-17T12:26:43.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.891+0000 7f83a1dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c15a220 con 0x7f839c14fea0 2023-05-17T12:26:43.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.891+0000 7f83a1dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c159d50 con 0x7f839c0717b0 2023-05-17T12:26:43.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.891+0000 7f839b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f839c14fea0 0x7f839c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:43.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.891+0000 7f839b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f839c14fea0 0x7f839c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50282/0 (socket says 172.21.15.88:50282) 2023-05-17T12:26:43.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.891+0000 7f839b7fe700 1 -- 172.21.15.88:0/3352124802 learned_addr learned my addr 172.21.15.88:0/3352124802 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:43.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.892+0000 7f839affd700 1 --2- 172.21.15.88:0/3352124802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839c0717b0 0x7f839c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.892+0000 7f839b7fe700 1 -- 172.21.15.88:0/3352124802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839c0717b0 msgr2=0x7f839c071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.892+0000 7f839b7fe700 1 --2- 172.21.15.88:0/3352124802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839c0717b0 0x7f839c071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.892+0000 7f839b7fe700 1 -- 172.21.15.88:0/3352124802 >> v1:172.21.15.187:6789/0 conn(0x7f839c1591c0 legacy=0x7f839c159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.892+0000 7f839b7fe700 1 -- 172.21.15.88:0/3352124802 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c06e4b0 con 0x7f839c14fea0 2023-05-17T12:26:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.892+0000 7f839b7fe700 1 --2- 172.21.15.88:0/3352124802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c14fea0 0x7f839c06e940 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f838c00bb90 tx=0x7f838c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57065532e56f199b server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.892+0000 7f839a7fc700 1 -- 172.21.15.88:0/3352124802 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00dc40 con 0x7f839c14fea0 2023-05-17T12:26:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.892+0000 7f839a7fc700 1 -- 172.21.15.88:0/3352124802 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c00dda0 con 0x7f839c14fea0 2023-05-17T12:26:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.892+0000 7f839a7fc700 1 -- 172.21.15.88:0/3352124802 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c017630 con 0x7f839c14fea0 2023-05-17T12:26:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.893+0000 7f83a1dff700 1 -- 172.21.15.88:0/3352124802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c14fea0 msgr2=0x7f839c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.893+0000 7f83a1dff700 1 --2- 172.21.15.88:0/3352124802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c14fea0 0x7f839c06e940 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f838c00bb90 tx=0x7f838c00bea0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.893+0000 7f83a1dff700 1 -- 172.21.15.88:0/3352124802 shutdown_connections 2023-05-17T12:26:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.893+0000 7f83a1dff700 1 --2- 172.21.15.88:0/3352124802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c14fea0 0x7f839c06e940 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.893+0000 7f83a1dff700 1 --2- 172.21.15.88:0/3352124802 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839c0717b0 0x7f839c071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.893+0000 7f83a1dff700 1 -- 172.21.15.88:0/3352124802 >> 172.21.15.88:0/3352124802 conn(0x7f839c0cecb0 msgr2=0x7f839c0cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.893+0000 7f83a1dff700 1 -- 172.21.15.88:0/3352124802 shutdown_connections 2023-05-17T12:26:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.893+0000 7f83a1dff700 1 -- 172.21.15.88:0/3352124802 wait complete. 2023-05-17T12:26:43.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.895+0000 7f83a1dff700 1 Processor -- start 2023-05-17T12:26:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.895+0000 7f83a1dff700 1 -- start start 2023-05-17T12:26:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f83a1dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c0717b0 0x7f839c0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f83a1dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f839c14fea0 0x7f839c0c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f83a1dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839c1591c0 0x7f839c1f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f83a1dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0c4b70 con 0x7f839c0717b0 2023-05-17T12:26:43.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f83a1dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0c4e10 con 0x7f839c14fea0 2023-05-17T12:26:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f83a1dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0c50f0 con 0x7f839c1591c0 2023-05-17T12:26:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f839b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c0717b0 0x7f839c0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f839b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c0717b0 0x7f839c0b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50288/0 (socket says 172.21.15.88:50288) 2023-05-17T12:26:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f839b7fe700 1 -- 172.21.15.88:0/1592387942 learned_addr learned my addr 172.21.15.88:0/1592387942 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f839b7fe700 1 -- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839c1591c0 msgr2=0x7f839c1f5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f839b7fe700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839c1591c0 0x7f839c1f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f839b7fe700 1 -- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f839c14fea0 msgr2=0x7f839c0c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f839b7fe700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f839c14fea0 0x7f839c0c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f839b7fe700 1 -- 172.21.15.88:0/1592387942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c00b7f0 con 0x7f839c0717b0 2023-05-17T12:26:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.896+0000 7f839b7fe700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c0717b0 0x7f839c0b44f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f838c019040 tx=0x7f838c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.897+0000 7f8383fff700 1 -- 172.21.15.88:0/1592387942 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c004050 con 0x7f839c0717b0 2023-05-17T12:26:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.897+0000 7f8383fff700 1 -- 172.21.15.88:0/1592387942 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c0041d0 con 0x7f839c0717b0 2023-05-17T12:26:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.897+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c06de60 con 0x7f839c0717b0 2023-05-17T12:26:43.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.897+0000 7f8383fff700 1 -- 172.21.15.88:0/1592387942 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c004580 con 0x7f839c0717b0 2023-05-17T12:26:43.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.897+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c159f40 con 0x7f839c0717b0 2023-05-17T12:26:43.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.898+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c06e140 con 0x7f839c0717b0 2023-05-17T12:26:43.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.899+0000 7f8383fff700 1 -- 172.21.15.88:0/1592387942 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f838c015070 con 0x7f839c0717b0 2023-05-17T12:26:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.900+0000 7f8383fff700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f838806ace0 0x7f838806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.900+0000 7f8383fff700 1 -- 172.21.15.88:0/1592387942 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f838c08af10 con 0x7f839c0717b0 2023-05-17T12:26:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.900+0000 7f839affd700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f838806ace0 0x7f838806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:43.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.901+0000 7f839affd700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f838806ace0 0x7f838806d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f839c15be90 tx=0x7f8390008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:43.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:43.904+0000 7f8383fff700 1 -- 172.21.15.88:0/1592387942 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f838c055d50 con 0x7f839c0717b0 2023-05-17T12:26:44.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.101+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f839c06e140 con 0x7f839c0717b0 2023-05-17T12:26:44.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.759+0000 7f8383fff700 1 -- 172.21.15.88:0/1592387942 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f838c059370 con 0x7f839c0717b0 2023-05-17T12:26:44.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.763+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f838806ace0 msgr2=0x7f838806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:44.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.763+0000 7f83a1dff700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f838806ace0 0x7f838806d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f839c15be90 tx=0x7f8390008040 comp rx=0 tx=0).stop 2023-05-17T12:26:44.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.763+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c0717b0 msgr2=0x7f839c0b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:44.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.763+0000 7f83a1dff700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c0717b0 0x7f839c0b44f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f838c019040 tx=0x7f838c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:44.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.763+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 shutdown_connections 2023-05-17T12:26:44.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.763+0000 7f83a1dff700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f838806ace0 0x7f838806d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:44.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.763+0000 7f83a1dff700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f839c1591c0 0x7f839c1f5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:44.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.763+0000 7f83a1dff700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f839c0717b0 0x7f839c0b44f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:44.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.763+0000 7f83a1dff700 1 --2- 172.21.15.88:0/1592387942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f839c14fea0 0x7f839c0c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:44.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.764+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 >> 172.21.15.88:0/1592387942 conn(0x7f839c0cecb0 msgr2=0x7f839c0cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:44.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.764+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 shutdown_connections 2023-05-17T12:26:44.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.764+0000 7f83a1dff700 1 -- 172.21.15.88:0/1592387942 wait complete. 2023-05-17T12:26:44.769 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2023-05-17T12:26:44.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-17T12:26:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.975+0000 7fdb769ff700 1 Processor -- start 2023-05-17T12:26:44.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.975+0000 7fdb769ff700 1 -- start start 2023-05-17T12:26:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.976+0000 7fdb769ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb701598d0 0x7fdb7006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.976+0000 7fdb769ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7006e4b0 con 0x7fdb7014fea0 2023-05-17T12:26:44.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.976+0000 7fdb769ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb70159f40 con 0x7fdb70071ec0 2023-05-17T12:26:44.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.976+0000 7fdb769ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7015a220 con 0x7fdb701598d0 2023-05-17T12:26:44.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.977+0000 7fdb74f9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb701598d0 0x7fdb7006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:44.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.977+0000 7fdb74f9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb701598d0 0x7fdb7006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50296/0 (socket says 172.21.15.88:50296) 2023-05-17T12:26:44.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.977+0000 7fdb74f9c700 1 -- 172.21.15.88:0/610614722 learned_addr learned my addr 172.21.15.88:0/610614722 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.977+0000 7fdb74f9c700 1 -- 172.21.15.88:0/610614722 >> v1:172.21.15.187:6789/0 conn(0x7fdb70071ec0 legacy=0x7fdb701591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.977+0000 7fdb74f9c700 1 -- 172.21.15.88:0/610614722 >> v1:172.21.15.88:6789/0 conn(0x7fdb7014fea0 legacy=0x7fdb700717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:44.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.977+0000 7fdb74f9c700 1 -- 172.21.15.88:0/610614722 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7006de60 con 0x7fdb701598d0 2023-05-17T12:26:44.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.977+0000 7fdb6effd700 1 -- 172.21.15.88:0/610614722 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022728732 0 0) 0x7fdb7006e4b0 con 0x7fdb7014fea0 2023-05-17T12:26:44.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.977+0000 7fdb74f9c700 1 --2- 172.21.15.88:0/610614722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb701598d0 0x7fdb7006e940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009e50 tx=0x7fdb6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628c6c79d81b34f3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:44.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.977+0000 7fdb6effd700 1 -- 172.21.15.88:0/610614722 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800e070 con 0x7fdb701598d0 2023-05-17T12:26:44.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.978+0000 7fdb6effd700 1 -- 172.21.15.88:0/610614722 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6800b9c0 con 0x7fdb701598d0 2023-05-17T12:26:44.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.978+0000 7fdb6effd700 1 -- 172.21.15.88:0/610614722 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800bd70 con 0x7fdb701598d0 2023-05-17T12:26:44.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.978+0000 7fdb769ff700 1 -- 172.21.15.88:0/610614722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb701598d0 msgr2=0x7fdb7006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:44.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.978+0000 7fdb769ff700 1 --2- 172.21.15.88:0/610614722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb701598d0 0x7fdb7006e940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009e50 tx=0x7fdb6800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:44.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.978+0000 7fdb769ff700 1 -- 172.21.15.88:0/610614722 shutdown_connections 2023-05-17T12:26:44.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.978+0000 7fdb769ff700 1 --2- 172.21.15.88:0/610614722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb701598d0 0x7fdb7006e940 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:44.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.978+0000 7fdb769ff700 1 -- 172.21.15.88:0/610614722 >> 172.21.15.88:0/610614722 conn(0x7fdb700cecb0 msgr2=0x7fdb700cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:44.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.978+0000 7fdb769ff700 1 -- 172.21.15.88:0/610614722 shutdown_connections 2023-05-17T12:26:44.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.978+0000 7fdb769ff700 1 -- 172.21.15.88:0/610614722 wait complete. 2023-05-17T12:26:44.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.980+0000 7fdb769ff700 1 Processor -- start 2023-05-17T12:26:44.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.980+0000 7fdb769ff700 1 -- start start 2023-05-17T12:26:44.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb769ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb70071ec0 0x7fdb7014f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:44.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb769ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7014fea0 0x7fdb701472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:44.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb769ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb701598d0 0x7fdb700c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:44.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb769ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7014f740 con 0x7fdb70071ec0 2023-05-17T12:26:44.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb769ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb700c19d0 con 0x7fdb7014fea0 2023-05-17T12:26:44.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb769ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb70147810 con 0x7fdb701598d0 2023-05-17T12:26:44.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb6ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb70071ec0 0x7fdb7014f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:44.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb6ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb70071ec0 0x7fdb7014f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50306/0 (socket says 172.21.15.88:50306) 2023-05-17T12:26:44.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb6ffff700 1 -- 172.21.15.88:0/2047395330 learned_addr learned my addr 172.21.15.88:0/2047395330 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:44.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb74f9c700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb701598d0 0x7fdb700c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:44.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.981+0000 7fdb6f7fe700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7014fea0 0x7fdb701472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:44.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb6ffff700 1 -- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb701598d0 msgr2=0x7fdb700c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:44.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb6ffff700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb701598d0 0x7fdb700c05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:44.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb6ffff700 1 -- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7014fea0 msgr2=0x7fdb701472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:44.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb6ffff700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7014fea0 0x7fdb701472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:44.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb6ffff700 1 -- 172.21.15.88:0/2047395330 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68009b30 con 0x7fdb70071ec0 2023-05-17T12:26:44.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb6ffff700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb70071ec0 0x7fdb7014f200 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdb60001eb0 tx=0x7fdb6000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:44.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb6cff9700 1 -- 172.21.15.88:0/2047395330 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb600054e0 con 0x7fdb70071ec0 2023-05-17T12:26:44.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb6cff9700 1 -- 172.21.15.88:0/2047395330 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb60003680 con 0x7fdb70071ec0 2023-05-17T12:26:44.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb6cff9700 1 -- 172.21.15.88:0/2047395330 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb600039f0 con 0x7fdb70071ec0 2023-05-17T12:26:44.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb70070f20 con 0x7fdb70071ec0 2023-05-17T12:26:44.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.982+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7006e140 con 0x7fdb70071ec0 2023-05-17T12:26:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.983+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb700710b0 con 0x7fdb70071ec0 2023-05-17T12:26:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.984+0000 7fdb6cff9700 1 -- 172.21.15.88:0/2047395330 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb60003b50 con 0x7fdb70071ec0 2023-05-17T12:26:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.985+0000 7fdb6cff9700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb5c06ace0 0x7fdb5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.985+0000 7fdb6cff9700 1 -- 172.21.15.88:0/2047395330 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fdb600889d0 con 0x7fdb70071ec0 2023-05-17T12:26:44.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.986+0000 7fdb6f7fe700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb5c06ace0 0x7fdb5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:44.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.986+0000 7fdb6f7fe700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb5c06ace0 0x7fdb5c06d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdb70145e50 tx=0x7fdb64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:44.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:44.990+0000 7fdb6cff9700 1 -- 172.21.15.88:0/2047395330 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdb600538c0 con 0x7fdb70071ec0 2023-05-17T12:26:45.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.183+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdb70074530 con 0x7fdb70071ec0 2023-05-17T12:26:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.763+0000 7fdb6cff9700 1 -- 172.21.15.88:0/2047395330 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdb60056ee0 con 0x7fdb70071ec0 2023-05-17T12:26:45.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.766+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb5c06ace0 msgr2=0x7fdb5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:45.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.766+0000 7fdb769ff700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb5c06ace0 0x7fdb5c06d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdb70145e50 tx=0x7fdb64009040 comp rx=0 tx=0).stop 2023-05-17T12:26:45.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb70071ec0 msgr2=0x7fdb7014f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:45.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb70071ec0 0x7fdb7014f200 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdb60001eb0 tx=0x7fdb6000c800 comp rx=0 tx=0).stop 2023-05-17T12:26:45.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 shutdown_connections 2023-05-17T12:26:45.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fdb5c06ace0 0x7fdb5c06d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:45.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb701598d0 0x7fdb700c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:45.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb70071ec0 0x7fdb7014f200 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:45.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 --2- 172.21.15.88:0/2047395330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb7014fea0 0x7fdb701472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:45.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 >> 172.21.15.88:0/2047395330 conn(0x7fdb700cecb0 msgr2=0x7fdb700b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:45.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 shutdown_connections 2023-05-17T12:26:45.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.767+0000 7fdb769ff700 1 -- 172.21.15.88:0/2047395330 wait complete. 2023-05-17T12:26:45.773 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2023-05-17T12:26:45.789 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-05-17T12:26:45.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.978+0000 7f99629ff700 1 Processor -- start 2023-05-17T12:26:45.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.978+0000 7f99629ff700 1 -- start start 2023-05-17T12:26:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.979+0000 7f99629ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c15c840 0x7f995c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.979+0000 7f99629ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f995c06b0b0 0x7f995c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.979+0000 7f99629ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995c0cd6b0 con 0x7f995c06c330 2023-05-17T12:26:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.979+0000 7f99629ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0cdf50 con 0x7f995c06b0b0 2023-05-17T12:26:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.979+0000 7f99629ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0cf860 con 0x7f995c15c840 2023-05-17T12:26:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.979+0000 7f9960f9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f995c06c330 0x7f995c160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36448/0 (socket says 172.21.15.88:36448) 2023-05-17T12:26:45.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.979+0000 7f9960f9c700 1 -- 172.21.15.88:0/2818601783 learned_addr learned my addr 172.21.15.88:0/2818601783 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:45.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.979+0000 7f995b7fe700 1 --2- 172.21.15.88:0/2818601783 >> v2:172.21.15.187:3300/0 conn(0x7f995c06b0b0 0x7f995c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:45.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.979+0000 7f995bfff700 1 --2- 172.21.15.88:0/2818601783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c15c840 0x7f995c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:45.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995affd700 1 -- 172.21.15.88:0/2818601783 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349063844 0 0) 0x7f995c0cd6b0 con 0x7f995c06c330 2023-05-17T12:26:45.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995affd700 1 -- 172.21.15.88:0/2818601783 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99440035b0 con 0x7f995c06c330 2023-05-17T12:26:45.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995b7fe700 1 -- 172.21.15.88:0/2818601783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c15c840 msgr2=0x7f995c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:45.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995b7fe700 1 --2- 172.21.15.88:0/2818601783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c15c840 0x7f995c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:45.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995b7fe700 1 -- 172.21.15.88:0/2818601783 >> v1:172.21.15.88:6789/0 conn(0x7f995c06c330 legacy=0x7f995c160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:45.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995b7fe700 1 -- 172.21.15.88:0/2818601783 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c0b2460 con 0x7f995c06b0b0 2023-05-17T12:26:45.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995bfff700 1 --2- 172.21.15.88:0/2818601783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c15c840 0x7f995c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:45.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995b7fe700 1 --2- 172.21.15.88:0/2818601783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f995c06b0b0 0x7f995c0cf320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9950009840 tx=0x7f9950009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac6ca53aeff7b21c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:45.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995affd700 1 -- 172.21.15.88:0/2818601783 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950011830 con 0x7f995c06b0b0 2023-05-17T12:26:45.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995affd700 1 -- 172.21.15.88:0/2818601783 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950011990 con 0x7f995c06b0b0 2023-05-17T12:26:45.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.980+0000 7f995affd700 1 -- 172.21.15.88:0/2818601783 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950011d20 con 0x7f995c06b0b0 2023-05-17T12:26:45.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.981+0000 7f99629ff700 1 -- 172.21.15.88:0/2818601783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f995c06b0b0 msgr2=0x7f995c0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:45.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.981+0000 7f99629ff700 1 --2- 172.21.15.88:0/2818601783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f995c06b0b0 0x7f995c0cf320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9950009840 tx=0x7f9950009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:45.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.981+0000 7f99629ff700 1 -- 172.21.15.88:0/2818601783 shutdown_connections 2023-05-17T12:26:45.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.981+0000 7f99629ff700 1 --2- 172.21.15.88:0/2818601783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c15c840 0x7f995c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:45.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.981+0000 7f99629ff700 1 --2- 172.21.15.88:0/2818601783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f995c06b0b0 0x7f995c0cf320 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:45.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.981+0000 7f99629ff700 1 -- 172.21.15.88:0/2818601783 >> 172.21.15.88:0/2818601783 conn(0x7f995c0d3060 msgr2=0x7f995c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:45.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.981+0000 7f99629ff700 1 -- 172.21.15.88:0/2818601783 shutdown_connections 2023-05-17T12:26:45.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.981+0000 7f99629ff700 1 -- 172.21.15.88:0/2818601783 wait complete. 2023-05-17T12:26:45.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.983+0000 7f99629ff700 1 Processor -- start 2023-05-17T12:26:45.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.983+0000 7f99629ff700 1 -- start start 2023-05-17T12:26:45.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f99629ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f995c06b0b0 0x7f995c157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:45.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f99629ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c06c330 0x7f995c1e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:45.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f99629ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995c15c840 0x7f995c1e67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:45.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f99629ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c15e050 con 0x7f995c15c840 2023-05-17T12:26:45.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f99629ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c15d440 con 0x7f995c06b0b0 2023-05-17T12:26:45.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f99629ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c15d720 con 0x7f995c06c330 2023-05-17T12:26:45.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f9960f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995c15c840 0x7f995c1e67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:45.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f9960f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995c15c840 0x7f995c1e67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50318/0 (socket says 172.21.15.88:50318) 2023-05-17T12:26:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f9960f9c700 1 -- 172.21.15.88:0/2397438211 learned_addr learned my addr 172.21.15.88:0/2397438211 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f995bfff700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f995c06b0b0 0x7f995c157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f995b7fe700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c06c330 0x7f995c1e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f9960f9c700 1 -- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c06c330 msgr2=0x7f995c1e62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f9960f9c700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c06c330 0x7f995c1e62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f9960f9c700 1 -- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f995c06b0b0 msgr2=0x7f995c157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:45.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f9960f9c700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f995c06b0b0 0x7f995c157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.984+0000 7f9960f9c700 1 -- 172.21.15.88:0/2397438211 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0094a0 con 0x7f995c15c840 2023-05-17T12:26:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.985+0000 7f9960f9c700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995c15c840 0x7f995c1e67e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f995400cb40 tx=0x7f995400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.985+0000 7f9958ff9700 1 -- 172.21.15.88:0/2397438211 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995400ab50 con 0x7f995c15c840 2023-05-17T12:26:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.985+0000 7f9958ff9700 1 -- 172.21.15.88:0/2397438211 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995400acb0 con 0x7f995c15c840 2023-05-17T12:26:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.985+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99500094a0 con 0x7f995c15c840 2023-05-17T12:26:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.985+0000 7f9958ff9700 1 -- 172.21.15.88:0/2397438211 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954012620 con 0x7f995c15c840 2023-05-17T12:26:45.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.985+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c0cd900 con 0x7f995c15c840 2023-05-17T12:26:45.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.986+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c0b2740 con 0x7f995c15c840 2023-05-17T12:26:45.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.987+0000 7f9958ff9700 1 -- 172.21.15.88:0/2397438211 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f995401b3b0 con 0x7f995c15c840 2023-05-17T12:26:45.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.988+0000 7f9958ff9700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f994806ace0 0x7f994806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:45.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.988+0000 7f9958ff9700 1 -- 172.21.15.88:0/2397438211 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f9954089250 con 0x7f995c15c840 2023-05-17T12:26:45.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.988+0000 7f995bfff700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f994806ace0 0x7f994806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:45.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.989+0000 7f995bfff700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f994806ace0 0x7f994806d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f994c009c60 tx=0x7f994c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:45.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:45.992+0000 7f9958ff9700 1 -- 172.21.15.88:0/2397438211 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f99540543a0 con 0x7f995c15c840 2023-05-17T12:26:46.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.185+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f995c0cdbe0 con 0x7f995c15c840 2023-05-17T12:26:46.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.765+0000 7f9958ff9700 1 -- 172.21.15.88:0/2397438211 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f99540579c0 con 0x7f995c15c840 2023-05-17T12:26:46.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f994806ace0 msgr2=0x7f994806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:46.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f994806ace0 0x7f994806d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f994c009c60 tx=0x7f994c008040 comp rx=0 tx=0).stop 2023-05-17T12:26:46.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995c15c840 msgr2=0x7f995c1e67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:46.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995c15c840 0x7f995c1e67e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f995400cb40 tx=0x7f995400cf00 comp rx=0 tx=0).stop 2023-05-17T12:26:46.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 shutdown_connections 2023-05-17T12:26:46.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f994806ace0 0x7f994806d190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:46.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995c15c840 0x7f995c1e67e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:46.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f995c06b0b0 0x7f995c157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:46.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 --2- 172.21.15.88:0/2397438211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f995c06c330 0x7f995c1e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:46.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 >> 172.21.15.88:0/2397438211 conn(0x7f995c0d3060 msgr2=0x7f995c0ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:46.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 shutdown_connections 2023-05-17T12:26:46.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:46.769+0000 7f99629ff700 1 -- 172.21.15.88:0/2397438211 wait complete. 2023-05-17T12:26:46.775 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data_ec' removed 2023-05-17T12:26:46.792 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-17T12:26:46.793 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-17T12:26:46.793 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-17T12:26:46.793 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T12:26:46.793 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-17T12:26:46.794 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-17T12:26:46.794 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-17T12:26:46.794 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T12:26:46.794 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-17T12:26:46.794 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-17T12:26:46.795 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-17T12:26:46.795 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T12:26:46.795 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-17T12:26:46.795 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-17T12:26:46.796 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-17T12:26:46.796 INFO:teuthology.orchestra.run:waiting for 300 2023-05-17T12:26:46.806 INFO:tasks.ceph.mds.a:Stopped 2023-05-17T12:26:46.806 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-17T12:26:46.808 INFO:tasks.ceph.mds.c:Stopped 2023-05-17T12:26:46.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-17T12:26:46.813 INFO:tasks.ceph.mds.d:Stopped 2023-05-17T12:26:46.813 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-17T12:26:46.814 INFO:tasks.ceph.mds.b:Stopped 2023-05-17T12:26:46.814 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-17T12:26:46.851 INFO:tasks.ceph.mds.a:Started 2023-05-17T12:26:46.851 DEBUG:teuthology.parallel:result is None 2023-05-17T12:26:46.854 INFO:tasks.ceph.mds.c:Started 2023-05-17T12:26:46.855 DEBUG:teuthology.parallel:result is None 2023-05-17T12:26:46.857 INFO:tasks.ceph.mds.d:Started 2023-05-17T12:26:46.857 DEBUG:teuthology.parallel:result is None 2023-05-17T12:26:46.859 INFO:tasks.ceph.mds.b:Started 2023-05-17T12:26:46.860 DEBUG:teuthology.parallel:result is None 2023-05-17T12:26:46.860 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-17T12:26:46.999 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-05-17T12:26:47.000 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-05-17T12:26:47.001 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-05-17T12:26:47.003 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-05-17T12:26:47.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.066+0000 7f94e6dff700 1 Processor -- start 2023-05-17T12:26:47.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.067+0000 7f94e6dff700 1 -- start start 2023-05-17T12:26:47.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.068+0000 7f94e6dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a1e0 0x7f94e00cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:47.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.068+0000 7f94e6dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e015cee0 con 0x7f94e015a5b0 2023-05-17T12:26:47.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.068+0000 7f94e6dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00b3940 con 0x7f94e01604d0 2023-05-17T12:26:47.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.068+0000 7f94e6dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0160960 con 0x7f94e015a1e0 2023-05-17T12:26:47.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.068+0000 7f94e539c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f94e015a5b0 0x7f94e00cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36478/0 (socket says 172.21.15.88:36478) 2023-05-17T12:26:47.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.068+0000 7f94e539c700 1 -- 172.21.15.88:0/4091801317 learned_addr learned my addr 172.21.15.88:0/4091801317 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:47.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.068+0000 7f94e4b9b700 1 --2- 172.21.15.88:0/4091801317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a1e0 0x7f94e00cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.068+0000 7f94df7fe700 1 -- 172.21.15.88:0/4091801317 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237395348 0 0) 0x7f94e015cee0 con 0x7f94e015a5b0 2023-05-17T12:26:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.068+0000 7f94df7fe700 1 -- 172.21.15.88:0/4091801317 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d00035b0 con 0x7f94e015a5b0 2023-05-17T12:26:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.069+0000 7f94e4b9b700 1 -- 172.21.15.88:0/4091801317 >> v1:172.21.15.187:6789/0 conn(0x7f94e01604d0 legacy=0x7f94e00b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.069+0000 7f94df7fe700 1 -- 172.21.15.88:0/4091801317 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293059221 0 0) 0x7f94e00b3940 con 0x7f94e01604d0 2023-05-17T12:26:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.069+0000 7f94e4b9b700 1 -- 172.21.15.88:0/4091801317 >> v1:172.21.15.88:6789/0 conn(0x7f94e015a5b0 legacy=0x7f94e00cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.069+0000 7f94e4b9b700 1 -- 172.21.15.88:0/4091801317 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0160c40 con 0x7f94e015a1e0 2023-05-17T12:26:47.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.069+0000 7f94e4b9b700 1 --2- 172.21.15.88:0/4091801317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a1e0 0x7f94e00cb510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009870 tx=0x7f94d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be109afaf01e0db4 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.069+0000 7f94df7fe700 1 -- 172.21.15.88:0/4091801317 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4011830 con 0x7f94e015a1e0 2023-05-17T12:26:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.069+0000 7f94df7fe700 1 -- 172.21.15.88:0/4091801317 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4011990 con 0x7f94e015a1e0 2023-05-17T12:26:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.069+0000 7f94df7fe700 1 -- 172.21.15.88:0/4091801317 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4011d20 con 0x7f94e015a1e0 2023-05-17T12:26:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.070+0000 7f94e6dff700 1 -- 172.21.15.88:0/4091801317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a1e0 msgr2=0x7f94e00cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.070+0000 7f94e6dff700 1 --2- 172.21.15.88:0/4091801317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a1e0 0x7f94e00cb510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009870 tx=0x7f94d4009b80 comp rx=0 tx=0).stop 2023-05-17T12:26:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.070+0000 7f94e6dff700 1 -- 172.21.15.88:0/4091801317 shutdown_connections 2023-05-17T12:26:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.070+0000 7f94e6dff700 1 --2- 172.21.15.88:0/4091801317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a1e0 0x7f94e00cb510 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:47.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.070+0000 7f94e6dff700 1 -- 172.21.15.88:0/4091801317 >> 172.21.15.88:0/4091801317 conn(0x7f94e006e0c0 msgr2=0x7f94e006e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:47.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.070+0000 7f94e6dff700 1 -- 172.21.15.88:0/4091801317 shutdown_connections 2023-05-17T12:26:47.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.070+0000 7f94e6dff700 1 -- 172.21.15.88:0/4091801317 wait complete. 2023-05-17T12:26:47.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.071+0000 7f94e6dff700 1 Processor -- start 2023-05-17T12:26:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.072+0000 7f94e6dff700 1 -- start start 2023-05-17T12:26:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.072+0000 7f94e6dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e015a1e0 0x7f94e01513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.072+0000 7f94e6dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a5b0 0x7f94e00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e6dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01604d0 0x7f94e00b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e6dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00b6c10 con 0x7f94e015a1e0 2023-05-17T12:26:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e6dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c81c0 con 0x7f94e01604d0 2023-05-17T12:26:47.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e6dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c84a0 con 0x7f94e015a5b0 2023-05-17T12:26:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e4b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e015a1e0 0x7f94e01513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e4b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e015a1e0 0x7f94e01513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50336/0 (socket says 172.21.15.88:50336) 2023-05-17T12:26:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e4b9b700 1 -- 172.21.15.88:0/478953981 learned_addr learned my addr 172.21.15.88:0/478953981 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94dffff700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a5b0 0x7f94e00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e539c700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01604d0 0x7f94e00b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e4b9b700 1 -- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a5b0 msgr2=0x7f94e00b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e4b9b700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a5b0 0x7f94e00b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:47.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e4b9b700 1 -- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01604d0 msgr2=0x7f94e00b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e4b9b700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01604d0 0x7f94e00b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e4b9b700 1 -- 172.21.15.88:0/478953981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d40094a0 con 0x7f94e015a1e0 2023-05-17T12:26:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e539c700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01604d0 0x7f94e00b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.073+0000 7f94e4b9b700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e015a1e0 0x7f94e01513f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f94d40090b0 tx=0x7f94d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.074+0000 7f94dd7fa700 1 -- 172.21.15.88:0/478953981 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d401a910 con 0x7f94e015a1e0 2023-05-17T12:26:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.074+0000 7f94dd7fa700 1 -- 172.21.15.88:0/478953981 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d401aa70 con 0x7f94e015a1e0 2023-05-17T12:26:47.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.074+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e0161200 con 0x7f94e015a1e0 2023-05-17T12:26:47.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.074+0000 7f94dd7fa700 1 -- 172.21.15.88:0/478953981 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d401ade0 con 0x7f94e015a1e0 2023-05-17T12:26:47.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.074+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e0160f20 con 0x7f94e015a1e0 2023-05-17T12:26:47.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.075+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00cba50 con 0x7f94e015a1e0 2023-05-17T12:26:47.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.076+0000 7f94dd7fa700 1 -- 172.21.15.88:0/478953981 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94d4022070 con 0x7f94e015a1e0 2023-05-17T12:26:47.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.077+0000 7f94dd7fa700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94c406ace0 0x7f94c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:47.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.077+0000 7f94dd7fa700 1 -- 172.21.15.88:0/478953981 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f94d408a5f0 con 0x7f94e015a1e0 2023-05-17T12:26:47.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.077+0000 7f94dffff700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94c406ace0 0x7f94c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:47.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.078+0000 7f94dffff700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94c406ace0 0x7f94c406d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94e01f5ce0 tx=0x7f94cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:47.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.081+0000 7f94dd7fa700 1 -- 172.21.15.88:0/478953981 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f94d4055990 con 0x7f94e015a1e0 2023-05-17T12:26:47.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:47.291+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f94e0074530 con 0x7f94e015a1e0 2023-05-17T12:26:48.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.045+0000 7f94dd7fa700 1 -- 172.21.15.88:0/478953981 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7f94d4058fb0 con 0x7f94e015a1e0 2023-05-17T12:26:48.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94c406ace0 msgr2=0x7f94c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94c406ace0 0x7f94c406d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94e01f5ce0 tx=0x7f94cc009040 comp rx=0 tx=0).stop 2023-05-17T12:26:48.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e015a1e0 msgr2=0x7f94e01513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e015a1e0 0x7f94e01513f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f94d40090b0 tx=0x7f94d4004750 comp rx=0 tx=0).stop 2023-05-17T12:26:48.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 shutdown_connections 2023-05-17T12:26:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f94c406ace0 0x7f94c406d190 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01604d0 0x7f94e00b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e015a1e0 0x7f94e01513f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 --2- 172.21.15.88:0/478953981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015a5b0 0x7f94e00b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 >> 172.21.15.88:0/478953981 conn(0x7f94e006e0c0 msgr2=0x7f94e0158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 shutdown_connections 2023-05-17T12:26:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.048+0000 7f94e6dff700 1 -- 172.21.15.88:0/478953981 wait complete. 2023-05-17T12:26:48.054 INFO:teuthology.orchestra.run.smithi088.stderr: removed all blocklist entries 2023-05-17T12:26:48.070 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-17T12:26:48.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.251+0000 7fae8c5ff700 1 Processor -- start 2023-05-17T12:26:48.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.252+0000 7fae8c5ff700 1 -- start start 2023-05-17T12:26:48.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.253+0000 7fae8c5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae84071540 0x7fae840cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.253+0000 7fae8c5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae840ce0d0 0x7fae840ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.253+0000 7fae8c5ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae841599b0 con 0x7fae841595e0 2023-05-17T12:26:48.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.253+0000 7fae8c5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae840ce570 con 0x7fae840ce0d0 2023-05-17T12:26:48.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.253+0000 7fae8c5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8415e000 con 0x7fae84071540 2023-05-17T12:26:48.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.253+0000 7fae8ab9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae840ce0d0 0x7fae840ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.253+0000 7fae8ab9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae840ce0d0 0x7fae840ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50352/0 (socket says 172.21.15.88:50352) 2023-05-17T12:26:48.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.253+0000 7fae8ab9c700 1 -- 172.21.15.88:0/504536495 learned_addr learned my addr 172.21.15.88:0/504536495 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:48.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.253+0000 7fae89b9a700 1 --2- 172.21.15.88:0/504536495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae84071540 0x7fae840cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.254+0000 7fae8ab9c700 1 -- 172.21.15.88:0/504536495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae84071540 msgr2=0x7fae840cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:48.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.254+0000 7fae8ab9c700 1 --2- 172.21.15.88:0/504536495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae84071540 0x7fae840cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.254+0000 7fae8ab9c700 1 -- 172.21.15.88:0/504536495 >> v1:172.21.15.187:6789/0 conn(0x7fae841595e0 legacy=0x7fae84070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.254+0000 7fae8ab9c700 1 -- 172.21.15.88:0/504536495 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae840cca80 con 0x7fae840ce0d0 2023-05-17T12:26:48.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.254+0000 7fae89b9a700 1 --2- 172.21.15.88:0/504536495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae84071540 0x7fae840cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:48.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.254+0000 7fae8ab9c700 1 --2- 172.21.15.88:0/504536495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae840ce0d0 0x7fae840ca270 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009e50 tx=0x7fae7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108821327059534 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:48.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.254+0000 7fae89399700 1 -- 172.21.15.88:0/504536495 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00bbc0 con 0x7fae840ce0d0 2023-05-17T12:26:48.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.254+0000 7fae89399700 1 -- 172.21.15.88:0/504536495 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c00bd20 con 0x7fae840ce0d0 2023-05-17T12:26:48.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.254+0000 7fae89399700 1 -- 172.21.15.88:0/504536495 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0116a0 con 0x7fae840ce0d0 2023-05-17T12:26:48.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.255+0000 7fae8c5ff700 1 -- 172.21.15.88:0/504536495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae840ce0d0 msgr2=0x7fae840ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.255+0000 7fae8c5ff700 1 --2- 172.21.15.88:0/504536495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae840ce0d0 0x7fae840ca270 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009e50 tx=0x7fae7c00b330 comp rx=0 tx=0).stop 2023-05-17T12:26:48.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.255+0000 7fae8c5ff700 1 -- 172.21.15.88:0/504536495 shutdown_connections 2023-05-17T12:26:48.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.255+0000 7fae8c5ff700 1 --2- 172.21.15.88:0/504536495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae840ce0d0 0x7fae840ca270 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.255+0000 7fae8c5ff700 1 --2- 172.21.15.88:0/504536495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae84071540 0x7fae840cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.255+0000 7fae8c5ff700 1 -- 172.21.15.88:0/504536495 >> 172.21.15.88:0/504536495 conn(0x7fae840ced10 msgr2=0x7fae840cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:48.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.255+0000 7fae8c5ff700 1 -- 172.21.15.88:0/504536495 shutdown_connections 2023-05-17T12:26:48.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.255+0000 7fae8c5ff700 1 -- 172.21.15.88:0/504536495 wait complete. 2023-05-17T12:26:48.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.256+0000 7fae8c5ff700 1 Processor -- start 2023-05-17T12:26:48.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.257+0000 7fae8c5ff700 1 -- start start 2023-05-17T12:26:48.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.257+0000 7fae8c5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae84071540 0x7fae841546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.257+0000 7fae8c5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae840ce0d0 0x7fae841f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8c5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae841595e0 0x7fae841f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8c5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae841f6bc0 con 0x7fae84071540 2023-05-17T12:26:48.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8c5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae841f25d0 con 0x7fae841595e0 2023-05-17T12:26:48.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8c5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae841f6600 con 0x7fae840ce0d0 2023-05-17T12:26:48.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8a39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae84071540 0x7fae841546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8a39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae84071540 0x7fae841546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50356/0 (socket says 172.21.15.88:50356) 2023-05-17T12:26:48.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8a39b700 1 -- 172.21.15.88:0/3045486807 learned_addr learned my addr 172.21.15.88:0/3045486807 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:48.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae89b9a700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae840ce0d0 0x7fae841f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8ab9c700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae841595e0 0x7fae841f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8a39b700 1 -- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae840ce0d0 msgr2=0x7fae841f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8a39b700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae840ce0d0 0x7fae841f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8a39b700 1 -- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae841595e0 msgr2=0x7fae841f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8a39b700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae841595e0 0x7fae841f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.258+0000 7fae8a39b700 1 -- 172.21.15.88:0/3045486807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c009b30 con 0x7fae84071540 2023-05-17T12:26:48.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.259+0000 7fae8a39b700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae84071540 0x7fae841546a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fae8000c450 tx=0x7fae8000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.259+0000 7fae7affd700 1 -- 172.21.15.88:0/3045486807 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800052d0 con 0x7fae84071540 2023-05-17T12:26:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.259+0000 7fae7affd700 1 -- 172.21.15.88:0/3045486807 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae80005430 con 0x7fae84071540 2023-05-17T12:26:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.259+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae840cd040 con 0x7fae84071540 2023-05-17T12:26:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.259+0000 7fae7affd700 1 -- 172.21.15.88:0/3045486807 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800038c0 con 0x7fae84071540 2023-05-17T12:26:48.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.259+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae840ccd60 con 0x7fae84071540 2023-05-17T12:26:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.260+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae840cd320 con 0x7fae84071540 2023-05-17T12:26:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.261+0000 7fae7affd700 1 -- 172.21.15.88:0/3045486807 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae80003a20 con 0x7fae84071540 2023-05-17T12:26:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.262+0000 7fae7affd700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae6806ace0 0x7fae6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.262+0000 7fae7affd700 1 -- 172.21.15.88:0/3045486807 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fae80088630 con 0x7fae84071540 2023-05-17T12:26:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.262+0000 7fae89b9a700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae6806ace0 0x7fae6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.263+0000 7fae89b9a700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae6806ace0 0x7fae6806d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae840c6120 tx=0x7fae74008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:48.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.266+0000 7fae7affd700 1 -- 172.21.15.88:0/3045486807 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fae80053850 con 0x7fae84071540 2023-05-17T12:26:48.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.534+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fae840cd560 con 0x7fae84071540 2023-05-17T12:26:48.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.535+0000 7fae7affd700 1 -- 172.21.15.88:0/3045486807 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fae8000ce60 con 0x7fae84071540 2023-05-17T12:26:48.540 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:48.540 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-05-17T12:26:48.540 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_dump": [ 2023-05-17T12:26:48.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.541 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.a", 2023-05-17T12:26:48.541 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBdx2RkJwtTHBAAPMdL+AKW5o+hNc22xgIADg==", 2023-05-17T12:26:48.542 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.542 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-05-17T12:26:48.542 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-05-17T12:26:48.542 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-05-17T12:26:48.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.543 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.544 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.b", 2023-05-17T12:26:48.544 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBdx2Rkplb7MRAA92QM43QQm/XEeWFeBESiYA==", 2023-05-17T12:26:48.545 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.545 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-05-17T12:26:48.545 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-05-17T12:26:48.545 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-05-17T12:26:48.545 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.546 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.546 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.c", 2023-05-17T12:26:48.547 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBdx2RkVng3JxAAg7HmTFwFc04cSTzN1YHYxQ==", 2023-05-17T12:26:48.547 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.547 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-05-17T12:26:48.547 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-05-17T12:26:48.548 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-05-17T12:26:48.548 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.549 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.d", 2023-05-17T12:26:48.549 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBex2Rki5LkABAA+Pmbr5jS8aZKTG2KesV7tg==", 2023-05-17T12:26:48.549 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.549 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-05-17T12:26:48.549 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-05-17T12:26:48.550 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-05-17T12:26:48.550 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.550 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.550 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.0", 2023-05-17T12:26:48.550 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBhx2Rkrpz0MhAAf91/kLGMbxxsj1vXVCTPSw==", 2023-05-17T12:26:48.550 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.551 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-05-17T12:26:48.551 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-05-17T12:26:48.551 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.551 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.552 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.1", 2023-05-17T12:26:48.552 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBkx2RkKjG2OBAA4NREeQryhvG0UpX8K2EAcg==", 2023-05-17T12:26:48.552 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.552 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-05-17T12:26:48.552 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-05-17T12:26:48.552 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.553 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.553 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.2", 2023-05-17T12:26:48.553 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBox2RkAHxaAxAAHUZoN5ymy+f9o/eFwinpew==", 2023-05-17T12:26:48.554 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.554 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-05-17T12:26:48.554 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-05-17T12:26:48.554 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.555 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.3", 2023-05-17T12:26:48.555 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBrx2RkD2dWCRAAyRKsbOLvWkvMrd5GTO+oJQ==", 2023-05-17T12:26:48.555 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.555 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-05-17T12:26:48.555 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-05-17T12:26:48.555 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.555 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.556 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.4", 2023-05-17T12:26:48.556 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBxx2Rka/MgHRAAXkuBP3JOWToC79EG7wBb9A==", 2023-05-17T12:26:48.556 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.556 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-05-17T12:26:48.556 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-05-17T12:26:48.557 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.557 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.557 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.5", 2023-05-17T12:26:48.557 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB0x2RkI0RPHxAAM/QelMN8dN6RYjPyNSnmCA==", 2023-05-17T12:26:48.557 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.558 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-05-17T12:26:48.558 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-05-17T12:26:48.558 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.558 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.558 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.6", 2023-05-17T12:26:48.558 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB3x2RkKDWUIRAAb3tIM1X1KyKQrhA969KDhA==", 2023-05-17T12:26:48.559 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.559 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-05-17T12:26:48.559 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-05-17T12:26:48.559 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.559 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.560 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.7", 2023-05-17T12:26:48.560 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQB6x2RkDr1kJBAAuJVGm/HZi7sY32t+fv4vXg==", 2023-05-17T12:26:48.561 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.561 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-05-17T12:26:48.561 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-05-17T12:26:48.561 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.562 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.562 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.0", 2023-05-17T12:26:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBex2Rk1nFUChAAukmFEq3MViAijh8ZXu6IBg==", 2023-05-17T12:26:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-05-17T12:26:48.563 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-05-17T12:26:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-05-17T12:26:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-05-17T12:26:48.564 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.1", 2023-05-17T12:26:48.565 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBex2RkuN86GBAAolpFFOo7rt9jPOjir69P6A==", 2023-05-17T12:26:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-05-17T12:26:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-05-17T12:26:48.566 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-05-17T12:26:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-05-17T12:26:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.2", 2023-05-17T12:26:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBex2RkiZZFERAAjurF568X0kJDp7BDda+LpQ==", 2023-05-17T12:26:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-05-17T12:26:48.568 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-05-17T12:26:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-05-17T12:26:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-05-17T12:26:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.3", 2023-05-17T12:26:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBex2RkB8gkHxAA0X3OADTiAFMkW2lkoHWrdQ==", 2023-05-17T12:26:48.570 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-05-17T12:26:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-05-17T12:26:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-05-17T12:26:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-05-17T12:26:48.571 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.572 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.admin", 2023-05-17T12:26:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBcx2RkErskJBAAMcDoKQHBdwUg8T39t5Of7g==", 2023-05-17T12:26:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-05-17T12:26:48.573 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-05-17T12:26:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-05-17T12:26:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.574 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mds", 2023-05-17T12:26:48.575 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCCx2RkidczEBAA3uixJKKJGmVTfsBh18qxMw==", 2023-05-17T12:26:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mds" 2023-05-17T12:26:48.576 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mgr", 2023-05-17T12:26:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCCx2RkK+EzEBAAL9J/sEwH1R4YBntAaZkCZw==", 2023-05-17T12:26:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-17T12:26:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-osd", 2023-05-17T12:26:48.578 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCCx2Rk4+kzEBAA9SZyISJgqaS8daIgfKNV/g==", 2023-05-17T12:26:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-osd" 2023-05-17T12:26:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.579 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd", 2023-05-17T12:26:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCCx2RkQfIzEBAABQauW6wai4JNqZtYWMnu1A==", 2023-05-17T12:26:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-17T12:26:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.580 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-17T12:26:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCCx2Rk7vozEBAAvmwMDHjGRQIf74tGKLBXqg==", 2023-05-17T12:26:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-17T12:26:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rgw", 2023-05-17T12:26:48.581 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQCCx2RktAU0EBAAANZDpdm7SjivMt749MkSBQ==", 2023-05-17T12:26:48.582 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.582 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-17T12:26:48.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.582 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.x", 2023-05-17T12:26:48.582 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBdx2RkH8gzFRAAK1hxXwVv4woXhMUs0C4YWg==", 2023-05-17T12:26:48.583 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.583 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-05-17T12:26:48.583 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-05-17T12:26:48.583 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.583 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:48.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:48.583 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.y", 2023-05-17T12:26:48.584 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQBdx2RkD//aDRAA0SoLiG2uPc5z98d7hr1J4g==", 2023-05-17T12:26:48.584 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-05-17T12:26:48.584 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-05-17T12:26:48.584 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-05-17T12:26:48.584 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-05-17T12:26:48.584 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.584 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:48.584 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-05-17T12:26:48.585 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-05-17T12:26:48.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae6806ace0 msgr2=0x7fae6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae6806ace0 0x7fae6806d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae840c6120 tx=0x7fae74008040 comp rx=0 tx=0).stop 2023-05-17T12:26:48.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae84071540 msgr2=0x7fae841546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae84071540 0x7fae841546a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fae8000c450 tx=0x7fae8000c760 comp rx=0 tx=0).stop 2023-05-17T12:26:48.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 shutdown_connections 2023-05-17T12:26:48.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fae6806ace0 0x7fae6806d190 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae841595e0 0x7fae841f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae84071540 0x7fae841546a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 --2- 172.21.15.88:0/3045486807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae840ce0d0 0x7fae841f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 >> 172.21.15.88:0/3045486807 conn(0x7fae840ced10 msgr2=0x7fae8415d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:48.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 shutdown_connections 2023-05-17T12:26:48.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.537+0000 7fae8c5ff700 1 -- 172.21.15.88:0/3045486807 wait complete. 2023-05-17T12:26:48.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-17T12:26:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.768+0000 7fd4251ff700 1 Processor -- start 2023-05-17T12:26:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.769+0000 7fd4251ff700 1 -- start start 2023-05-17T12:26:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.770+0000 7fd4251ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd42006ddb0 0x7fd420070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.770+0000 7fd4251ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4200714b0 0x7fd4200b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.770+0000 7fd4251ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42006d080 con 0x7fd420159b70 2023-05-17T12:26:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.770+0000 7fd4251ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd420159f40 con 0x7fd42006ddb0 2023-05-17T12:26:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.770+0000 7fd4251ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd420071930 con 0x7fd4200714b0 2023-05-17T12:26:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.770+0000 7fd417fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd42006ddb0 0x7fd420070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.770+0000 7fd41f59e700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4200714b0 0x7fd4200b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.770+0000 7fd417fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd42006ddb0 0x7fd420070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:55952/0 (socket says 172.21.15.88:55952) 2023-05-17T12:26:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.770+0000 7fd417fff700 1 -- 172.21.15.88:0/3348503839 learned_addr learned my addr 172.21.15.88:0/3348503839 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.771+0000 7fd41f59e700 1 -- 172.21.15.88:0/3348503839 >> v2:172.21.15.187:3300/0 conn(0x7fd42006ddb0 msgr2=0x7fd420070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.771+0000 7fd41f59e700 1 --2- 172.21.15.88:0/3348503839 >> v2:172.21.15.187:3300/0 conn(0x7fd42006ddb0 0x7fd420070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.771+0000 7fd41f59e700 1 -- 172.21.15.88:0/3348503839 >> v1:172.21.15.187:6789/0 conn(0x7fd420159b70 legacy=0x7fd4200cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.771+0000 7fd41f59e700 1 -- 172.21.15.88:0/3348503839 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42006d920 con 0x7fd4200714b0 2023-05-17T12:26:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.771+0000 7fd417fff700 1 --2- 172.21.15.88:0/3348503839 >> v2:172.21.15.187:3300/0 conn(0x7fd42006ddb0 0x7fd420070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.771+0000 7fd41f59e700 1 --2- 172.21.15.88:0/3348503839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4200714b0 0x7fd4200b1ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd418009dc0 tx=0x7fd41800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f11efc028e972a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.771+0000 7fd41e59c700 1 -- 172.21.15.88:0/3348503839 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41800e070 con 0x7fd4200714b0 2023-05-17T12:26:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.771+0000 7fd41e59c700 1 -- 172.21.15.88:0/3348503839 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41800bae0 con 0x7fd4200714b0 2023-05-17T12:26:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.771+0000 7fd41e59c700 1 -- 172.21.15.88:0/3348503839 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41800be90 con 0x7fd4200714b0 2023-05-17T12:26:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.772+0000 7fd4251ff700 1 -- 172.21.15.88:0/3348503839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4200714b0 msgr2=0x7fd4200b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.772+0000 7fd4251ff700 1 --2- 172.21.15.88:0/3348503839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4200714b0 0x7fd4200b1ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd418009dc0 tx=0x7fd41800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.772+0000 7fd4251ff700 1 -- 172.21.15.88:0/3348503839 shutdown_connections 2023-05-17T12:26:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.772+0000 7fd4251ff700 1 --2- 172.21.15.88:0/3348503839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4200714b0 0x7fd4200b1ba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.772+0000 7fd4251ff700 1 --2- 172.21.15.88:0/3348503839 >> v2:172.21.15.187:3300/0 conn(0x7fd42006ddb0 0x7fd420070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.772+0000 7fd4251ff700 1 -- 172.21.15.88:0/3348503839 >> 172.21.15.88:0/3348503839 conn(0x7fd4200b1530 msgr2=0x7fd4200ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.772+0000 7fd4251ff700 1 -- 172.21.15.88:0/3348503839 shutdown_connections 2023-05-17T12:26:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.772+0000 7fd4251ff700 1 -- 172.21.15.88:0/3348503839 wait complete. 2023-05-17T12:26:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.773+0000 7fd4251ff700 1 Processor -- start 2023-05-17T12:26:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.774+0000 7fd4251ff700 1 -- start start 2023-05-17T12:26:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.774+0000 7fd4251ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd42006ddb0 0x7fd4201f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.774+0000 7fd4251ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4200714b0 0x7fd4201f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.774+0000 7fd4251ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd420159b70 0x7fd420153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.774+0000 7fd4251ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4201f4b00 con 0x7fd42006ddb0 2023-05-17T12:26:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.774+0000 7fd4251ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4201f3ef0 con 0x7fd4200714b0 2023-05-17T12:26:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.774+0000 7fd4251ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4201f41d0 con 0x7fd420159b70 2023-05-17T12:26:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd42006ddb0 0x7fd4201f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41ed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd42006ddb0 0x7fd4201f4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50368/0 (socket says 172.21.15.88:50368) 2023-05-17T12:26:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41ed9d700 1 -- 172.21.15.88:0/1776488940 learned_addr learned my addr 172.21.15.88:0/1776488940 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd417fff700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4200714b0 0x7fd4201f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41f59e700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd420159b70 0x7fd420153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41ed9d700 1 -- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd420159b70 msgr2=0x7fd420153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41ed9d700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd420159b70 0x7fd420153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41ed9d700 1 -- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4200714b0 msgr2=0x7fd4201f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41ed9d700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4200714b0 0x7fd4201f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:48.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41ed9d700 1 -- 172.21.15.88:0/1776488940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40800b7f0 con 0x7fd42006ddb0 2023-05-17T12:26:48.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.775+0000 7fd41ed9d700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd42006ddb0 0x7fd4201f4f90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c450 tx=0x7fd41000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:48.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.776+0000 7fd4177fe700 1 -- 172.21.15.88:0/1776488940 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100052d0 con 0x7fd42006ddb0 2023-05-17T12:26:48.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.776+0000 7fd4177fe700 1 -- 172.21.15.88:0/1776488940 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd410005430 con 0x7fd42006ddb0 2023-05-17T12:26:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.776+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd418009a70 con 0x7fd42006ddb0 2023-05-17T12:26:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.776+0000 7fd4177fe700 1 -- 172.21.15.88:0/1776488940 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100038c0 con 0x7fd42006ddb0 2023-05-17T12:26:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.776+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42006d2d0 con 0x7fd42006ddb0 2023-05-17T12:26:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.777+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4200ce930 con 0x7fd42006ddb0 2023-05-17T12:26:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.778+0000 7fd4177fe700 1 -- 172.21.15.88:0/1776488940 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd410003a20 con 0x7fd42006ddb0 2023-05-17T12:26:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.779+0000 7fd4177fe700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd40006ace0 0x7fd40006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.779+0000 7fd4177fe700 1 -- 172.21.15.88:0/1776488940 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd410088590 con 0x7fd42006ddb0 2023-05-17T12:26:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.779+0000 7fd417fff700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd40006ace0 0x7fd40006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.780+0000 7fd417fff700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd40006ace0 0x7fd40006d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd40800b240 tx=0x7fd40800b4d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:48.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:48.788+0000 7fd4177fe700 1 -- 172.21.15.88:0/1776488940 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd410053850 con 0x7fd42006ddb0 2023-05-17T12:26:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.055+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd42006d5b0 con 0x7fd42006ddb0 2023-05-17T12:26:49.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.061+0000 7fd4177fe700 1 -- 172.21.15.88:0/1776488940 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd41000ce60 con 0x7fd42006ddb0 2023-05-17T12:26:49.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd40006ace0 msgr2=0x7fd40006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd40006ace0 0x7fd40006d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd40800b240 tx=0x7fd40800b4d0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd42006ddb0 msgr2=0x7fd4201f4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd42006ddb0 0x7fd4201f4f90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c450 tx=0x7fd41000c760 comp rx=0 tx=0).stop 2023-05-17T12:26:49.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 shutdown_connections 2023-05-17T12:26:49.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fd40006ace0 0x7fd40006d190 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd420159b70 0x7fd420153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd42006ddb0 0x7fd4201f4f90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 --2- 172.21.15.88:0/1776488940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4200714b0 0x7fd4201f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 >> 172.21.15.88:0/1776488940 conn(0x7fd4200b1530 msgr2=0x7fd4200cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:49.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 shutdown_connections 2023-05-17T12:26:49.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.063+0000 7fd4251ff700 1 -- 172.21.15.88:0/1776488940 wait complete. 2023-05-17T12:26:49.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-17T12:26:49.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.267+0000 7fed0b9ff700 1 Processor -- start 2023-05-17T12:26:49.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.267+0000 7fed0b9ff700 1 -- start start 2023-05-17T12:26:49.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.269+0000 7fed0b9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed0406d0f0 0x7fed04071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.269+0000 7fed0b9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0406de30 con 0x7fed04158fd0 2023-05-17T12:26:49.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.269+0000 7fed0b9ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0415d620 con 0x7fed041593a0 2023-05-17T12:26:49.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.269+0000 7fed0b9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0415d430 con 0x7fed0406d0f0 2023-05-17T12:26:49.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.269+0000 7fed0979b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fed04158fd0 0x7fed0415cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36488/0 (socket says 172.21.15.88:36488) 2023-05-17T12:26:49.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.269+0000 7fed0979b700 1 -- 172.21.15.88:0/3815103783 learned_addr learned my addr 172.21.15.88:0/3815103783 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:49.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.269+0000 7fed09f9c700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed0406d0f0 0x7fed04071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.269+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267227491 0 0) 0x7fed0406de30 con 0x7fed04158fd0 2023-05-17T12:26:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.269+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf00034d0 con 0x7fed04158fd0 2023-05-17T12:26:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83777288 0 0) 0x7fed0415d620 con 0x7fed041593a0 2023-05-17T12:26:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed0406de30 con 0x7fed041593a0 2023-05-17T12:26:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3839437609 0 0) 0x7fecf00034d0 con 0x7fed04158fd0 2023-05-17T12:26:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed0406d0f0 msgr2=0x7fed04071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:49.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed0406d0f0 0x7fed04071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 >> v1:172.21.15.187:6789/0 conn(0x7fed041593a0 legacy=0x7fed0406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0415d900 con 0x7fed04158fd0 2023-05-17T12:26:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7fed00001670 con 0x7fed04158fd0 2023-05-17T12:26:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 >> v1:172.21.15.88:6789/0 conn(0x7fed04158fd0 legacy=0x7fed0415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed0406d0f0 0x7fecf0003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecf0004210 0x7fecf000a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf000b000 0x7fecf000d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf000dd30 con 0x7fecf0004210 2023-05-17T12:26:49.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf000dea0 con 0x7fecf000b000 2023-05-17T12:26:49.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf000e060 con 0x7fed0406d0f0 2023-05-17T12:26:49.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fed08f9a700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecf0004210 0x7fecf000a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fed09f9c700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf000b000 0x7fecf000d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fed0979b700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed0406d0f0 0x7fecf0003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fed08f9a700 1 -- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed0406d0f0 msgr2=0x7fecf0003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fed08f9a700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed0406d0f0 0x7fecf0003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fed08f9a700 1 -- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf000b000 msgr2=0x7fecf000d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fed08f9a700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf000b000 0x7fecf000d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fed08f9a700 1 -- 172.21.15.88:0/3815103783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf00034d0 con 0x7fecf0004210 2023-05-17T12:26:49.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.270+0000 7fed09f9c700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf000b000 0x7fecf000d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.271+0000 7fed08f9a700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecf0004210 0x7fecf000a990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fed0406bc40 tx=0x7fecf0003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3082bfaa6de05bd8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.271+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4001430 con 0x7fecf0004210 2023-05-17T12:26:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.271+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40052d0 con 0x7fecf0004210 2023-05-17T12:26:49.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.271+0000 7fecfbfff700 1 -- 172.21.15.88:0/3815103783 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4001d40 con 0x7fecf0004210 2023-05-17T12:26:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.271+0000 7fed0b9ff700 1 -- 172.21.15.88:0/3815103783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecf0004210 msgr2=0x7fecf000a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.271+0000 7fed0b9ff700 1 --2- 172.21.15.88:0/3815103783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecf0004210 0x7fecf000a990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fed0406bc40 tx=0x7fecf0003780 comp rx=0 tx=0).stop 2023-05-17T12:26:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.271+0000 7fed09f9c700 1 -- 172.21.15.88:0/3815103783 reap_dead start 2023-05-17T12:26:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.271+0000 7fed0b9ff700 1 -- 172.21.15.88:0/3815103783 shutdown_connections 2023-05-17T12:26:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.271+0000 7fed0b9ff700 1 -- 172.21.15.88:0/3815103783 >> 172.21.15.88:0/3815103783 conn(0x7fed040b1530 msgr2=0x7fed040ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.272+0000 7fed0b9ff700 1 -- 172.21.15.88:0/3815103783 shutdown_connections 2023-05-17T12:26:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.272+0000 7fed0b9ff700 1 -- 172.21.15.88:0/3815103783 wait complete. 2023-05-17T12:26:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.273+0000 7fed0b9ff700 1 Processor -- start 2023-05-17T12:26:49.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.273+0000 7fed0b9ff700 1 -- start start 2023-05-17T12:26:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.274+0000 7fed0b9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf0004210 0x7fed04154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.274+0000 7fed0b9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed04154d80 0x7fed0415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.274+0000 7fed0b9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed040ac4c0 0x7fed040ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.274+0000 7fed0b9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040acea0 con 0x7fed040ac4c0 2023-05-17T12:26:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.274+0000 7fed0b9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed041f3f00 con 0x7fecf0004210 2023-05-17T12:26:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.274+0000 7fed0b9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed041f3140 con 0x7fed04154d80 2023-05-17T12:26:49.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed0979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf0004210 0x7fed04154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed09f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed040ac4c0 0x7fed040ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed0979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf0004210 0x7fed04154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:55984/0 (socket says 172.21.15.88:55984) 2023-05-17T12:26:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed0979b700 1 -- 172.21.15.88:0/1776238054 learned_addr learned my addr 172.21.15.88:0/1776238054 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed08f9a700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed04154d80 0x7fed0415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed09f9c700 1 -- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed04154d80 msgr2=0x7fed0415b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed09f9c700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed04154d80 0x7fed0415b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed09f9c700 1 -- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf0004210 msgr2=0x7fed04154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed09f9c700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf0004210 0x7fed04154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed09f9c700 1 -- 172.21.15.88:0/1776238054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed040c9fc0 con 0x7fed040ac4c0 2023-05-17T12:26:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed0979b700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf0004210 0x7fed04154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:26:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed09f9c700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed040ac4c0 0x7fed040ac960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fed040c99b0 tx=0x7fecfc0104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fecf9ffb700 1 -- 172.21.15.88:0/1776238054 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc01b070 con 0x7fed040ac4c0 2023-05-17T12:26:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fecf9ffb700 1 -- 172.21.15.88:0/1776238054 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc00f040 con 0x7fed040ac4c0 2023-05-17T12:26:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.275+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0415dbe0 con 0x7fed040ac4c0 2023-05-17T12:26:49.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.276+0000 7fecf9ffb700 1 -- 172.21.15.88:0/1776238054 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc00e050 con 0x7fed040ac4c0 2023-05-17T12:26:49.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.276+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed040ca2a0 con 0x7fed040ac4c0 2023-05-17T12:26:49.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.277+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed04074530 con 0x7fed040ac4c0 2023-05-17T12:26:49.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.277+0000 7fecf9ffb700 1 -- 172.21.15.88:0/1776238054 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fecfc003a20 con 0x7fed040ac4c0 2023-05-17T12:26:49.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.278+0000 7fecf9ffb700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fece806ace0 0x7fece806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.278+0000 7fecf9ffb700 1 -- 172.21.15.88:0/1776238054 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fecfc0893b0 con 0x7fed040ac4c0 2023-05-17T12:26:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.279+0000 7fed0979b700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fece806ace0 0x7fece806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.280+0000 7fed0979b700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fece806ace0 0x7fece806d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fed00011310 tx=0x7fed00007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:49.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.282+0000 7fecf9ffb700 1 -- 172.21.15.88:0/1776238054 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fecfc0545d0 con 0x7fed040ac4c0 2023-05-17T12:26:49.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.556+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fed040b4cd0 con 0x7fed040ac4c0 2023-05-17T12:26:49.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.562+0000 7fecf9ffb700 1 -- 172.21.15.88:0/1776238054 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fecfc057bf0 con 0x7fed040ac4c0 2023-05-17T12:26:49.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fece806ace0 msgr2=0x7fece806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fece806ace0 0x7fece806d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fed00011310 tx=0x7fed00007040 comp rx=0 tx=0).stop 2023-05-17T12:26:49.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed040ac4c0 msgr2=0x7fed040ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed040ac4c0 0x7fed040ac960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fed040c99b0 tx=0x7fecfc0104a0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 shutdown_connections 2023-05-17T12:26:49.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fece806ace0 0x7fece806d190 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed040ac4c0 0x7fed040ac960 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecf0004210 0x7fed04154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 --2- 172.21.15.88:0/1776238054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed04154d80 0x7fed0415b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 >> 172.21.15.88:0/1776238054 conn(0x7fed040b1530 msgr2=0x7fed0406e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:49.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 shutdown_connections 2023-05-17T12:26:49.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.565+0000 7fed0b9ff700 1 -- 172.21.15.88:0/1776238054 wait complete. 2023-05-17T12:26:49.586 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-17T12:26:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.767+0000 7f72829ff700 1 Processor -- start 2023-05-17T12:26:49.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.767+0000 7f72829ff700 1 -- start start 2023-05-17T12:26:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.768+0000 7f72829ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f727c15ab80 0x7f727c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.768+0000 7f72829ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c06b2c0 con 0x7f727c0cd590 2023-05-17T12:26:49.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.768+0000 7f72829ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c15af50 con 0x7f727c070f70 2023-05-17T12:26:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.768+0000 7f72829ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c06bc90 con 0x7f727c15ab80 2023-05-17T12:26:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.768+0000 7f727bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f727c15ab80 0x7f727c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.768+0000 7f727b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f727c0cd590 0x7f727c06da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36502/0 (socket says 172.21.15.88:36502) 2023-05-17T12:26:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.768+0000 7f727b7fe700 1 -- 172.21.15.88:0/2062057023 learned_addr learned my addr 172.21.15.88:0/2062057023 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.769+0000 7f727affd700 1 -- 172.21.15.88:0/2062057023 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674618079 0 0) 0x7f727c06b2c0 con 0x7f727c0cd590 2023-05-17T12:26:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.769+0000 7f727affd700 1 -- 172.21.15.88:0/2062057023 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72640035b0 con 0x7f727c0cd590 2023-05-17T12:26:49.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.769+0000 7f727bfff700 1 -- 172.21.15.88:0/2062057023 >> v1:172.21.15.187:6789/0 conn(0x7f727c070f70 legacy=0x7f727c071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.769+0000 7f727bfff700 1 -- 172.21.15.88:0/2062057023 >> v1:172.21.15.88:6789/0 conn(0x7f727c0cd590 legacy=0x7f727c06da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.769+0000 7f727bfff700 1 -- 172.21.15.88:0/2062057023 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c06a6b0 con 0x7f727c15ab80 2023-05-17T12:26:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.769+0000 7f727bfff700 1 --2- 172.21.15.88:0/2062057023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c15ab80 0x7f727c06b750 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f726c009840 tx=0x7f726c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251da61ae6923c87 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.769+0000 7f727affd700 1 -- 172.21.15.88:0/2062057023 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c011830 con 0x7f727c15ab80 2023-05-17T12:26:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.769+0000 7f727affd700 1 -- 172.21.15.88:0/2062057023 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c011990 con 0x7f727c15ab80 2023-05-17T12:26:49.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.769+0000 7f727affd700 1 -- 172.21.15.88:0/2062057023 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c011d00 con 0x7f727c15ab80 2023-05-17T12:26:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.770+0000 7f72829ff700 1 -- 172.21.15.88:0/2062057023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c15ab80 msgr2=0x7f727c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.770+0000 7f72829ff700 1 --2- 172.21.15.88:0/2062057023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c15ab80 0x7f727c06b750 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f726c009840 tx=0x7f726c009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.770+0000 7f72829ff700 1 -- 172.21.15.88:0/2062057023 shutdown_connections 2023-05-17T12:26:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.770+0000 7f72829ff700 1 --2- 172.21.15.88:0/2062057023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c15ab80 0x7f727c06b750 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.770+0000 7f72829ff700 1 -- 172.21.15.88:0/2062057023 >> 172.21.15.88:0/2062057023 conn(0x7f727c0b1530 msgr2=0x7f727c0ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.770+0000 7f72829ff700 1 -- 172.21.15.88:0/2062057023 shutdown_connections 2023-05-17T12:26:49.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.770+0000 7f72829ff700 1 -- 172.21.15.88:0/2062057023 wait complete. 2023-05-17T12:26:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.772+0000 7f72829ff700 1 Processor -- start 2023-05-17T12:26:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.772+0000 7f72829ff700 1 -- start start 2023-05-17T12:26:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f72829ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c070f70 0x7f727c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f72829ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0cd590 0x7f727c0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f72829ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15ab80 0x7f727c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f72829ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c14ea20 con 0x7f727c0cd590 2023-05-17T12:26:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f72829ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c151e90 con 0x7f727c070f70 2023-05-17T12:26:49.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f72829ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0c5ec0 con 0x7f727c15ab80 2023-05-17T12:26:49.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f727b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0cd590 0x7f727c0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f727b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0cd590 0x7f727c0b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50400/0 (socket says 172.21.15.88:50400) 2023-05-17T12:26:49.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f727b7fe700 1 -- 172.21.15.88:0/2108034537 learned_addr learned my addr 172.21.15.88:0/2108034537 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:49.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f727bfff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c070f70 0x7f727c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f7280f9c700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15ab80 0x7f727c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.773+0000 7f727b7fe700 1 -- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15ab80 msgr2=0x7f727c0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f727b7fe700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15ab80 0x7f727c0b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f727b7fe700 1 -- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c070f70 msgr2=0x7f727c14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f727b7fe700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c070f70 0x7f727c14e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f727b7fe700 1 -- 172.21.15.88:0/2108034537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0094a0 con 0x7f727c0cd590 2023-05-17T12:26:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f727bfff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c070f70 0x7f727c14e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:49.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f727b7fe700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0cd590 0x7f727c0b3c40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f727000c700 tx=0x7f727000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f7278ff9700 1 -- 172.21.15.88:0/2108034537 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270005d70 con 0x7f727c0cd590 2023-05-17T12:26:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f7278ff9700 1 -- 172.21.15.88:0/2108034537 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72700070d0 con 0x7f727c0cd590 2023-05-17T12:26:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c06ac70 con 0x7f727c0cd590 2023-05-17T12:26:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f7278ff9700 1 -- 172.21.15.88:0/2108034537 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270007460 con 0x7f727c0cd590 2023-05-17T12:26:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.774+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c06a990 con 0x7f727c0cd590 2023-05-17T12:26:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.775+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c06af50 con 0x7f727c0cd590 2023-05-17T12:26:49.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.776+0000 7f7278ff9700 1 -- 172.21.15.88:0/2108034537 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f72700075c0 con 0x7f727c0cd590 2023-05-17T12:26:49.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.777+0000 7f7278ff9700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f726806ace0 0x7f726806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:49.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.777+0000 7f7278ff9700 1 -- 172.21.15.88:0/2108034537 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7270088980 con 0x7f727c0cd590 2023-05-17T12:26:49.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.777+0000 7f727bfff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f726806ace0 0x7f726806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:49.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.778+0000 7f727bfff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f726806ace0 0x7f726806d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f726c009fd0 tx=0x7f726c01c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:49.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:49.781+0000 7f7278ff9700 1 -- 172.21.15.88:0/2108034537 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7270053bb0 con 0x7f727c0cd590 2023-05-17T12:26:50.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.054+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f727c074530 con 0x7f727c0cd590 2023-05-17T12:26:50.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.060+0000 7f7278ff9700 1 -- 172.21.15.88:0/2108034537 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f72700571d0 con 0x7f727c0cd590 2023-05-17T12:26:50.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f726806ace0 msgr2=0x7f726806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f726806ace0 0x7f726806d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f726c009fd0 tx=0x7f726c01c040 comp rx=0 tx=0).stop 2023-05-17T12:26:50.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0cd590 msgr2=0x7f727c0b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0cd590 0x7f727c0b3c40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f727000c700 tx=0x7f727000cac0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 shutdown_connections 2023-05-17T12:26:50.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f726806ace0 0x7f726806d190 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15ab80 0x7f727c0b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c070f70 0x7f727c14e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 --2- 172.21.15.88:0/2108034537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0cd590 0x7f727c0b3c40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 >> 172.21.15.88:0/2108034537 conn(0x7f727c0b1530 msgr2=0x7f727c0af180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:50.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 shutdown_connections 2023-05-17T12:26:50.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.063+0000 7f72829ff700 1 -- 172.21.15.88:0/2108034537 wait complete. 2023-05-17T12:26:50.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-17T12:26:50.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.264+0000 7f32e2dff700 1 Processor -- start 2023-05-17T12:26:50.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.264+0000 7f32e2dff700 1 -- start start 2023-05-17T12:26:50.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32e2dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f32dc15ca90 0x7f32dc0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32e2dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc06cc20 0x7f32dc0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32e2dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32dc161410 con 0x7f32dc160f90 2023-05-17T12:26:50.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32e2dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32dc0cde90 con 0x7f32dc15ca90 2023-05-17T12:26:50.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32e2dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc15d270 con 0x7f32dc06cc20 2023-05-17T12:26:50.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32dbfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f32dc160f90 0x7f32dc06c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36506/0 (socket says 172.21.15.88:36506) 2023-05-17T12:26:50.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32dbfff700 1 -- 172.21.15.88:0/2616115881 learned_addr learned my addr 172.21.15.88:0/2616115881 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:50.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32e0b9b700 1 --2- 172.21.15.88:0/2616115881 >> v2:172.21.15.187:3300/0 conn(0x7f32dc15ca90 0x7f32dc0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32e139c700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc06cc20 0x7f32dc0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571978387 0 0) 0x7f32dc161410 con 0x7f32dc160f90 2023-05-17T12:26:50.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.266+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32cc0035b0 con 0x7f32dc160f90 2023-05-17T12:26:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2138298010 0 0) 0x7f32cc0035b0 con 0x7f32dc160f90 2023-05-17T12:26:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc06cc20 msgr2=0x7f32dc0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc06cc20 0x7f32dc0d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 >> v2:172.21.15.187:3300/0 conn(0x7f32dc15ca90 msgr2=0x7f32dc0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:50.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 --2- 172.21.15.88:0/2616115881 >> v2:172.21.15.187:3300/0 conn(0x7f32dc15ca90 0x7f32dc0cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc15d550 con 0x7f32dc160f90 2023-05-17T12:26:50.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f32c8001670 con 0x7f32dc160f90 2023-05-17T12:26:50.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 >> v1:172.21.15.88:6789/0 conn(0x7f32dc160f90 legacy=0x7f32dc06c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc003a00 0x7f32cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32cc0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc06cc20 0x7f32cc004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0cde90 con 0x7f32cc004430 2023-05-17T12:26:50.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc15d270 con 0x7f32cc003a00 2023-05-17T12:26:50.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc00ba10 con 0x7f32dc06cc20 2023-05-17T12:26:50.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32dbfff700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32cc0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32e139c700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc06cc20 0x7f32cc004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.267+0000 7f32e0b9b700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc003a00 0x7f32cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.268+0000 7f32dbfff700 1 -- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc06cc20 msgr2=0x7f32cc004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:50.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.268+0000 7f32dbfff700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc06cc20 0x7f32cc004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.268+0000 7f32dbfff700 1 -- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc003a00 msgr2=0x7f32cc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:50.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.268+0000 7f32dbfff700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32cc003a00 0x7f32cc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.268+0000 7f32dbfff700 1 -- 172.21.15.88:0/2616115881 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0035b0 con 0x7f32cc004430 2023-05-17T12:26:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.268+0000 7f32dbfff700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32cc0048f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f32c800c370 tx=0x7f32cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c31ba6d58de44e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.268+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8007c60 con 0x7f32cc004430 2023-05-17T12:26:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.268+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c8005960 con 0x7f32cc004430 2023-05-17T12:26:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.268+0000 7f32db7fe700 1 -- 172.21.15.88:0/2616115881 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8005d10 con 0x7f32cc004430 2023-05-17T12:26:50.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.269+0000 7f32e2dff700 1 -- 172.21.15.88:0/2616115881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 msgr2=0x7f32cc0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.269+0000 7f32e2dff700 1 --2- 172.21.15.88:0/2616115881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32cc0048f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f32c800c370 tx=0x7f32cc005880 comp rx=0 tx=0).stop 2023-05-17T12:26:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.269+0000 7f32e139c700 1 -- 172.21.15.88:0/2616115881 reap_dead start 2023-05-17T12:26:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.269+0000 7f32e2dff700 1 -- 172.21.15.88:0/2616115881 shutdown_connections 2023-05-17T12:26:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.269+0000 7f32e2dff700 1 -- 172.21.15.88:0/2616115881 >> 172.21.15.88:0/2616115881 conn(0x7f32dc0d3ed0 msgr2=0x7f32dc0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.269+0000 7f32e2dff700 1 -- 172.21.15.88:0/2616115881 shutdown_connections 2023-05-17T12:26:50.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.269+0000 7f32e2dff700 1 -- 172.21.15.88:0/2616115881 wait complete. 2023-05-17T12:26:50.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.270+0000 7f32e2dff700 1 Processor -- start 2023-05-17T12:26:50.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.271+0000 7f32e2dff700 1 -- start start 2023-05-17T12:26:50.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.271+0000 7f32e2dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32dc15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.271+0000 7f32e2dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc159650 0x7f32dc0b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.271+0000 7f32e2dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32dc0b7fd0 0x7f32dc156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e2dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc15b670 con 0x7f32cc004430 2023-05-17T12:26:50.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e2dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0b8450 con 0x7f32dc0b7fd0 2023-05-17T12:26:50.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e2dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc15c150 con 0x7f32dc159650 2023-05-17T12:26:50.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e0b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32dc15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e0b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32dc15bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50412/0 (socket says 172.21.15.88:50412) 2023-05-17T12:26:50.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e0b9b700 1 -- 172.21.15.88:0/1827271639 learned_addr learned my addr 172.21.15.88:0/1827271639 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:50.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e139c700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32dc0b7fd0 0x7f32dc156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32dbfff700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc159650 0x7f32dc0b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e0b9b700 1 -- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc159650 msgr2=0x7f32dc0b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e0b9b700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc159650 0x7f32dc0b7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e0b9b700 1 -- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32dc0b7fd0 msgr2=0x7f32dc156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e0b9b700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32dc0b7fd0 0x7f32dc156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e0b9b700 1 -- 172.21.15.88:0/1827271639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc15dd50 con 0x7f32cc004430 2023-05-17T12:26:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e139c700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32dc0b7fd0 0x7f32dc156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.272+0000 7f32e0b9b700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32dc15bb70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f32d0011ad0 tx=0x7f32d0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.273+0000 7f32d97fa700 1 -- 172.21.15.88:0/1827271639 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d000fa00 con 0x7f32cc004430 2023-05-17T12:26:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.273+0000 7f32d97fa700 1 -- 172.21.15.88:0/1827271639 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d000fb80 con 0x7f32cc004430 2023-05-17T12:26:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.273+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32dc15d830 con 0x7f32cc004430 2023-05-17T12:26:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.273+0000 7f32d97fa700 1 -- 172.21.15.88:0/1827271639 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0014440 con 0x7f32cc004430 2023-05-17T12:26:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.273+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc15ce60 con 0x7f32cc004430 2023-05-17T12:26:50.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.274+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32dc0cc2c0 con 0x7f32cc004430 2023-05-17T12:26:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.275+0000 7f32d97fa700 1 -- 172.21.15.88:0/1827271639 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32d00145a0 con 0x7f32cc004430 2023-05-17T12:26:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.276+0000 7f32d97fa700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32c006ace0 0x7f32c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.276+0000 7f32d97fa700 1 -- 172.21.15.88:0/1827271639 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f32d0089a50 con 0x7f32cc004430 2023-05-17T12:26:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.277+0000 7f32dbfff700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32c006ace0 0x7f32c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.277+0000 7f32dbfff700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32c006ace0 0x7f32c006d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32c8015040 tx=0x7f32c800a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:50.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.280+0000 7f32d97fa700 1 -- 172.21.15.88:0/1827271639 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f32d0054dd0 con 0x7f32cc004430 2023-05-17T12:26:50.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.555+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f32dc074530 con 0x7f32cc004430 2023-05-17T12:26:50.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.561+0000 7f32d97fa700 1 -- 172.21.15.88:0/1827271639 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f32d00583f0 con 0x7f32cc004430 2023-05-17T12:26:50.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.563+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32c006ace0 msgr2=0x7f32c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.563+0000 7f32e2dff700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32c006ace0 0x7f32c006d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32c8015040 tx=0x7f32c800a000 comp rx=0 tx=0).stop 2023-05-17T12:26:50.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.563+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 msgr2=0x7f32dc15bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.563+0000 7f32e2dff700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32dc15bb70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f32d0011ad0 tx=0x7f32d0011e90 comp rx=0 tx=0).stop 2023-05-17T12:26:50.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.563+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 shutdown_connections 2023-05-17T12:26:50.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.563+0000 7f32e2dff700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f32c006ace0 0x7f32c006d190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.563+0000 7f32e2dff700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32dc0b7fd0 0x7f32dc156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.563+0000 7f32e2dff700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32cc004430 0x7f32dc15bb70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.563+0000 7f32e2dff700 1 --2- 172.21.15.88:0/1827271639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32dc159650 0x7f32dc0b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.564+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 >> 172.21.15.88:0/1827271639 conn(0x7f32dc0d3ed0 msgr2=0x7f32dc15f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:50.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.564+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 shutdown_connections 2023-05-17T12:26:50.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.564+0000 7f32e2dff700 1 -- 172.21.15.88:0/1827271639 wait complete. 2023-05-17T12:26:50.584 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-17T12:26:50.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.765+0000 7f86759ff700 1 Processor -- start 2023-05-17T12:26:50.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.765+0000 7f86759ff700 1 -- start start 2023-05-17T12:26:50.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f86759ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f86700cd800 0x7f8670160f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f86759ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700cdc00 con 0x7f867006cc20 2023-05-17T12:26:50.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f86759ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700cde90 con 0x7f867015ca90 2023-05-17T12:26:50.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f86759ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86701614d0 con 0x7f86700cd800 2023-05-17T12:26:50.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f8667fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f867006cc20 0x7f86700d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36510/0 (socket says 172.21.15.88:36510) 2023-05-17T12:26:50.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f8667fff700 1 -- 172.21.15.88:0/4021391509 learned_addr learned my addr 172.21.15.88:0/4021391509 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:50.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f866f7fe700 1 --2- 172.21.15.88:0/4021391509 >> v2:172.21.15.187:3300/0 conn(0x7f86700cd800 0x7f8670160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118767152 0 0) 0x7f86700cdc00 con 0x7f867006cc20 2023-05-17T12:26:50.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f865c0035b0 con 0x7f867006cc20 2023-05-17T12:26:50.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3353249766 0 0) 0x7f865c0035b0 con 0x7f867006cc20 2023-05-17T12:26:50.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 >> v2:172.21.15.187:3300/0 conn(0x7f86700cd800 msgr2=0x7f8670160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:50.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f866e7fc700 1 --2- 172.21.15.88:0/4021391509 >> v2:172.21.15.187:3300/0 conn(0x7f86700cd800 0x7f8670160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 >> v1:172.21.15.187:6789/0 conn(0x7f867015ca90 legacy=0x7f867006c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.767+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867015d270 con 0x7f867006cc20 2023-05-17T12:26:50.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7f8658001670 con 0x7f867006cc20 2023-05-17T12:26:50.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 >> v1:172.21.15.88:6789/0 conn(0x7f867006cc20 legacy=0x7f86700d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866e7fc700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f865c003a00 0x7f865c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866e7fc700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f865c004850 0x7f865c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866e7fc700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c005200 0x7f865c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701614d0 con 0x7f865c005200 2023-05-17T12:26:50.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c00c080 con 0x7f865c004850 2023-05-17T12:26:50.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c00c240 con 0x7f865c003a00 2023-05-17T12:26:50.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866f7fe700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c005200 0x7f865c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f8667fff700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f865c004850 0x7f865c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866effd700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f865c003a00 0x7f865c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866f7fe700 1 -- 172.21.15.88:0/4021391509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f865c003a00 msgr2=0x7f865c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:50.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866f7fe700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f865c003a00 0x7f865c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866f7fe700 1 -- 172.21.15.88:0/4021391509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f865c004850 msgr2=0x7f865c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:50.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866f7fe700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f865c004850 0x7f865c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866f7fe700 1 -- 172.21.15.88:0/4021391509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0035b0 con 0x7f865c005200 2023-05-17T12:26:50.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.768+0000 7f866f7fe700 1 -- 172.21.15.88:0/4021391509 reap_dead start 2023-05-17T12:26:50.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f866f7fe700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c005200 0x7f865c00ba10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8668009fc0 tx=0x7f865c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c58720df425e4e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:50.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668003a20 con 0x7f865c005200 2023-05-17T12:26:50.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866800f040 con 0x7f865c005200 2023-05-17T12:26:50.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f866e7fc700 1 -- 172.21.15.88:0/4021391509 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668003de0 con 0x7f865c005200 2023-05-17T12:26:50.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f86759ff700 1 -- 172.21.15.88:0/4021391509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c005200 msgr2=0x7f865c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f86759ff700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c005200 0x7f865c00ba10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8668009fc0 tx=0x7f865c005880 comp rx=0 tx=0).stop 2023-05-17T12:26:50.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f86759ff700 1 -- 172.21.15.88:0/4021391509 shutdown_connections 2023-05-17T12:26:50.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f86759ff700 1 --2- 172.21.15.88:0/4021391509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f865c005200 0x7f865c00ba10 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f86759ff700 1 -- 172.21.15.88:0/4021391509 >> 172.21.15.88:0/4021391509 conn(0x7f86700d3ed0 msgr2=0x7f86700cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:50.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f86759ff700 1 -- 172.21.15.88:0/4021391509 shutdown_connections 2023-05-17T12:26:50.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.769+0000 7f86759ff700 1 -- 172.21.15.88:0/4021391509 wait complete. 2023-05-17T12:26:50.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.771+0000 7f86759ff700 1 Processor -- start 2023-05-17T12:26:50.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.771+0000 7f86759ff700 1 -- start start 2023-05-17T12:26:50.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f86759ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f865c005200 0x7f8670159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f86759ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f867015b430 0x7f867014c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f86759ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8670156480 0x7f86700cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f86759ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867015a0f0 con 0x7f867015b430 2023-05-17T12:26:50.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f86759ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867014ca10 con 0x7f8670156480 2023-05-17T12:26:50.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f86759ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867015a390 con 0x7f865c005200 2023-05-17T12:26:50.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f8667fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f867015b430 0x7f867014c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f8667fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f867015b430 0x7f867014c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50430/0 (socket says 172.21.15.88:50430) 2023-05-17T12:26:50.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f8667fff700 1 -- 172.21.15.88:0/3737975988 learned_addr learned my addr 172.21.15.88:0/3737975988 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:50.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.772+0000 7f866effd700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f865c005200 0x7f8670159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f866f7fe700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8670156480 0x7f86700cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f8667fff700 1 -- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f865c005200 msgr2=0x7f8670159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f8667fff700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f865c005200 0x7f8670159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f8667fff700 1 -- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8670156480 msgr2=0x7f86700cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:50.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f8667fff700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8670156480 0x7f86700cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:50.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f8667fff700 1 -- 172.21.15.88:0/3737975988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867015d830 con 0x7f867015b430 2023-05-17T12:26:50.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f8667fff700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f867015b430 0x7f867014c4d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8658007290 tx=0x7f86580075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:50.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f866cff9700 1 -- 172.21.15.88:0/3737975988 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658011580 con 0x7f867015b430 2023-05-17T12:26:50.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f866cff9700 1 -- 172.21.15.88:0/3737975988 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86580116e0 con 0x7f867015b430 2023-05-17T12:26:50.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867015d550 con 0x7f867015b430 2023-05-17T12:26:50.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f866cff9700 1 -- 172.21.15.88:0/3737975988 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658011a90 con 0x7f867015b430 2023-05-17T12:26:50.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.773+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867015dd50 con 0x7f867015b430 2023-05-17T12:26:50.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.774+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867015ce60 con 0x7f867015b430 2023-05-17T12:26:50.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.775+0000 7f866cff9700 1 -- 172.21.15.88:0/3737975988 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8658011bf0 con 0x7f867015b430 2023-05-17T12:26:50.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.776+0000 7f866cff9700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865006ad10 0x7f865006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:50.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.776+0000 7f866cff9700 1 -- 172.21.15.88:0/3737975988 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f86580893d0 con 0x7f867015b430 2023-05-17T12:26:50.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.777+0000 7f866effd700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865006ad10 0x7f865006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:50.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.777+0000 7f866effd700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865006ad10 0x7f865006d1c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8660000c00 tx=0x7f8660009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:50.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:50.781+0000 7f866cff9700 1 -- 172.21.15.88:0/3737975988 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8658054560 con 0x7f867015b430 2023-05-17T12:26:51.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.054+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f8670074530 con 0x7f867015b430 2023-05-17T12:26:51.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.058+0000 7f866cff9700 1 -- 172.21.15.88:0/3737975988 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8658057b80 con 0x7f867015b430 2023-05-17T12:26:51.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865006ad10 msgr2=0x7f865006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865006ad10 0x7f865006d1c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8660000c00 tx=0x7f8660009040 comp rx=0 tx=0).stop 2023-05-17T12:26:51.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f867015b430 msgr2=0x7f867014c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f867015b430 0x7f867014c4d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8658007290 tx=0x7f86580075a0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 shutdown_connections 2023-05-17T12:26:51.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f865006ad10 0x7f865006d1c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8670156480 0x7f86700cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f865c005200 0x7f8670159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 --2- 172.21.15.88:0/3737975988 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f867015b430 0x7f867014c4d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 >> 172.21.15.88:0/3737975988 conn(0x7f86700d3ed0 msgr2=0x7f86700b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:51.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 shutdown_connections 2023-05-17T12:26:51.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.060+0000 7f86759ff700 1 -- 172.21.15.88:0/3737975988 wait complete. 2023-05-17T12:26:51.081 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-17T12:26:51.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.261+0000 7fb9cfbff700 1 Processor -- start 2023-05-17T12:26:51.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.261+0000 7fb9cfbff700 1 -- start start 2023-05-17T12:26:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.262+0000 7fb9cfbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9c80d1bb0 0x7fb9c80d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.262+0000 7fb9cfbff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb9c815d990 0x7fb9c806c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cfbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c81574f0 con 0x7fb9c80cf650 2023-05-17T12:26:51.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cfbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c80cd800 con 0x7fb9c80d1bb0 2023-05-17T12:26:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cfbff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c80cd9e0 con 0x7fb9c815d990 2023-05-17T12:26:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cd99b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9c80d1bb0 0x7fb9c80d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cd99b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9c80d1bb0 0x7fb9c80d1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46038/0 (socket says 172.21.15.88:46038) 2023-05-17T12:26:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cd99b700 1 -- 172.21.15.88:0/3537063507 learned_addr learned my addr 172.21.15.88:0/3537063507 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9ce19c700 1 --2- 172.21.15.88:0/3537063507 >> v2:172.21.15.187:3300/0 conn(0x7fb9c815d990 0x7fb9c806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cd99b700 1 -- 172.21.15.88:0/3537063507 >> v2:172.21.15.187:3300/0 conn(0x7fb9c815d990 msgr2=0x7fb9c806c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:51.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cd99b700 1 --2- 172.21.15.88:0/3537063507 >> v2:172.21.15.187:3300/0 conn(0x7fb9c815d990 0x7fb9c806c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cd99b700 1 -- 172.21.15.88:0/3537063507 >> v1:172.21.15.187:6789/0 conn(0x7fb9c80cf650 legacy=0x7fb9c8160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:51.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cd99b700 1 -- 172.21.15.88:0/3537063507 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c80cdcc0 con 0x7fb9c80d1bb0 2023-05-17T12:26:51.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9ce19c700 1 --2- 172.21.15.88:0/3537063507 >> v2:172.21.15.187:3300/0 conn(0x7fb9c815d990 0x7fb9c806c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:51.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.263+0000 7fb9cd99b700 1 --2- 172.21.15.88:0/3537063507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c80d1bb0 0x7fb9c80d1f80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80cea20 tx=0x7fb9c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941c18153073d6f server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:51.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cc999700 1 -- 172.21.15.88:0/3537063507 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4004230 con 0x7fb9c80d1bb0 2023-05-17T12:26:51.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cc999700 1 -- 172.21.15.88:0/3537063507 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c4004390 con 0x7fb9c80d1bb0 2023-05-17T12:26:51.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cc999700 1 -- 172.21.15.88:0/3537063507 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c40036a0 con 0x7fb9c80d1bb0 2023-05-17T12:26:51.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cfbff700 1 -- 172.21.15.88:0/3537063507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c80d1bb0 msgr2=0x7fb9c80d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cfbff700 1 --2- 172.21.15.88:0/3537063507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c80d1bb0 0x7fb9c80d1f80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80cea20 tx=0x7fb9c4009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cfbff700 1 -- 172.21.15.88:0/3537063507 shutdown_connections 2023-05-17T12:26:51.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cfbff700 1 --2- 172.21.15.88:0/3537063507 >> v2:172.21.15.187:3300/0 conn(0x7fb9c815d990 0x7fb9c806c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cfbff700 1 --2- 172.21.15.88:0/3537063507 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c80d1bb0 0x7fb9c80d1f80 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cfbff700 1 -- 172.21.15.88:0/3537063507 >> 172.21.15.88:0/3537063507 conn(0x7fb9c80d3ed0 msgr2=0x7fb9c80cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:51.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cfbff700 1 -- 172.21.15.88:0/3537063507 shutdown_connections 2023-05-17T12:26:51.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.264+0000 7fb9cfbff700 1 -- 172.21.15.88:0/3537063507 wait complete. 2023-05-17T12:26:51.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.266+0000 7fb9cfbff700 1 Processor -- start 2023-05-17T12:26:51.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.266+0000 7fb9cfbff700 1 -- start start 2023-05-17T12:26:51.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9cfbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9c80cf650 0x7fb9c815e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9cfbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9c80d1bb0 0x7fb9c8152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9cfbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c815d990 0x7fb9c814db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9cfbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80ca790 con 0x7fb9c815d990 2023-05-17T12:26:51.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9cfbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8152d60 con 0x7fb9c80cf650 2023-05-17T12:26:51.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9cfbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c814e080 con 0x7fb9c80d1bb0 2023-05-17T12:26:51.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9ce19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c815d990 0x7fb9c814db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9ce19c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c815d990 0x7fb9c814db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46046/0 (socket says 172.21.15.88:46046) 2023-05-17T12:26:51.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9ce19c700 1 -- 172.21.15.88:0/1211638629 learned_addr learned my addr 172.21.15.88:0/1211638629 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:51.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9cd99b700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9c80cf650 0x7fb9c815e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.267+0000 7fb9cd19a700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9c80d1bb0 0x7fb9c8152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9ce19c700 1 -- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9c80d1bb0 msgr2=0x7fb9c8152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9ce19c700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9c80d1bb0 0x7fb9c8152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9ce19c700 1 -- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9c80cf650 msgr2=0x7fb9c815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9ce19c700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9c80cf650 0x7fb9c815e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9ce19c700 1 -- 172.21.15.88:0/1211638629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4009550 con 0x7fb9c815d990 2023-05-17T12:26:51.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9ce19c700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c815d990 0x7fb9c814db40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000cd80 tx=0x7fb9c000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:51.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9be7fc700 1 -- 172.21.15.88:0/1211638629 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000f480 con 0x7fb9c815d990 2023-05-17T12:26:51.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9be7fc700 1 -- 172.21.15.88:0/1211638629 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c000f600 con 0x7fb9c815d990 2023-05-17T12:26:51.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9be7fc700 1 -- 172.21.15.88:0/1211638629 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000f9b0 con 0x7fb9c815d990 2023-05-17T12:26:51.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c815d470 con 0x7fb9c815d990 2023-05-17T12:26:51.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.268+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c815d190 con 0x7fb9c815d990 2023-05-17T12:26:51.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.270+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c80cdfa0 con 0x7fb9c815d990 2023-05-17T12:26:51.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.270+0000 7fb9be7fc700 1 -- 172.21.15.88:0/1211638629 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9c000b040 con 0x7fb9c815d990 2023-05-17T12:26:51.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.271+0000 7fb9be7fc700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb9ac06ace0 0x7fb9ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.272+0000 7fb9be7fc700 1 -- 172.21.15.88:0/1211638629 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb9c0089930 con 0x7fb9c815d990 2023-05-17T12:26:51.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.272+0000 7fb9cd99b700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb9ac06ace0 0x7fb9ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.273+0000 7fb9cd99b700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb9ac06ace0 0x7fb9ac06d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009130 tx=0x7fb9c4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:51.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.275+0000 7fb9be7fc700 1 -- 172.21.15.88:0/1211638629 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb9c0054c80 con 0x7fb9c815d990 2023-05-17T12:26:51.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.553+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fb9c80ca940 con 0x7fb9c815d990 2023-05-17T12:26:51.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.557+0000 7fb9be7fc700 1 -- 172.21.15.88:0/1211638629 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb9c80ca940 con 0x7fb9c815d990 2023-05-17T12:26:51.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb9ac06ace0 msgr2=0x7fb9ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb9ac06ace0 0x7fb9ac06d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009130 tx=0x7fb9c4008030 comp rx=0 tx=0).stop 2023-05-17T12:26:51.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c815d990 msgr2=0x7fb9c814db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c815d990 0x7fb9c814db40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000cd80 tx=0x7fb9c000a560 comp rx=0 tx=0).stop 2023-05-17T12:26:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 shutdown_connections 2023-05-17T12:26:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fb9ac06ace0 0x7fb9ac06d190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c815d990 0x7fb9c814db40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9c80cf650 0x7fb9c815e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 --2- 172.21.15.88:0/1211638629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9c80d1bb0 0x7fb9c8152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 >> 172.21.15.88:0/1211638629 conn(0x7fb9c80d3ed0 msgr2=0x7fb9c80d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 shutdown_connections 2023-05-17T12:26:51.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.559+0000 7fb9cfbff700 1 -- 172.21.15.88:0/1211638629 wait complete. 2023-05-17T12:26:51.580 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:51.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.760+0000 7ff93cbff700 1 Processor -- start 2023-05-17T12:26:51.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.760+0000 7ff93cbff700 1 -- start start 2023-05-17T12:26:51.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.761+0000 7ff93cbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 0x7ff93806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.761+0000 7ff93cbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff93806c330 0x7ff93806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.761+0000 7ff93cbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9380cd6b0 con 0x7ff93815c840 2023-05-17T12:26:51.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.761+0000 7ff93cbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9380cdf50 con 0x7ff93806c330 2023-05-17T12:26:51.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.761+0000 7ff93cbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93806ccf0 con 0x7ff93806b0b0 2023-05-17T12:26:51.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.761+0000 7ff936d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff93806c330 0x7ff93806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.761+0000 7ff936d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff93806c330 0x7ff93806c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46056/0 (socket says 172.21.15.88:46056) 2023-05-17T12:26:51.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.761+0000 7ff936d9d700 1 -- 172.21.15.88:0/188711056 learned_addr learned my addr 172.21.15.88:0/188711056 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:51.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff936d9d700 1 -- 172.21.15.88:0/188711056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 msgr2=0x7ff93806b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:51.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff92ffff700 1 --2- 172.21.15.88:0/188711056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 0x7ff93806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff936d9d700 1 --2- 172.21.15.88:0/188711056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 0x7ff93806b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff936d9d700 1 -- 172.21.15.88:0/188711056 >> v1:172.21.15.187:6789/0 conn(0x7ff93815c840 legacy=0x7ff9380cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff936d9d700 1 -- 172.21.15.88:0/188711056 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380b2460 con 0x7ff93806c330 2023-05-17T12:26:51.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff92ffff700 1 --2- 172.21.15.88:0/188711056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 0x7ff93806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:51.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff936d9d700 1 --2- 172.21.15.88:0/188711056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93806c330 0x7ff93806c7b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff930009e50 tx=0x7ff93000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dd1e380e62b16c server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:51.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff935d9b700 1 -- 172.21.15.88:0/188711056 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000e070 con 0x7ff93806c330 2023-05-17T12:26:51.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff935d9b700 1 -- 172.21.15.88:0/188711056 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93000b9c0 con 0x7ff93806c330 2023-05-17T12:26:51.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.762+0000 7ff935d9b700 1 -- 172.21.15.88:0/188711056 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000bd70 con 0x7ff93806c330 2023-05-17T12:26:51.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.763+0000 7ff93cbff700 1 -- 172.21.15.88:0/188711056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93806c330 msgr2=0x7ff93806c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.763+0000 7ff93cbff700 1 --2- 172.21.15.88:0/188711056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93806c330 0x7ff93806c7b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff930009e50 tx=0x7ff93000b330 comp rx=0 tx=0).stop 2023-05-17T12:26:51.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.763+0000 7ff93cbff700 1 -- 172.21.15.88:0/188711056 shutdown_connections 2023-05-17T12:26:51.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.763+0000 7ff93cbff700 1 --2- 172.21.15.88:0/188711056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93806c330 0x7ff93806c7b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.763+0000 7ff93cbff700 1 --2- 172.21.15.88:0/188711056 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 0x7ff93806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.763+0000 7ff93cbff700 1 -- 172.21.15.88:0/188711056 >> 172.21.15.88:0/188711056 conn(0x7ff9380d3060 msgr2=0x7ff9380d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:51.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.763+0000 7ff93cbff700 1 -- 172.21.15.88:0/188711056 shutdown_connections 2023-05-17T12:26:51.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.763+0000 7ff93cbff700 1 -- 172.21.15.88:0/188711056 wait complete. 2023-05-17T12:26:51.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.765+0000 7ff93cbff700 1 Processor -- start 2023-05-17T12:26:51.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.765+0000 7ff93cbff700 1 -- start start 2023-05-17T12:26:51.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff93cbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 0x7ff938158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff93cbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff93806c330 0x7ff9381e3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff93cbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93815c840 0x7ff9380c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff93cbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938159dd0 con 0x7ff93815c840 2023-05-17T12:26:51.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff93cbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381591c0 con 0x7ff93806c330 2023-05-17T12:26:51.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff93cbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381594a0 con 0x7ff93806b0b0 2023-05-17T12:26:51.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff936d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93815c840 0x7ff9380c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff936d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93815c840 0x7ff9380c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46060/0 (socket says 172.21.15.88:46060) 2023-05-17T12:26:51.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff936d9d700 1 -- 172.21.15.88:0/3109074798 learned_addr learned my addr 172.21.15.88:0/3109074798 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:51.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff92ffff700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff93806c330 0x7ff9381e3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff93659c700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 0x7ff938158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff936d9d700 1 -- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 msgr2=0x7ff938158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff936d9d700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 0x7ff938158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff936d9d700 1 -- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff93806c330 msgr2=0x7ff9381e3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff936d9d700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff93806c330 0x7ff9381e3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.766+0000 7ff936d9d700 1 -- 172.21.15.88:0/3109074798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930009b30 con 0x7ff93815c840 2023-05-17T12:26:51.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.767+0000 7ff936d9d700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93815c840 0x7ff9380c8c60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff9380d3d00 tx=0x7ff930004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:51.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.767+0000 7ff92effd700 1 -- 172.21.15.88:0/3109074798 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9300092e0 con 0x7ff93815c840 2023-05-17T12:26:51.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.767+0000 7ff92effd700 1 -- 172.21.15.88:0/3109074798 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9300099b0 con 0x7ff93815c840 2023-05-17T12:26:51.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.767+0000 7ff92effd700 1 -- 172.21.15.88:0/3109074798 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93001c680 con 0x7ff93815c840 2023-05-17T12:26:51.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.767+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9380cd900 con 0x7ff93815c840 2023-05-17T12:26:51.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.767+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9380b2740 con 0x7ff93815c840 2023-05-17T12:26:51.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.768+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9380cdbe0 con 0x7ff93815c840 2023-05-17T12:26:51.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.769+0000 7ff92effd700 1 -- 172.21.15.88:0/3109074798 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff93001c7e0 con 0x7ff93815c840 2023-05-17T12:26:51.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.770+0000 7ff92effd700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff91806ad10 0x7ff91806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:51.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.770+0000 7ff92effd700 1 -- 172.21.15.88:0/3109074798 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff93008b0d0 con 0x7ff93815c840 2023-05-17T12:26:51.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.770+0000 7ff93659c700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff91806ad10 0x7ff91806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:51.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.771+0000 7ff93659c700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff91806ad10 0x7ff91806d1c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff928000f60 tx=0x7ff928009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:51.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.774+0000 7ff92effd700 1 -- 172.21.15.88:0/3109074798 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff930056380 con 0x7ff93815c840 2023-05-17T12:26:51.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.967+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff938074530 con 0x7ff93815c840 2023-05-17T12:26:51.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.968+0000 7ff92effd700 1 -- 172.21.15.88:0/3109074798 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+14832 (secure 0 0 0) 0x7ff9300599a0 con 0x7ff93815c840 2023-05-17T12:26:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:51.972 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:26:48.038179+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff91806ad10 msgr2=0x7ff91806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff91806ad10 0x7ff91806d1c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff928000f60 tx=0x7ff928009040 comp rx=0 tx=0).stop 2023-05-17T12:26:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93815c840 msgr2=0x7ff9380c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93815c840 0x7ff9380c8c60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff9380d3d00 tx=0x7ff930004ad0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 shutdown_connections 2023-05-17T12:26:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff91806ad10 0x7ff91806d1c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff93815c840 0x7ff9380c8c60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff93806b0b0 0x7ff938158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 --2- 172.21.15.88:0/3109074798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff93806c330 0x7ff9381e3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 >> 172.21.15.88:0/3109074798 conn(0x7ff9380d3060 msgr2=0x7ff9380cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 shutdown_connections 2023-05-17T12:26:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:51.970+0000 7ff93cbff700 1 -- 172.21.15.88:0/3109074798 wait complete. 2023-05-17T12:26:51.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-17T12:24:47.499653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-17T12:24:54.004138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-17T12:26:51.992 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-17T12:26:52.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.175+0000 7f8778bff700 1 Processor -- start 2023-05-17T12:26:52.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.175+0000 7f8778bff700 1 -- start start 2023-05-17T12:26:52.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.176+0000 7f8778bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f877406c760 0x7f877406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.176+0000 7f8778bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87740b23a0 0x7f877406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.176+0000 7f8778bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877406b4a0 con 0x7f87740cf190 2023-05-17T12:26:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.176+0000 7f8778bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877406a510 con 0x7f87740b23a0 2023-05-17T12:26:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.176+0000 7f8778bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877406d070 con 0x7f877406c760 2023-05-17T12:26:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.177+0000 7f876bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f87740b23a0 0x7f877406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.177+0000 7f8772d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f87740cf190 0x7f8774160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41256/0 (socket says 172.21.15.88:41256) 2023-05-17T12:26:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.177+0000 7f8772d9d700 1 -- 172.21.15.88:0/4041679655 learned_addr learned my addr 172.21.15.88:0/4041679655 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:52.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.177+0000 7f877259c700 1 --2- 172.21.15.88:0/4041679655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f877406c760 0x7f877406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.177+0000 7f876bfff700 1 -- 172.21.15.88:0/4041679655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f877406c760 msgr2=0x7f877406af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:52.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.177+0000 7f876bfff700 1 --2- 172.21.15.88:0/4041679655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f877406c760 0x7f877406af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.177+0000 7f876bfff700 1 -- 172.21.15.88:0/4041679655 >> v1:172.21.15.88:6789/0 conn(0x7f87740cf190 legacy=0x7f8774160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.177+0000 7f876bfff700 1 -- 172.21.15.88:0/4041679655 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740cd840 con 0x7f87740b23a0 2023-05-17T12:26:52.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.177+0000 7f8771d9b700 1 -- 172.21.15.88:0/4041679655 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868578534 0 0) 0x7f876c001490 con 0x7f87740cf190 2023-05-17T12:26:52.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f876bfff700 1 --2- 172.21.15.88:0/4041679655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740b23a0 0x7f877406cb30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f875c009840 tx=0x7f875c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd59c18ac9ff34a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:52.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8771d9b700 1 -- 172.21.15.88:0/4041679655 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c011830 con 0x7f87740b23a0 2023-05-17T12:26:52.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8771d9b700 1 -- 172.21.15.88:0/4041679655 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c011990 con 0x7f87740b23a0 2023-05-17T12:26:52.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8771d9b700 1 -- 172.21.15.88:0/4041679655 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c011d20 con 0x7f87740b23a0 2023-05-17T12:26:52.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8778bff700 1 -- 172.21.15.88:0/4041679655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740b23a0 msgr2=0x7f877406cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8778bff700 1 --2- 172.21.15.88:0/4041679655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740b23a0 0x7f877406cb30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f875c009840 tx=0x7f875c009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8778bff700 1 -- 172.21.15.88:0/4041679655 shutdown_connections 2023-05-17T12:26:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8778bff700 1 --2- 172.21.15.88:0/4041679655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f877406c760 0x7f877406af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8778bff700 1 --2- 172.21.15.88:0/4041679655 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740b23a0 0x7f877406cb30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8778bff700 1 -- 172.21.15.88:0/4041679655 >> 172.21.15.88:0/4041679655 conn(0x7f87740d06f0 msgr2=0x7f87740d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.178+0000 7f8778bff700 1 -- 172.21.15.88:0/4041679655 shutdown_connections 2023-05-17T12:26:52.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.179+0000 7f8778bff700 1 -- 172.21.15.88:0/4041679655 wait complete. 2023-05-17T12:26:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.181+0000 7f8778bff700 1 Processor -- start 2023-05-17T12:26:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.181+0000 7f8778bff700 1 -- start start 2023-05-17T12:26:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.182+0000 7f8778bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f877406c760 0x7f87740cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.182+0000 7f8778bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740cf190 0x7f87740b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.182+0000 7f8778bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87740b3010 0x7f87740b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.182+0000 7f8778bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740b34b0 con 0x7f87740cf190 2023-05-17T12:26:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.182+0000 7f8778bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740b5920 con 0x7f877406c760 2023-05-17T12:26:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.182+0000 7f8778bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87740c73d0 con 0x7f87740b3010 2023-05-17T12:26:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.182+0000 7f876bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740cf190 0x7f87740b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.182+0000 7f876bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740cf190 0x7f87740b2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46074/0 (socket says 172.21.15.88:46074) 2023-05-17T12:26:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876bfff700 1 -- 172.21.15.88:0/3513602117 learned_addr learned my addr 172.21.15.88:0/3513602117 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f877259c700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f877406c760 0x7f87740cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f8772d9d700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87740b3010 0x7f87740b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876bfff700 1 -- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87740b3010 msgr2=0x7f87740b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876bfff700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87740b3010 0x7f87740b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876bfff700 1 -- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f877406c760 msgr2=0x7f87740cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876bfff700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f877406c760 0x7f87740cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876bfff700 1 -- 172.21.15.88:0/3513602117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c0094a0 con 0x7f87740cf190 2023-05-17T12:26:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f877259c700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f877406c760 0x7f87740cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:52.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876bfff700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740cf190 0x7f87740b2ad0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f875c009fd0 tx=0x7f875c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:52.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876affd700 1 -- 172.21.15.88:0/3513602117 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c0038a0 con 0x7f87740cf190 2023-05-17T12:26:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876affd700 1 -- 172.21.15.88:0/3513602117 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c01f070 con 0x7f87740cf190 2023-05-17T12:26:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.183+0000 7f876affd700 1 -- 172.21.15.88:0/3513602117 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c003c40 con 0x7f87740cf190 2023-05-17T12:26:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.184+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877406a760 con 0x7f87740cf190 2023-05-17T12:26:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.184+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87740cdb20 con 0x7f87740cf190 2023-05-17T12:26:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.185+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877406aa40 con 0x7f87740cf190 2023-05-17T12:26:52.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.185+0000 7f876affd700 1 -- 172.21.15.88:0/3513602117 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f875c026480 con 0x7f87740cf190 2023-05-17T12:26:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.186+0000 7f876affd700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f875406ace0 0x7f875406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.186+0000 7f876affd700 1 -- 172.21.15.88:0/3513602117 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f875c021070 con 0x7f87740cf190 2023-05-17T12:26:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.187+0000 7f877259c700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f875406ace0 0x7f875406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.188+0000 7f877259c700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f875406ace0 0x7f875406d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8764009c30 tx=0x7f8764008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:52.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.191+0000 7f876affd700 1 -- 172.21.15.88:0/3513602117 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f875c055e60 con 0x7f87740cf190 2023-05-17T12:26:52.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.384+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8774074530 con 0x7f87740cf190 2023-05-17T12:26:52.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.384+0000 7f876affd700 1 -- 172.21.15.88:0/3513602117 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f875c0150a0 con 0x7f87740cf190 2023-05-17T12:26:52.388 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-05-17T12:26:52.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f875406ace0 msgr2=0x7f875406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f875406ace0 0x7f875406d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8764009c30 tx=0x7f8764008040 comp rx=0 tx=0).stop 2023-05-17T12:26:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740cf190 msgr2=0x7f87740b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740cf190 0x7f87740b2ad0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f875c009fd0 tx=0x7f875c004750 comp rx=0 tx=0).stop 2023-05-17T12:26:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 shutdown_connections 2023-05-17T12:26:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f875406ace0 0x7f875406d190 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87740b3010 0x7f87740b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f877406c760 0x7f87740cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 --2- 172.21.15.88:0/3513602117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87740cf190 0x7f87740b2ad0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 >> 172.21.15.88:0/3513602117 conn(0x7f87740d06f0 msgr2=0x7f87740b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:52.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 shutdown_connections 2023-05-17T12:26:52.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.387+0000 7f8778bff700 1 -- 172.21.15.88:0/3513602117 wait complete. 2023-05-17T12:26:52.408 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-17T12:26:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.594+0000 7f84efdff700 1 Processor -- start 2023-05-17T12:26:52.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.594+0000 7f84efdff700 1 -- start start 2023-05-17T12:26:52.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.595+0000 7f84efdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e806af60 0x7f84e8160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.595+0000 7f84efdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e806a510 con 0x7f84e80b23a0 2023-05-17T12:26:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.595+0000 7f84efdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e80cf8a0 con 0x7f84e806c760 2023-05-17T12:26:52.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.595+0000 7f84efdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80cd840 con 0x7f84e806af60 2023-05-17T12:26:52.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.595+0000 7f84ed39a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f84e80b23a0 0x7f84e80cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41258/0 (socket says 172.21.15.88:41258) 2023-05-17T12:26:52.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.595+0000 7f84ed39a700 1 -- 172.21.15.88:0/2705995360 learned_addr learned my addr 172.21.15.88:0/2705995360 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:52.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.596+0000 7f84ee39c700 1 --2- 172.21.15.88:0/2705995360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e806af60 0x7f84e8160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.596+0000 7f84ecb99700 1 -- 172.21.15.88:0/2705995360 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465045650 0 0) 0x7f84e806a510 con 0x7f84e80b23a0 2023-05-17T12:26:52.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.596+0000 7f84ecb99700 1 -- 172.21.15.88:0/2705995360 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d40035b0 con 0x7f84e80b23a0 2023-05-17T12:26:52.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.596+0000 7f84ecb99700 1 -- 172.21.15.88:0/2705995360 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810302212 0 0) 0x7f84e80cf8a0 con 0x7f84e806c760 2023-05-17T12:26:52.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.596+0000 7f84ecb99700 1 -- 172.21.15.88:0/2705995360 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e806a510 con 0x7f84e806c760 2023-05-17T12:26:52.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.596+0000 7f84ee39c700 1 -- 172.21.15.88:0/2705995360 >> v1:172.21.15.187:6789/0 conn(0x7f84e806c760 legacy=0x7f84e806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.596+0000 7f84ee39c700 1 -- 172.21.15.88:0/2705995360 >> v1:172.21.15.88:6789/0 conn(0x7f84e80b23a0 legacy=0x7f84e80cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.596+0000 7f84ee39c700 1 -- 172.21.15.88:0/2705995360 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80cdb20 con 0x7f84e806af60 2023-05-17T12:26:52.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84ee39c700 1 --2- 172.21.15.88:0/2705995360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e806af60 0x7f84e8160380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009dc0 tx=0x7f84e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6010b6a9d24f3447 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:52.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84ecb99700 1 -- 172.21.15.88:0/2705995360 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000e070 con 0x7f84e806af60 2023-05-17T12:26:52.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84ecb99700 1 -- 172.21.15.88:0/2705995360 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e000bb20 con 0x7f84e806af60 2023-05-17T12:26:52.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84ecb99700 1 -- 172.21.15.88:0/2705995360 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0012430 con 0x7f84e806af60 2023-05-17T12:26:52.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84efdff700 1 -- 172.21.15.88:0/2705995360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e806af60 msgr2=0x7f84e8160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84efdff700 1 --2- 172.21.15.88:0/2705995360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e806af60 0x7f84e8160380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009dc0 tx=0x7f84e000b330 comp rx=0 tx=0).stop 2023-05-17T12:26:52.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84efdff700 1 -- 172.21.15.88:0/2705995360 shutdown_connections 2023-05-17T12:26:52.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84efdff700 1 --2- 172.21.15.88:0/2705995360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e806af60 0x7f84e8160380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84efdff700 1 -- 172.21.15.88:0/2705995360 >> 172.21.15.88:0/2705995360 conn(0x7f84e80d06f0 msgr2=0x7f84e80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:52.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84efdff700 1 -- 172.21.15.88:0/2705995360 shutdown_connections 2023-05-17T12:26:52.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.597+0000 7f84efdff700 1 -- 172.21.15.88:0/2705995360 wait complete. 2023-05-17T12:26:52.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.599+0000 7f84efdff700 1 Processor -- start 2023-05-17T12:26:52.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.599+0000 7f84efdff700 1 -- start start 2023-05-17T12:26:52.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.600+0000 7f84efdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84e806af60 0x7f84e815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.600+0000 7f84efdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e806c760 0x7f84e80b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.600+0000 7f84efdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e814f010 0x7f84e814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.600+0000 7f84efdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e814c6d0 con 0x7f84e806c760 2023-05-17T12:26:52.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.600+0000 7f84efdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e815b170 con 0x7f84e806af60 2023-05-17T12:26:52.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.600+0000 7f84efdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e815b450 con 0x7f84e814f010 2023-05-17T12:26:52.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.600+0000 7f84ed39a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e806c760 0x7f84e80b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.600+0000 7f84ed39a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e806c760 0x7f84e80b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46090/0 (socket says 172.21.15.88:46090) 2023-05-17T12:26:52.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.600+0000 7f84ed39a700 1 -- 172.21.15.88:0/1158366397 learned_addr learned my addr 172.21.15.88:0/1158366397 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:52.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84edb9b700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84e806af60 0x7f84e815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84ee39c700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e814f010 0x7f84e814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84ed39a700 1 -- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e814f010 msgr2=0x7f84e814e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84ed39a700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e814f010 0x7f84e814e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84ed39a700 1 -- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84e806af60 msgr2=0x7f84e815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84ed39a700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84e806af60 0x7f84e815a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84ed39a700 1 -- 172.21.15.88:0/1158366397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009a70 con 0x7f84e806c760 2023-05-17T12:26:52.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84ed39a700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e806c760 0x7f84e80b11f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f84d8001eb0 tx=0x7f84d800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:52.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84de7fc700 1 -- 172.21.15.88:0/1158366397 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8005d70 con 0x7f84e806c760 2023-05-17T12:26:52.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84de7fc700 1 -- 172.21.15.88:0/1158366397 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d80070d0 con 0x7f84e806c760 2023-05-17T12:26:52.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e806aa40 con 0x7f84e806c760 2023-05-17T12:26:52.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84de7fc700 1 -- 172.21.15.88:0/1158366397 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8007460 con 0x7f84e806c760 2023-05-17T12:26:52.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.601+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e806a760 con 0x7f84e806c760 2023-05-17T12:26:52.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.602+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e806b3c0 con 0x7f84e806c760 2023-05-17T12:26:52.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.603+0000 7f84de7fc700 1 -- 172.21.15.88:0/1158366397 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84d80075c0 con 0x7f84e806c760 2023-05-17T12:26:52.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.604+0000 7f84de7fc700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f84cc06ace0 0x7f84cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:52.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.604+0000 7f84de7fc700 1 -- 172.21.15.88:0/1158366397 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f84d80888b0 con 0x7f84e806c760 2023-05-17T12:26:52.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.605+0000 7f84edb9b700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f84cc06ace0 0x7f84cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:52.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.605+0000 7f84edb9b700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f84cc06ace0 0x7f84cc06d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f84e4001220 tx=0x7f84e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:52.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.608+0000 7f84de7fc700 1 -- 172.21.15.88:0/1158366397 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f84d8053ad0 con 0x7f84e806c760 2023-05-17T12:26:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.802+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f84e8074530 con 0x7f84e806c760 2023-05-17T12:26:52.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.802+0000 7f84de7fc700 1 -- 172.21.15.88:0/1158366397 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f84d80570f0 con 0x7f84e806c760 2023-05-17T12:26:52.807 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-05-17T12:26:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f84cc06ace0 msgr2=0x7f84cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f84cc06ace0 0x7f84cc06d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f84e4001220 tx=0x7f84e4009040 comp rx=0 tx=0).stop 2023-05-17T12:26:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e806c760 msgr2=0x7f84e80b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e806c760 0x7f84e80b11f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f84d8001eb0 tx=0x7f84d800c860 comp rx=0 tx=0).stop 2023-05-17T12:26:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 shutdown_connections 2023-05-17T12:26:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f84cc06ace0 0x7f84cc06d190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84e814f010 0x7f84e814e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84e806af60 0x7f84e815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 --2- 172.21.15.88:0/1158366397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e806c760 0x7f84e80b11f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 >> 172.21.15.88:0/1158366397 conn(0x7f84e80d06f0 msgr2=0x7f84e80b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 shutdown_connections 2023-05-17T12:26:52.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:52.805+0000 7f84efdff700 1 -- 172.21.15.88:0/1158366397 wait complete. 2023-05-17T12:26:52.825 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-17T12:26:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.006+0000 7f38a2bff700 1 Processor -- start 2023-05-17T12:26:53.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.006+0000 7f38a2bff700 1 -- start start 2023-05-17T12:26:53.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.007+0000 7f38a2bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f389c15c840 0x7f389c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.007+0000 7f38a2bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f389c06b0b0 0x7f389c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f38a2bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389c0cd6b0 con 0x7f389c06c330 2023-05-17T12:26:53.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f38a2bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c0cdf50 con 0x7f389c06b0b0 2023-05-17T12:26:53.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f38a2bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c0cf860 con 0x7f389c15c840 2023-05-17T12:26:53.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f389bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f389c06b0b0 0x7f389c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f389bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f389c06b0b0 0x7f389c0cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46096/0 (socket says 172.21.15.88:46096) 2023-05-17T12:26:53.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f389bfff700 1 -- 172.21.15.88:0/3095729314 learned_addr learned my addr 172.21.15.88:0/3095729314 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:53.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f38a099b700 1 --2- 172.21.15.88:0/3095729314 >> v2:172.21.15.187:3300/0 conn(0x7f389c15c840 0x7f389c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f389bfff700 1 -- 172.21.15.88:0/3095729314 >> v2:172.21.15.187:3300/0 conn(0x7f389c15c840 msgr2=0x7f389c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:53.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f389bfff700 1 --2- 172.21.15.88:0/3095729314 >> v2:172.21.15.187:3300/0 conn(0x7f389c15c840 0x7f389c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f389bfff700 1 -- 172.21.15.88:0/3095729314 >> v1:172.21.15.187:6789/0 conn(0x7f389c06c330 legacy=0x7f389c160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:53.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f389bfff700 1 -- 172.21.15.88:0/3095729314 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c0b2460 con 0x7f389c06b0b0 2023-05-17T12:26:53.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.008+0000 7f389bfff700 1 --2- 172.21.15.88:0/3095729314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 0x7f389c0cf320 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f389c0cfa40 tx=0x7f3888009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7167ce1ee6b8eea server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:53.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f389b7fe700 1 -- 172.21.15.88:0/3095729314 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888004230 con 0x7f389c06b0b0 2023-05-17T12:26:53.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f389b7fe700 1 -- 172.21.15.88:0/3095729314 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3888004390 con 0x7f389c06b0b0 2023-05-17T12:26:53.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f389b7fe700 1 -- 172.21.15.88:0/3095729314 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38880036a0 con 0x7f389c06b0b0 2023-05-17T12:26:53.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f38a2bff700 1 -- 172.21.15.88:0/3095729314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 msgr2=0x7f389c0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f38a2bff700 1 --2- 172.21.15.88:0/3095729314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 0x7f389c0cf320 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f389c0cfa40 tx=0x7f3888009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f38a2bff700 1 -- 172.21.15.88:0/3095729314 shutdown_connections 2023-05-17T12:26:53.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f38a2bff700 1 --2- 172.21.15.88:0/3095729314 >> v2:172.21.15.187:3300/0 conn(0x7f389c15c840 0x7f389c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f38a2bff700 1 --2- 172.21.15.88:0/3095729314 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 0x7f389c0cf320 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f38a2bff700 1 -- 172.21.15.88:0/3095729314 >> 172.21.15.88:0/3095729314 conn(0x7f389c0d3060 msgr2=0x7f389c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:53.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f38a2bff700 1 -- 172.21.15.88:0/3095729314 shutdown_connections 2023-05-17T12:26:53.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.009+0000 7f38a2bff700 1 -- 172.21.15.88:0/3095729314 wait complete. 2023-05-17T12:26:53.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.011+0000 7f38a2bff700 1 Processor -- start 2023-05-17T12:26:53.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.011+0000 7f38a2bff700 1 -- start start 2023-05-17T12:26:53.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.012+0000 7f38a2bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 0x7f389c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.012+0000 7f38a2bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f389c06c330 0x7f389c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.012+0000 7f38a2bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389c15c840 0x7f389c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.012+0000 7f38a2bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c0b36c0 con 0x7f389c06b0b0 2023-05-17T12:26:53.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.012+0000 7f38a2bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c151a90 con 0x7f389c06c330 2023-05-17T12:26:53.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.012+0000 7f38a2bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389c0b2a40 con 0x7f389c15c840 2023-05-17T12:26:53.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.012+0000 7f38a099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 0x7f389c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.012+0000 7f38a099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 0x7f389c151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46100/0 (socket says 172.21.15.88:46100) 2023-05-17T12:26:53.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.012+0000 7f38a099b700 1 -- 172.21.15.88:0/1527199958 learned_addr learned my addr 172.21.15.88:0/1527199958 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:53.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f389bfff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f389c06c330 0x7f389c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38a119c700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389c15c840 0x7f389c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38a099b700 1 -- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389c15c840 msgr2=0x7f389c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38a099b700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389c15c840 0x7f389c0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38a099b700 1 -- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f389c06c330 msgr2=0x7f389c152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38a099b700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f389c06c330 0x7f389c152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38a099b700 1 -- 172.21.15.88:0/1527199958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3888009550 con 0x7f389c06b0b0 2023-05-17T12:26:53.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f389bfff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f389c06c330 0x7f389c152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:53.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38a099b700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 0x7f389c151550 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f389000d800 tx=0x7f389000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:53.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38997fa700 1 -- 172.21.15.88:0/1527199958 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38900125f0 con 0x7f389c06b0b0 2023-05-17T12:26:53.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38997fa700 1 -- 172.21.15.88:0/1527199958 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3890012750 con 0x7f389c06b0b0 2023-05-17T12:26:53.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c0cd900 con 0x7f389c06b0b0 2023-05-17T12:26:53.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38997fa700 1 -- 172.21.15.88:0/1527199958 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890012b00 con 0x7f389c06b0b0 2023-05-17T12:26:53.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.013+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c0b2740 con 0x7f389c06b0b0 2023-05-17T12:26:53.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.014+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389c0cdbe0 con 0x7f389c06b0b0 2023-05-17T12:26:53.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.015+0000 7f38997fa700 1 -- 172.21.15.88:0/1527199958 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3890012c60 con 0x7f389c06b0b0 2023-05-17T12:26:53.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.016+0000 7f38997fa700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f388006ace0 0x7f388006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.017+0000 7f38997fa700 1 -- 172.21.15.88:0/1527199958 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f38900896d0 con 0x7f389c06b0b0 2023-05-17T12:26:53.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.017+0000 7f389bfff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f388006ace0 0x7f388006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.018+0000 7f389bfff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f388006ace0 0x7f388006d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3888009130 tx=0x7f3888008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:53.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.021+0000 7f38997fa700 1 -- 172.21.15.88:0/1527199958 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f38900548f0 con 0x7f389c06b0b0 2023-05-17T12:26:53.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.214+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f389c0b3930 con 0x7f389c06b0b0 2023-05-17T12:26:53.219 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.215+0000 7f38997fa700 1 -- 172.21.15.88:0/1527199958 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3890057f10 con 0x7f389c06b0b0 2023-05-17T12:26:53.219 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:53.220 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-05-17T12:26:53.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:53.220 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-05-17T12:26:53.221 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-05-17T12:26:53.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:26:53.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-05-17T12:26:53.221 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 2, 2023-05-17T12:26:53.221 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "rbd" 2023-05-17T12:26:53.221 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:26:53.221 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-05-17T12:26:53.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f388006ace0 msgr2=0x7f388006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f388006ace0 0x7f388006d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3888009130 tx=0x7f3888008030 comp rx=0 tx=0).stop 2023-05-17T12:26:53.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 msgr2=0x7f389c151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 0x7f389c151550 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f389000d800 tx=0x7f389000dbc0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 shutdown_connections 2023-05-17T12:26:53.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f388006ace0 0x7f388006d190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f389c15c840 0x7f389c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f389c06b0b0 0x7f389c151550 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 --2- 172.21.15.88:0/1527199958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f389c06c330 0x7f389c152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 >> 172.21.15.88:0/1527199958 conn(0x7f389c0d3060 msgr2=0x7f389c06c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:53.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 shutdown_connections 2023-05-17T12:26:53.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.217+0000 7f38a2bff700 1 -- 172.21.15.88:0/1527199958 wait complete. 2023-05-17T12:26:53.237 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-17T12:26:53.238 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-17T12:26:53.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.423+0000 7f8ea37ff700 1 Processor -- start 2023-05-17T12:26:53.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.423+0000 7f8ea37ff700 1 -- start start 2023-05-17T12:26:53.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.424+0000 7f8ea37ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8e9c15c840 0x7f8e9c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.424+0000 7f8ea37ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e9c06c330 0x7f8e9c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.424+0000 7f8ea37ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c0cd6b0 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.424+0000 7f8ea37ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c0cdf50 con 0x7f8e9c06c330 2023-05-17T12:26:53.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.424+0000 7f8ea37ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c06ccb0 con 0x7f8e9c15c840 2023-05-17T12:26:53.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.424+0000 7f8ea1d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e9c06c330 0x7f8e9c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.424+0000 7f8ea1d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e9c06c330 0x7f8e9c06c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46104/0 (socket says 172.21.15.88:46104) 2023-05-17T12:26:53.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.424+0000 7f8ea1d9c700 1 -- 172.21.15.88:0/2415677926 learned_addr learned my addr 172.21.15.88:0/2415677926 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:53.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.425+0000 7f8ea159b700 1 --2- 172.21.15.88:0/2415677926 >> v2:172.21.15.187:3300/0 conn(0x7f8e9c15c840 0x7f8e9c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.425+0000 7f8ea1d9c700 1 -- 172.21.15.88:0/2415677926 >> v2:172.21.15.187:3300/0 conn(0x7f8e9c15c840 msgr2=0x7f8e9c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:53.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.425+0000 7f8ea1d9c700 1 --2- 172.21.15.88:0/2415677926 >> v2:172.21.15.187:3300/0 conn(0x7f8e9c15c840 0x7f8e9c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.425+0000 7f8ea1d9c700 1 -- 172.21.15.88:0/2415677926 >> v1:172.21.15.187:6789/0 conn(0x7f8e9c06b0b0 legacy=0x7f8e9c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.425+0000 7f8ea1d9c700 1 -- 172.21.15.88:0/2415677926 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0b2460 con 0x7f8e9c06c330 2023-05-17T12:26:53.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.425+0000 7f8ea1d9c700 1 --2- 172.21.15.88:0/2415677926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06c330 0x7f8e9c06c770 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0cfa40 tx=0x7f8e9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cd2b3dc06ff362 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:53.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.425+0000 7f8e93fff700 1 -- 172.21.15.88:0/2415677926 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400e070 con 0x7f8e9c06c330 2023-05-17T12:26:53.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.425+0000 7f8e93fff700 1 -- 172.21.15.88:0/2415677926 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9400b910 con 0x7f8e9c06c330 2023-05-17T12:26:53.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.425+0000 7f8e93fff700 1 -- 172.21.15.88:0/2415677926 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400bcc0 con 0x7f8e9c06c330 2023-05-17T12:26:53.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.426+0000 7f8ea37ff700 1 -- 172.21.15.88:0/2415677926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06c330 msgr2=0x7f8e9c06c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.426+0000 7f8ea37ff700 1 --2- 172.21.15.88:0/2415677926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06c330 0x7f8e9c06c770 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0cfa40 tx=0x7f8e9400b330 comp rx=0 tx=0).stop 2023-05-17T12:26:53.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.426+0000 7f8ea37ff700 1 -- 172.21.15.88:0/2415677926 shutdown_connections 2023-05-17T12:26:53.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.426+0000 7f8ea37ff700 1 --2- 172.21.15.88:0/2415677926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06c330 0x7f8e9c06c770 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.426+0000 7f8ea37ff700 1 --2- 172.21.15.88:0/2415677926 >> v2:172.21.15.187:3300/0 conn(0x7f8e9c15c840 0x7f8e9c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.426+0000 7f8ea37ff700 1 -- 172.21.15.88:0/2415677926 >> 172.21.15.88:0/2415677926 conn(0x7f8e9c0d3060 msgr2=0x7f8e9c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:53.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.426+0000 7f8ea37ff700 1 -- 172.21.15.88:0/2415677926 shutdown_connections 2023-05-17T12:26:53.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.426+0000 7f8ea37ff700 1 -- 172.21.15.88:0/2415677926 wait complete. 2023-05-17T12:26:53.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.428+0000 7f8ea37ff700 1 Processor -- start 2023-05-17T12:26:53.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.428+0000 7f8ea37ff700 1 -- start start 2023-05-17T12:26:53.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea37ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06b0b0 0x7f8e9c159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea37ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c06c330 0x7f8e9c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea37ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c15c840 0x7f8e9c15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea37ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c157b10 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea37ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c1599c0 con 0x7f8e9c15c840 2023-05-17T12:26:53.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea37ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c159ca0 con 0x7f8e9c06c330 2023-05-17T12:26:53.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea159b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06b0b0 0x7f8e9c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea159b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06b0b0 0x7f8e9c159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46116/0 (socket says 172.21.15.88:46116) 2023-05-17T12:26:53.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea159b700 1 -- 172.21.15.88:0/704038920 learned_addr learned my addr 172.21.15.88:0/704038920 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:53.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea1d9c700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c15c840 0x7f8e9c15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea0d9a700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c06c330 0x7f8e9c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea159b700 1 -- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c06c330 msgr2=0x7f8e9c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea159b700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c06c330 0x7f8e9c0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea159b700 1 -- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c15c840 msgr2=0x7f8e9c15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea159b700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c15c840 0x7f8e9c15ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.429+0000 7f8ea159b700 1 -- 172.21.15.88:0/704038920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e94009b30 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.430+0000 7f8ea159b700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06b0b0 0x7f8e9c159330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e870 tx=0x7f8e9800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:53.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.430+0000 7f8e91ffb700 1 -- 172.21.15.88:0/704038920 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98009590 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.430+0000 7f8e91ffb700 1 -- 172.21.15.88:0/704038920 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98013680 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.430+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c0cd900 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.430+0000 7f8e91ffb700 1 -- 172.21.15.88:0/704038920 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980139f0 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.430+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c0b2740 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.431+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c0cdbe0 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.432+0000 7f8e91ffb700 1 -- 172.21.15.88:0/704038920 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e98013b50 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.433+0000 7f8e91ffb700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8e8006ace0 0x7f8e8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:53.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.433+0000 7f8e91ffb700 1 -- 172.21.15.88:0/704038920 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8e980891f0 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.433+0000 7f8ea0d9a700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8e8006ace0 0x7f8e8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:53.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.434+0000 7f8ea0d9a700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8e8006ace0 0x7f8e8006d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c06ced0 tx=0x7f8e8c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:53.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.437+0000 7f8e91ffb700 1 -- 172.21.15.88:0/704038920 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8e98054420 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.631+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8e9c144330 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.799+0000 7f8e91ffb700 1 -- 172.21.15.88:0/704038920 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8e98057a40 con 0x7f8e9c06b0b0 2023-05-17T12:26:53.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.805+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8e8006ace0 msgr2=0x7f8e8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.805+0000 7f8ea37ff700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8e8006ace0 0x7f8e8006d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c06ced0 tx=0x7f8e8c009040 comp rx=0 tx=0).stop 2023-05-17T12:26:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.805+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06b0b0 msgr2=0x7f8e9c159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.805+0000 7f8ea37ff700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06b0b0 0x7f8e9c159330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e870 tx=0x7f8e9800eb80 comp rx=0 tx=0).stop 2023-05-17T12:26:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.807+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 shutdown_connections 2023-05-17T12:26:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.807+0000 7f8ea37ff700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f8e8006ace0 0x7f8e8006d190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.807+0000 7f8ea37ff700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c15c840 0x7f8e9c15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.807+0000 7f8ea37ff700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e9c06b0b0 0x7f8e9c159330 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.807+0000 7f8ea37ff700 1 --2- 172.21.15.88:0/704038920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c06c330 0x7f8e9c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.807+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 >> 172.21.15.88:0/704038920 conn(0x7f8e9c0d3060 msgr2=0x7f8e9c0b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.807+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 shutdown_connections 2023-05-17T12:26:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:53.807+0000 7f8ea37ff700 1 -- 172.21.15.88:0/704038920 wait complete. 2023-05-17T12:26:53.813 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-05-17T12:26:53.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-17T12:26:54.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.015+0000 7ff324dff700 1 Processor -- start 2023-05-17T12:26:54.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.015+0000 7ff324dff700 1 -- start start 2023-05-17T12:26:54.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.016+0000 7ff324dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff32015c840 0x7ff32006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:54.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.016+0000 7ff324dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff32006c330 0x7ff32006c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:54.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.016+0000 7ff324dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3200cd6b0 con 0x7ff32006b0b0 2023-05-17T12:26:54.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.016+0000 7ff324dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3200cdf50 con 0x7ff32006c330 2023-05-17T12:26:54.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.016+0000 7ff324dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32006ccf0 con 0x7ff32015c840 2023-05-17T12:26:54.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.016+0000 7ff31dd9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff32006b0b0 0x7ff3200cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41262/0 (socket says 172.21.15.88:41262) 2023-05-17T12:26:54.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.016+0000 7ff31dd9b700 1 -- 172.21.15.88:0/3847599208 learned_addr learned my addr 172.21.15.88:0/3847599208 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:54.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31ed9d700 1 --2- 172.21.15.88:0/3847599208 >> v2:172.21.15.187:3300/0 conn(0x7ff32006c330 0x7ff32006c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:54.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31e59c700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff32015c840 0x7ff32006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:54.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46262146 0 0) 0x7ff3200cd6b0 con 0x7ff32006b0b0 2023-05-17T12:26:54.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3080035b0 con 0x7ff32006b0b0 2023-05-17T12:26:54.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90076436 0 0) 0x7ff3080035b0 con 0x7ff32006b0b0 2023-05-17T12:26:54.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff32015c840 msgr2=0x7ff32006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:54.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff32015c840 0x7ff32006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 >> v2:172.21.15.187:3300/0 conn(0x7ff32006c330 msgr2=0x7ff32006c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:54.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 --2- 172.21.15.88:0/3847599208 >> v2:172.21.15.187:3300/0 conn(0x7ff32006c330 0x7ff32006c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3200b2460 con 0x7ff32006b0b0 2023-05-17T12:26:54.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7ff314001670 con 0x7ff32006b0b0 2023-05-17T12:26:54.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 >> v1:172.21.15.88:6789/0 conn(0x7ff32006b0b0 legacy=0x7ff3200cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:54.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff308003a70 0x7ff308003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:54.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff32015c840 0x7ff308004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:54.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.017+0000 7ff31d59a700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff308004d90 0x7ff308005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:54.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32006ccf0 con 0x7ff308004d90 2023-05-17T12:26:54.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30800ba10 con 0x7ff308003a70 2023-05-17T12:26:54.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30800bba0 con 0x7ff32015c840 2023-05-17T12:26:54.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31ed9d700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff308004d90 0x7ff308005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:54.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31e59c700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff308003a70 0x7ff308003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:54.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31dd9b700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff32015c840 0x7ff308004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:54.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31ed9d700 1 -- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff32015c840 msgr2=0x7ff308004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:54.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31ed9d700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff32015c840 0x7ff308004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31ed9d700 1 -- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff308003a70 msgr2=0x7ff308003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:54.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31ed9d700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff308003a70 0x7ff308003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31ed9d700 1 -- 172.21.15.88:0/3847599208 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3080035b0 con 0x7ff308004d90 2023-05-17T12:26:54.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31ed9d700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff308004d90 0x7ff308005200 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff31800e170 tx=0x7ff308005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836d9f1f1622008 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:54.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.018+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31800ec90 con 0x7ff308004d90 2023-05-17T12:26:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.019+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31800f040 con 0x7ff308004d90 2023-05-17T12:26:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.019+0000 7ff31d59a700 1 -- 172.21.15.88:0/3847599208 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318014480 con 0x7ff308004d90 2023-05-17T12:26:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.019+0000 7ff324dff700 1 -- 172.21.15.88:0/3847599208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff308004d90 msgr2=0x7ff308005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.019+0000 7ff324dff700 1 --2- 172.21.15.88:0/3847599208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff308004d90 0x7ff308005200 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff31800e170 tx=0x7ff308005880 comp rx=0 tx=0).stop 2023-05-17T12:26:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.019+0000 7ff31ed9d700 1 -- 172.21.15.88:0/3847599208 reap_dead start 2023-05-17T12:26:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.019+0000 7ff324dff700 1 -- 172.21.15.88:0/3847599208 shutdown_connections 2023-05-17T12:26:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.019+0000 7ff324dff700 1 -- 172.21.15.88:0/3847599208 >> 172.21.15.88:0/3847599208 conn(0x7ff3200d3060 msgr2=0x7ff3200d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:54.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.019+0000 7ff324dff700 1 -- 172.21.15.88:0/3847599208 shutdown_connections 2023-05-17T12:26:54.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.019+0000 7ff324dff700 1 -- 172.21.15.88:0/3847599208 wait complete. 2023-05-17T12:26:54.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.021+0000 7ff324dff700 1 Processor -- start 2023-05-17T12:26:54.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.021+0000 7ff324dff700 1 -- start start 2023-05-17T12:26:54.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff324dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff308004d90 0x7ff320159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:54.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff324dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff320146390 0x7ff32015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:54.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff324dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff32015bb00 0x7ff3201f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:54.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff324dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3201580b0 con 0x7ff320146390 2023-05-17T12:26:54.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff324dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff320158300 con 0x7ff32015bb00 2023-05-17T12:26:54.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff324dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3201585e0 con 0x7ff308004d90 2023-05-17T12:26:54.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff31dd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff320146390 0x7ff32015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:54.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff31dd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff320146390 0x7ff32015b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46122/0 (socket says 172.21.15.88:46122) 2023-05-17T12:26:54.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff31dd9b700 1 -- 172.21.15.88:0/4137204834 learned_addr learned my addr 172.21.15.88:0/4137204834 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:54.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff31e59c700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff308004d90 0x7ff320159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:54.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.022+0000 7ff31ed9d700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff32015bb00 0x7ff3201f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:54.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff31dd9b700 1 -- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff308004d90 msgr2=0x7ff320159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:54.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff31dd9b700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff308004d90 0x7ff320159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff31dd9b700 1 -- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff32015bb00 msgr2=0x7ff3201f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff31dd9b700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff32015bb00 0x7ff3201f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff31dd9b700 1 -- 172.21.15.88:0/4137204834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3200cd900 con 0x7ff320146390 2023-05-17T12:26:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff31dd9b700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff320146390 0x7ff32015b5c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff314007310 tx=0x7ff314007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff30effd700 1 -- 172.21.15.88:0/4137204834 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400f660 con 0x7ff320146390 2023-05-17T12:26:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff30effd700 1 -- 172.21.15.88:0/4137204834 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31400f7c0 con 0x7ff320146390 2023-05-17T12:26:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3200b2740 con 0x7ff320146390 2023-05-17T12:26:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff30effd700 1 -- 172.21.15.88:0/4137204834 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400fb70 con 0x7ff320146390 2023-05-17T12:26:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.023+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3200cdbe0 con 0x7ff320146390 2023-05-17T12:26:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.024+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff320074530 con 0x7ff320146390 2023-05-17T12:26:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.025+0000 7ff30effd700 1 -- 172.21.15.88:0/4137204834 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff31400fcd0 con 0x7ff320146390 2023-05-17T12:26:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.026+0000 7ff30effd700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff30006ace0 0x7ff30006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.026+0000 7ff30effd700 1 -- 172.21.15.88:0/4137204834 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5900+0+0 (secure 0 0 0) 0x7ff314089340 con 0x7ff320146390 2023-05-17T12:26:54.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.027+0000 7ff31e59c700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff30006ace0 0x7ff30006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:54.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.028+0000 7ff31e59c700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff30006ace0 0x7ff30006d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff310009be0 tx=0x7ff310009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:54.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.031+0000 7ff30effd700 1 -- 172.21.15.88:0/4137204834 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff3140543f0 con 0x7ff320146390 2023-05-17T12:26:54.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.223+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff3200b7600 con 0x7ff320146390 2023-05-17T12:26:54.487 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:26:54.492 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:26:54.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.806+0000 7ff30effd700 1 -- 172.21.15.88:0/4137204834 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v40) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff314057a10 con 0x7ff320146390 2023-05-17T12:26:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff30006ace0 msgr2=0x7ff30006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:54.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff30006ace0 0x7ff30006d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff310009be0 tx=0x7ff310009210 comp rx=0 tx=0).stop 2023-05-17T12:26:54.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff320146390 msgr2=0x7ff32015b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:54.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff320146390 0x7ff32015b5c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff314007310 tx=0x7ff314007620 comp rx=0 tx=0).stop 2023-05-17T12:26:54.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 shutdown_connections 2023-05-17T12:26:54.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7ff30006ace0 0x7ff30006d190 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff32015bb00 0x7ff3201f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff308004d90 0x7ff320159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 --2- 172.21.15.88:0/4137204834 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff320146390 0x7ff32015b5c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:54.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.819+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 >> 172.21.15.88:0/4137204834 conn(0x7ff3200d3060 msgr2=0x7ff3200b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.820+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 shutdown_connections 2023-05-17T12:26:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:54.821+0000 7ff324dff700 1 -- 172.21.15.88:0/4137204834 wait complete. 2023-05-17T12:26:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-05-17T12:26:54.846 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-17T12:26:55.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.030+0000 7fa40fbff700 1 Processor -- start 2023-05-17T12:26:55.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.030+0000 7fa40fbff700 1 -- start start 2023-05-17T12:26:55.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.031+0000 7fa40fbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa40806c760 0x7fa40806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.031+0000 7fa40fbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4080b23a0 0x7fa40806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.031+0000 7fa40fbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40806b4a0 con 0x7fa4080cf190 2023-05-17T12:26:55.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.031+0000 7fa40fbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40806a510 con 0x7fa40806c760 2023-05-17T12:26:55.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.031+0000 7fa40fbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40806d070 con 0x7fa4080b23a0 2023-05-17T12:26:55.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.031+0000 7fa40d99b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa40806c760 0x7fa40806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.031+0000 7fa40d99b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa40806c760 0x7fa40806af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46132/0 (socket says 172.21.15.88:46132) 2023-05-17T12:26:55.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.031+0000 7fa40d99b700 1 -- 172.21.15.88:0/92581179 learned_addr learned my addr 172.21.15.88:0/92581179 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:55.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.032+0000 7fa40d19a700 1 --2- 172.21.15.88:0/92581179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4080b23a0 0x7fa40806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.032+0000 7fa40d99b700 1 -- 172.21.15.88:0/92581179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4080b23a0 msgr2=0x7fa40806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:55.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.032+0000 7fa40d99b700 1 --2- 172.21.15.88:0/92581179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4080b23a0 0x7fa40806cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.032+0000 7fa40d99b700 1 -- 172.21.15.88:0/92581179 >> v1:172.21.15.187:6789/0 conn(0x7fa4080cf190 legacy=0x7fa408160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.032+0000 7fa40d99b700 1 -- 172.21.15.88:0/92581179 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4080cd840 con 0x7fa40806c760 2023-05-17T12:26:55.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.032+0000 7fa40d99b700 1 --2- 172.21.15.88:0/92581179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa40806c760 0x7fa40806af60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa4040098f0 tx=0x7fa404009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44158663b1ff0fb2 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:55.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.032+0000 7fa40c999700 1 -- 172.21.15.88:0/92581179 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400b8a0 con 0x7fa40806c760 2023-05-17T12:26:55.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.032+0000 7fa40c999700 1 -- 172.21.15.88:0/92581179 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400ba00 con 0x7fa40806c760 2023-05-17T12:26:55.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.032+0000 7fa40c999700 1 -- 172.21.15.88:0/92581179 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400bd90 con 0x7fa40806c760 2023-05-17T12:26:55.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.033+0000 7fa40fbff700 1 -- 172.21.15.88:0/92581179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa40806c760 msgr2=0x7fa40806af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.033+0000 7fa40fbff700 1 --2- 172.21.15.88:0/92581179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa40806c760 0x7fa40806af60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa4040098f0 tx=0x7fa404009c00 comp rx=0 tx=0).stop 2023-05-17T12:26:55.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.033+0000 7fa40fbff700 1 -- 172.21.15.88:0/92581179 shutdown_connections 2023-05-17T12:26:55.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.033+0000 7fa40fbff700 1 --2- 172.21.15.88:0/92581179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa40806c760 0x7fa40806af60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.033+0000 7fa40fbff700 1 --2- 172.21.15.88:0/92581179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4080b23a0 0x7fa40806cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.033+0000 7fa40fbff700 1 -- 172.21.15.88:0/92581179 >> 172.21.15.88:0/92581179 conn(0x7fa4080d06f0 msgr2=0x7fa4080d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:55.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.033+0000 7fa40fbff700 1 -- 172.21.15.88:0/92581179 shutdown_connections 2023-05-17T12:26:55.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.033+0000 7fa40fbff700 1 -- 172.21.15.88:0/92581179 wait complete. 2023-05-17T12:26:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.035+0000 7fa40fbff700 1 Processor -- start 2023-05-17T12:26:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.035+0000 7fa40fbff700 1 -- start start 2023-05-17T12:26:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40fbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa40806c760 0x7fa40814b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40fbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4080cf190 0x7fa4080ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40fbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4081565c0 0x7fa4080cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40fbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080cb630 con 0x7fa4080cf190 2023-05-17T12:26:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40fbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080caa20 con 0x7fa4081565c0 2023-05-17T12:26:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40fbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080cad00 con 0x7fa40806c760 2023-05-17T12:26:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40d19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4080cf190 0x7fa4080ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40d19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4080cf190 0x7fa4080ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46144/0 (socket says 172.21.15.88:46144) 2023-05-17T12:26:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40d19a700 1 -- 172.21.15.88:0/2166846519 learned_addr learned my addr 172.21.15.88:0/2166846519 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40d99b700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa40806c760 0x7fa40814b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.036+0000 7fa40e19c700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4081565c0 0x7fa4080cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa40d19a700 1 -- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa40806c760 msgr2=0x7fa40814b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa40d19a700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa40806c760 0x7fa40814b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa40d19a700 1 -- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4081565c0 msgr2=0x7fa4080cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa40d19a700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4081565c0 0x7fa4080cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa40d19a700 1 -- 172.21.15.88:0/2166846519 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009550 con 0x7fa4080cf190 2023-05-17T12:26:55.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa40d19a700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4080cf190 0x7fa4080ca120 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800e810 tx=0x7fa3f800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:55.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa3fe7fc700 1 -- 172.21.15.88:0/2166846519 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f800c070 con 0x7fa4080cf190 2023-05-17T12:26:55.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa3fe7fc700 1 -- 172.21.15.88:0/2166846519 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f8013610 con 0x7fa4080cf190 2023-05-17T12:26:55.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40806a760 con 0x7fa4080cf190 2023-05-17T12:26:55.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa3fe7fc700 1 -- 172.21.15.88:0/2166846519 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f80139c0 con 0x7fa4080cf190 2023-05-17T12:26:55.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.037+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4080cdb20 con 0x7fa4080cf190 2023-05-17T12:26:55.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.038+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40806aa40 con 0x7fa4080cf190 2023-05-17T12:26:55.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.040+0000 7fa3fe7fc700 1 -- 172.21.15.88:0/2166846519 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3f8013b20 con 0x7fa4080cf190 2023-05-17T12:26:55.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.040+0000 7fa3fe7fc700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa3ec06ace0 0x7fa3ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.041+0000 7fa3fe7fc700 1 -- 172.21.15.88:0/2166846519 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fa3f8089860 con 0x7fa4080cf190 2023-05-17T12:26:55.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.041+0000 7fa40d99b700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa3ec06ace0 0x7fa3ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.042+0000 7fa40d99b700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa3ec06ace0 0x7fa3ec06d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa404014040 tx=0x7fa404008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:55.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.044+0000 7fa3fe7fc700 1 -- 172.21.15.88:0/2166846519 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa3f8058350 con 0x7fa4080cf190 2023-05-17T12:26:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.277+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa408074530 con 0x7fa4080cf190 2023-05-17T12:26:55.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.285+0000 7fa3fe7fc700 1 -- 172.21.15.88:0/2166846519 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa3f8057ee0 con 0x7fa4080cf190 2023-05-17T12:26:55.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.290+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa3ec06ace0 msgr2=0x7fa3ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.290+0000 7fa40fbff700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa3ec06ace0 0x7fa3ec06d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa404014040 tx=0x7fa404008030 comp rx=0 tx=0).stop 2023-05-17T12:26:55.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.290+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4080cf190 msgr2=0x7fa4080ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.290+0000 7fa40fbff700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4080cf190 0x7fa4080ca120 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800e810 tx=0x7fa3f800eb20 comp rx=0 tx=0).stop 2023-05-17T12:26:55.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.292+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 shutdown_connections 2023-05-17T12:26:55.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.292+0000 7fa40fbff700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa3ec06ace0 0x7fa3ec06d190 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.292+0000 7fa40fbff700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4081565c0 0x7fa4080cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.292+0000 7fa40fbff700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa40806c760 0x7fa40814b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.292+0000 7fa40fbff700 1 --2- 172.21.15.88:0/2166846519 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4080cf190 0x7fa4080ca120 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.292+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 >> 172.21.15.88:0/2166846519 conn(0x7fa4080d06f0 msgr2=0x7fa4080b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:55.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.292+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 shutdown_connections 2023-05-17T12:26:55.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.292+0000 7fa40fbff700 1 -- 172.21.15.88:0/2166846519 wait complete. 2023-05-17T12:26:55.308 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 6 and data pool 7 2023-05-17T12:26:55.330 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:55.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.510+0000 7f6d427ff700 1 Processor -- start 2023-05-17T12:26:55.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.511+0000 7f6d427ff700 1 -- start start 2023-05-17T12:26:55.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d427ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d3c06ca40 0x7f6d3c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d427ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c0cd6b0 con 0x7f6d3c15c840 2023-05-17T12:26:55.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d427ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c0b2460 con 0x7f6d3c06b0b0 2023-05-17T12:26:55.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d427ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3c0cdf50 con 0x7f6d3c06ca40 2023-05-17T12:26:55.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d40d9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d3c06ca40 0x7f6d3c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d3bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6d3c15c840 0x7f6d3c0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41278/0 (socket says 172.21.15.88:41278) 2023-05-17T12:26:55.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d3bfff700 1 -- 172.21.15.88:0/2331006817 learned_addr learned my addr 172.21.15.88:0/2331006817 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:55.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d40d9c700 1 -- 172.21.15.88:0/2331006817 >> v1:172.21.15.187:6789/0 conn(0x7f6d3c06b0b0 legacy=0x7f6d3c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:55.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d40d9c700 1 -- 172.21.15.88:0/2331006817 >> v1:172.21.15.88:6789/0 conn(0x7f6d3c15c840 legacy=0x7f6d3c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d40d9c700 1 -- 172.21.15.88:0/2331006817 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0b2740 con 0x7f6d3c06ca40 2023-05-17T12:26:55.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.512+0000 7f6d3affd700 1 -- 172.21.15.88:0/2331006817 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177130269 0 0) 0x7f6d3c0cd6b0 con 0x7f6d3c15c840 2023-05-17T12:26:55.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.513+0000 7f6d40d9c700 1 --2- 172.21.15.88:0/2331006817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c06ca40 0x7f6d3c06b940 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009d90 tx=0x7f6d3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8046a2cb3d99df server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:55.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.513+0000 7f6d3affd700 1 -- 172.21.15.88:0/2331006817 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3400e070 con 0x7f6d3c06ca40 2023-05-17T12:26:55.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.513+0000 7f6d3affd700 1 -- 172.21.15.88:0/2331006817 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3400bb90 con 0x7f6d3c06ca40 2023-05-17T12:26:55.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.513+0000 7f6d3affd700 1 -- 172.21.15.88:0/2331006817 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34003a20 con 0x7f6d3c06ca40 2023-05-17T12:26:55.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.513+0000 7f6d427ff700 1 -- 172.21.15.88:0/2331006817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c06ca40 msgr2=0x7f6d3c06b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.513+0000 7f6d427ff700 1 --2- 172.21.15.88:0/2331006817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c06ca40 0x7f6d3c06b940 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009d90 tx=0x7f6d3400b330 comp rx=0 tx=0).stop 2023-05-17T12:26:55.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.514+0000 7f6d427ff700 1 -- 172.21.15.88:0/2331006817 shutdown_connections 2023-05-17T12:26:55.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.514+0000 7f6d427ff700 1 --2- 172.21.15.88:0/2331006817 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c06ca40 0x7f6d3c06b940 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.514+0000 7f6d427ff700 1 -- 172.21.15.88:0/2331006817 >> 172.21.15.88:0/2331006817 conn(0x7f6d3c0d3060 msgr2=0x7f6d3c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:55.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.514+0000 7f6d427ff700 1 -- 172.21.15.88:0/2331006817 shutdown_connections 2023-05-17T12:26:55.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.514+0000 7f6d427ff700 1 -- 172.21.15.88:0/2331006817 wait complete. 2023-05-17T12:26:55.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.516+0000 7f6d427ff700 1 Processor -- start 2023-05-17T12:26:55.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.516+0000 7f6d427ff700 1 -- start start 2023-05-17T12:26:55.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.517+0000 7f6d427ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d3c06b0b0 0x7f6d3c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.517+0000 7f6d427ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d3c06ca40 0x7f6d3c1f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.517+0000 7f6d427ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c15c840 0x7f6d3c0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.517+0000 7f6d427ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0b4000 con 0x7f6d3c15c840 2023-05-17T12:26:55.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.517+0000 7f6d427ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0b3a40 con 0x7f6d3c06ca40 2023-05-17T12:26:55.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.517+0000 7f6d427ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0b3d20 con 0x7f6d3c06b0b0 2023-05-17T12:26:55.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d40d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c15c840 0x7f6d3c0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d40d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c15c840 0x7f6d3c0b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46170/0 (socket says 172.21.15.88:46170) 2023-05-17T12:26:55.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d40d9c700 1 -- 172.21.15.88:0/1570428786 learned_addr learned my addr 172.21.15.88:0/1570428786 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:55.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d3b7fe700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d3c06ca40 0x7f6d3c1f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d3bfff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d3c06b0b0 0x7f6d3c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d40d9c700 1 -- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d3c06b0b0 msgr2=0x7f6d3c0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d40d9c700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d3c06b0b0 0x7f6d3c0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d40d9c700 1 -- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d3c06ca40 msgr2=0x7f6d3c1f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d40d9c700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d3c06ca40 0x7f6d3c1f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d40d9c700 1 -- 172.21.15.88:0/1570428786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d34009a70 con 0x7f6d3c15c840 2023-05-17T12:26:55.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d3bfff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d3c06b0b0 0x7f6d3c0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:55.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.518+0000 7f6d40d9c700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c15c840 0x7f6d3c0b49c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0d3d00 tx=0x7f6d34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:55.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.519+0000 7f6d38ff9700 1 -- 172.21.15.88:0/1570428786 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34012630 con 0x7f6d3c15c840 2023-05-17T12:26:55.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.519+0000 7f6d38ff9700 1 -- 172.21.15.88:0/1570428786 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34012790 con 0x7f6d3c15c840 2023-05-17T12:26:55.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.519+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c0cdbe0 con 0x7f6d3c15c840 2023-05-17T12:26:55.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.519+0000 7f6d38ff9700 1 -- 172.21.15.88:0/1570428786 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34012b40 con 0x7f6d3c15c840 2023-05-17T12:26:55.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.519+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c0cd900 con 0x7f6d3c15c840 2023-05-17T12:26:55.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.520+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3c15cc10 con 0x7f6d3c15c840 2023-05-17T12:26:55.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.521+0000 7f6d38ff9700 1 -- 172.21.15.88:0/1570428786 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d34012ca0 con 0x7f6d3c15c840 2023-05-17T12:26:55.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.522+0000 7f6d38ff9700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6d2806ace0 0x7f6d2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.522+0000 7f6d38ff9700 1 -- 172.21.15.88:0/1570428786 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6d3408bc60 con 0x7f6d3c15c840 2023-05-17T12:26:55.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.522+0000 7f6d3bfff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6d2806ace0 0x7f6d2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.523+0000 7f6d3bfff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6d2806ace0 0x7f6d2806d190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c000f60 tx=0x7f6d2c007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:55.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.526+0000 7f6d38ff9700 1 -- 172.21.15.88:0/1570428786 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6d34056bc0 con 0x7f6d3c15c840 2023-05-17T12:26:55.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.724+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d3c0c7be0 con 0x7f6d3c15c840 2023-05-17T12:26:55.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.725+0000 7f6d38ff9700 1 -- 172.21.15.88:0/1570428786 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18501 (secure 0 0 0) 0x7f6d3c0c7be0 con 0x7f6d3c15c840 2023-05-17T12:26:55.729 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:55.730 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":41,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:26:55.279008+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:26:53.670063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-17T12:26:54.262195+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:55.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6d2806ace0 msgr2=0x7f6d2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6d2806ace0 0x7f6d2806d190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c000f60 tx=0x7f6d2c007d30 comp rx=0 tx=0).stop 2023-05-17T12:26:55.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c15c840 msgr2=0x7f6d3c0b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c15c840 0x7f6d3c0b49c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0d3d00 tx=0x7f6d34004ad0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 shutdown_connections 2023-05-17T12:26:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f6d2806ace0 0x7f6d2806d190 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d3c15c840 0x7f6d3c0b49c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6d3c06b0b0 0x7f6d3c0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 --2- 172.21.15.88:0/1570428786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6d3c06ca40 0x7f6d3c1f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 >> 172.21.15.88:0/1570428786 conn(0x7f6d3c0d3060 msgr2=0x7f6d3c06a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 shutdown_connections 2023-05-17T12:26:55.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.728+0000 7f6d427ff700 1 -- 172.21.15.88:0/1570428786 wait complete. 2023-05-17T12:26:55.749 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:55.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.932+0000 7fc4fd5ff700 1 Processor -- start 2023-05-17T12:26:55.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.933+0000 7fc4fd5ff700 1 -- start start 2023-05-17T12:26:55.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4fd5ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc4f815c840 0x7fc4f806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4fd5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f806b0b0 0x7fc4f80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4fd5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4f806c330 0x7fc4f806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4fd5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f80cdf50 con 0x7fc4f806c330 2023-05-17T12:26:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4fd5ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f806ccf0 con 0x7fc4f815c840 2023-05-17T12:26:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4fd5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f80cd6b0 con 0x7fc4f806b0b0 2023-05-17T12:26:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4f806c330 0x7fc4f806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4f806c330 0x7fc4f806c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46184/0 (socket says 172.21.15.88:46184) 2023-05-17T12:26:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f77fe700 1 -- 172.21.15.88:0/2555068466 learned_addr learned my addr 172.21.15.88:0/2555068466 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f77fe700 1 -- 172.21.15.88:0/2555068466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f806b0b0 msgr2=0x7fc4f80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f67fc700 1 --2- 172.21.15.88:0/2555068466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f806b0b0 0x7fc4f80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f6ffd700 1 --2- 172.21.15.88:0/2555068466 >> v2:172.21.15.187:3300/0 conn(0x7fc4f815c840 0x7fc4f806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f77fe700 1 --2- 172.21.15.88:0/2555068466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f806b0b0 0x7fc4f80cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f77fe700 1 -- 172.21.15.88:0/2555068466 >> v2:172.21.15.187:3300/0 conn(0x7fc4f815c840 msgr2=0x7fc4f806b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f77fe700 1 --2- 172.21.15.88:0/2555068466 >> v2:172.21.15.187:3300/0 conn(0x7fc4f815c840 0x7fc4f806b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f77fe700 1 -- 172.21.15.88:0/2555068466 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f80cf860 con 0x7fc4f806c330 2023-05-17T12:26:55.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f67fc700 1 --2- 172.21.15.88:0/2555068466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f806b0b0 0x7fc4f80cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:55.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.934+0000 7fc4f6ffd700 1 --2- 172.21.15.88:0/2555068466 >> v2:172.21.15.187:3300/0 conn(0x7fc4f815c840 0x7fc4f806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:55.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.935+0000 7fc4f77fe700 1 --2- 172.21.15.88:0/2555068466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 0x7fc4f806c7b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80cfa40 tx=0x7fc4f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5603641c9968e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:55.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.935+0000 7fc4f5ffb700 1 -- 172.21.15.88:0/2555068466 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000e070 con 0x7fc4f806c330 2023-05-17T12:26:55.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.935+0000 7fc4f5ffb700 1 -- 172.21.15.88:0/2555068466 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f000b9c0 con 0x7fc4f806c330 2023-05-17T12:26:55.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.935+0000 7fc4f5ffb700 1 -- 172.21.15.88:0/2555068466 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000bd70 con 0x7fc4f806c330 2023-05-17T12:26:55.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.935+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/2555068466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 msgr2=0x7fc4f806c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.935+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/2555068466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 0x7fc4f806c7b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80cfa40 tx=0x7fc4f000b330 comp rx=0 tx=0).stop 2023-05-17T12:26:55.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.936+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/2555068466 shutdown_connections 2023-05-17T12:26:55.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.936+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/2555068466 >> v2:172.21.15.187:3300/0 conn(0x7fc4f815c840 0x7fc4f806b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.936+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/2555068466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 0x7fc4f806c7b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.936+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/2555068466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f806b0b0 0x7fc4f80cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.936+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/2555068466 >> 172.21.15.88:0/2555068466 conn(0x7fc4f80d3060 msgr2=0x7fc4f80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:55.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.936+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/2555068466 shutdown_connections 2023-05-17T12:26:55.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.936+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/2555068466 wait complete. 2023-05-17T12:26:55.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.937+0000 7fc4fd5ff700 1 Processor -- start 2023-05-17T12:26:55.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.938+0000 7fc4fd5ff700 1 -- start start 2023-05-17T12:26:55.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.938+0000 7fc4fd5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4f806b0b0 0x7fc4f815b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4fd5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 0x7fc4f80c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4fd5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f815c840 0x7fc4f80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4fd5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f815b5f0 con 0x7fc4f806c330 2023-05-17T12:26:55.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4fd5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f815a360 con 0x7fc4f806b0b0 2023-05-17T12:26:55.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4fd5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f81f6490 con 0x7fc4f815c840 2023-05-17T12:26:55.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4f67fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 0x7fc4f80c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4f67fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 0x7fc4f80c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46200/0 (socket says 172.21.15.88:46200) 2023-05-17T12:26:55.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4f67fc700 1 -- 172.21.15.88:0/1989098317 learned_addr learned my addr 172.21.15.88:0/1989098317 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:55.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4f67fc700 1 -- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f815c840 msgr2=0x7fc4f80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4f67fc700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f815c840 0x7fc4f80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4f67fc700 1 -- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4f806b0b0 msgr2=0x7fc4f815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:55.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4f67fc700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4f806b0b0 0x7fc4f815b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:55.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4f67fc700 1 -- 172.21.15.88:0/1989098317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f0009b30 con 0x7fc4f806c330 2023-05-17T12:26:55.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.939+0000 7fc4f67fc700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 0x7fc4f80c8ca0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c770 tx=0x7fc4ec00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:55.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.940+0000 7fc4df7fe700 1 -- 172.21.15.88:0/1989098317 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec011800 con 0x7fc4f806c330 2023-05-17T12:26:55.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.940+0000 7fc4df7fe700 1 -- 172.21.15.88:0/1989098317 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec011960 con 0x7fc4f806c330 2023-05-17T12:26:55.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.940+0000 7fc4df7fe700 1 -- 172.21.15.88:0/1989098317 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec011cd0 con 0x7fc4f806c330 2023-05-17T12:26:55.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.940+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f80b2740 con 0x7fc4f806c330 2023-05-17T12:26:55.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.940+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f80b2460 con 0x7fc4f806c330 2023-05-17T12:26:55.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.941+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f80cd900 con 0x7fc4f806c330 2023-05-17T12:26:55.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.942+0000 7fc4df7fe700 1 -- 172.21.15.88:0/1989098317 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4ec021350 con 0x7fc4f806c330 2023-05-17T12:26:55.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.943+0000 7fc4df7fe700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4e406ace0 0x7fc4e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:55.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.943+0000 7fc4df7fe700 1 -- 172.21.15.88:0/1989098317 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc4ec089470 con 0x7fc4f806c330 2023-05-17T12:26:55.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.943+0000 7fc4f6ffd700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4e406ace0 0x7fc4e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:55.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.944+0000 7fc4f6ffd700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4e406ace0 0x7fc4e406d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800a8b0 tx=0x7fc4e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:55.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:55.947+0000 7fc4df7fe700 1 -- 172.21.15.88:0/1989098317 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc4ec057f00 con 0x7fc4f806c330 2023-05-17T12:26:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.140+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f8074530 con 0x7fc4f806c330 2023-05-17T12:26:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.142+0000 7fc4df7fe700 1 -- 172.21.15.88:0/1989098317 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18501 (secure 0 0 0) 0x7fc4ec057a90 con 0x7fc4f806c330 2023-05-17T12:26:56.146 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:56.146 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":41,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:26:55.279008+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:26:53.670063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-17T12:26:54.262195+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4e406ace0 msgr2=0x7fc4e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4e406ace0 0x7fc4e406d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc4e800a8b0 tx=0x7fc4e8008040 comp rx=0 tx=0).stop 2023-05-17T12:26:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 msgr2=0x7fc4f80c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 0x7fc4f80c8ca0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c770 tx=0x7fc4ec00cb30 comp rx=0 tx=0).stop 2023-05-17T12:26:56.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 shutdown_connections 2023-05-17T12:26:56.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc4e406ace0 0x7fc4e406d190 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4f815c840 0x7fc4f80cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4f806b0b0 0x7fc4f815b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 --2- 172.21.15.88:0/1989098317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4f806c330 0x7fc4f80c8ca0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 >> 172.21.15.88:0/1989098317 conn(0x7fc4f80d3060 msgr2=0x7fc4f80b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:56.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 shutdown_connections 2023-05-17T12:26:56.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.144+0000 7fc4fd5ff700 1 -- 172.21.15.88:0/1989098317 wait complete. 2023-05-17T12:26:56.165 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-17T12:26:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.351+0000 7fa2953ff700 1 Processor -- start 2023-05-17T12:26:56.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.352+0000 7fa2953ff700 1 -- start start 2023-05-17T12:26:56.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.353+0000 7fa2953ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa29006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:56.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.353+0000 7fa2953ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2900b23a0 0x7fa29006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.353+0000 7fa2953ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2900cf190 0x7fa290160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.353+0000 7fa2953ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29006b4a0 con 0x7fa2900b23a0 2023-05-17T12:26:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.353+0000 7fa2953ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29006a510 con 0x7fa2900cf190 2023-05-17T12:26:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.353+0000 7fa2953ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29006d070 con 0x7fa29006c760 2023-05-17T12:26:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.353+0000 7fa287fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2900b23a0 0x7fa29006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:56.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa287fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2900b23a0 0x7fa29006cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46208/0 (socket says 172.21.15.88:46208) 2023-05-17T12:26:56.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa287fff700 1 -- 172.21.15.88:0/2026939351 learned_addr learned my addr 172.21.15.88:0/2026939351 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa28effd700 1 --2- 172.21.15.88:0/2026939351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa29006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa28f7fe700 1 --2- 172.21.15.88:0/2026939351 >> v2:172.21.15.187:3300/0 conn(0x7fa2900cf190 0x7fa290160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa287fff700 1 -- 172.21.15.88:0/2026939351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 msgr2=0x7fa29006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:56.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa287fff700 1 --2- 172.21.15.88:0/2026939351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa29006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa287fff700 1 -- 172.21.15.88:0/2026939351 >> v2:172.21.15.187:3300/0 conn(0x7fa2900cf190 msgr2=0x7fa290160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa287fff700 1 --2- 172.21.15.88:0/2026939351 >> v2:172.21.15.187:3300/0 conn(0x7fa2900cf190 0x7fa290160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa287fff700 1 -- 172.21.15.88:0/2026939351 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900cd840 con 0x7fa2900b23a0 2023-05-17T12:26:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa28effd700 1 --2- 172.21.15.88:0/2026939351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa29006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa28f7fe700 1 --2- 172.21.15.88:0/2026939351 >> v2:172.21.15.187:3300/0 conn(0x7fa2900cf190 0x7fa290160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa287fff700 1 --2- 172.21.15.88:0/2026939351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900b23a0 0x7fa29006cb30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa29008c3d0 tx=0x7fa278009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105cdfd8c165122a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:56.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa28e7fc700 1 -- 172.21.15.88:0/2026939351 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800b870 con 0x7fa2900b23a0 2023-05-17T12:26:56.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.354+0000 7fa28e7fc700 1 -- 172.21.15.88:0/2026939351 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800b9d0 con 0x7fa2900b23a0 2023-05-17T12:26:56.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa28e7fc700 1 -- 172.21.15.88:0/2026939351 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800bd60 con 0x7fa2900b23a0 2023-05-17T12:26:56.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa2953ff700 1 -- 172.21.15.88:0/2026939351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900b23a0 msgr2=0x7fa29006cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:56.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa2953ff700 1 --2- 172.21.15.88:0/2026939351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900b23a0 0x7fa29006cb30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa29008c3d0 tx=0x7fa278009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa2953ff700 1 -- 172.21.15.88:0/2026939351 shutdown_connections 2023-05-17T12:26:56.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa2953ff700 1 --2- 172.21.15.88:0/2026939351 >> v2:172.21.15.187:3300/0 conn(0x7fa2900cf190 0x7fa290160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa2953ff700 1 --2- 172.21.15.88:0/2026939351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa29006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa2953ff700 1 --2- 172.21.15.88:0/2026939351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900b23a0 0x7fa29006cb30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa2953ff700 1 -- 172.21.15.88:0/2026939351 >> 172.21.15.88:0/2026939351 conn(0x7fa2900d06f0 msgr2=0x7fa2900d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa2953ff700 1 -- 172.21.15.88:0/2026939351 shutdown_connections 2023-05-17T12:26:56.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.355+0000 7fa2953ff700 1 -- 172.21.15.88:0/2026939351 wait complete. 2023-05-17T12:26:56.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.357+0000 7fa2953ff700 1 Processor -- start 2023-05-17T12:26:56.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.357+0000 7fa2953ff700 1 -- start start 2023-05-17T12:26:56.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa2953ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa2901e3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:56.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa2953ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa29014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:56.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa2953ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2901e1d00 0x7fa2901e2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:56.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa2953ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29015b810 con 0x7fa2900cf190 2023-05-17T12:26:56.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa2953ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29014e970 con 0x7fa2901e1d00 2023-05-17T12:26:56.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa2953ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2901e2870 con 0x7fa29006c760 2023-05-17T12:26:56.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa287fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa29014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:56.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa287fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa29014e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46224/0 (socket says 172.21.15.88:46224) 2023-05-17T12:26:56.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa287fff700 1 -- 172.21.15.88:0/3969654916 learned_addr learned my addr 172.21.15.88:0/3969654916 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:56.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa28effd700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa2901e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:56.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.358+0000 7fa28f7fe700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2901e1d00 0x7fa2901e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:56.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa287fff700 1 -- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 msgr2=0x7fa2901e3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:56.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa287fff700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa2901e3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa287fff700 1 -- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2901e1d00 msgr2=0x7fa2901e2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:56.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa287fff700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2901e1d00 0x7fa2901e2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:56.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa287fff700 1 -- 172.21.15.88:0/3969654916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278009550 con 0x7fa2900cf190 2023-05-17T12:26:56.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa28f7fe700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2901e1d00 0x7fa2901e2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:56.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa287fff700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa29014e430 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa29006c6b0 tx=0x7fa278004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:56.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa2877fe700 1 -- 172.21.15.88:0/3969654916 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278004310 con 0x7fa2900cf190 2023-05-17T12:26:56.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa2877fe700 1 -- 172.21.15.88:0/3969654916 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27801f070 con 0x7fa2900cf190 2023-05-17T12:26:56.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa2877fe700 1 -- 172.21.15.88:0/3969654916 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780036a0 con 0x7fa2900cf190 2023-05-17T12:26:56.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29006a760 con 0x7fa2900cf190 2023-05-17T12:26:56.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.359+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2900cdb20 con 0x7fa2900cf190 2023-05-17T12:26:56.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.360+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29006aa40 con 0x7fa2900cf190 2023-05-17T12:26:56.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.361+0000 7fa2877fe700 1 -- 172.21.15.88:0/3969654916 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa278021030 con 0x7fa2900cf190 2023-05-17T12:26:56.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.362+0000 7fa2877fe700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27006ace0 0x7fa27006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:56.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.363+0000 7fa2877fe700 1 -- 172.21.15.88:0/3969654916 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa27808aaf0 con 0x7fa2900cf190 2023-05-17T12:26:56.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.363+0000 7fa28effd700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27006ace0 0x7fa27006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:56.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.364+0000 7fa28effd700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27006ace0 0x7fa27006d190 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa280006fd0 tx=0x7fa280008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:56.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.367+0000 7fa2877fe700 1 -- 172.21.15.88:0/3969654916 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa2780559c0 con 0x7fa2900cf190 2023-05-17T12:26:56.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:56.602+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa290074530 con 0x7fa2900cf190 2023-05-17T12:26:57.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.296+0000 7fa2877fe700 1 -- 172.21.15.88:0/3969654916 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa278058fe0 con 0x7fa2900cf190 2023-05-17T12:26:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27006ace0 msgr2=0x7fa27006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27006ace0 0x7fa27006d190 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa280006fd0 tx=0x7fa280008040 comp rx=0 tx=0).stop 2023-05-17T12:26:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 msgr2=0x7fa29014e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa29014e430 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa29006c6b0 tx=0x7fa278004750 comp rx=0 tx=0).stop 2023-05-17T12:26:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 shutdown_connections 2023-05-17T12:26:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa27006ace0 0x7fa27006d190 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2901e1d00 0x7fa2901e2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa29006c760 0x7fa2901e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 --2- 172.21.15.88:0/3969654916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2900cf190 0x7fa29014e430 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.298+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 >> 172.21.15.88:0/3969654916 conn(0x7fa2900d06f0 msgr2=0x7fa2900b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.299+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 shutdown_connections 2023-05-17T12:26:57.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.299+0000 7fa2953ff700 1 -- 172.21.15.88:0/3969654916 wait complete. 2023-05-17T12:26:57.320 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-17T12:26:57.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-17T12:26:57.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.506+0000 7fa4c3dff700 1 Processor -- start 2023-05-17T12:26:57.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.506+0000 7fa4c3dff700 1 -- start start 2023-05-17T12:26:57.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.507+0000 7fa4c3dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa4bc0cdb10 0x7fa4bc0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:57.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.507+0000 7fa4c3dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc0ca660 0x7fa4bc0caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:57.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.507+0000 7fa4c3dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0ce4a0 con 0x7fa4bc153d60 2023-05-17T12:26:57.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.507+0000 7fa4c3dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc159ed0 con 0x7fa4bc0cdb10 2023-05-17T12:26:57.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.507+0000 7fa4c3dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15a1b0 con 0x7fa4bc0ca660 2023-05-17T12:26:57.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.507+0000 7fa4c1b9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa4bc153d60 0x7fa4bc15daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41288/0 (socket says 172.21.15.88:41288) 2023-05-17T12:26:57.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.507+0000 7fa4c1b9b700 1 -- 172.21.15.88:0/1163269510 learned_addr learned my addr 172.21.15.88:0/1163269510 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:57.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c139a700 1 --2- 172.21.15.88:0/1163269510 >> v2:172.21.15.187:3300/0 conn(0x7fa4bc0cdb10 0x7fa4bc0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:57.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c239c700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc0ca660 0x7fa4bc0caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:57.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1277509068 0 0) 0x7fa4b8001110 con 0x7fa4bc153d60 2023-05-17T12:26:57.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a80035b0 con 0x7fa4bc153d60 2023-05-17T12:26:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3709158429 0 0) 0x7fa4a80035b0 con 0x7fa4bc153d60 2023-05-17T12:26:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc0ca660 msgr2=0x7fa4bc0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc0ca660 0x7fa4bc0caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 >> v2:172.21.15.187:3300/0 conn(0x7fa4bc0cdb10 msgr2=0x7fa4bc0cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 --2- 172.21.15.88:0/1163269510 >> v2:172.21.15.187:3300/0 conn(0x7fa4bc0cdb10 0x7fa4bc0cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc15a490 con 0x7fa4bc153d60 2023-05-17T12:26:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1412821001 0 0) 0x7fa4b8001800 con 0x7fa4bc153d60 2023-05-17T12:26:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 >> v1:172.21.15.88:6789/0 conn(0x7fa4bc153d60 legacy=0x7fa4bc15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc0ca660 0x7fa4a8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8003f80 0x7fa4a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4a8004d90 0x7fa4a8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc159ed0 con 0x7fa4a8004d90 2023-05-17T12:26:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15a1b0 con 0x7fa4a8003f80 2023-05-17T12:26:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.508+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a800ba10 con 0x7fa4bc0ca660 2023-05-17T12:26:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c239c700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4a8004d90 0x7fa4a8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c139a700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8003f80 0x7fa4a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c1b9b700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc0ca660 0x7fa4a8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c239c700 1 -- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc0ca660 msgr2=0x7fa4a8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c239c700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc0ca660 0x7fa4a8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c239c700 1 -- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8003f80 msgr2=0x7fa4a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c239c700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8003f80 0x7fa4a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c239c700 1 -- 172.21.15.88:0/1163269510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a80035b0 con 0x7fa4a8004d90 2023-05-17T12:26:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c1b9b700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc0ca660 0x7fa4a8003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c139a700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8003f80 0x7fa4a8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c239c700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4a8004d90 0x7fa4a8005200 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009fc0 tx=0x7fa4a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c974ba16faaba8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400ec30 con 0x7fa4a8004d90 2023-05-17T12:26:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b400f040 con 0x7fa4a8004d90 2023-05-17T12:26:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.509+0000 7fa4c0b99700 1 -- 172.21.15.88:0/1163269510 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4014480 con 0x7fa4a8004d90 2023-05-17T12:26:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.510+0000 7fa4c3dff700 1 -- 172.21.15.88:0/1163269510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4a8004d90 msgr2=0x7fa4a8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.510+0000 7fa4c3dff700 1 --2- 172.21.15.88:0/1163269510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4a8004d90 0x7fa4a8005200 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009fc0 tx=0x7fa4a8005880 comp rx=0 tx=0).stop 2023-05-17T12:26:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.510+0000 7fa4c239c700 1 -- 172.21.15.88:0/1163269510 reap_dead start 2023-05-17T12:26:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.510+0000 7fa4c3dff700 1 -- 172.21.15.88:0/1163269510 shutdown_connections 2023-05-17T12:26:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.510+0000 7fa4c3dff700 1 -- 172.21.15.88:0/1163269510 >> 172.21.15.88:0/1163269510 conn(0x7fa4bc0cf970 msgr2=0x7fa4bc0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.510+0000 7fa4c3dff700 1 -- 172.21.15.88:0/1163269510 shutdown_connections 2023-05-17T12:26:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.510+0000 7fa4c3dff700 1 -- 172.21.15.88:0/1163269510 wait complete. 2023-05-17T12:26:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.512+0000 7fa4c3dff700 1 Processor -- start 2023-05-17T12:26:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.512+0000 7fa4c3dff700 1 -- start start 2023-05-17T12:26:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c3dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8004d90 0x7fa4bc14cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c3dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc14ded0 0x7fa4bc147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c3dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4bc14e340 0x7fa4bc148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c3dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc14be40 con 0x7fa4bc14e340 2023-05-17T12:26:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c3dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc14c120 con 0x7fa4a8004d90 2023-05-17T12:26:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c3dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc14c400 con 0x7fa4bc14ded0 2023-05-17T12:26:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c239c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4bc14e340 0x7fa4bc148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c239c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4bc14e340 0x7fa4bc148020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46240/0 (socket says 172.21.15.88:46240) 2023-05-17T12:26:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c239c700 1 -- 172.21.15.88:0/2416309553 learned_addr learned my addr 172.21.15.88:0/2416309553 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c1b9b700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8004d90 0x7fa4bc14cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.513+0000 7fa4c139a700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc14ded0 0x7fa4bc147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4c239c700 1 -- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc14ded0 msgr2=0x7fa4bc147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:57.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4c239c700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc14ded0 0x7fa4bc147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4c239c700 1 -- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8004d90 msgr2=0x7fa4bc14cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4c239c700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8004d90 0x7fa4bc14cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4c239c700 1 -- 172.21.15.88:0/2416309553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc15aa50 con 0x7fa4bc14e340 2023-05-17T12:26:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4c239c700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4bc14e340 0x7fa4bc148020 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4017040 tx=0x7fa4b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4b27fc700 1 -- 172.21.15.88:0/2416309553 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4007000 con 0x7fa4bc14e340 2023-05-17T12:26:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4b27fc700 1 -- 172.21.15.88:0/2416309553 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4004470 con 0x7fa4bc14e340 2023-05-17T12:26:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4b27fc700 1 -- 172.21.15.88:0/2416309553 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4004820 con 0x7fa4bc14e340 2023-05-17T12:26:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc15a770 con 0x7fa4bc14e340 2023-05-17T12:26:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.514+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc0cc0d0 con 0x7fa4bc14e340 2023-05-17T12:26:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.515+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc074530 con 0x7fa4bc14e340 2023-05-17T12:26:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.516+0000 7fa4b27fc700 1 -- 172.21.15.88:0/2416309553 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa4b4023070 con 0x7fa4bc14e340 2023-05-17T12:26:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.517+0000 7fa4b27fc700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa4a006ace0 0x7fa4a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.517+0000 7fa4b27fc700 1 -- 172.21.15.88:0/2416309553 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa4b408a890 con 0x7fa4bc14e340 2023-05-17T12:26:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.518+0000 7fa4c1b9b700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa4a006ace0 0x7fa4a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.518+0000 7fa4c1b9b700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa4a006ace0 0x7fa4a006d190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8007e60 tx=0x7fa4b80015c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.521+0000 7fa4b27fc700 1 -- 172.21.15.88:0/2416309553 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa4b4055910 con 0x7fa4bc14e340 2023-05-17T12:26:57.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:57.759+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa4bc0c8520 con 0x7fa4bc14e340 2023-05-17T12:26:57.785 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T12:26:57.781+0000 7fcc481f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-17T12:26:58.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.302+0000 7fa4b27fc700 1 -- 172.21.15.88:0/2416309553 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa4b4058f30 con 0x7fa4bc14e340 2023-05-17T12:26:58.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa4a006ace0 msgr2=0x7fa4a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa4a006ace0 0x7fa4a006d190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8007e60 tx=0x7fa4b80015c0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4bc14e340 msgr2=0x7fa4bc148020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4bc14e340 0x7fa4bc148020 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4017040 tx=0x7fa4b4009750 comp rx=0 tx=0).stop 2023-05-17T12:26:58.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 shutdown_connections 2023-05-17T12:26:58.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fa4a006ace0 0x7fa4a006d190 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4bc14e340 0x7fa4bc148020 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a8004d90 0x7fa4bc14cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 --2- 172.21.15.88:0/2416309553 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4bc14ded0 0x7fa4bc147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 >> 172.21.15.88:0/2416309553 conn(0x7fa4bc0cf970 msgr2=0x7fa4bc06b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:58.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 shutdown_connections 2023-05-17T12:26:58.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.305+0000 7fa4c3dff700 1 -- 172.21.15.88:0/2416309553 wait complete. 2023-05-17T12:26:58.328 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-17T12:26:58.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:26:58.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.513+0000 7fc3bdfff700 1 Processor -- start 2023-05-17T12:26:58.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.513+0000 7fc3bdfff700 1 -- start start 2023-05-17T12:26:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.514+0000 7fc3bdfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3b81595e0 0x7fc3b8070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.514+0000 7fc3bdfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc3b80ce2a0 0x7fc3b80ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.514+0000 7fc3bdfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b81599b0 con 0x7fc3b8071370 2023-05-17T12:26:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.514+0000 7fc3bdfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b80717e0 con 0x7fc3b81595e0 2023-05-17T12:26:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.514+0000 7fc3bdfff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b815e000 con 0x7fc3b80ce2a0 2023-05-17T12:26:58.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.514+0000 7fc3b77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3b81595e0 0x7fc3b8070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.514+0000 7fc3b6ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc3b8071370 0x7fc3b80cdb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41304/0 (socket says 172.21.15.88:41304) 2023-05-17T12:26:58.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.514+0000 7fc3b6ffd700 1 -- 172.21.15.88:0/36567474 learned_addr learned my addr 172.21.15.88:0/36567474 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b7fff700 1 --2- 172.21.15.88:0/36567474 >> v2:172.21.15.187:3300/0 conn(0x7fc3b80ce2a0 0x7fc3b80ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b77fe700 1 -- 172.21.15.88:0/36567474 >> v2:172.21.15.187:3300/0 conn(0x7fc3b80ce2a0 msgr2=0x7fc3b80ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b77fe700 1 --2- 172.21.15.88:0/36567474 >> v2:172.21.15.187:3300/0 conn(0x7fc3b80ce2a0 0x7fc3b80ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b77fe700 1 -- 172.21.15.88:0/36567474 >> v1:172.21.15.88:6789/0 conn(0x7fc3b8071370 legacy=0x7fc3b80cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b77fe700 1 -- 172.21.15.88:0/36567474 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b80cca80 con 0x7fc3b81595e0 2023-05-17T12:26:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b7fff700 1 --2- 172.21.15.88:0/36567474 >> v2:172.21.15.187:3300/0 conn(0x7fc3b80ce2a0 0x7fc3b80ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:26:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b67fc700 1 -- 172.21.15.88:0/36567474 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669028187 0 0) 0x7fc3b81599b0 con 0x7fc3b8071370 2023-05-17T12:26:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b77fe700 1 --2- 172.21.15.88:0/36567474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 0x7fc3b8070e30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80cfb00 tx=0x7fc3a8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec68aa09e5480986 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b67fc700 1 -- 172.21.15.88:0/36567474 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8011830 con 0x7fc3b81595e0 2023-05-17T12:26:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b67fc700 1 -- 172.21.15.88:0/36567474 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a8011990 con 0x7fc3b81595e0 2023-05-17T12:26:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.515+0000 7fc3b67fc700 1 -- 172.21.15.88:0/36567474 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8011d20 con 0x7fc3b81595e0 2023-05-17T12:26:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.516+0000 7fc3bdfff700 1 -- 172.21.15.88:0/36567474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 msgr2=0x7fc3b8070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.516+0000 7fc3bdfff700 1 --2- 172.21.15.88:0/36567474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 0x7fc3b8070e30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80cfb00 tx=0x7fc3a8009b20 comp rx=0 tx=0).stop 2023-05-17T12:26:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.516+0000 7fc3bdfff700 1 -- 172.21.15.88:0/36567474 shutdown_connections 2023-05-17T12:26:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.516+0000 7fc3bdfff700 1 --2- 172.21.15.88:0/36567474 >> v2:172.21.15.187:3300/0 conn(0x7fc3b80ce2a0 0x7fc3b80ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.516+0000 7fc3bdfff700 1 --2- 172.21.15.88:0/36567474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 0x7fc3b8070e30 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.516+0000 7fc3bdfff700 1 -- 172.21.15.88:0/36567474 >> 172.21.15.88:0/36567474 conn(0x7fc3b80ced10 msgr2=0x7fc3b80cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.516+0000 7fc3bdfff700 1 -- 172.21.15.88:0/36567474 shutdown_connections 2023-05-17T12:26:58.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.516+0000 7fc3bdfff700 1 -- 172.21.15.88:0/36567474 wait complete. 2023-05-17T12:26:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.518+0000 7fc3bdfff700 1 Processor -- start 2023-05-17T12:26:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.519+0000 7fc3bdfff700 1 -- start start 2023-05-17T12:26:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3bdfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b8071370 0x7fc3b81f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3bdfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b80ce2a0 0x7fc3b80c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3bdfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 0x7fc3b81577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3bdfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b80c79a0 con 0x7fc3b81595e0 2023-05-17T12:26:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3bdfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b80c6ed0 con 0x7fc3b80ce2a0 2023-05-17T12:26:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3bdfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b80c6630 con 0x7fc3b8071370 2023-05-17T12:26:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 0x7fc3b81577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 0x7fc3b81577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46252/0 (socket says 172.21.15.88:46252) 2023-05-17T12:26:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b7fff700 1 -- 172.21.15.88:0/896736092 learned_addr learned my addr 172.21.15.88:0/896736092 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b77fe700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b8071370 0x7fc3b81f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b6ffd700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b80ce2a0 0x7fc3b80c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b7fff700 1 -- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b8071370 msgr2=0x7fc3b81f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b7fff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b8071370 0x7fc3b81f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b7fff700 1 -- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b80ce2a0 msgr2=0x7fc3b80c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b7fff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b80ce2a0 0x7fc3b80c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b7fff700 1 -- 172.21.15.88:0/896736092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a80094a0 con 0x7fc3b81595e0 2023-05-17T12:26:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.520+0000 7fc3b6ffd700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b80ce2a0 0x7fc3b80c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.521+0000 7fc3b7fff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 0x7fc3b81577d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000ce40 tx=0x7fc3b000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.521+0000 7fc39ffff700 1 -- 172.21.15.88:0/896736092 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000ad40 con 0x7fc3b81595e0 2023-05-17T12:26:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.521+0000 7fc39ffff700 1 -- 172.21.15.88:0/896736092 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b0003a20 con 0x7fc3b81595e0 2023-05-17T12:26:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.521+0000 7fc39ffff700 1 -- 172.21.15.88:0/896736092 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0003dd0 con 0x7fc3b81595e0 2023-05-17T12:26:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.521+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b80cd040 con 0x7fc3b81595e0 2023-05-17T12:26:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.521+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b80ccd60 con 0x7fc3b81595e0 2023-05-17T12:26:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.522+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b80cd320 con 0x7fc3b81595e0 2023-05-17T12:26:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.523+0000 7fc39ffff700 1 -- 172.21.15.88:0/896736092 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3b0003f30 con 0x7fc3b81595e0 2023-05-17T12:26:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.524+0000 7fc39ffff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc3a406acb0 0x7fc3a406d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.524+0000 7fc39ffff700 1 -- 172.21.15.88:0/896736092 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc3b0089890 con 0x7fc3b81595e0 2023-05-17T12:26:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.525+0000 7fc3b77fe700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc3a406acb0 0x7fc3a406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.525+0000 7fc3b77fe700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc3a406acb0 0x7fc3a406d160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80090b0 tx=0x7fc3a801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:58.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.528+0000 7fc39ffff700 1 -- 172.21.15.88:0/896736092 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc3b00547f0 con 0x7fc3b81595e0 2023-05-17T12:26:58.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.760+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3b80c7ae0 con 0x7fc3b81595e0 2023-05-17T12:26:58.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.761+0000 7fc39ffff700 1 -- 172.21.15.88:0/896736092 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4674 (secure 0 0 0) 0x7fc3b80c7ae0 con 0x7fc3b81595e0 2023-05-17T12:26:58.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:58.765 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/907915818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":907915818},{"type":"v1","addr":"172.21.15.187:6836","nonce":907915818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3236077070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3236077070},{"type":"v1","addr":"172.21.15.187:6837","nonce":3236077070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2500925233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2500925233},{"type":"v1","addr":"172.21.15.88:6835","nonce":2500925233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:26:55.279357+0000","modified":"2023-05-17T12:26:58.296235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5392":{"gid":5392,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6833/3964515495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3964515495},{"type":"v1","addr":"172.21.15.88:6833","nonce":3964515495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-17T12:26:58.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc3a406acb0 msgr2=0x7fc3a406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc3a406acb0 0x7fc3a406d160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80090b0 tx=0x7fc3a801c040 comp rx=0 tx=0).stop 2023-05-17T12:26:58.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 msgr2=0x7fc3b81577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 0x7fc3b81577d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000ce40 tx=0x7fc3b000ce70 comp rx=0 tx=0).stop 2023-05-17T12:26:58.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 shutdown_connections 2023-05-17T12:26:58.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fc3a406acb0 0x7fc3a406d160 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3b81595e0 0x7fc3b81577d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3b8071370 0x7fc3b81f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 --2- 172.21.15.88:0/896736092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3b80ce2a0 0x7fc3b80c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 >> 172.21.15.88:0/896736092 conn(0x7fc3b80ced10 msgr2=0x7fc3b8071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 shutdown_connections 2023-05-17T12:26:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.763+0000 7fc3bdfff700 1 -- 172.21.15.88:0/896736092 wait complete. 2023-05-17T12:26:58.769 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 17 2023-05-17T12:26:58.784 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-17T12:26:58.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.965+0000 7f86a9dff700 1 Processor -- start 2023-05-17T12:26:58.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.965+0000 7f86a9dff700 1 -- start start 2023-05-17T12:26:58.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.966+0000 7f86a9dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86a415a580 0x7f86a40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.966+0000 7f86a9dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f86a415a950 0x7f86a4070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.966+0000 7f86a9dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a415ec80 con 0x7f86a40c98a0 2023-05-17T12:26:58.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.966+0000 7f86a9dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a415f110 con 0x7f86a415a580 2023-05-17T12:26:58.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.966+0000 7f86a9dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a415e350 con 0x7f86a415a950 2023-05-17T12:26:58.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.966+0000 7f86a37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86a415a580 0x7f86a40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.966+0000 7f86a37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86a415a580 0x7f86a40c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46264/0 (socket says 172.21.15.88:46264) 2023-05-17T12:26:58.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.966+0000 7f86a37fe700 1 -- 172.21.15.88:0/1457982343 learned_addr learned my addr 172.21.15.88:0/1457982343 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:58.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.966+0000 7f869bfff700 1 --2- 172.21.15.88:0/1457982343 >> v2:172.21.15.187:3300/0 conn(0x7f86a415a950 0x7f86a4070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.967+0000 7f86a37fe700 1 -- 172.21.15.88:0/1457982343 >> v2:172.21.15.187:3300/0 conn(0x7f86a415a950 msgr2=0x7f86a4070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:58.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.967+0000 7f86a37fe700 1 --2- 172.21.15.88:0/1457982343 >> v2:172.21.15.187:3300/0 conn(0x7f86a415a950 0x7f86a4070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.967+0000 7f86a37fe700 1 -- 172.21.15.88:0/1457982343 >> v1:172.21.15.187:6789/0 conn(0x7f86a40c98a0 legacy=0x7f86a406a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.967+0000 7f86a37fe700 1 -- 172.21.15.88:0/1457982343 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a415e630 con 0x7f86a415a580 2023-05-17T12:26:58.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.967+0000 7f869bfff700 1 --2- 172.21.15.88:0/1457982343 >> v2:172.21.15.187:3300/0 conn(0x7f86a415a950 0x7f86a4070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:26:58.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.967+0000 7f86a37fe700 1 --2- 172.21.15.88:0/1457982343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a415a580 0x7f86a40c9360 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f86a40722d0 tx=0x7f8694009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae03b7ae34275f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:58.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.967+0000 7f86a2ffd700 1 -- 172.21.15.88:0/1457982343 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400b870 con 0x7f86a415a580 2023-05-17T12:26:58.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.967+0000 7f86a2ffd700 1 -- 172.21.15.88:0/1457982343 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869400b9d0 con 0x7f86a415a580 2023-05-17T12:26:58.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.967+0000 7f86a2ffd700 1 -- 172.21.15.88:0/1457982343 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400bd60 con 0x7f86a415a580 2023-05-17T12:26:58.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.968+0000 7f86a9dff700 1 -- 172.21.15.88:0/1457982343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a415a580 msgr2=0x7f86a40c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.968+0000 7f86a9dff700 1 --2- 172.21.15.88:0/1457982343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a415a580 0x7f86a40c9360 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f86a40722d0 tx=0x7f8694009bd0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.968+0000 7f86a9dff700 1 -- 172.21.15.88:0/1457982343 shutdown_connections 2023-05-17T12:26:58.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.968+0000 7f86a9dff700 1 --2- 172.21.15.88:0/1457982343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a415a580 0x7f86a40c9360 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.968+0000 7f86a9dff700 1 --2- 172.21.15.88:0/1457982343 >> v2:172.21.15.187:3300/0 conn(0x7f86a415a950 0x7f86a4070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.968+0000 7f86a9dff700 1 -- 172.21.15.88:0/1457982343 >> 172.21.15.88:0/1457982343 conn(0x7f86a40ced10 msgr2=0x7f86a40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:58.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.968+0000 7f86a9dff700 1 -- 172.21.15.88:0/1457982343 shutdown_connections 2023-05-17T12:26:58.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.968+0000 7f86a9dff700 1 -- 172.21.15.88:0/1457982343 wait complete. 2023-05-17T12:26:58.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.970+0000 7f86a9dff700 1 Processor -- start 2023-05-17T12:26:58.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.970+0000 7f86a9dff700 1 -- start start 2023-05-17T12:26:58.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a9dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a40c98a0 0x7f86a41540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a9dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86a415a580 0x7f86a40ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a9dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86a415a950 0x7f86a40ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a9dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40ad7d0 con 0x7f86a40c98a0 2023-05-17T12:26:58.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a9dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40ac1f0 con 0x7f86a415a950 2023-05-17T12:26:58.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a9dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40ac4d0 con 0x7f86a415a580 2023-05-17T12:26:58.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a40c98a0 0x7f86a41540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a40c98a0 0x7f86a41540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46278/0 (socket says 172.21.15.88:46278) 2023-05-17T12:26:58.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a37fe700 1 -- 172.21.15.88:0/2169596859 learned_addr learned my addr 172.21.15.88:0/2169596859 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:58.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a3fff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86a415a950 0x7f86a40ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f869bfff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86a415a580 0x7f86a40ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a37fe700 1 -- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86a415a580 msgr2=0x7f86a40ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.971+0000 7f86a37fe700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86a415a580 0x7f86a40ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.972+0000 7f86a37fe700 1 -- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86a415a950 msgr2=0x7f86a40ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:58.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.972+0000 7f86a37fe700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86a415a950 0x7f86a40ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.972+0000 7f86a37fe700 1 -- 172.21.15.88:0/2169596859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694009550 con 0x7f86a40c98a0 2023-05-17T12:26:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.972+0000 7f86a37fe700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a40c98a0 0x7f86a41540e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8694000c00 tx=0x7f8694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.972+0000 7f86a0ff9700 1 -- 172.21.15.88:0/2169596859 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694004540 con 0x7f86a40c98a0 2023-05-17T12:26:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.972+0000 7f86a0ff9700 1 -- 172.21.15.88:0/2169596859 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940036a0 con 0x7f86a40c98a0 2023-05-17T12:26:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.972+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a40cde00 con 0x7f86a40c98a0 2023-05-17T12:26:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.972+0000 7f86a0ff9700 1 -- 172.21.15.88:0/2169596859 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694003a30 con 0x7f86a40c98a0 2023-05-17T12:26:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.972+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a415e910 con 0x7f86a40c98a0 2023-05-17T12:26:58.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.973+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a40cea60 con 0x7f86a40c98a0 2023-05-17T12:26:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.974+0000 7f86a0ff9700 1 -- 172.21.15.88:0/2169596859 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8694021070 con 0x7f86a40c98a0 2023-05-17T12:26:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.975+0000 7f86a0ff9700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f868406ace0 0x7f868406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.975+0000 7f86a0ff9700 1 -- 172.21.15.88:0/2169596859 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f869408ad30 con 0x7f86a40c98a0 2023-05-17T12:26:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.976+0000 7f869bfff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f868406ace0 0x7f868406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.976+0000 7f869bfff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f868406ace0 0x7f868406d190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f86a40b0610 tx=0x7f868c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:58.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:58.979+0000 7f86a0ff9700 1 -- 172.21.15.88:0/2169596859 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8694055c90 con 0x7f86a40c98a0 2023-05-17T12:26:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.176+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86a4074530 con 0x7f86a40c98a0 2023-05-17T12:26:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.177+0000 7f86a0ff9700 1 -- 172.21.15.88:0/2169596859 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18488 (secure 0 0 0) 0x7f8694015090 con 0x7f86a40c98a0 2023-05-17T12:26:59.182 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:59.182 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":42,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","created":"2023-05-17T12:24:34.271310+0000","modified":"2023-05-17T12:26:56.281938+0000","last_up_change":"2023-05-17T12:24:46.596514+0000","last_in_change":"2023-05-17T12:24:37.653519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-17T12:24:47.499653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-17T12:24:54.004138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-17T12:26:53.670063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-17T12:26:54.262195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d655120-e2e4-4e56-ad85-62d3af479c45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6801","nonce":441996497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6803","nonce":441996497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6807","nonce":441996497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":441996497},{"type":"v1","addr":"172.21.15.88:6805","nonce":441996497}]},"public_addr":"172.21.15.88:6801/441996497","cluster_addr":"172.21.15.88:6803/441996497","heartbeat_back_addr":"172.21.15.88:6807/441996497","heartbeat_front_addr":"172.21.15.88:6805/441996497","state":["exists","up"]},{"osd":1,"uuid":"4dc8ee5c-4dd5-4abf-86e9-2038e1353d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6817","nonce":2066173711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6819","nonce":2066173711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6823","nonce":2066173711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2066173711},{"type":"v1","addr":"172.21.15.88:6821","nonce":2066173711}]},"public_addr":"172.21.15.88:6817/2066173711","cluster_addr":"172.21.15.88:6819/2066173711","heartbeat_back_addr":"172.21.15.88:6823/2066173711","heartbeat_front_addr":"172.21.15.88:6821/2066173711","state":["exists","up"]},{"osd":2,"uuid":"5b72c775-3c4a-4d6d-ba6d-a23fbbba168f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6809","nonce":3210201149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6811","nonce":3210201149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6815","nonce":3210201149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3210201149},{"type":"v1","addr":"172.21.15.88:6813","nonce":3210201149}]},"public_addr":"172.21.15.88:6809/3210201149","cluster_addr":"172.21.15.88:6811/3210201149","heartbeat_back_addr":"172.21.15.88:6815/3210201149","heartbeat_front_addr":"172.21.15.88:6813/3210201149","state":["exists","up"]},{"osd":3,"uuid":"d12a1bf2-1510-462a-a734-fb204b1c8465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6825","nonce":2184192424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6827","nonce":2184192424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6831","nonce":2184192424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2184192424},{"type":"v1","addr":"172.21.15.88:6829","nonce":2184192424}]},"public_addr":"172.21.15.88:6825/2184192424","cluster_addr":"172.21.15.88:6827/2184192424","heartbeat_back_addr":"172.21.15.88:6831/2184192424","heartbeat_front_addr":"172.21.15.88:6829/2184192424","state":["exists","up"]},{"osd":4,"uuid":"15a8e45a-7004-4f11-8790-cb6575823725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6801","nonce":2496559669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6803","nonce":2496559669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6807","nonce":2496559669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2496559669},{"type":"v1","addr":"172.21.15.187:6805","nonce":2496559669}]},"public_addr":"172.21.15.187:6801/2496559669","cluster_addr":"172.21.15.187:6803/2496559669","heartbeat_back_addr":"172.21.15.187:6807/2496559669","heartbeat_front_addr":"172.21.15.187:6805/2496559669","state":["exists","up"]},{"osd":5,"uuid":"f7b8b23d-a2c2-4565-a243-a8afe667a365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6818","nonce":133779704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6822","nonce":133779704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6829","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6831","nonce":133779704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6825","nonce":133779704},{"type":"v1","addr":"172.21.15.187:6827","nonce":133779704}]},"public_addr":"172.21.15.187:6818/133779704","cluster_addr":"172.21.15.187:6822/133779704","heartbeat_back_addr":"172.21.15.187:6831/133779704","heartbeat_front_addr":"172.21.15.187:6827/133779704","state":["exists","up"]},{"osd":6,"uuid":"ac0a3f4b-4d94-4857-acce-e2798bd54be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6819","nonce":3144907026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6821","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6823","nonce":3144907026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6830","nonce":3144907026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":3144907026},{"type":"v1","addr":"172.21.15.187:6826","nonce":3144907026}]},"public_addr":"172.21.15.187:6819/3144907026","cluster_addr":"172.21.15.187:6823/3144907026","heartbeat_back_addr":"172.21.15.187:6830/3144907026","heartbeat_front_addr":"172.21.15.187:6826/3144907026","state":["exists","up"]},{"osd":7,"uuid":"8a5e0c25-1500-4453-b8fc-951fb9e0fea7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6809","nonce":3991459512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6811","nonce":3991459512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6815","nonce":3991459512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3991459512},{"type":"v1","addr":"172.21.15.187:6813","nonce":3991459512}]},"public_addr":"172.21.15.187:6809/3991459512","cluster_addr":"172.21.15.187:6811/3991459512","heartbeat_back_addr":"172.21.15.187:6815/3991459512","heartbeat_front_addr":"172.21.15.187:6813/3991459512","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.869714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.940536+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.183004+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.199254+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:42.906827+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.010991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.196572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-17T12:24:43.195006+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-17T12:26:59.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f868406ace0 msgr2=0x7f868406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f868406ace0 0x7f868406d190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f86a40b0610 tx=0x7f868c008040 comp rx=0 tx=0).stop 2023-05-17T12:26:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a40c98a0 msgr2=0x7f86a41540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a40c98a0 0x7f86a41540e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8694000c00 tx=0x7f8694004750 comp rx=0 tx=0).stop 2023-05-17T12:26:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 shutdown_connections 2023-05-17T12:26:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f868406ace0 0x7f868406d190 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86a415a950 0x7f86a40ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86a40c98a0 0x7f86a41540e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 --2- 172.21.15.88:0/2169596859 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86a415a580 0x7f86a40ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 >> 172.21.15.88:0/2169596859 conn(0x7f86a40ced10 msgr2=0x7f86a406a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 shutdown_connections 2023-05-17T12:26:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.180+0000 7f86a9dff700 1 -- 172.21.15.88:0/2169596859 wait complete. 2023-05-17T12:26:59.201 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-17T12:26:59.201 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T12:26:59.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.384+0000 7f95ea3ff700 1 Processor -- start 2023-05-17T12:26:59.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.384+0000 7f95ea3ff700 1 -- start start 2023-05-17T12:26:59.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.385+0000 7f95ea3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e415a580 0x7f95e40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.385+0000 7f95ea3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f95e415a950 0x7f95e4070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.385+0000 7f95ea3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e415ec80 con 0x7f95e40c98a0 2023-05-17T12:26:59.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.385+0000 7f95ea3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e415f110 con 0x7f95e415a950 2023-05-17T12:26:59.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.385+0000 7f95ea3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e415e350 con 0x7f95e415a580 2023-05-17T12:26:59.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e37fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f95e415a950 0x7f95e4070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e415a580 0x7f95e40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e415a580 0x7f95e40c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:41900/0 (socket says 172.21.15.88:41900) 2023-05-17T12:26:59.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e3fff700 1 -- 172.21.15.88:0/2854706283 learned_addr learned my addr 172.21.15.88:0/2854706283 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:59.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e37fe700 1 --2- 172.21.15.88:0/2854706283 >> v2:172.21.15.187:3300/0 conn(0x7f95e415a950 0x7f95e4070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:45096/0 (socket says 172.21.15.88:45096) 2023-05-17T12:26:59.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e37fe700 1 -- 172.21.15.88:0/2854706283 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e415a580 msgr2=0x7f95e40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:59.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e37fe700 1 --2- 172.21.15.88:0/2854706283 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e415a580 0x7f95e40c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e37fe700 1 -- 172.21.15.88:0/2854706283 >> v1:172.21.15.187:6789/0 conn(0x7f95e40c98a0 legacy=0x7f95e406a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e37fe700 1 -- 172.21.15.88:0/2854706283 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e415e630 con 0x7f95e415a950 2023-05-17T12:26:59.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.386+0000 7f95e37fe700 1 --2- 172.21.15.88:0/2854706283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95e415a950 0x7f95e4070e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009840 tx=0x7f95d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb51838c5be4c00a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:59.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95e2ffd700 1 -- 172.21.15.88:0/2854706283 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8011830 con 0x7f95e415a950 2023-05-17T12:26:59.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95e2ffd700 1 -- 172.21.15.88:0/2854706283 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8011990 con 0x7f95e415a950 2023-05-17T12:26:59.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95e2ffd700 1 -- 172.21.15.88:0/2854706283 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8011d20 con 0x7f95e415a950 2023-05-17T12:26:59.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95ea3ff700 1 -- 172.21.15.88:0/2854706283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95e415a950 msgr2=0x7f95e4070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95ea3ff700 1 --2- 172.21.15.88:0/2854706283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95e415a950 0x7f95e4070e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009840 tx=0x7f95d8009b50 comp rx=0 tx=0).stop 2023-05-17T12:26:59.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95ea3ff700 1 -- 172.21.15.88:0/2854706283 shutdown_connections 2023-05-17T12:26:59.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95ea3ff700 1 --2- 172.21.15.88:0/2854706283 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e415a580 0x7f95e40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95ea3ff700 1 --2- 172.21.15.88:0/2854706283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95e415a950 0x7f95e4070e30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95ea3ff700 1 -- 172.21.15.88:0/2854706283 >> 172.21.15.88:0/2854706283 conn(0x7f95e40ced10 msgr2=0x7f95e40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:59.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.387+0000 7f95ea3ff700 1 -- 172.21.15.88:0/2854706283 shutdown_connections 2023-05-17T12:26:59.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.388+0000 7f95ea3ff700 1 -- 172.21.15.88:0/2854706283 wait complete. 2023-05-17T12:26:59.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.389+0000 7f95ea3ff700 1 Processor -- start 2023-05-17T12:26:59.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.389+0000 7f95ea3ff700 1 -- start start 2023-05-17T12:26:59.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.390+0000 7f95ea3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e40c98a0 0x7f95e40ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.390+0000 7f95ea3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e415a580 0x7f95e415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.390+0000 7f95ea3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95e415a950 0x7f95e40ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.390+0000 7f95ea3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40ad970 con 0x7f95e415a580 2023-05-17T12:26:59.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.390+0000 7f95ea3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e415b630 con 0x7f95e415a950 2023-05-17T12:26:59.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.390+0000 7f95ea3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40acdf0 con 0x7f95e40c98a0 2023-05-17T12:26:59.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e415a580 0x7f95e415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e415a580 0x7f95e415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46280/0 (socket says 172.21.15.88:46280) 2023-05-17T12:26:59.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e37fe700 1 -- 172.21.15.88:0/3015756123 learned_addr learned my addr 172.21.15.88:0/3015756123 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:59.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e3fff700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e40c98a0 0x7f95e40ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e899c700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95e415a950 0x7f95e40ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e37fe700 1 -- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e40c98a0 msgr2=0x7f95e40ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e37fe700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e40c98a0 0x7f95e40ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e37fe700 1 -- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95e415a950 msgr2=0x7f95e40ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e37fe700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95e415a950 0x7f95e40ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e37fe700 1 -- 172.21.15.88:0/3015756123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d80094a0 con 0x7f95e415a580 2023-05-17T12:26:59.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.391+0000 7f95e37fe700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e415a580 0x7f95e415d860 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f95d80090b0 tx=0x7f95d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:59.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.392+0000 7f95e0ff9700 1 -- 172.21.15.88:0/3015756123 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80036a0 con 0x7f95e415a580 2023-05-17T12:26:59.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.392+0000 7f95e0ff9700 1 -- 172.21.15.88:0/3015756123 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d801e070 con 0x7f95e415a580 2023-05-17T12:26:59.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.392+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e40cde00 con 0x7f95e415a580 2023-05-17T12:26:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.392+0000 7f95e0ff9700 1 -- 172.21.15.88:0/3015756123 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8003a60 con 0x7f95e415a580 2023-05-17T12:26:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.392+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e415e910 con 0x7f95e415a580 2023-05-17T12:26:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.393+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e40cea60 con 0x7f95e415a580 2023-05-17T12:26:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.394+0000 7f95e0ff9700 1 -- 172.21.15.88:0/3015756123 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95d8003bc0 con 0x7f95e415a580 2023-05-17T12:26:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.394+0000 7f95e0ff9700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95d006ace0 0x7f95d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.395+0000 7f95e0ff9700 1 -- 172.21.15.88:0/3015756123 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f95d808a7f0 con 0x7f95e415a580 2023-05-17T12:26:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.395+0000 7f95e3fff700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95d006ace0 0x7f95d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.396+0000 7f95e3fff700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95d006ace0 0x7f95d006d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009bd0 tx=0x7f95d40092c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:59.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.399+0000 7f95e0ff9700 1 -- 172.21.15.88:0/3015756123 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f95d80556d0 con 0x7f95e415a580 2023-05-17T12:26:59.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.587+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 --> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95e4074530 con 0x7f95d006ace0 2023-05-17T12:26:59.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.598+0000 7f95e0ff9700 1 -- 172.21.15.88:0/3015756123 <== mgr.4106 v2:172.21.15.187:6832/2490620069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311348 (secure 0 0 0) 0x7f95e4074530 con 0x7f95d006ace0 2023-05-17T12:26:59.605 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:26:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95d006ace0 msgr2=0x7f95d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95d006ace0 0x7f95d006d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009bd0 tx=0x7f95d40092c0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e415a580 msgr2=0x7f95e415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e415a580 0x7f95e415d860 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f95d80090b0 tx=0x7f95d8004750 comp rx=0 tx=0).stop 2023-05-17T12:26:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 shutdown_connections 2023-05-17T12:26:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f95d006ace0 0x7f95d006d190 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95e415a950 0x7f95e40ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95e40c98a0 0x7f95e40ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 --2- 172.21.15.88:0/3015756123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f95e415a580 0x7f95e415d860 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.602+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 >> 172.21.15.88:0/3015756123 conn(0x7f95e40ced10 msgr2=0x7f95e40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:59.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.603+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 shutdown_connections 2023-05-17T12:26:59.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.603+0000 7f95ea3ff700 1 -- 172.21.15.88:0/3015756123 wait complete. 2023-05-17T12:26:59.610 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-05-17T12:26:59.623 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-05-17T12:26:59.479853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71864,"kb_used_data":4984,"kb_used_omap":0,"kb_used_meta":66816,"kb_avail":754902856,"statfs":{"total":773094113280,"available":773020524544,"internally_reserved":0,"allocated":5103616,"data_stored":2907776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68419584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.680035"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.308213+0000","last_change":"2023-05-17T12:26:55.305727+0000","last_active":"2023-05-17T12:26:55.308213+0000","last_peered":"2023-05-17T12:26:55.308213+0000","last_clean":"2023-05-17T12:26:55.308213+0000","last_became_active":"2023-05-17T12:26:55.305442+0000","last_became_peered":"2023-05-17T12:26:55.305442+0000","last_unstale":"2023-05-17T12:26:55.308213+0000","last_undegraded":"2023-05-17T12:26:55.308213+0000","last_fullsized":"2023-05-17T12:26:55.308213+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:05:55.849947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292690+0000","last_change":"2023-05-17T12:26:55.306609+0000","last_active":"2023-05-17T12:26:56.292690+0000","last_peered":"2023-05-17T12:26:56.292690+0000","last_clean":"2023-05-17T12:26:56.292690+0000","last_became_active":"2023-05-17T12:26:55.306317+0000","last_became_peered":"2023-05-17T12:26:55.306317+0000","last_unstale":"2023-05-17T12:26:56.292690+0000","last_undegraded":"2023-05-17T12:26:56.292690+0000","last_fullsized":"2023-05-17T12:26:56.292690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:40:55.717293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292178+0000","last_change":"2023-05-17T12:26:55.311737+0000","last_active":"2023-05-17T12:26:56.292178+0000","last_peered":"2023-05-17T12:26:56.292178+0000","last_clean":"2023-05-17T12:26:56.292178+0000","last_became_active":"2023-05-17T12:26:55.311493+0000","last_became_peered":"2023-05-17T12:26:55.311493+0000","last_unstale":"2023-05-17T12:26:56.292178+0000","last_undegraded":"2023-05-17T12:26:56.292178+0000","last_fullsized":"2023-05-17T12:26:56.292178+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:04:43.953886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320554+0000","last_change":"2023-05-17T12:26:55.315453+0000","last_active":"2023-05-17T12:26:55.320554+0000","last_peered":"2023-05-17T12:26:55.320554+0000","last_clean":"2023-05-17T12:26:55.320554+0000","last_became_active":"2023-05-17T12:26:55.315139+0000","last_became_peered":"2023-05-17T12:26:55.315139+0000","last_unstale":"2023-05-17T12:26:55.320554+0000","last_undegraded":"2023-05-17T12:26:55.320554+0000","last_fullsized":"2023-05-17T12:26:55.320554+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:01:56.568414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292540+0000","last_change":"2023-05-17T12:26:55.304947+0000","last_active":"2023-05-17T12:26:56.292540+0000","last_peered":"2023-05-17T12:26:56.292540+0000","last_clean":"2023-05-17T12:26:56.292540+0000","last_became_active":"2023-05-17T12:26:55.304657+0000","last_became_peered":"2023-05-17T12:26:55.304657+0000","last_unstale":"2023-05-17T12:26:56.292540+0000","last_undegraded":"2023-05-17T12:26:56.292540+0000","last_fullsized":"2023-05-17T12:26:56.292540+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:19:38.848665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677872+0000","last_change":"2023-05-17T12:26:55.295262+0000","last_active":"2023-05-17T12:26:56.677872+0000","last_peered":"2023-05-17T12:26:56.677872+0000","last_clean":"2023-05-17T12:26:56.677872+0000","last_became_active":"2023-05-17T12:26:55.294998+0000","last_became_peered":"2023-05-17T12:26:55.294998+0000","last_unstale":"2023-05-17T12:26:56.677872+0000","last_undegraded":"2023-05-17T12:26:56.677872+0000","last_fullsized":"2023-05-17T12:26:56.677872+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.406938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.305150+0000","last_change":"2023-05-17T12:26:55.299076+0000","last_active":"2023-05-17T12:26:55.305150+0000","last_peered":"2023-05-17T12:26:55.305150+0000","last_clean":"2023-05-17T12:26:55.305150+0000","last_became_active":"2023-05-17T12:26:55.298790+0000","last_became_peered":"2023-05-17T12:26:55.298790+0000","last_unstale":"2023-05-17T12:26:55.305150+0000","last_undegraded":"2023-05-17T12:26:55.305150+0000","last_fullsized":"2023-05-17T12:26:55.305150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:51:44.448308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320331+0000","last_change":"2023-05-17T12:26:55.315987+0000","last_active":"2023-05-17T12:26:55.320331+0000","last_peered":"2023-05-17T12:26:55.320331+0000","last_clean":"2023-05-17T12:26:55.320331+0000","last_became_active":"2023-05-17T12:26:55.315654+0000","last_became_peered":"2023-05-17T12:26:55.315654+0000","last_unstale":"2023-05-17T12:26:55.320331+0000","last_undegraded":"2023-05-17T12:26:55.320331+0000","last_fullsized":"2023-05-17T12:26:55.320331+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:37:29.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320486+0000","last_change":"2023-05-17T12:26:55.308289+0000","last_active":"2023-05-17T12:26:55.320486+0000","last_peered":"2023-05-17T12:26:55.320486+0000","last_clean":"2023-05-17T12:26:55.320486+0000","last_became_active":"2023-05-17T12:26:55.308033+0000","last_became_peered":"2023-05-17T12:26:55.308033+0000","last_unstale":"2023-05-17T12:26:55.320486+0000","last_undegraded":"2023-05-17T12:26:55.320486+0000","last_fullsized":"2023-05-17T12:26:55.320486+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:20:56.171898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320642+0000","last_change":"2023-05-17T12:26:55.316814+0000","last_active":"2023-05-17T12:26:55.320642+0000","last_peered":"2023-05-17T12:26:55.320642+0000","last_clean":"2023-05-17T12:26:55.320642+0000","last_became_active":"2023-05-17T12:26:55.316510+0000","last_became_peered":"2023-05-17T12:26:55.316510+0000","last_unstale":"2023-05-17T12:26:55.320642+0000","last_undegraded":"2023-05-17T12:26:55.320642+0000","last_fullsized":"2023-05-17T12:26:55.320642+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:09.066643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320360+0000","last_change":"2023-05-17T12:26:55.304516+0000","last_active":"2023-05-17T12:26:55.320360+0000","last_peered":"2023-05-17T12:26:55.320360+0000","last_clean":"2023-05-17T12:26:55.320360+0000","last_became_active":"2023-05-17T12:26:55.304215+0000","last_became_peered":"2023-05-17T12:26:55.304215+0000","last_unstale":"2023-05-17T12:26:55.320360+0000","last_undegraded":"2023-05-17T12:26:55.320360+0000","last_fullsized":"2023-05-17T12:26:55.320360+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:25:57.810334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292880+0000","last_change":"2023-05-17T12:26:55.312711+0000","last_active":"2023-05-17T12:26:56.292880+0000","last_peered":"2023-05-17T12:26:56.292880+0000","last_clean":"2023-05-17T12:26:56.292880+0000","last_became_active":"2023-05-17T12:26:55.312449+0000","last_became_peered":"2023-05-17T12:26:55.312449+0000","last_unstale":"2023-05-17T12:26:56.292880+0000","last_undegraded":"2023-05-17T12:26:56.292880+0000","last_fullsized":"2023-05-17T12:26:56.292880+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:14:40.849108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.321551+0000","last_change":"2023-05-17T12:26:55.312697+0000","last_active":"2023-05-17T12:26:55.321551+0000","last_peered":"2023-05-17T12:26:55.321551+0000","last_clean":"2023-05-17T12:26:55.321551+0000","last_became_active":"2023-05-17T12:26:55.312214+0000","last_became_peered":"2023-05-17T12:26:55.312214+0000","last_unstale":"2023-05-17T12:26:55.321551+0000","last_undegraded":"2023-05-17T12:26:55.321551+0000","last_fullsized":"2023-05-17T12:26:55.321551+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:53:49.852602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320606+0000","last_change":"2023-05-17T12:26:55.307783+0000","last_active":"2023-05-17T12:26:55.320606+0000","last_peered":"2023-05-17T12:26:55.320606+0000","last_clean":"2023-05-17T12:26:55.320606+0000","last_became_active":"2023-05-17T12:26:55.307539+0000","last_became_peered":"2023-05-17T12:26:55.307539+0000","last_unstale":"2023-05-17T12:26:55.320606+0000","last_undegraded":"2023-05-17T12:26:55.320606+0000","last_fullsized":"2023-05-17T12:26:55.320606+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:07:07.279000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677747+0000","last_change":"2023-05-17T12:26:55.304702+0000","last_active":"2023-05-17T12:26:56.677747+0000","last_peered":"2023-05-17T12:26:56.677747+0000","last_clean":"2023-05-17T12:26:56.677747+0000","last_became_active":"2023-05-17T12:26:55.304299+0000","last_became_peered":"2023-05-17T12:26:55.304299+0000","last_unstale":"2023-05-17T12:26:56.677747+0000","last_undegraded":"2023-05-17T12:26:56.677747+0000","last_fullsized":"2023-05-17T12:26:56.677747+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:21:48.033779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.314093+0000","last_change":"2023-05-17T12:26:55.307990+0000","last_active":"2023-05-17T12:26:55.314093+0000","last_peered":"2023-05-17T12:26:55.314093+0000","last_clean":"2023-05-17T12:26:55.314093+0000","last_became_active":"2023-05-17T12:26:55.307701+0000","last_became_peered":"2023-05-17T12:26:55.307701+0000","last_unstale":"2023-05-17T12:26:55.314093+0000","last_undegraded":"2023-05-17T12:26:55.314093+0000","last_fullsized":"2023-05-17T12:26:55.314093+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:27:57.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292623+0000","last_change":"2023-05-17T12:26:55.305091+0000","last_active":"2023-05-17T12:26:56.292623+0000","last_peered":"2023-05-17T12:26:56.292623+0000","last_clean":"2023-05-17T12:26:56.292623+0000","last_became_active":"2023-05-17T12:26:55.304751+0000","last_became_peered":"2023-05-17T12:26:55.304751+0000","last_unstale":"2023-05-17T12:26:56.292623+0000","last_undegraded":"2023-05-17T12:26:56.292623+0000","last_fullsized":"2023-05-17T12:26:56.292623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:48:11.902634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292409+0000","last_change":"2023-05-17T12:26:55.316771+0000","last_active":"2023-05-17T12:26:56.292409+0000","last_peered":"2023-05-17T12:26:56.292409+0000","last_clean":"2023-05-17T12:26:56.292409+0000","last_became_active":"2023-05-17T12:26:55.316343+0000","last_became_peered":"2023-05-17T12:26:55.316343+0000","last_unstale":"2023-05-17T12:26:56.292409+0000","last_undegraded":"2023-05-17T12:26:56.292409+0000","last_fullsized":"2023-05-17T12:26:56.292409+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:24:08.443344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318617+0000","last_change":"2023-05-17T12:26:55.315835+0000","last_active":"2023-05-17T12:26:55.318617+0000","last_peered":"2023-05-17T12:26:55.318617+0000","last_clean":"2023-05-17T12:26:55.318617+0000","last_became_active":"2023-05-17T12:26:55.315339+0000","last_became_peered":"2023-05-17T12:26:55.315339+0000","last_unstale":"2023-05-17T12:26:55.318617+0000","last_undegraded":"2023-05-17T12:26:55.318617+0000","last_fullsized":"2023-05-17T12:26:55.318617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:53:49.852602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.321398+0000","last_change":"2023-05-17T12:26:55.311909+0000","last_active":"2023-05-17T12:26:55.321398+0000","last_peered":"2023-05-17T12:26:55.321398+0000","last_clean":"2023-05-17T12:26:55.321398+0000","last_became_active":"2023-05-17T12:26:55.311644+0000","last_became_peered":"2023-05-17T12:26:55.311644+0000","last_unstale":"2023-05-17T12:26:55.321398+0000","last_undegraded":"2023-05-17T12:26:55.321398+0000","last_fullsized":"2023-05-17T12:26:55.321398+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:27:57.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677848+0000","last_change":"2023-05-17T12:26:55.319526+0000","last_active":"2023-05-17T12:26:56.677848+0000","last_peered":"2023-05-17T12:26:56.677848+0000","last_clean":"2023-05-17T12:26:56.677848+0000","last_became_active":"2023-05-17T12:26:55.319221+0000","last_became_peered":"2023-05-17T12:26:55.319221+0000","last_unstale":"2023-05-17T12:26:56.677848+0000","last_undegraded":"2023-05-17T12:26:56.677848+0000","last_fullsized":"2023-05-17T12:26:56.677848+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:01:06.099429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320626+0000","last_change":"2023-05-17T12:26:55.315826+0000","last_active":"2023-05-17T12:26:55.320626+0000","last_peered":"2023-05-17T12:26:55.320626+0000","last_clean":"2023-05-17T12:26:55.320626+0000","last_became_active":"2023-05-17T12:26:55.315193+0000","last_became_peered":"2023-05-17T12:26:55.315193+0000","last_unstale":"2023-05-17T12:26:55.320626+0000","last_undegraded":"2023-05-17T12:26:55.320626+0000","last_fullsized":"2023-05-17T12:26:55.320626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:50:57.265338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318334+0000","last_change":"2023-05-17T12:26:55.314675+0000","last_active":"2023-05-17T12:26:55.318334+0000","last_peered":"2023-05-17T12:26:55.318334+0000","last_clean":"2023-05-17T12:26:55.318334+0000","last_became_active":"2023-05-17T12:26:55.314282+0000","last_became_peered":"2023-05-17T12:26:55.314282+0000","last_unstale":"2023-05-17T12:26:55.318334+0000","last_undegraded":"2023-05-17T12:26:55.318334+0000","last_fullsized":"2023-05-17T12:26:55.318334+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:37:54.341810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.314119+0000","last_change":"2023-05-17T12:26:55.310402+0000","last_active":"2023-05-17T12:26:55.314119+0000","last_peered":"2023-05-17T12:26:55.314119+0000","last_clean":"2023-05-17T12:26:55.314119+0000","last_became_active":"2023-05-17T12:26:55.310091+0000","last_became_peered":"2023-05-17T12:26:55.310091+0000","last_unstale":"2023-05-17T12:26:55.314119+0000","last_undegraded":"2023-05-17T12:26:55.314119+0000","last_fullsized":"2023-05-17T12:26:55.314119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:44:56.024311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.314041+0000","last_change":"2023-05-17T12:26:55.307280+0000","last_active":"2023-05-17T12:26:55.314041+0000","last_peered":"2023-05-17T12:26:55.314041+0000","last_clean":"2023-05-17T12:26:55.314041+0000","last_became_active":"2023-05-17T12:26:55.306998+0000","last_became_peered":"2023-05-17T12:26:55.306998+0000","last_unstale":"2023-05-17T12:26:55.314041+0000","last_undegraded":"2023-05-17T12:26:55.314041+0000","last_fullsized":"2023-05-17T12:26:55.314041+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:47:04.958759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.321837+0000","last_change":"2023-05-17T12:26:55.312036+0000","last_active":"2023-05-17T12:26:55.321837+0000","last_peered":"2023-05-17T12:26:55.321837+0000","last_clean":"2023-05-17T12:26:55.321837+0000","last_became_active":"2023-05-17T12:26:55.311749+0000","last_became_peered":"2023-05-17T12:26:55.311749+0000","last_unstale":"2023-05-17T12:26:55.321837+0000","last_undegraded":"2023-05-17T12:26:55.321837+0000","last_fullsized":"2023-05-17T12:26:55.321837+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:53:20.480128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292349+0000","last_change":"2023-05-17T12:26:55.304476+0000","last_active":"2023-05-17T12:26:56.292349+0000","last_peered":"2023-05-17T12:26:56.292349+0000","last_clean":"2023-05-17T12:26:56.292349+0000","last_became_active":"2023-05-17T12:26:55.304180+0000","last_became_peered":"2023-05-17T12:26:55.304180+0000","last_unstale":"2023-05-17T12:26:56.292349+0000","last_undegraded":"2023-05-17T12:26:56.292349+0000","last_fullsized":"2023-05-17T12:26:56.292349+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:43:36.592466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292538+0000","last_change":"2023-05-17T12:26:55.300316+0000","last_active":"2023-05-17T12:26:56.292538+0000","last_peered":"2023-05-17T12:26:56.292538+0000","last_clean":"2023-05-17T12:26:56.292538+0000","last_became_active":"2023-05-17T12:26:55.300041+0000","last_became_peered":"2023-05-17T12:26:55.300041+0000","last_unstale":"2023-05-17T12:26:56.292538+0000","last_undegraded":"2023-05-17T12:26:56.292538+0000","last_fullsized":"2023-05-17T12:26:56.292538+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:04:10.101729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318157+0000","last_change":"2023-05-17T12:26:55.312852+0000","last_active":"2023-05-17T12:26:55.318157+0000","last_peered":"2023-05-17T12:26:55.318157+0000","last_clean":"2023-05-17T12:26:55.318157+0000","last_became_active":"2023-05-17T12:26:55.312437+0000","last_became_peered":"2023-05-17T12:26:55.312437+0000","last_unstale":"2023-05-17T12:26:55.318157+0000","last_undegraded":"2023-05-17T12:26:55.318157+0000","last_fullsized":"2023-05-17T12:26:55.318157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:32:05.231707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292026+0000","last_change":"2023-05-17T12:26:55.309698+0000","last_active":"2023-05-17T12:26:56.292026+0000","last_peered":"2023-05-17T12:26:56.292026+0000","last_clean":"2023-05-17T12:26:56.292026+0000","last_became_active":"2023-05-17T12:26:55.309284+0000","last_became_peered":"2023-05-17T12:26:55.309284+0000","last_unstale":"2023-05-17T12:26:56.292026+0000","last_undegraded":"2023-05-17T12:26:56.292026+0000","last_fullsized":"2023-05-17T12:26:56.292026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:54.611375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677549+0000","last_change":"2023-05-17T12:26:55.293106+0000","last_active":"2023-05-17T12:26:56.677549+0000","last_peered":"2023-05-17T12:26:56.677549+0000","last_clean":"2023-05-17T12:26:56.677549+0000","last_became_active":"2023-05-17T12:26:55.292821+0000","last_became_peered":"2023-05-17T12:26:55.292821+0000","last_unstale":"2023-05-17T12:26:56.677549+0000","last_undegraded":"2023-05-17T12:26:56.677549+0000","last_fullsized":"2023-05-17T12:26:56.677549+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:58:45.351179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.311199+0000","last_change":"2023-05-17T12:26:55.305695+0000","last_active":"2023-05-17T12:26:55.311199+0000","last_peered":"2023-05-17T12:26:55.311199+0000","last_clean":"2023-05-17T12:26:55.311199+0000","last_became_active":"2023-05-17T12:26:55.305390+0000","last_became_peered":"2023-05-17T12:26:55.305390+0000","last_unstale":"2023-05-17T12:26:55.311199+0000","last_undegraded":"2023-05-17T12:26:55.311199+0000","last_fullsized":"2023-05-17T12:26:55.311199+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:44:42.624736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.291042+0000","last_change":"2023-05-17T12:26:55.308758+0000","last_active":"2023-05-17T12:26:56.291042+0000","last_peered":"2023-05-17T12:26:56.291042+0000","last_clean":"2023-05-17T12:26:56.291042+0000","last_became_active":"2023-05-17T12:26:55.308493+0000","last_became_peered":"2023-05-17T12:26:55.308493+0000","last_unstale":"2023-05-17T12:26:56.291042+0000","last_undegraded":"2023-05-17T12:26:56.291042+0000","last_fullsized":"2023-05-17T12:26:56.291042+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:09.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677956+0000","last_change":"2023-05-17T12:26:54.824568+0000","last_active":"2023-05-17T12:26:56.677956+0000","last_peered":"2023-05-17T12:26:56.677956+0000","last_clean":"2023-05-17T12:26:56.677956+0000","last_became_active":"2023-05-17T12:26:54.824320+0000","last_became_peered":"2023-05-17T12:26:54.824320+0000","last_unstale":"2023-05-17T12:26:56.677956+0000","last_undegraded":"2023-05-17T12:26:56.677956+0000","last_fullsized":"2023-05-17T12:26:56.677956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:19:37.843051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.315543+0000","last_change":"2023-05-17T12:26:55.312936+0000","last_active":"2023-05-17T12:26:55.315543+0000","last_peered":"2023-05-17T12:26:55.315543+0000","last_clean":"2023-05-17T12:26:55.315543+0000","last_became_active":"2023-05-17T12:26:55.312614+0000","last_became_peered":"2023-05-17T12:26:55.312614+0000","last_unstale":"2023-05-17T12:26:55.315543+0000","last_undegraded":"2023-05-17T12:26:55.315543+0000","last_fullsized":"2023-05-17T12:26:55.315543+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:53:20.480128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292797+0000","last_change":"2023-05-17T12:26:54.823396+0000","last_active":"2023-05-17T12:26:56.292797+0000","last_peered":"2023-05-17T12:26:56.292797+0000","last_clean":"2023-05-17T12:26:56.292797+0000","last_became_active":"2023-05-17T12:26:54.823056+0000","last_became_peered":"2023-05-17T12:26:54.823056+0000","last_unstale":"2023-05-17T12:26:56.292797+0000","last_undegraded":"2023-05-17T12:26:56.292797+0000","last_fullsized":"2023-05-17T12:26:56.292797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:45:22.555777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292724+0000","last_change":"2023-05-17T12:26:55.299770+0000","last_active":"2023-05-17T12:26:56.292724+0000","last_peered":"2023-05-17T12:26:56.292724+0000","last_clean":"2023-05-17T12:26:56.292724+0000","last_became_active":"2023-05-17T12:26:55.299502+0000","last_became_peered":"2023-05-17T12:26:55.299502+0000","last_unstale":"2023-05-17T12:26:56.292724+0000","last_undegraded":"2023-05-17T12:26:56.292724+0000","last_fullsized":"2023-05-17T12:26:56.292724+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:15:25.877956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.291047+0000","last_change":"2023-05-17T12:26:54.830891+0000","last_active":"2023-05-17T12:26:56.291047+0000","last_peered":"2023-05-17T12:26:56.291047+0000","last_clean":"2023-05-17T12:26:56.291047+0000","last_became_active":"2023-05-17T12:26:54.830710+0000","last_became_peered":"2023-05-17T12:26:54.830710+0000","last_unstale":"2023-05-17T12:26:56.291047+0000","last_undegraded":"2023-05-17T12:26:56.291047+0000","last_fullsized":"2023-05-17T12:26:56.291047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:15:14.487874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290994+0000","last_change":"2023-05-17T12:26:55.316607+0000","last_active":"2023-05-17T12:26:56.290994+0000","last_peered":"2023-05-17T12:26:56.290994+0000","last_clean":"2023-05-17T12:26:56.290994+0000","last_became_active":"2023-05-17T12:26:55.316191+0000","last_became_peered":"2023-05-17T12:26:55.316191+0000","last_unstale":"2023-05-17T12:26:56.290994+0000","last_undegraded":"2023-05-17T12:26:56.290994+0000","last_fullsized":"2023-05-17T12:26:56.290994+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:34:19.280405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.313673+0000","last_change":"2023-05-17T12:26:54.827974+0000","last_active":"2023-05-17T12:26:55.313673+0000","last_peered":"2023-05-17T12:26:55.313673+0000","last_clean":"2023-05-17T12:26:55.313673+0000","last_became_active":"2023-05-17T12:26:54.827706+0000","last_became_peered":"2023-05-17T12:26:54.827706+0000","last_unstale":"2023-05-17T12:26:55.313673+0000","last_undegraded":"2023-05-17T12:26:55.313673+0000","last_fullsized":"2023-05-17T12:26:55.313673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:08:54.388335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292220+0000","last_change":"2023-05-17T12:26:55.314236+0000","last_active":"2023-05-17T12:26:56.292220+0000","last_peered":"2023-05-17T12:26:56.292220+0000","last_clean":"2023-05-17T12:26:56.292220+0000","last_became_active":"2023-05-17T12:26:55.313915+0000","last_became_peered":"2023-05-17T12:26:55.313915+0000","last_unstale":"2023-05-17T12:26:56.292220+0000","last_undegraded":"2023-05-17T12:26:56.292220+0000","last_fullsized":"2023-05-17T12:26:56.292220+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:31:24.393417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677862+0000","last_change":"2023-05-17T12:26:54.821734+0000","last_active":"2023-05-17T12:26:56.677862+0000","last_peered":"2023-05-17T12:26:56.677862+0000","last_clean":"2023-05-17T12:26:56.677862+0000","last_became_active":"2023-05-17T12:26:54.821314+0000","last_became_peered":"2023-05-17T12:26:54.821314+0000","last_unstale":"2023-05-17T12:26:56.677862+0000","last_undegraded":"2023-05-17T12:26:56.677862+0000","last_fullsized":"2023-05-17T12:26:56.677862+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:54:59.093438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320776+0000","last_change":"2023-05-17T12:26:55.312828+0000","last_active":"2023-05-17T12:26:55.320776+0000","last_peered":"2023-05-17T12:26:55.320776+0000","last_clean":"2023-05-17T12:26:55.320776+0000","last_became_active":"2023-05-17T12:26:55.312557+0000","last_became_peered":"2023-05-17T12:26:55.312557+0000","last_unstale":"2023-05-17T12:26:55.320776+0000","last_undegraded":"2023-05-17T12:26:55.320776+0000","last_fullsized":"2023-05-17T12:26:55.320776+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:30:29.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292385+0000","last_change":"2023-05-17T12:26:54.820287+0000","last_active":"2023-05-17T12:26:56.292385+0000","last_peered":"2023-05-17T12:26:56.292385+0000","last_clean":"2023-05-17T12:26:56.292385+0000","last_became_active":"2023-05-17T12:26:54.819966+0000","last_became_peered":"2023-05-17T12:26:54.819966+0000","last_unstale":"2023-05-17T12:26:56.292385+0000","last_undegraded":"2023-05-17T12:26:56.292385+0000","last_fullsized":"2023-05-17T12:26:56.292385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:41:58.251263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320312+0000","last_change":"2023-05-17T12:26:55.315743+0000","last_active":"2023-05-17T12:26:55.320312+0000","last_peered":"2023-05-17T12:26:55.320312+0000","last_clean":"2023-05-17T12:26:55.320312+0000","last_became_active":"2023-05-17T12:26:55.315481+0000","last_became_peered":"2023-05-17T12:26:55.315481+0000","last_unstale":"2023-05-17T12:26:55.320312+0000","last_undegraded":"2023-05-17T12:26:55.320312+0000","last_fullsized":"2023-05-17T12:26:55.320312+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:09.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292348+0000","last_change":"2023-05-17T12:26:54.825434+0000","last_active":"2023-05-17T12:26:56.292348+0000","last_peered":"2023-05-17T12:26:56.292348+0000","last_clean":"2023-05-17T12:26:56.292348+0000","last_became_active":"2023-05-17T12:26:54.825093+0000","last_became_peered":"2023-05-17T12:26:54.825093+0000","last_unstale":"2023-05-17T12:26:56.292348+0000","last_undegraded":"2023-05-17T12:26:56.292348+0000","last_fullsized":"2023-05-17T12:26:56.292348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:02:23.575125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318303+0000","last_change":"2023-05-17T12:26:55.314594+0000","last_active":"2023-05-17T12:26:55.318303+0000","last_peered":"2023-05-17T12:26:55.318303+0000","last_clean":"2023-05-17T12:26:55.318303+0000","last_became_active":"2023-05-17T12:26:55.314262+0000","last_became_peered":"2023-05-17T12:26:55.314262+0000","last_unstale":"2023-05-17T12:26:55.318303+0000","last_undegraded":"2023-05-17T12:26:55.318303+0000","last_fullsized":"2023-05-17T12:26:55.318303+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:35:27.746640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.298954+0000","last_change":"2023-05-17T12:26:54.824576+0000","last_active":"2023-05-17T12:26:55.298954+0000","last_peered":"2023-05-17T12:26:55.298954+0000","last_clean":"2023-05-17T12:26:55.298954+0000","last_became_active":"2023-05-17T12:26:54.823866+0000","last_became_peered":"2023-05-17T12:26:54.823866+0000","last_unstale":"2023-05-17T12:26:55.298954+0000","last_undegraded":"2023-05-17T12:26:55.298954+0000","last_fullsized":"2023-05-17T12:26:55.298954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:22:40.822374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292648+0000","last_change":"2023-05-17T12:26:55.316592+0000","last_active":"2023-05-17T12:26:56.292648+0000","last_peered":"2023-05-17T12:26:56.292648+0000","last_clean":"2023-05-17T12:26:56.292648+0000","last_became_active":"2023-05-17T12:26:55.315977+0000","last_became_peered":"2023-05-17T12:26:55.315977+0000","last_unstale":"2023-05-17T12:26:56.292648+0000","last_undegraded":"2023-05-17T12:26:56.292648+0000","last_fullsized":"2023-05-17T12:26:56.292648+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:12:39.522561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292932+0000","last_change":"2023-05-17T12:26:54.819591+0000","last_active":"2023-05-17T12:26:56.292932+0000","last_peered":"2023-05-17T12:26:56.292932+0000","last_clean":"2023-05-17T12:26:56.292932+0000","last_became_active":"2023-05-17T12:26:54.819293+0000","last_became_peered":"2023-05-17T12:26:54.819293+0000","last_unstale":"2023-05-17T12:26:56.292932+0000","last_undegraded":"2023-05-17T12:26:56.292932+0000","last_fullsized":"2023-05-17T12:26:56.292932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:40:10.647414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.302788+0000","last_change":"2023-05-17T12:26:55.291935+0000","last_active":"2023-05-17T12:26:55.302788+0000","last_peered":"2023-05-17T12:26:55.302788+0000","last_clean":"2023-05-17T12:26:55.302788+0000","last_became_active":"2023-05-17T12:26:55.291620+0000","last_became_peered":"2023-05-17T12:26:55.291620+0000","last_unstale":"2023-05-17T12:26:55.302788+0000","last_undegraded":"2023-05-17T12:26:55.302788+0000","last_fullsized":"2023-05-17T12:26:55.302788+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:17.366645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.301063+0000","last_change":"2023-05-17T12:26:54.822457+0000","last_active":"2023-05-17T12:26:55.301063+0000","last_peered":"2023-05-17T12:26:55.301063+0000","last_clean":"2023-05-17T12:26:55.301063+0000","last_became_active":"2023-05-17T12:26:54.822167+0000","last_became_peered":"2023-05-17T12:26:54.822167+0000","last_unstale":"2023-05-17T12:26:55.301063+0000","last_undegraded":"2023-05-17T12:26:55.301063+0000","last_fullsized":"2023-05-17T12:26:55.301063+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:38:20.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677860+0000","last_change":"2023-05-17T12:26:55.315983+0000","last_active":"2023-05-17T12:26:56.677860+0000","last_peered":"2023-05-17T12:26:56.677860+0000","last_clean":"2023-05-17T12:26:56.677860+0000","last_became_active":"2023-05-17T12:26:55.315567+0000","last_became_peered":"2023-05-17T12:26:55.315567+0000","last_unstale":"2023-05-17T12:26:56.677860+0000","last_undegraded":"2023-05-17T12:26:56.677860+0000","last_fullsized":"2023-05-17T12:26:56.677860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:02:24.580740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.315226+0000","last_change":"2023-05-17T12:26:54.827054+0000","last_active":"2023-05-17T12:26:55.315226+0000","last_peered":"2023-05-17T12:26:55.315226+0000","last_clean":"2023-05-17T12:26:55.315226+0000","last_became_active":"2023-05-17T12:26:54.826716+0000","last_became_peered":"2023-05-17T12:26:54.826716+0000","last_unstale":"2023-05-17T12:26:55.315226+0000","last_undegraded":"2023-05-17T12:26:55.315226+0000","last_fullsized":"2023-05-17T12:26:55.315226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:52:55.830008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.305318+0000","last_change":"2023-05-17T12:26:55.299490+0000","last_active":"2023-05-17T12:26:55.305318+0000","last_peered":"2023-05-17T12:26:55.305318+0000","last_clean":"2023-05-17T12:26:55.305318+0000","last_became_active":"2023-05-17T12:26:55.298993+0000","last_became_peered":"2023-05-17T12:26:55.298993+0000","last_unstale":"2023-05-17T12:26:55.305318+0000","last_undegraded":"2023-05-17T12:26:55.305318+0000","last_fullsized":"2023-05-17T12:26:55.305318+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:24.761124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.324980+0000","last_change":"2023-05-17T12:26:54.820358+0000","last_active":"2023-05-17T12:26:55.324980+0000","last_peered":"2023-05-17T12:26:55.324980+0000","last_clean":"2023-05-17T12:26:55.324980+0000","last_became_active":"2023-05-17T12:26:54.820089+0000","last_became_peered":"2023-05-17T12:26:54.820089+0000","last_unstale":"2023-05-17T12:26:55.324980+0000","last_undegraded":"2023-05-17T12:26:55.324980+0000","last_fullsized":"2023-05-17T12:26:55.324980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:06:03.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.323021+0000","last_change":"2023-05-17T12:26:55.321670+0000","last_active":"2023-05-17T12:26:55.323021+0000","last_peered":"2023-05-17T12:26:55.323021+0000","last_clean":"2023-05-17T12:26:55.323021+0000","last_became_active":"2023-05-17T12:26:55.321424+0000","last_became_peered":"2023-05-17T12:26:55.321424+0000","last_unstale":"2023-05-17T12:26:55.323021+0000","last_undegraded":"2023-05-17T12:26:55.323021+0000","last_fullsized":"2023-05-17T12:26:55.323021+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:48:46.609743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.678006+0000","last_change":"2023-05-17T12:26:54.818285+0000","last_active":"2023-05-17T12:26:56.678006+0000","last_peered":"2023-05-17T12:26:56.678006+0000","last_clean":"2023-05-17T12:26:56.678006+0000","last_became_active":"2023-05-17T12:26:54.817993+0000","last_became_peered":"2023-05-17T12:26:54.817993+0000","last_unstale":"2023-05-17T12:26:56.678006+0000","last_undegraded":"2023-05-17T12:26:56.678006+0000","last_fullsized":"2023-05-17T12:26:56.678006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:15:24.872341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320732+0000","last_change":"2023-05-17T12:26:55.309173+0000","last_active":"2023-05-17T12:26:55.320732+0000","last_peered":"2023-05-17T12:26:55.320732+0000","last_clean":"2023-05-17T12:26:55.320732+0000","last_became_active":"2023-05-17T12:26:55.308945+0000","last_became_peered":"2023-05-17T12:26:55.308945+0000","last_unstale":"2023-05-17T12:26:55.320732+0000","last_undegraded":"2023-05-17T12:26:55.320732+0000","last_fullsized":"2023-05-17T12:26:55.320732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:18:48.279265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.286062+0000","last_change":"2023-05-17T12:26:54.822551+0000","last_active":"2023-05-17T12:26:55.286062+0000","last_peered":"2023-05-17T12:26:55.286062+0000","last_clean":"2023-05-17T12:26:55.286062+0000","last_became_active":"2023-05-17T12:26:54.822247+0000","last_became_peered":"2023-05-17T12:26:54.822247+0000","last_unstale":"2023-05-17T12:26:55.286062+0000","last_undegraded":"2023-05-17T12:26:55.286062+0000","last_fullsized":"2023-05-17T12:26:55.286062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:38:20.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677546+0000","last_change":"2023-05-17T12:26:55.308076+0000","last_active":"2023-05-17T12:26:56.677546+0000","last_peered":"2023-05-17T12:26:56.677546+0000","last_clean":"2023-05-17T12:26:56.677546+0000","last_became_active":"2023-05-17T12:26:55.307799+0000","last_became_peered":"2023-05-17T12:26:55.307799+0000","last_unstale":"2023-05-17T12:26:56.677546+0000","last_undegraded":"2023-05-17T12:26:56.677546+0000","last_fullsized":"2023-05-17T12:26:56.677546+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:37:25.078754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677594+0000","last_change":"2023-05-17T12:26:54.818531+0000","last_active":"2023-05-17T12:26:56.677594+0000","last_peered":"2023-05-17T12:26:56.677594+0000","last_clean":"2023-05-17T12:26:56.677594+0000","last_became_active":"2023-05-17T12:26:54.818150+0000","last_became_peered":"2023-05-17T12:26:54.818150+0000","last_unstale":"2023-05-17T12:26:56.677594+0000","last_undegraded":"2023-05-17T12:26:56.677594+0000","last_fullsized":"2023-05-17T12:26:56.677594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:14:46.613156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318599+0000","last_change":"2023-05-17T12:26:55.315564+0000","last_active":"2023-05-17T12:26:55.318599+0000","last_peered":"2023-05-17T12:26:55.318599+0000","last_clean":"2023-05-17T12:26:55.318599+0000","last_became_active":"2023-05-17T12:26:55.315219+0000","last_became_peered":"2023-05-17T12:26:55.315219+0000","last_unstale":"2023-05-17T12:26:55.318599+0000","last_undegraded":"2023-05-17T12:26:55.318599+0000","last_fullsized":"2023-05-17T12:26:55.318599+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:58:44.217184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320262+0000","last_change":"2023-05-17T12:26:54.825208+0000","last_active":"2023-05-17T12:26:55.320262+0000","last_peered":"2023-05-17T12:26:55.320262+0000","last_clean":"2023-05-17T12:26:55.320262+0000","last_became_active":"2023-05-17T12:26:54.824961+0000","last_became_peered":"2023-05-17T12:26:54.824961+0000","last_unstale":"2023-05-17T12:26:55.320262+0000","last_undegraded":"2023-05-17T12:26:55.320262+0000","last_fullsized":"2023-05-17T12:26:55.320262+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:55:51.135871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.321817+0000","last_change":"2023-05-17T12:26:55.311386+0000","last_active":"2023-05-17T12:26:55.321817+0000","last_peered":"2023-05-17T12:26:55.321817+0000","last_clean":"2023-05-17T12:26:55.321817+0000","last_became_active":"2023-05-17T12:26:55.311118+0000","last_became_peered":"2023-05-17T12:26:55.311118+0000","last_unstale":"2023-05-17T12:26:55.321817+0000","last_undegraded":"2023-05-17T12:26:55.321817+0000","last_fullsized":"2023-05-17T12:26:55.321817+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:48:46.609743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.322643+0000","last_change":"2023-05-17T12:26:54.825413+0000","last_active":"2023-05-17T12:26:55.322643+0000","last_peered":"2023-05-17T12:26:55.322643+0000","last_clean":"2023-05-17T12:26:55.322643+0000","last_became_active":"2023-05-17T12:26:54.825169+0000","last_became_peered":"2023-05-17T12:26:54.825169+0000","last_unstale":"2023-05-17T12:26:55.322643+0000","last_undegraded":"2023-05-17T12:26:55.322643+0000","last_fullsized":"2023-05-17T12:26:55.322643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:47:03.953145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320504+0000","last_change":"2023-05-17T12:26:55.312227+0000","last_active":"2023-05-17T12:26:55.320504+0000","last_peered":"2023-05-17T12:26:55.320504+0000","last_clean":"2023-05-17T12:26:55.320504+0000","last_became_active":"2023-05-17T12:26:55.311986+0000","last_became_peered":"2023-05-17T12:26:55.311986+0000","last_unstale":"2023-05-17T12:26:55.320504+0000","last_undegraded":"2023-05-17T12:26:55.320504+0000","last_fullsized":"2023-05-17T12:26:55.320504+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:05:13.080369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292876+0000","last_change":"2023-05-17T12:26:54.823724+0000","last_active":"2023-05-17T12:26:56.292876+0000","last_peered":"2023-05-17T12:26:56.292876+0000","last_clean":"2023-05-17T12:26:56.292876+0000","last_became_active":"2023-05-17T12:26:54.821707+0000","last_became_peered":"2023-05-17T12:26:54.821707+0000","last_unstale":"2023-05-17T12:26:56.292876+0000","last_undegraded":"2023-05-17T12:26:56.292876+0000","last_fullsized":"2023-05-17T12:26:56.292876+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:05:50.095579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.315405+0000","last_change":"2023-05-17T12:26:55.313214+0000","last_active":"2023-05-17T12:26:55.315405+0000","last_peered":"2023-05-17T12:26:55.315405+0000","last_clean":"2023-05-17T12:26:55.315405+0000","last_became_active":"2023-05-17T12:26:55.312881+0000","last_became_peered":"2023-05-17T12:26:55.312881+0000","last_unstale":"2023-05-17T12:26:55.315405+0000","last_undegraded":"2023-05-17T12:26:55.315405+0000","last_fullsized":"2023-05-17T12:26:55.315405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:39.395708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.293099+0000","last_change":"2023-05-17T12:26:54.826607+0000","last_active":"2023-05-17T12:26:56.293099+0000","last_peered":"2023-05-17T12:26:56.293099+0000","last_clean":"2023-05-17T12:26:56.293099+0000","last_became_active":"2023-05-17T12:26:54.826341+0000","last_became_peered":"2023-05-17T12:26:54.826341+0000","last_unstale":"2023-05-17T12:26:56.293099+0000","last_undegraded":"2023-05-17T12:26:56.293099+0000","last_fullsized":"2023-05-17T12:26:56.293099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:54:25.923550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318187+0000","last_change":"2023-05-17T12:26:55.313954+0000","last_active":"2023-05-17T12:26:55.318187+0000","last_peered":"2023-05-17T12:26:55.318187+0000","last_clean":"2023-05-17T12:26:55.318187+0000","last_became_active":"2023-05-17T12:26:55.313632+0000","last_became_peered":"2023-05-17T12:26:55.313632+0000","last_unstale":"2023-05-17T12:26:55.318187+0000","last_undegraded":"2023-05-17T12:26:55.318187+0000","last_fullsized":"2023-05-17T12:26:55.318187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:01.082778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677953+0000","last_change":"2023-05-17T12:26:54.824203+0000","last_active":"2023-05-17T12:26:56.677953+0000","last_peered":"2023-05-17T12:26:56.677953+0000","last_clean":"2023-05-17T12:26:56.677953+0000","last_became_active":"2023-05-17T12:26:54.823976+0000","last_became_peered":"2023-05-17T12:26:54.823976+0000","last_unstale":"2023-05-17T12:26:56.677953+0000","last_undegraded":"2023-05-17T12:26:56.677953+0000","last_fullsized":"2023-05-17T12:26:56.677953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:04:09.096115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677611+0000","last_change":"2023-05-17T12:26:55.308724+0000","last_active":"2023-05-17T12:26:56.677611+0000","last_peered":"2023-05-17T12:26:56.677611+0000","last_clean":"2023-05-17T12:26:56.677611+0000","last_became_active":"2023-05-17T12:26:55.308488+0000","last_became_peered":"2023-05-17T12:26:55.308488+0000","last_unstale":"2023-05-17T12:26:56.677611+0000","last_undegraded":"2023-05-17T12:26:56.677611+0000","last_fullsized":"2023-05-17T12:26:56.677611+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:22:47.817778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.678045+0000","last_change":"2023-05-17T12:26:54.821568+0000","last_active":"2023-05-17T12:26:56.678045+0000","last_peered":"2023-05-17T12:26:56.678045+0000","last_clean":"2023-05-17T12:26:56.678045+0000","last_became_active":"2023-05-17T12:26:54.820976+0000","last_became_peered":"2023-05-17T12:26:54.820976+0000","last_unstale":"2023-05-17T12:26:56.678045+0000","last_undegraded":"2023-05-17T12:26:56.678045+0000","last_fullsized":"2023-05-17T12:26:56.678045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:14:39.843494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290843+0000","last_change":"2023-05-17T12:26:55.306200+0000","last_active":"2023-05-17T12:26:56.290843+0000","last_peered":"2023-05-17T12:26:56.290843+0000","last_clean":"2023-05-17T12:26:56.290843+0000","last_became_active":"2023-05-17T12:26:55.305927+0000","last_became_peered":"2023-05-17T12:26:55.305927+0000","last_unstale":"2023-05-17T12:26:56.290843+0000","last_undegraded":"2023-05-17T12:26:56.290843+0000","last_fullsized":"2023-05-17T12:26:56.290843+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:20:56.171898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292500+0000","last_change":"2023-05-17T12:26:54.826218+0000","last_active":"2023-05-17T12:26:56.292500+0000","last_peered":"2023-05-17T12:26:56.292500+0000","last_clean":"2023-05-17T12:26:56.292500+0000","last_became_active":"2023-05-17T12:26:54.825702+0000","last_became_peered":"2023-05-17T12:26:54.825702+0000","last_unstale":"2023-05-17T12:26:56.292500+0000","last_undegraded":"2023-05-17T12:26:56.292500+0000","last_fullsized":"2023-05-17T12:26:56.292500+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:30:19.606678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.319054+0000","last_change":"2023-05-17T12:26:55.309540+0000","last_active":"2023-05-17T12:26:55.319054+0000","last_peered":"2023-05-17T12:26:55.319054+0000","last_clean":"2023-05-17T12:26:55.319054+0000","last_became_active":"2023-05-17T12:26:55.309238+0000","last_became_peered":"2023-05-17T12:26:55.309238+0000","last_unstale":"2023-05-17T12:26:55.319054+0000","last_undegraded":"2023-05-17T12:26:55.319054+0000","last_fullsized":"2023-05-17T12:26:55.319054+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:38:49.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.297761+0000","last_change":"2023-05-17T12:26:54.823367+0000","last_active":"2023-05-17T12:26:55.297761+0000","last_peered":"2023-05-17T12:26:55.297761+0000","last_clean":"2023-05-17T12:26:55.297761+0000","last_became_active":"2023-05-17T12:26:54.823083+0000","last_became_peered":"2023-05-17T12:26:54.823083+0000","last_unstale":"2023-05-17T12:26:55.297761+0000","last_undegraded":"2023-05-17T12:26:55.297761+0000","last_fullsized":"2023-05-17T12:26:55.297761+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:15:14.487874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320580+0000","last_change":"2023-05-17T12:26:55.308581+0000","last_active":"2023-05-17T12:26:55.320580+0000","last_peered":"2023-05-17T12:26:55.320580+0000","last_clean":"2023-05-17T12:26:55.320580+0000","last_became_active":"2023-05-17T12:26:55.308293+0000","last_became_peered":"2023-05-17T12:26:55.308293+0000","last_unstale":"2023-05-17T12:26:55.320580+0000","last_undegraded":"2023-05-17T12:26:55.320580+0000","last_fullsized":"2023-05-17T12:26:55.320580+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:34:19.280405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.287598+0000","last_change":"2023-05-17T12:26:54.824933+0000","last_active":"2023-05-17T12:26:55.287598+0000","last_peered":"2023-05-17T12:26:55.287598+0000","last_clean":"2023-05-17T12:26:55.287598+0000","last_became_active":"2023-05-17T12:26:54.824608+0000","last_became_peered":"2023-05-17T12:26:54.824608+0000","last_unstale":"2023-05-17T12:26:55.287598+0000","last_undegraded":"2023-05-17T12:26:55.287598+0000","last_fullsized":"2023-05-17T12:26:55.287598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:33.198529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292096+0000","last_change":"2023-05-17T12:26:55.304122+0000","last_active":"2023-05-17T12:26:56.292096+0000","last_peered":"2023-05-17T12:26:56.292096+0000","last_clean":"2023-05-17T12:26:56.292096+0000","last_became_active":"2023-05-17T12:26:55.303840+0000","last_became_peered":"2023-05-17T12:26:55.303840+0000","last_unstale":"2023-05-17T12:26:56.292096+0000","last_undegraded":"2023-05-17T12:26:56.292096+0000","last_fullsized":"2023-05-17T12:26:56.292096+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:40:10.778893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.299084+0000","last_change":"2023-05-17T12:26:54.824724+0000","last_active":"2023-05-17T12:26:55.299084+0000","last_peered":"2023-05-17T12:26:55.299084+0000","last_clean":"2023-05-17T12:26:55.299084+0000","last_became_active":"2023-05-17T12:26:54.824479+0000","last_became_peered":"2023-05-17T12:26:54.824479+0000","last_unstale":"2023-05-17T12:26:55.299084+0000","last_undegraded":"2023-05-17T12:26:55.299084+0000","last_fullsized":"2023-05-17T12:26:55.299084+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:00:38.924919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290792+0000","last_change":"2023-05-17T12:24:55.792670+0000","last_active":"2023-05-17T12:26:56.290792+0000","last_peered":"2023-05-17T12:26:56.290792+0000","last_clean":"2023-05-17T12:26:56.290792+0000","last_became_active":"2023-05-17T12:24:55.792363+0000","last_became_peered":"2023-05-17T12:24:55.792363+0000","last_unstale":"2023-05-17T12:26:56.290792+0000","last_undegraded":"2023-05-17T12:26:56.290792+0000","last_fullsized":"2023-05-17T12:26:56.290792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:13.015221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318558+0000","last_change":"2023-05-17T12:26:55.316368+0000","last_active":"2023-05-17T12:26:55.318558+0000","last_peered":"2023-05-17T12:26:55.318558+0000","last_clean":"2023-05-17T12:26:55.318558+0000","last_became_active":"2023-05-17T12:26:55.315480+0000","last_became_peered":"2023-05-17T12:26:55.315480+0000","last_unstale":"2023-05-17T12:26:55.318558+0000","last_undegraded":"2023-05-17T12:26:55.318558+0000","last_fullsized":"2023-05-17T12:26:55.318558+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:06:04.199036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:57.005889+0000","last_change":"2023-05-17T12:26:54.819171+0000","last_active":"2023-05-17T12:26:57.005889+0000","last_peered":"2023-05-17T12:26:57.005889+0000","last_clean":"2023-05-17T12:26:57.005889+0000","last_became_active":"2023-05-17T12:26:54.818937+0000","last_became_peered":"2023-05-17T12:26:54.818937+0000","last_unstale":"2023-05-17T12:26:57.005889+0000","last_undegraded":"2023-05-17T12:26:57.005889+0000","last_fullsized":"2023-05-17T12:26:57.005889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:30:19.606678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292653+0000","last_change":"2023-05-17T12:24:55.754074+0000","last_active":"2023-05-17T12:26:56.292653+0000","last_peered":"2023-05-17T12:26:56.292653+0000","last_clean":"2023-05-17T12:26:56.292653+0000","last_became_active":"2023-05-17T12:24:55.753544+0000","last_became_peered":"2023-05-17T12:24:55.753544+0000","last_unstale":"2023-05-17T12:26:56.292653+0000","last_undegraded":"2023-05-17T12:26:56.292653+0000","last_fullsized":"2023-05-17T12:26:56.292653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:31:07.379328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320537+0000","last_change":"2023-05-17T12:26:55.304514+0000","last_active":"2023-05-17T12:26:55.320537+0000","last_peered":"2023-05-17T12:26:55.320537+0000","last_clean":"2023-05-17T12:26:55.320537+0000","last_became_active":"2023-05-17T12:26:55.304229+0000","last_became_peered":"2023-05-17T12:26:55.304229+0000","last_unstale":"2023-05-17T12:26:55.320537+0000","last_undegraded":"2023-05-17T12:26:55.320537+0000","last_fullsized":"2023-05-17T12:26:55.320537+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:49:42.570249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.288333+0000","last_change":"2023-05-17T12:26:54.828563+0000","last_active":"2023-05-17T12:26:55.288333+0000","last_peered":"2023-05-17T12:26:55.288333+0000","last_clean":"2023-05-17T12:26:55.288333+0000","last_became_active":"2023-05-17T12:26:54.828318+0000","last_became_peered":"2023-05-17T12:26:54.828318+0000","last_unstale":"2023-05-17T12:26:55.288333+0000","last_undegraded":"2023-05-17T12:26:55.288333+0000","last_fullsized":"2023-05-17T12:26:55.288333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:15:43.601540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.290391+0000","last_change":"2023-05-17T12:24:56.008501+0000","last_active":"2023-05-17T12:26:55.290391+0000","last_peered":"2023-05-17T12:26:55.290391+0000","last_clean":"2023-05-17T12:26:55.290391+0000","last_became_active":"2023-05-17T12:24:56.008203+0000","last_became_peered":"2023-05-17T12:24:56.008203+0000","last_unstale":"2023-05-17T12:26:55.290391+0000","last_undegraded":"2023-05-17T12:26:55.290391+0000","last_fullsized":"2023-05-17T12:26:55.290391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:42:55.959163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320623+0000","last_change":"2023-05-17T12:26:55.309392+0000","last_active":"2023-05-17T12:26:55.320623+0000","last_peered":"2023-05-17T12:26:55.320623+0000","last_clean":"2023-05-17T12:26:55.320623+0000","last_became_active":"2023-05-17T12:26:55.309076+0000","last_became_peered":"2023-05-17T12:26:55.309076+0000","last_unstale":"2023-05-17T12:26:55.320623+0000","last_undegraded":"2023-05-17T12:26:55.320623+0000","last_fullsized":"2023-05-17T12:26:55.320623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:11:17.753723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.293187+0000","last_change":"2023-05-17T12:26:54.827181+0000","last_active":"2023-05-17T12:26:56.293187+0000","last_peered":"2023-05-17T12:26:56.293187+0000","last_clean":"2023-05-17T12:26:56.293187+0000","last_became_active":"2023-05-17T12:26:54.826895+0000","last_became_peered":"2023-05-17T12:26:54.826895+0000","last_unstale":"2023-05-17T12:26:56.293187+0000","last_undegraded":"2023-05-17T12:26:56.293187+0000","last_fullsized":"2023-05-17T12:26:56.293187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:39:29.493064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292626+0000","last_change":"2023-05-17T12:24:55.753963+0000","last_active":"2023-05-17T12:26:56.292626+0000","last_peered":"2023-05-17T12:26:56.292626+0000","last_clean":"2023-05-17T12:26:56.292626+0000","last_became_active":"2023-05-17T12:24:55.753582+0000","last_became_peered":"2023-05-17T12:24:55.753582+0000","last_unstale":"2023-05-17T12:26:56.292626+0000","last_undegraded":"2023-05-17T12:26:56.292626+0000","last_fullsized":"2023-05-17T12:26:56.292626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:42:33.932129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":206,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.287715+0000","last_change":"2023-05-17T12:24:48.829166+0000","last_active":"2023-05-17T12:26:55.287715+0000","last_peered":"2023-05-17T12:26:55.287715+0000","last_clean":"2023-05-17T12:26:55.287715+0000","last_became_active":"2023-05-17T12:24:48.828767+0000","last_became_peered":"2023-05-17T12:24:48.828767+0000","last_unstale":"2023-05-17T12:26:55.287715+0000","last_undegraded":"2023-05-17T12:26:55.287715+0000","last_fullsized":"2023-05-17T12:26:55.287715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_clean_scrub_stamp":"2023-05-17T12:24:47.688706+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:39:49.412468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.305296+0000","last_change":"2023-05-17T12:26:55.299291+0000","last_active":"2023-05-17T12:26:55.305296+0000","last_peered":"2023-05-17T12:26:55.305296+0000","last_clean":"2023-05-17T12:26:55.305296+0000","last_became_active":"2023-05-17T12:26:55.298637+0000","last_became_peered":"2023-05-17T12:26:55.298637+0000","last_unstale":"2023-05-17T12:26:55.305296+0000","last_undegraded":"2023-05-17T12:26:55.305296+0000","last_fullsized":"2023-05-17T12:26:55.305296+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:57.911700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290801+0000","last_change":"2023-05-17T12:26:54.826202+0000","last_active":"2023-05-17T12:26:56.290801+0000","last_peered":"2023-05-17T12:26:56.290801+0000","last_clean":"2023-05-17T12:26:56.290801+0000","last_became_active":"2023-05-17T12:26:54.825933+0000","last_became_peered":"2023-05-17T12:26:54.825933+0000","last_unstale":"2023-05-17T12:26:56.290801+0000","last_undegraded":"2023-05-17T12:26:56.290801+0000","last_fullsized":"2023-05-17T12:26:56.290801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:07:06.273386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.288000+0000","last_change":"2023-05-17T12:24:55.756595+0000","last_active":"2023-05-17T12:26:55.288000+0000","last_peered":"2023-05-17T12:26:55.288000+0000","last_clean":"2023-05-17T12:26:55.288000+0000","last_became_active":"2023-05-17T12:24:55.756274+0000","last_became_peered":"2023-05-17T12:24:55.756274+0000","last_unstale":"2023-05-17T12:26:55.288000+0000","last_undegraded":"2023-05-17T12:26:55.288000+0000","last_fullsized":"2023-05-17T12:26:55.288000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:21:43.516314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292301+0000","last_change":"2023-05-17T12:26:55.295940+0000","last_active":"2023-05-17T12:26:56.292301+0000","last_peered":"2023-05-17T12:26:56.292301+0000","last_clean":"2023-05-17T12:26:56.292301+0000","last_became_active":"2023-05-17T12:26:55.295657+0000","last_became_peered":"2023-05-17T12:26:55.295657+0000","last_unstale":"2023-05-17T12:26:56.292301+0000","last_undegraded":"2023-05-17T12:26:56.292301+0000","last_fullsized":"2023-05-17T12:26:56.292301+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.406938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290746+0000","last_change":"2023-05-17T12:26:54.822872+0000","last_active":"2023-05-17T12:26:56.290746+0000","last_peered":"2023-05-17T12:26:56.290746+0000","last_clean":"2023-05-17T12:26:56.290746+0000","last_became_active":"2023-05-17T12:26:54.822671+0000","last_became_peered":"2023-05-17T12:26:54.822671+0000","last_unstale":"2023-05-17T12:26:56.290746+0000","last_undegraded":"2023-05-17T12:26:56.290746+0000","last_fullsized":"2023-05-17T12:26:56.290746+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:11:16.748109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.288048+0000","last_change":"2023-05-17T12:24:55.792994+0000","last_active":"2023-05-17T12:26:55.288048+0000","last_peered":"2023-05-17T12:26:55.288048+0000","last_clean":"2023-05-17T12:26:55.288048+0000","last_became_active":"2023-05-17T12:24:55.792597+0000","last_became_peered":"2023-05-17T12:24:55.792597+0000","last_unstale":"2023-05-17T12:26:55.288048+0000","last_undegraded":"2023-05-17T12:26:55.288048+0000","last_fullsized":"2023-05-17T12:26:55.288048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:31:49.937880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677973+0000","last_change":"2023-05-17T12:26:55.308191+0000","last_active":"2023-05-17T12:26:56.677973+0000","last_peered":"2023-05-17T12:26:56.677973+0000","last_clean":"2023-05-17T12:26:56.677973+0000","last_became_active":"2023-05-17T12:26:55.307929+0000","last_became_peered":"2023-05-17T12:26:55.307929+0000","last_unstale":"2023-05-17T12:26:56.677973+0000","last_undegraded":"2023-05-17T12:26:56.677973+0000","last_fullsized":"2023-05-17T12:26:56.677973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:40:55.717293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292547+0000","last_change":"2023-05-17T12:26:54.828862+0000","last_active":"2023-05-17T12:26:56.292547+0000","last_peered":"2023-05-17T12:26:56.292547+0000","last_clean":"2023-05-17T12:26:56.292547+0000","last_became_active":"2023-05-17T12:26:54.828604+0000","last_became_peered":"2023-05-17T12:26:54.828604+0000","last_unstale":"2023-05-17T12:26:56.292547+0000","last_undegraded":"2023-05-17T12:26:56.292547+0000","last_fullsized":"2023-05-17T12:26:56.292547+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:57:36.505407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.291080+0000","last_change":"2023-05-17T12:24:55.755523+0000","last_active":"2023-05-17T12:26:56.291080+0000","last_peered":"2023-05-17T12:26:56.291080+0000","last_clean":"2023-05-17T12:26:56.291080+0000","last_became_active":"2023-05-17T12:24:55.755229+0000","last_became_peered":"2023-05-17T12:24:55.755229+0000","last_unstale":"2023-05-17T12:26:56.291080+0000","last_undegraded":"2023-05-17T12:26:56.291080+0000","last_fullsized":"2023-05-17T12:26:56.291080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:42:09.001495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677978+0000","last_change":"2023-05-17T12:26:55.298695+0000","last_active":"2023-05-17T12:26:56.677978+0000","last_peered":"2023-05-17T12:26:56.677978+0000","last_clean":"2023-05-17T12:26:56.677978+0000","last_became_active":"2023-05-17T12:26:55.298419+0000","last_became_peered":"2023-05-17T12:26:55.298419+0000","last_unstale":"2023-05-17T12:26:56.677978+0000","last_undegraded":"2023-05-17T12:26:56.677978+0000","last_fullsized":"2023-05-17T12:26:56.677978+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:33:07.444476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.287301+0000","last_change":"2023-05-17T12:26:54.827969+0000","last_active":"2023-05-17T12:26:55.287301+0000","last_peered":"2023-05-17T12:26:55.287301+0000","last_clean":"2023-05-17T12:26:55.287301+0000","last_became_active":"2023-05-17T12:26:54.827685+0000","last_became_peered":"2023-05-17T12:26:54.827685+0000","last_unstale":"2023-05-17T12:26:55.287301+0000","last_undegraded":"2023-05-17T12:26:55.287301+0000","last_fullsized":"2023-05-17T12:26:55.287301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:43:57.977707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.296580+0000","last_change":"2023-05-17T12:24:55.755814+0000","last_active":"2023-05-17T12:26:55.296580+0000","last_peered":"2023-05-17T12:26:55.296580+0000","last_clean":"2023-05-17T12:26:55.296580+0000","last_became_active":"2023-05-17T12:24:55.755481+0000","last_became_peered":"2023-05-17T12:24:55.755481+0000","last_unstale":"2023-05-17T12:26:55.296580+0000","last_undegraded":"2023-05-17T12:26:55.296580+0000","last_fullsized":"2023-05-17T12:26:55.296580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:29:48.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9824,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362016,"statfs":{"total":96636764160,"available":96626704384,"internally_reserved":0,"allocated":1073152,"data_stored":802261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.65400000000000003}]},{"osd":1,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.628},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.746}]},{"osd":2,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98099999999999998,"5min":1.085,"15min":1.085},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.45800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91600000000000004,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71799999999999997}]},{"osd":5,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.60899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8608,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363232,"statfs":{"total":96636764160,"available":96627949568,"internally_reserved":0,"allocated":483328,"data_stored":212475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81100000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70199999999999996}]},{"osd":1,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.48199999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83499999999999996,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.083,"15min":1.083},"last":0.498}]},{"osd":3,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.81100000000000005,"15min":0.82999999999999996},"min":{"1min":0.57499999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88100000000000001,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.48599999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1990000000000001,"5min":1.258,"15min":1.258},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66700000000000004,"15min":0.66800000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.751,"15min":0.749},"min":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1379999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66600000000000004}]},{"osd":7,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.069,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.57299999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.85899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8744,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363096,"statfs":{"total":96636764160,"available":96627810304,"internally_reserved":0,"allocated":491520,"data_stored":218846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.433,"15min":0.443},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52000000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59899999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42099999999999999,"15min":0.42299999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.50900000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.501,"15min":0.505},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.54800000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.44800000000000001}]},{"osd":3,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50700000000000001,"15min":0.51400000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.76000000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":4.2160000000000002,"5min":4.2160000000000002,"15min":4.2160000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.96399999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.74299999999999999,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.85599999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.68999999999999995}]},{"osd":7,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2310000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.624}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9824,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362016,"statfs":{"total":96636764160,"available":96626704384,"internally_reserved":0,"allocated":1073152,"data_stored":802205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.52600000000000002,"15min":0.54600000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.88300000000000001,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":0.255},{"interface":"front","average":{"1min":0.44,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.745,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65700000000000003,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61899999999999999,"5min":4.1509999999999998,"15min":4.1509999999999998},"last":0.502}]},{"osd":3,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":0.442}]},{"osd":4,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.85999999999999999,"15min":0.89400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.81999999999999995,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":1.1479999999999999,"15min":1.23},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.84399999999999997,"5min":12.159000000000001,"15min":12.159000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":1.1359999999999999,"15min":1.2130000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.873,"5min":12.124000000000001,"15min":12.124000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.874,"15min":0.91000000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.90400000000000003,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.60899999999999999}]},{"osd":6,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.88200000000000001,"15min":0.92000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.871,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.876,"15min":0.91200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90700000000000003,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93700000000000006,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":1.155,"15min":1.2390000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.85899999999999999,"5min":12.077999999999999,"15min":12.077999999999999},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":491520,"data_stored":213389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.23999999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.77200000000000002,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.435},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.93000000000000005,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.9710000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85399999999999998,"5min":1.363,"15min":1.363},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.496}]},{"osd":4,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.81899999999999995,"5min":1.196,"15min":1.196},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81899999999999995,"15min":0.81299999999999994},"min":{"1min":0.48399999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.3029999999999999,"5min":3.3029999999999999,"15min":3.3029999999999999},"last":0.89000000000000001}]},{"osd":5,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.80300000000000005,"15min":0.81699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97199999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.875},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.91100000000000003,"15min":0.94099999999999995},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98299999999999998,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":0.80300000000000005}]},{"osd":6,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.84799999999999998},"min":{"1min":0.51900000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97199999999999998,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.76600000000000001}]},{"osd":7,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0880000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.81999999999999995,"15min":0.83399999999999996},"min":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92800000000000005,"5min":1.704,"15min":1.704},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":219414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":1.3200000000000001,"15min":1.47},"min":{"1min":0.27700000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.56100000000000005,"5min":19.986999999999998,"15min":19.986999999999998},"last":0.313},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.65900000000000003,"15min":0.69899999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":5.1710000000000003,"15min":5.1710000000000003},"last":0.41099999999999998}]},{"osd":1,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":1.4319999999999999,"15min":1.6020000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.47999999999999998,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.443,"5min":1.391,"15min":1.5489999999999999},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":19.956,"15min":19.956},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":1.0189999999999999,"15min":1.109},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60299999999999998,"5min":11.821999999999999,"15min":11.821999999999999},"last":0.439},{"interface":"front","average":{"1min":0.51200000000000001,"5min":1.429,"15min":1.5820000000000001},"min":{"1min":0.441,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67300000000000004,"5min":19.914999999999999,"15min":19.914999999999999},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.59399999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95099999999999996,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.266,"15min":1.3660000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88400000000000001,"5min":11.914999999999999,"15min":11.914999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.167,"15min":1.2490000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85899999999999999,"5min":9.0489999999999995,"15min":9.0489999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":1.002,"15min":1.056},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90700000000000003,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.62}]},{"osd":6,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":1.272,"15min":1.365},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3740000000000001,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.1299999999999999,"15min":1.202},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.85599999999999998,"5min":9.0939999999999994,"15min":9.0939999999999994},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.96699999999999997,"15min":1.0089999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3400000000000001,"5min":5.0709999999999997,"15min":5.0709999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":1.286,"15min":1.381},"min":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85699999999999998,"5min":11.949,"15min":11.949},"last":0.66600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8816,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363024,"statfs":{"total":96636764160,"available":96627736576,"internally_reserved":0,"allocated":499712,"data_stored":220340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.83699999999999997}]},{"osd":1,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93100000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72099999999999997,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84899999999999998,"5min":1.129,"15min":1.129},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90000000000000002,"5min":1.149,"15min":1.149},"last":0.76500000000000001}]},{"osd":3,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84899999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.81200000000000006,"5min":1.228,"15min":1.228},"last":0.72799999999999998}]},{"osd":5,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.84799999999999998}]},{"osd":6,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.877},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":1.024,"15min":1.024},"last":0.92400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":491520,"data_stored":218846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.1419999999999999,"15min":1.2290000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81499999999999995,"5min":9.8559999999999999,"15min":9.8559999999999999},"last":9.7949999999999999},{"interface":"front","average":{"1min":0.628,"5min":1.1719999999999999,"15min":1.262},"min":{"1min":0.51100000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.79700000000000004,"5min":9.8179999999999996,"15min":9.8179999999999996},"last":14.616}]},{"osd":1,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":1.2310000000000001,"15min":1.327},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88100000000000001,"5min":10.776,"15min":10.776},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.623,"5min":1.258,"15min":1.3640000000000001},"min":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":10.823,"15min":10.823},"last":15.311999999999999}]},{"osd":2,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":1.272,"15min":1.3759999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88300000000000001,"5min":9.7769999999999992,"15min":9.7769999999999992},"last":15.122},{"interface":"front","average":{"1min":0.63900000000000001,"5min":1.244,"15min":1.345},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.77800000000000002,"5min":10.013999999999999,"15min":10.013999999999999},"last":2.3420000000000001}]},{"osd":3,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.278,"15min":1.3879999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.76700000000000002,"5min":10.884,"15min":10.884},"last":2.6360000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":1.333,"15min":1.4450000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.84499999999999997,"5min":10.965999999999999,"15min":10.965999999999999},"last":15.077}]},{"osd":4,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64700000000000002,"15min":0.66200000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":2.754},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.70599999999999996,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.77300000000000002,"5min":1.649,"15min":1.649},"last":0.97799999999999998}]},{"osd":6,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.79800000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":15.515000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85399999999999998,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":2.798}]},{"osd":7,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.78400000000000003,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.87,"5min":1.458,"15min":1.458},"last":15.260999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T12:26:59.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-17T12:26:59.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.843+0000 7f41965ff700 1 Processor -- start 2023-05-17T12:26:59.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.843+0000 7f41965ff700 1 -- start start 2023-05-17T12:26:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.844+0000 7f41965ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006b0b0 0x7f419006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.844+0000 7f41965ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f419006c330 0x7f419006c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.844+0000 7f41965ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41900cd6b0 con 0x7f419015c840 2023-05-17T12:26:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.844+0000 7f41965ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41900cdf50 con 0x7f419006c330 2023-05-17T12:26:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.844+0000 7f41965ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419006ccf0 con 0x7f419006b0b0 2023-05-17T12:26:59.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f418ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f419015c840 0x7f41900cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41320/0 (socket says 172.21.15.88:41320) 2023-05-17T12:26:59.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f418ffff700 1 -- 172.21.15.88:0/2759097854 learned_addr learned my addr 172.21.15.88:0/2759097854 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:26:59.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f4194b9c700 1 --2- 172.21.15.88:0/2759097854 >> v2:172.21.15.88:3300/0 conn(0x7f419006c330 0x7f419006c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f418f7fe700 1 --2- 172.21.15.88:0/2759097854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006b0b0 0x7f419006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f418effd700 1 -- 172.21.15.88:0/2759097854 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281129494 0 0) 0x7f41900cd6b0 con 0x7f419015c840 2023-05-17T12:26:59.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f418effd700 1 -- 172.21.15.88:0/2759097854 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41780035b0 con 0x7f419015c840 2023-05-17T12:26:59.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f4194b9c700 1 -- 172.21.15.88:0/2759097854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006b0b0 msgr2=0x7f419006b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:26:59.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f4194b9c700 1 --2- 172.21.15.88:0/2759097854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006b0b0 0x7f419006b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f4194b9c700 1 -- 172.21.15.88:0/2759097854 >> v1:172.21.15.88:6789/0 conn(0x7f419015c840 legacy=0x7f41900cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f4194b9c700 1 -- 172.21.15.88:0/2759097854 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41900b2460 con 0x7f419006c330 2023-05-17T12:26:59.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.845+0000 7f4194b9c700 1 --2- 172.21.15.88:0/2759097854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419006c330 0x7f419006c7b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4188009d90 tx=0x7f418800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd993004b1f8b08 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f418effd700 1 -- 172.21.15.88:0/2759097854 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418800e070 con 0x7f419006c330 2023-05-17T12:26:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f418effd700 1 -- 172.21.15.88:0/2759097854 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418800bb20 con 0x7f419006c330 2023-05-17T12:26:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f418effd700 1 -- 172.21.15.88:0/2759097854 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188012430 con 0x7f419006c330 2023-05-17T12:26:59.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f41965ff700 1 -- 172.21.15.88:0/2759097854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419006c330 msgr2=0x7f419006c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f41965ff700 1 --2- 172.21.15.88:0/2759097854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419006c330 0x7f419006c7b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4188009d90 tx=0x7f418800b330 comp rx=0 tx=0).stop 2023-05-17T12:26:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f41965ff700 1 -- 172.21.15.88:0/2759097854 shutdown_connections 2023-05-17T12:26:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f41965ff700 1 --2- 172.21.15.88:0/2759097854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419006c330 0x7f419006c7b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f41965ff700 1 --2- 172.21.15.88:0/2759097854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006b0b0 0x7f419006b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f41965ff700 1 -- 172.21.15.88:0/2759097854 >> 172.21.15.88:0/2759097854 conn(0x7f41900d3060 msgr2=0x7f41900d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:26:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f41965ff700 1 -- 172.21.15.88:0/2759097854 shutdown_connections 2023-05-17T12:26:59.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.846+0000 7f41965ff700 1 -- 172.21.15.88:0/2759097854 wait complete. 2023-05-17T12:26:59.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.848+0000 7f41965ff700 1 Processor -- start 2023-05-17T12:26:59.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.848+0000 7f41965ff700 1 -- start start 2023-05-17T12:26:59.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.849+0000 7f41965ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f419006b0b0 0x7f41900b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.849+0000 7f41965ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006c330 0x7f41900c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.849+0000 7f41965ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419015c840 0x7f41900b8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.849+0000 7f41965ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41901f1f80 con 0x7f419015c840 2023-05-17T12:26:59.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.849+0000 7f41965ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41900b4d10 con 0x7f419006b0b0 2023-05-17T12:26:59.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.849+0000 7f41965ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41900b4ff0 con 0x7f419006c330 2023-05-17T12:26:59.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.849+0000 7f4194b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419015c840 0x7f41900b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.849+0000 7f4194b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419015c840 0x7f41900b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46292/0 (socket says 172.21.15.88:46292) 2023-05-17T12:26:59.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.849+0000 7f4194b9c700 1 -- 172.21.15.88:0/1395987846 learned_addr learned my addr 172.21.15.88:0/1395987846 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:26:59.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f418f7fe700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006c330 0x7f41900c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f418ffff700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f419006b0b0 0x7f41900b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f4194b9c700 1 -- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006c330 msgr2=0x7f41900c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f4194b9c700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006c330 0x7f41900c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f4194b9c700 1 -- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f419006b0b0 msgr2=0x7f41900b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:26:59.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f4194b9c700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f419006b0b0 0x7f41900b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:26:59.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f4194b9c700 1 -- 172.21.15.88:0/1395987846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4188009a70 con 0x7f419015c840 2023-05-17T12:26:59.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f4194b9c700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419015c840 0x7f41900b8600 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4188014040 tx=0x7f4188004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:59.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f418cff9700 1 -- 172.21.15.88:0/1395987846 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880129f0 con 0x7f419015c840 2023-05-17T12:26:59.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f418cff9700 1 -- 172.21.15.88:0/1395987846 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4188020070 con 0x7f419015c840 2023-05-17T12:26:59.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.850+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41900cd900 con 0x7f419015c840 2023-05-17T12:26:59.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.851+0000 7f418cff9700 1 -- 172.21.15.88:0/1395987846 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188012db0 con 0x7f419015c840 2023-05-17T12:26:59.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.851+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41900b2740 con 0x7f419015c840 2023-05-17T12:26:59.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.852+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41900cdbe0 con 0x7f419015c840 2023-05-17T12:26:59.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.853+0000 7f418cff9700 1 -- 172.21.15.88:0/1395987846 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4188004040 con 0x7f419015c840 2023-05-17T12:26:59.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.853+0000 7f418cff9700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f417c06ace0 0x7f417c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:26:59.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.853+0000 7f418cff9700 1 -- 172.21.15.88:0/1395987846 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4188022070 con 0x7f419015c840 2023-05-17T12:26:59.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.854+0000 7f418ffff700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f417c06ace0 0x7f417c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:26:59.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.855+0000 7f418ffff700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f417c06ace0 0x7f417c06d190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4180007fd0 tx=0x7f4180007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:26:59.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:26:59.858+0000 7f418cff9700 1 -- 172.21.15.88:0/1395987846 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f41880bd2d0 con 0x7f419015c840 2023-05-17T12:27:00.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.045+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 --> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4190074530 con 0x7f417c06ace0 2023-05-17T12:27:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.054+0000 7f418cff9700 1 -- 172.21.15.88:0/1395987846 <== mgr.4106 v2:172.21.15.187:6832/2490620069 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311348 (secure 0 0 0) 0x7f4190074530 con 0x7f417c06ace0 2023-05-17T12:27:00.062 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:27:00.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f417c06ace0 msgr2=0x7f417c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f417c06ace0 0x7f417c06d190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4180007fd0 tx=0x7f4180007dc0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419015c840 msgr2=0x7f41900b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419015c840 0x7f41900b8600 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4188014040 tx=0x7f4188004ad0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 shutdown_connections 2023-05-17T12:27:00.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f417c06ace0 0x7f417c06d190 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419015c840 0x7f41900b8600 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f419006b0b0 0x7f41900b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 --2- 172.21.15.88:0/1395987846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f419006c330 0x7f41900c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 >> 172.21.15.88:0/1395987846 conn(0x7f41900d3060 msgr2=0x7f41901e1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:00.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 shutdown_connections 2023-05-17T12:27:00.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.059+0000 7f41965ff700 1 -- 172.21.15.88:0/1395987846 wait complete. 2023-05-17T12:27:00.065 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-05-17T12:27:00.079 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-05-17T12:26:59.479853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71864,"kb_used_data":4984,"kb_used_omap":0,"kb_used_meta":66816,"kb_avail":754902856,"statfs":{"total":773094113280,"available":773020524544,"internally_reserved":0,"allocated":5103616,"data_stored":2907776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68419584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.680035"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.308213+0000","last_change":"2023-05-17T12:26:55.305727+0000","last_active":"2023-05-17T12:26:55.308213+0000","last_peered":"2023-05-17T12:26:55.308213+0000","last_clean":"2023-05-17T12:26:55.308213+0000","last_became_active":"2023-05-17T12:26:55.305442+0000","last_became_peered":"2023-05-17T12:26:55.305442+0000","last_unstale":"2023-05-17T12:26:55.308213+0000","last_undegraded":"2023-05-17T12:26:55.308213+0000","last_fullsized":"2023-05-17T12:26:55.308213+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:05:55.849947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292690+0000","last_change":"2023-05-17T12:26:55.306609+0000","last_active":"2023-05-17T12:26:56.292690+0000","last_peered":"2023-05-17T12:26:56.292690+0000","last_clean":"2023-05-17T12:26:56.292690+0000","last_became_active":"2023-05-17T12:26:55.306317+0000","last_became_peered":"2023-05-17T12:26:55.306317+0000","last_unstale":"2023-05-17T12:26:56.292690+0000","last_undegraded":"2023-05-17T12:26:56.292690+0000","last_fullsized":"2023-05-17T12:26:56.292690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:40:55.717293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292178+0000","last_change":"2023-05-17T12:26:55.311737+0000","last_active":"2023-05-17T12:26:56.292178+0000","last_peered":"2023-05-17T12:26:56.292178+0000","last_clean":"2023-05-17T12:26:56.292178+0000","last_became_active":"2023-05-17T12:26:55.311493+0000","last_became_peered":"2023-05-17T12:26:55.311493+0000","last_unstale":"2023-05-17T12:26:56.292178+0000","last_undegraded":"2023-05-17T12:26:56.292178+0000","last_fullsized":"2023-05-17T12:26:56.292178+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:04:43.953886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320554+0000","last_change":"2023-05-17T12:26:55.315453+0000","last_active":"2023-05-17T12:26:55.320554+0000","last_peered":"2023-05-17T12:26:55.320554+0000","last_clean":"2023-05-17T12:26:55.320554+0000","last_became_active":"2023-05-17T12:26:55.315139+0000","last_became_peered":"2023-05-17T12:26:55.315139+0000","last_unstale":"2023-05-17T12:26:55.320554+0000","last_undegraded":"2023-05-17T12:26:55.320554+0000","last_fullsized":"2023-05-17T12:26:55.320554+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:01:56.568414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292540+0000","last_change":"2023-05-17T12:26:55.304947+0000","last_active":"2023-05-17T12:26:56.292540+0000","last_peered":"2023-05-17T12:26:56.292540+0000","last_clean":"2023-05-17T12:26:56.292540+0000","last_became_active":"2023-05-17T12:26:55.304657+0000","last_became_peered":"2023-05-17T12:26:55.304657+0000","last_unstale":"2023-05-17T12:26:56.292540+0000","last_undegraded":"2023-05-17T12:26:56.292540+0000","last_fullsized":"2023-05-17T12:26:56.292540+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:19:38.848665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677872+0000","last_change":"2023-05-17T12:26:55.295262+0000","last_active":"2023-05-17T12:26:56.677872+0000","last_peered":"2023-05-17T12:26:56.677872+0000","last_clean":"2023-05-17T12:26:56.677872+0000","last_became_active":"2023-05-17T12:26:55.294998+0000","last_became_peered":"2023-05-17T12:26:55.294998+0000","last_unstale":"2023-05-17T12:26:56.677872+0000","last_undegraded":"2023-05-17T12:26:56.677872+0000","last_fullsized":"2023-05-17T12:26:56.677872+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.406938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.305150+0000","last_change":"2023-05-17T12:26:55.299076+0000","last_active":"2023-05-17T12:26:55.305150+0000","last_peered":"2023-05-17T12:26:55.305150+0000","last_clean":"2023-05-17T12:26:55.305150+0000","last_became_active":"2023-05-17T12:26:55.298790+0000","last_became_peered":"2023-05-17T12:26:55.298790+0000","last_unstale":"2023-05-17T12:26:55.305150+0000","last_undegraded":"2023-05-17T12:26:55.305150+0000","last_fullsized":"2023-05-17T12:26:55.305150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:51:44.448308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320331+0000","last_change":"2023-05-17T12:26:55.315987+0000","last_active":"2023-05-17T12:26:55.320331+0000","last_peered":"2023-05-17T12:26:55.320331+0000","last_clean":"2023-05-17T12:26:55.320331+0000","last_became_active":"2023-05-17T12:26:55.315654+0000","last_became_peered":"2023-05-17T12:26:55.315654+0000","last_unstale":"2023-05-17T12:26:55.320331+0000","last_undegraded":"2023-05-17T12:26:55.320331+0000","last_fullsized":"2023-05-17T12:26:55.320331+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:37:29.903699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320486+0000","last_change":"2023-05-17T12:26:55.308289+0000","last_active":"2023-05-17T12:26:55.320486+0000","last_peered":"2023-05-17T12:26:55.320486+0000","last_clean":"2023-05-17T12:26:55.320486+0000","last_became_active":"2023-05-17T12:26:55.308033+0000","last_became_peered":"2023-05-17T12:26:55.308033+0000","last_unstale":"2023-05-17T12:26:55.320486+0000","last_undegraded":"2023-05-17T12:26:55.320486+0000","last_fullsized":"2023-05-17T12:26:55.320486+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:20:56.171898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320642+0000","last_change":"2023-05-17T12:26:55.316814+0000","last_active":"2023-05-17T12:26:55.320642+0000","last_peered":"2023-05-17T12:26:55.320642+0000","last_clean":"2023-05-17T12:26:55.320642+0000","last_became_active":"2023-05-17T12:26:55.316510+0000","last_became_peered":"2023-05-17T12:26:55.316510+0000","last_unstale":"2023-05-17T12:26:55.320642+0000","last_undegraded":"2023-05-17T12:26:55.320642+0000","last_fullsized":"2023-05-17T12:26:55.320642+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:44:09.066643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320360+0000","last_change":"2023-05-17T12:26:55.304516+0000","last_active":"2023-05-17T12:26:55.320360+0000","last_peered":"2023-05-17T12:26:55.320360+0000","last_clean":"2023-05-17T12:26:55.320360+0000","last_became_active":"2023-05-17T12:26:55.304215+0000","last_became_peered":"2023-05-17T12:26:55.304215+0000","last_unstale":"2023-05-17T12:26:55.320360+0000","last_undegraded":"2023-05-17T12:26:55.320360+0000","last_fullsized":"2023-05-17T12:26:55.320360+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:25:57.810334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292880+0000","last_change":"2023-05-17T12:26:55.312711+0000","last_active":"2023-05-17T12:26:56.292880+0000","last_peered":"2023-05-17T12:26:56.292880+0000","last_clean":"2023-05-17T12:26:56.292880+0000","last_became_active":"2023-05-17T12:26:55.312449+0000","last_became_peered":"2023-05-17T12:26:55.312449+0000","last_unstale":"2023-05-17T12:26:56.292880+0000","last_undegraded":"2023-05-17T12:26:56.292880+0000","last_fullsized":"2023-05-17T12:26:56.292880+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:14:40.849108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.321551+0000","last_change":"2023-05-17T12:26:55.312697+0000","last_active":"2023-05-17T12:26:55.321551+0000","last_peered":"2023-05-17T12:26:55.321551+0000","last_clean":"2023-05-17T12:26:55.321551+0000","last_became_active":"2023-05-17T12:26:55.312214+0000","last_became_peered":"2023-05-17T12:26:55.312214+0000","last_unstale":"2023-05-17T12:26:55.321551+0000","last_undegraded":"2023-05-17T12:26:55.321551+0000","last_fullsized":"2023-05-17T12:26:55.321551+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:53:49.852602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320606+0000","last_change":"2023-05-17T12:26:55.307783+0000","last_active":"2023-05-17T12:26:55.320606+0000","last_peered":"2023-05-17T12:26:55.320606+0000","last_clean":"2023-05-17T12:26:55.320606+0000","last_became_active":"2023-05-17T12:26:55.307539+0000","last_became_peered":"2023-05-17T12:26:55.307539+0000","last_unstale":"2023-05-17T12:26:55.320606+0000","last_undegraded":"2023-05-17T12:26:55.320606+0000","last_fullsized":"2023-05-17T12:26:55.320606+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:07:07.279000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677747+0000","last_change":"2023-05-17T12:26:55.304702+0000","last_active":"2023-05-17T12:26:56.677747+0000","last_peered":"2023-05-17T12:26:56.677747+0000","last_clean":"2023-05-17T12:26:56.677747+0000","last_became_active":"2023-05-17T12:26:55.304299+0000","last_became_peered":"2023-05-17T12:26:55.304299+0000","last_unstale":"2023-05-17T12:26:56.677747+0000","last_undegraded":"2023-05-17T12:26:56.677747+0000","last_fullsized":"2023-05-17T12:26:56.677747+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:21:48.033779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.314093+0000","last_change":"2023-05-17T12:26:55.307990+0000","last_active":"2023-05-17T12:26:55.314093+0000","last_peered":"2023-05-17T12:26:55.314093+0000","last_clean":"2023-05-17T12:26:55.314093+0000","last_became_active":"2023-05-17T12:26:55.307701+0000","last_became_peered":"2023-05-17T12:26:55.307701+0000","last_unstale":"2023-05-17T12:26:55.314093+0000","last_undegraded":"2023-05-17T12:26:55.314093+0000","last_fullsized":"2023-05-17T12:26:55.314093+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:27:57.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292623+0000","last_change":"2023-05-17T12:26:55.305091+0000","last_active":"2023-05-17T12:26:56.292623+0000","last_peered":"2023-05-17T12:26:56.292623+0000","last_clean":"2023-05-17T12:26:56.292623+0000","last_became_active":"2023-05-17T12:26:55.304751+0000","last_became_peered":"2023-05-17T12:26:55.304751+0000","last_unstale":"2023-05-17T12:26:56.292623+0000","last_undegraded":"2023-05-17T12:26:56.292623+0000","last_fullsized":"2023-05-17T12:26:56.292623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:48:11.902634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292409+0000","last_change":"2023-05-17T12:26:55.316771+0000","last_active":"2023-05-17T12:26:56.292409+0000","last_peered":"2023-05-17T12:26:56.292409+0000","last_clean":"2023-05-17T12:26:56.292409+0000","last_became_active":"2023-05-17T12:26:55.316343+0000","last_became_peered":"2023-05-17T12:26:55.316343+0000","last_unstale":"2023-05-17T12:26:56.292409+0000","last_undegraded":"2023-05-17T12:26:56.292409+0000","last_fullsized":"2023-05-17T12:26:56.292409+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:24:08.443344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318617+0000","last_change":"2023-05-17T12:26:55.315835+0000","last_active":"2023-05-17T12:26:55.318617+0000","last_peered":"2023-05-17T12:26:55.318617+0000","last_clean":"2023-05-17T12:26:55.318617+0000","last_became_active":"2023-05-17T12:26:55.315339+0000","last_became_peered":"2023-05-17T12:26:55.315339+0000","last_unstale":"2023-05-17T12:26:55.318617+0000","last_undegraded":"2023-05-17T12:26:55.318617+0000","last_fullsized":"2023-05-17T12:26:55.318617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:53:49.852602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.321398+0000","last_change":"2023-05-17T12:26:55.311909+0000","last_active":"2023-05-17T12:26:55.321398+0000","last_peered":"2023-05-17T12:26:55.321398+0000","last_clean":"2023-05-17T12:26:55.321398+0000","last_became_active":"2023-05-17T12:26:55.311644+0000","last_became_peered":"2023-05-17T12:26:55.311644+0000","last_unstale":"2023-05-17T12:26:55.321398+0000","last_undegraded":"2023-05-17T12:26:55.321398+0000","last_fullsized":"2023-05-17T12:26:55.321398+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:27:57.828625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677848+0000","last_change":"2023-05-17T12:26:55.319526+0000","last_active":"2023-05-17T12:26:56.677848+0000","last_peered":"2023-05-17T12:26:56.677848+0000","last_clean":"2023-05-17T12:26:56.677848+0000","last_became_active":"2023-05-17T12:26:55.319221+0000","last_became_peered":"2023-05-17T12:26:55.319221+0000","last_unstale":"2023-05-17T12:26:56.677848+0000","last_undegraded":"2023-05-17T12:26:56.677848+0000","last_fullsized":"2023-05-17T12:26:56.677848+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:01:06.099429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320626+0000","last_change":"2023-05-17T12:26:55.315826+0000","last_active":"2023-05-17T12:26:55.320626+0000","last_peered":"2023-05-17T12:26:55.320626+0000","last_clean":"2023-05-17T12:26:55.320626+0000","last_became_active":"2023-05-17T12:26:55.315193+0000","last_became_peered":"2023-05-17T12:26:55.315193+0000","last_unstale":"2023-05-17T12:26:55.320626+0000","last_undegraded":"2023-05-17T12:26:55.320626+0000","last_fullsized":"2023-05-17T12:26:55.320626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:50:57.265338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318334+0000","last_change":"2023-05-17T12:26:55.314675+0000","last_active":"2023-05-17T12:26:55.318334+0000","last_peered":"2023-05-17T12:26:55.318334+0000","last_clean":"2023-05-17T12:26:55.318334+0000","last_became_active":"2023-05-17T12:26:55.314282+0000","last_became_peered":"2023-05-17T12:26:55.314282+0000","last_unstale":"2023-05-17T12:26:55.318334+0000","last_undegraded":"2023-05-17T12:26:55.318334+0000","last_fullsized":"2023-05-17T12:26:55.318334+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:37:54.341810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.314119+0000","last_change":"2023-05-17T12:26:55.310402+0000","last_active":"2023-05-17T12:26:55.314119+0000","last_peered":"2023-05-17T12:26:55.314119+0000","last_clean":"2023-05-17T12:26:55.314119+0000","last_became_active":"2023-05-17T12:26:55.310091+0000","last_became_peered":"2023-05-17T12:26:55.310091+0000","last_unstale":"2023-05-17T12:26:55.314119+0000","last_undegraded":"2023-05-17T12:26:55.314119+0000","last_fullsized":"2023-05-17T12:26:55.314119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:44:56.024311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.314041+0000","last_change":"2023-05-17T12:26:55.307280+0000","last_active":"2023-05-17T12:26:55.314041+0000","last_peered":"2023-05-17T12:26:55.314041+0000","last_clean":"2023-05-17T12:26:55.314041+0000","last_became_active":"2023-05-17T12:26:55.306998+0000","last_became_peered":"2023-05-17T12:26:55.306998+0000","last_unstale":"2023-05-17T12:26:55.314041+0000","last_undegraded":"2023-05-17T12:26:55.314041+0000","last_fullsized":"2023-05-17T12:26:55.314041+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:47:04.958759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.321837+0000","last_change":"2023-05-17T12:26:55.312036+0000","last_active":"2023-05-17T12:26:55.321837+0000","last_peered":"2023-05-17T12:26:55.321837+0000","last_clean":"2023-05-17T12:26:55.321837+0000","last_became_active":"2023-05-17T12:26:55.311749+0000","last_became_peered":"2023-05-17T12:26:55.311749+0000","last_unstale":"2023-05-17T12:26:55.321837+0000","last_undegraded":"2023-05-17T12:26:55.321837+0000","last_fullsized":"2023-05-17T12:26:55.321837+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:53:20.480128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292349+0000","last_change":"2023-05-17T12:26:55.304476+0000","last_active":"2023-05-17T12:26:56.292349+0000","last_peered":"2023-05-17T12:26:56.292349+0000","last_clean":"2023-05-17T12:26:56.292349+0000","last_became_active":"2023-05-17T12:26:55.304180+0000","last_became_peered":"2023-05-17T12:26:55.304180+0000","last_unstale":"2023-05-17T12:26:56.292349+0000","last_undegraded":"2023-05-17T12:26:56.292349+0000","last_fullsized":"2023-05-17T12:26:56.292349+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:43:36.592466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292538+0000","last_change":"2023-05-17T12:26:55.300316+0000","last_active":"2023-05-17T12:26:56.292538+0000","last_peered":"2023-05-17T12:26:56.292538+0000","last_clean":"2023-05-17T12:26:56.292538+0000","last_became_active":"2023-05-17T12:26:55.300041+0000","last_became_peered":"2023-05-17T12:26:55.300041+0000","last_unstale":"2023-05-17T12:26:56.292538+0000","last_undegraded":"2023-05-17T12:26:56.292538+0000","last_fullsized":"2023-05-17T12:26:56.292538+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:04:10.101729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318157+0000","last_change":"2023-05-17T12:26:55.312852+0000","last_active":"2023-05-17T12:26:55.318157+0000","last_peered":"2023-05-17T12:26:55.318157+0000","last_clean":"2023-05-17T12:26:55.318157+0000","last_became_active":"2023-05-17T12:26:55.312437+0000","last_became_peered":"2023-05-17T12:26:55.312437+0000","last_unstale":"2023-05-17T12:26:55.318157+0000","last_undegraded":"2023-05-17T12:26:55.318157+0000","last_fullsized":"2023-05-17T12:26:55.318157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:32:05.231707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292026+0000","last_change":"2023-05-17T12:26:55.309698+0000","last_active":"2023-05-17T12:26:56.292026+0000","last_peered":"2023-05-17T12:26:56.292026+0000","last_clean":"2023-05-17T12:26:56.292026+0000","last_became_active":"2023-05-17T12:26:55.309284+0000","last_became_peered":"2023-05-17T12:26:55.309284+0000","last_unstale":"2023-05-17T12:26:56.292026+0000","last_undegraded":"2023-05-17T12:26:56.292026+0000","last_fullsized":"2023-05-17T12:26:56.292026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:54.611375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677549+0000","last_change":"2023-05-17T12:26:55.293106+0000","last_active":"2023-05-17T12:26:56.677549+0000","last_peered":"2023-05-17T12:26:56.677549+0000","last_clean":"2023-05-17T12:26:56.677549+0000","last_became_active":"2023-05-17T12:26:55.292821+0000","last_became_peered":"2023-05-17T12:26:55.292821+0000","last_unstale":"2023-05-17T12:26:56.677549+0000","last_undegraded":"2023-05-17T12:26:56.677549+0000","last_fullsized":"2023-05-17T12:26:56.677549+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:58:45.351179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.311199+0000","last_change":"2023-05-17T12:26:55.305695+0000","last_active":"2023-05-17T12:26:55.311199+0000","last_peered":"2023-05-17T12:26:55.311199+0000","last_clean":"2023-05-17T12:26:55.311199+0000","last_became_active":"2023-05-17T12:26:55.305390+0000","last_became_peered":"2023-05-17T12:26:55.305390+0000","last_unstale":"2023-05-17T12:26:55.311199+0000","last_undegraded":"2023-05-17T12:26:55.311199+0000","last_fullsized":"2023-05-17T12:26:55.311199+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:44:42.624736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.291042+0000","last_change":"2023-05-17T12:26:55.308758+0000","last_active":"2023-05-17T12:26:56.291042+0000","last_peered":"2023-05-17T12:26:56.291042+0000","last_clean":"2023-05-17T12:26:56.291042+0000","last_became_active":"2023-05-17T12:26:55.308493+0000","last_became_peered":"2023-05-17T12:26:55.308493+0000","last_unstale":"2023-05-17T12:26:56.291042+0000","last_undegraded":"2023-05-17T12:26:56.291042+0000","last_fullsized":"2023-05-17T12:26:56.291042+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:09.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677956+0000","last_change":"2023-05-17T12:26:54.824568+0000","last_active":"2023-05-17T12:26:56.677956+0000","last_peered":"2023-05-17T12:26:56.677956+0000","last_clean":"2023-05-17T12:26:56.677956+0000","last_became_active":"2023-05-17T12:26:54.824320+0000","last_became_peered":"2023-05-17T12:26:54.824320+0000","last_unstale":"2023-05-17T12:26:56.677956+0000","last_undegraded":"2023-05-17T12:26:56.677956+0000","last_fullsized":"2023-05-17T12:26:56.677956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:19:37.843051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.315543+0000","last_change":"2023-05-17T12:26:55.312936+0000","last_active":"2023-05-17T12:26:55.315543+0000","last_peered":"2023-05-17T12:26:55.315543+0000","last_clean":"2023-05-17T12:26:55.315543+0000","last_became_active":"2023-05-17T12:26:55.312614+0000","last_became_peered":"2023-05-17T12:26:55.312614+0000","last_unstale":"2023-05-17T12:26:55.315543+0000","last_undegraded":"2023-05-17T12:26:55.315543+0000","last_fullsized":"2023-05-17T12:26:55.315543+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:53:20.480128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292797+0000","last_change":"2023-05-17T12:26:54.823396+0000","last_active":"2023-05-17T12:26:56.292797+0000","last_peered":"2023-05-17T12:26:56.292797+0000","last_clean":"2023-05-17T12:26:56.292797+0000","last_became_active":"2023-05-17T12:26:54.823056+0000","last_became_peered":"2023-05-17T12:26:54.823056+0000","last_unstale":"2023-05-17T12:26:56.292797+0000","last_undegraded":"2023-05-17T12:26:56.292797+0000","last_fullsized":"2023-05-17T12:26:56.292797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:45:22.555777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292724+0000","last_change":"2023-05-17T12:26:55.299770+0000","last_active":"2023-05-17T12:26:56.292724+0000","last_peered":"2023-05-17T12:26:56.292724+0000","last_clean":"2023-05-17T12:26:56.292724+0000","last_became_active":"2023-05-17T12:26:55.299502+0000","last_became_peered":"2023-05-17T12:26:55.299502+0000","last_unstale":"2023-05-17T12:26:56.292724+0000","last_undegraded":"2023-05-17T12:26:56.292724+0000","last_fullsized":"2023-05-17T12:26:56.292724+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:15:25.877956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.291047+0000","last_change":"2023-05-17T12:26:54.830891+0000","last_active":"2023-05-17T12:26:56.291047+0000","last_peered":"2023-05-17T12:26:56.291047+0000","last_clean":"2023-05-17T12:26:56.291047+0000","last_became_active":"2023-05-17T12:26:54.830710+0000","last_became_peered":"2023-05-17T12:26:54.830710+0000","last_unstale":"2023-05-17T12:26:56.291047+0000","last_undegraded":"2023-05-17T12:26:56.291047+0000","last_fullsized":"2023-05-17T12:26:56.291047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:15:14.487874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290994+0000","last_change":"2023-05-17T12:26:55.316607+0000","last_active":"2023-05-17T12:26:56.290994+0000","last_peered":"2023-05-17T12:26:56.290994+0000","last_clean":"2023-05-17T12:26:56.290994+0000","last_became_active":"2023-05-17T12:26:55.316191+0000","last_became_peered":"2023-05-17T12:26:55.316191+0000","last_unstale":"2023-05-17T12:26:56.290994+0000","last_undegraded":"2023-05-17T12:26:56.290994+0000","last_fullsized":"2023-05-17T12:26:56.290994+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:34:19.280405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.313673+0000","last_change":"2023-05-17T12:26:54.827974+0000","last_active":"2023-05-17T12:26:55.313673+0000","last_peered":"2023-05-17T12:26:55.313673+0000","last_clean":"2023-05-17T12:26:55.313673+0000","last_became_active":"2023-05-17T12:26:54.827706+0000","last_became_peered":"2023-05-17T12:26:54.827706+0000","last_unstale":"2023-05-17T12:26:55.313673+0000","last_undegraded":"2023-05-17T12:26:55.313673+0000","last_fullsized":"2023-05-17T12:26:55.313673+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:08:54.388335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292220+0000","last_change":"2023-05-17T12:26:55.314236+0000","last_active":"2023-05-17T12:26:56.292220+0000","last_peered":"2023-05-17T12:26:56.292220+0000","last_clean":"2023-05-17T12:26:56.292220+0000","last_became_active":"2023-05-17T12:26:55.313915+0000","last_became_peered":"2023-05-17T12:26:55.313915+0000","last_unstale":"2023-05-17T12:26:56.292220+0000","last_undegraded":"2023-05-17T12:26:56.292220+0000","last_fullsized":"2023-05-17T12:26:56.292220+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:31:24.393417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677862+0000","last_change":"2023-05-17T12:26:54.821734+0000","last_active":"2023-05-17T12:26:56.677862+0000","last_peered":"2023-05-17T12:26:56.677862+0000","last_clean":"2023-05-17T12:26:56.677862+0000","last_became_active":"2023-05-17T12:26:54.821314+0000","last_became_peered":"2023-05-17T12:26:54.821314+0000","last_unstale":"2023-05-17T12:26:56.677862+0000","last_undegraded":"2023-05-17T12:26:56.677862+0000","last_fullsized":"2023-05-17T12:26:56.677862+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:54:59.093438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320776+0000","last_change":"2023-05-17T12:26:55.312828+0000","last_active":"2023-05-17T12:26:55.320776+0000","last_peered":"2023-05-17T12:26:55.320776+0000","last_clean":"2023-05-17T12:26:55.320776+0000","last_became_active":"2023-05-17T12:26:55.312557+0000","last_became_peered":"2023-05-17T12:26:55.312557+0000","last_unstale":"2023-05-17T12:26:55.320776+0000","last_undegraded":"2023-05-17T12:26:55.320776+0000","last_fullsized":"2023-05-17T12:26:55.320776+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:30:29.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292385+0000","last_change":"2023-05-17T12:26:54.820287+0000","last_active":"2023-05-17T12:26:56.292385+0000","last_peered":"2023-05-17T12:26:56.292385+0000","last_clean":"2023-05-17T12:26:56.292385+0000","last_became_active":"2023-05-17T12:26:54.819966+0000","last_became_peered":"2023-05-17T12:26:54.819966+0000","last_unstale":"2023-05-17T12:26:56.292385+0000","last_undegraded":"2023-05-17T12:26:56.292385+0000","last_fullsized":"2023-05-17T12:26:56.292385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:41:58.251263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320312+0000","last_change":"2023-05-17T12:26:55.315743+0000","last_active":"2023-05-17T12:26:55.320312+0000","last_peered":"2023-05-17T12:26:55.320312+0000","last_clean":"2023-05-17T12:26:55.320312+0000","last_became_active":"2023-05-17T12:26:55.315481+0000","last_became_peered":"2023-05-17T12:26:55.315481+0000","last_unstale":"2023-05-17T12:26:55.320312+0000","last_undegraded":"2023-05-17T12:26:55.320312+0000","last_fullsized":"2023-05-17T12:26:55.320312+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:09.311580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292348+0000","last_change":"2023-05-17T12:26:54.825434+0000","last_active":"2023-05-17T12:26:56.292348+0000","last_peered":"2023-05-17T12:26:56.292348+0000","last_clean":"2023-05-17T12:26:56.292348+0000","last_became_active":"2023-05-17T12:26:54.825093+0000","last_became_peered":"2023-05-17T12:26:54.825093+0000","last_unstale":"2023-05-17T12:26:56.292348+0000","last_undegraded":"2023-05-17T12:26:56.292348+0000","last_fullsized":"2023-05-17T12:26:56.292348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:02:23.575125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318303+0000","last_change":"2023-05-17T12:26:55.314594+0000","last_active":"2023-05-17T12:26:55.318303+0000","last_peered":"2023-05-17T12:26:55.318303+0000","last_clean":"2023-05-17T12:26:55.318303+0000","last_became_active":"2023-05-17T12:26:55.314262+0000","last_became_peered":"2023-05-17T12:26:55.314262+0000","last_unstale":"2023-05-17T12:26:55.318303+0000","last_undegraded":"2023-05-17T12:26:55.318303+0000","last_fullsized":"2023-05-17T12:26:55.318303+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:35:27.746640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.298954+0000","last_change":"2023-05-17T12:26:54.824576+0000","last_active":"2023-05-17T12:26:55.298954+0000","last_peered":"2023-05-17T12:26:55.298954+0000","last_clean":"2023-05-17T12:26:55.298954+0000","last_became_active":"2023-05-17T12:26:54.823866+0000","last_became_peered":"2023-05-17T12:26:54.823866+0000","last_unstale":"2023-05-17T12:26:55.298954+0000","last_undegraded":"2023-05-17T12:26:55.298954+0000","last_fullsized":"2023-05-17T12:26:55.298954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:22:40.822374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292648+0000","last_change":"2023-05-17T12:26:55.316592+0000","last_active":"2023-05-17T12:26:56.292648+0000","last_peered":"2023-05-17T12:26:56.292648+0000","last_clean":"2023-05-17T12:26:56.292648+0000","last_became_active":"2023-05-17T12:26:55.315977+0000","last_became_peered":"2023-05-17T12:26:55.315977+0000","last_unstale":"2023-05-17T12:26:56.292648+0000","last_undegraded":"2023-05-17T12:26:56.292648+0000","last_fullsized":"2023-05-17T12:26:56.292648+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:12:39.522561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292932+0000","last_change":"2023-05-17T12:26:54.819591+0000","last_active":"2023-05-17T12:26:56.292932+0000","last_peered":"2023-05-17T12:26:56.292932+0000","last_clean":"2023-05-17T12:26:56.292932+0000","last_became_active":"2023-05-17T12:26:54.819293+0000","last_became_peered":"2023-05-17T12:26:54.819293+0000","last_unstale":"2023-05-17T12:26:56.292932+0000","last_undegraded":"2023-05-17T12:26:56.292932+0000","last_fullsized":"2023-05-17T12:26:56.292932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:40:10.647414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.302788+0000","last_change":"2023-05-17T12:26:55.291935+0000","last_active":"2023-05-17T12:26:55.302788+0000","last_peered":"2023-05-17T12:26:55.302788+0000","last_clean":"2023-05-17T12:26:55.302788+0000","last_became_active":"2023-05-17T12:26:55.291620+0000","last_became_peered":"2023-05-17T12:26:55.291620+0000","last_unstale":"2023-05-17T12:26:55.302788+0000","last_undegraded":"2023-05-17T12:26:55.302788+0000","last_fullsized":"2023-05-17T12:26:55.302788+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:51:17.366645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.301063+0000","last_change":"2023-05-17T12:26:54.822457+0000","last_active":"2023-05-17T12:26:55.301063+0000","last_peered":"2023-05-17T12:26:55.301063+0000","last_clean":"2023-05-17T12:26:55.301063+0000","last_became_active":"2023-05-17T12:26:54.822167+0000","last_became_peered":"2023-05-17T12:26:54.822167+0000","last_unstale":"2023-05-17T12:26:55.301063+0000","last_undegraded":"2023-05-17T12:26:55.301063+0000","last_fullsized":"2023-05-17T12:26:55.301063+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:38:20.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677860+0000","last_change":"2023-05-17T12:26:55.315983+0000","last_active":"2023-05-17T12:26:56.677860+0000","last_peered":"2023-05-17T12:26:56.677860+0000","last_clean":"2023-05-17T12:26:56.677860+0000","last_became_active":"2023-05-17T12:26:55.315567+0000","last_became_peered":"2023-05-17T12:26:55.315567+0000","last_unstale":"2023-05-17T12:26:56.677860+0000","last_undegraded":"2023-05-17T12:26:56.677860+0000","last_fullsized":"2023-05-17T12:26:56.677860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:02:24.580740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.315226+0000","last_change":"2023-05-17T12:26:54.827054+0000","last_active":"2023-05-17T12:26:55.315226+0000","last_peered":"2023-05-17T12:26:55.315226+0000","last_clean":"2023-05-17T12:26:55.315226+0000","last_became_active":"2023-05-17T12:26:54.826716+0000","last_became_peered":"2023-05-17T12:26:54.826716+0000","last_unstale":"2023-05-17T12:26:55.315226+0000","last_undegraded":"2023-05-17T12:26:55.315226+0000","last_fullsized":"2023-05-17T12:26:55.315226+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:52:55.830008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.305318+0000","last_change":"2023-05-17T12:26:55.299490+0000","last_active":"2023-05-17T12:26:55.305318+0000","last_peered":"2023-05-17T12:26:55.305318+0000","last_clean":"2023-05-17T12:26:55.305318+0000","last_became_active":"2023-05-17T12:26:55.298993+0000","last_became_peered":"2023-05-17T12:26:55.298993+0000","last_unstale":"2023-05-17T12:26:55.305318+0000","last_undegraded":"2023-05-17T12:26:55.305318+0000","last_fullsized":"2023-05-17T12:26:55.305318+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:55:24.761124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.324980+0000","last_change":"2023-05-17T12:26:54.820358+0000","last_active":"2023-05-17T12:26:55.324980+0000","last_peered":"2023-05-17T12:26:55.324980+0000","last_clean":"2023-05-17T12:26:55.324980+0000","last_became_active":"2023-05-17T12:26:54.820089+0000","last_became_peered":"2023-05-17T12:26:54.820089+0000","last_unstale":"2023-05-17T12:26:55.324980+0000","last_undegraded":"2023-05-17T12:26:55.324980+0000","last_fullsized":"2023-05-17T12:26:55.324980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:06:03.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.323021+0000","last_change":"2023-05-17T12:26:55.321670+0000","last_active":"2023-05-17T12:26:55.323021+0000","last_peered":"2023-05-17T12:26:55.323021+0000","last_clean":"2023-05-17T12:26:55.323021+0000","last_became_active":"2023-05-17T12:26:55.321424+0000","last_became_peered":"2023-05-17T12:26:55.321424+0000","last_unstale":"2023-05-17T12:26:55.323021+0000","last_undegraded":"2023-05-17T12:26:55.323021+0000","last_fullsized":"2023-05-17T12:26:55.323021+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:48:46.609743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.678006+0000","last_change":"2023-05-17T12:26:54.818285+0000","last_active":"2023-05-17T12:26:56.678006+0000","last_peered":"2023-05-17T12:26:56.678006+0000","last_clean":"2023-05-17T12:26:56.678006+0000","last_became_active":"2023-05-17T12:26:54.817993+0000","last_became_peered":"2023-05-17T12:26:54.817993+0000","last_unstale":"2023-05-17T12:26:56.678006+0000","last_undegraded":"2023-05-17T12:26:56.678006+0000","last_fullsized":"2023-05-17T12:26:56.678006+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:15:24.872341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320732+0000","last_change":"2023-05-17T12:26:55.309173+0000","last_active":"2023-05-17T12:26:55.320732+0000","last_peered":"2023-05-17T12:26:55.320732+0000","last_clean":"2023-05-17T12:26:55.320732+0000","last_became_active":"2023-05-17T12:26:55.308945+0000","last_became_peered":"2023-05-17T12:26:55.308945+0000","last_unstale":"2023-05-17T12:26:55.320732+0000","last_undegraded":"2023-05-17T12:26:55.320732+0000","last_fullsized":"2023-05-17T12:26:55.320732+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:18:48.279265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.286062+0000","last_change":"2023-05-17T12:26:54.822551+0000","last_active":"2023-05-17T12:26:55.286062+0000","last_peered":"2023-05-17T12:26:55.286062+0000","last_clean":"2023-05-17T12:26:55.286062+0000","last_became_active":"2023-05-17T12:26:54.822247+0000","last_became_peered":"2023-05-17T12:26:54.822247+0000","last_unstale":"2023-05-17T12:26:55.286062+0000","last_undegraded":"2023-05-17T12:26:55.286062+0000","last_fullsized":"2023-05-17T12:26:55.286062+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T14:38:20.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677546+0000","last_change":"2023-05-17T12:26:55.308076+0000","last_active":"2023-05-17T12:26:56.677546+0000","last_peered":"2023-05-17T12:26:56.677546+0000","last_clean":"2023-05-17T12:26:56.677546+0000","last_became_active":"2023-05-17T12:26:55.307799+0000","last_became_peered":"2023-05-17T12:26:55.307799+0000","last_unstale":"2023-05-17T12:26:56.677546+0000","last_undegraded":"2023-05-17T12:26:56.677546+0000","last_fullsized":"2023-05-17T12:26:56.677546+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:37:25.078754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677594+0000","last_change":"2023-05-17T12:26:54.818531+0000","last_active":"2023-05-17T12:26:56.677594+0000","last_peered":"2023-05-17T12:26:56.677594+0000","last_clean":"2023-05-17T12:26:56.677594+0000","last_became_active":"2023-05-17T12:26:54.818150+0000","last_became_peered":"2023-05-17T12:26:54.818150+0000","last_unstale":"2023-05-17T12:26:56.677594+0000","last_undegraded":"2023-05-17T12:26:56.677594+0000","last_fullsized":"2023-05-17T12:26:56.677594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:14:46.613156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318599+0000","last_change":"2023-05-17T12:26:55.315564+0000","last_active":"2023-05-17T12:26:55.318599+0000","last_peered":"2023-05-17T12:26:55.318599+0000","last_clean":"2023-05-17T12:26:55.318599+0000","last_became_active":"2023-05-17T12:26:55.315219+0000","last_became_peered":"2023-05-17T12:26:55.315219+0000","last_unstale":"2023-05-17T12:26:55.318599+0000","last_undegraded":"2023-05-17T12:26:55.318599+0000","last_fullsized":"2023-05-17T12:26:55.318599+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:58:44.217184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320262+0000","last_change":"2023-05-17T12:26:54.825208+0000","last_active":"2023-05-17T12:26:55.320262+0000","last_peered":"2023-05-17T12:26:55.320262+0000","last_clean":"2023-05-17T12:26:55.320262+0000","last_became_active":"2023-05-17T12:26:54.824961+0000","last_became_peered":"2023-05-17T12:26:54.824961+0000","last_unstale":"2023-05-17T12:26:55.320262+0000","last_undegraded":"2023-05-17T12:26:55.320262+0000","last_fullsized":"2023-05-17T12:26:55.320262+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:55:51.135871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.321817+0000","last_change":"2023-05-17T12:26:55.311386+0000","last_active":"2023-05-17T12:26:55.321817+0000","last_peered":"2023-05-17T12:26:55.321817+0000","last_clean":"2023-05-17T12:26:55.321817+0000","last_became_active":"2023-05-17T12:26:55.311118+0000","last_became_peered":"2023-05-17T12:26:55.311118+0000","last_unstale":"2023-05-17T12:26:55.321817+0000","last_undegraded":"2023-05-17T12:26:55.321817+0000","last_fullsized":"2023-05-17T12:26:55.321817+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:48:46.609743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.322643+0000","last_change":"2023-05-17T12:26:54.825413+0000","last_active":"2023-05-17T12:26:55.322643+0000","last_peered":"2023-05-17T12:26:55.322643+0000","last_clean":"2023-05-17T12:26:55.322643+0000","last_became_active":"2023-05-17T12:26:54.825169+0000","last_became_peered":"2023-05-17T12:26:54.825169+0000","last_unstale":"2023-05-17T12:26:55.322643+0000","last_undegraded":"2023-05-17T12:26:55.322643+0000","last_fullsized":"2023-05-17T12:26:55.322643+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:47:03.953145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320504+0000","last_change":"2023-05-17T12:26:55.312227+0000","last_active":"2023-05-17T12:26:55.320504+0000","last_peered":"2023-05-17T12:26:55.320504+0000","last_clean":"2023-05-17T12:26:55.320504+0000","last_became_active":"2023-05-17T12:26:55.311986+0000","last_became_peered":"2023-05-17T12:26:55.311986+0000","last_unstale":"2023-05-17T12:26:55.320504+0000","last_undegraded":"2023-05-17T12:26:55.320504+0000","last_fullsized":"2023-05-17T12:26:55.320504+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:05:13.080369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292876+0000","last_change":"2023-05-17T12:26:54.823724+0000","last_active":"2023-05-17T12:26:56.292876+0000","last_peered":"2023-05-17T12:26:56.292876+0000","last_clean":"2023-05-17T12:26:56.292876+0000","last_became_active":"2023-05-17T12:26:54.821707+0000","last_became_peered":"2023-05-17T12:26:54.821707+0000","last_unstale":"2023-05-17T12:26:56.292876+0000","last_undegraded":"2023-05-17T12:26:56.292876+0000","last_fullsized":"2023-05-17T12:26:56.292876+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:05:50.095579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.315405+0000","last_change":"2023-05-17T12:26:55.313214+0000","last_active":"2023-05-17T12:26:55.315405+0000","last_peered":"2023-05-17T12:26:55.315405+0000","last_clean":"2023-05-17T12:26:55.315405+0000","last_became_active":"2023-05-17T12:26:55.312881+0000","last_became_peered":"2023-05-17T12:26:55.312881+0000","last_unstale":"2023-05-17T12:26:55.315405+0000","last_undegraded":"2023-05-17T12:26:55.315405+0000","last_fullsized":"2023-05-17T12:26:55.315405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:54:39.395708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.293099+0000","last_change":"2023-05-17T12:26:54.826607+0000","last_active":"2023-05-17T12:26:56.293099+0000","last_peered":"2023-05-17T12:26:56.293099+0000","last_clean":"2023-05-17T12:26:56.293099+0000","last_became_active":"2023-05-17T12:26:54.826341+0000","last_became_peered":"2023-05-17T12:26:54.826341+0000","last_unstale":"2023-05-17T12:26:56.293099+0000","last_undegraded":"2023-05-17T12:26:56.293099+0000","last_fullsized":"2023-05-17T12:26:56.293099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:54:25.923550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318187+0000","last_change":"2023-05-17T12:26:55.313954+0000","last_active":"2023-05-17T12:26:55.318187+0000","last_peered":"2023-05-17T12:26:55.318187+0000","last_clean":"2023-05-17T12:26:55.318187+0000","last_became_active":"2023-05-17T12:26:55.313632+0000","last_became_peered":"2023-05-17T12:26:55.313632+0000","last_unstale":"2023-05-17T12:26:55.318187+0000","last_undegraded":"2023-05-17T12:26:55.318187+0000","last_fullsized":"2023-05-17T12:26:55.318187+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:01.082778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677953+0000","last_change":"2023-05-17T12:26:54.824203+0000","last_active":"2023-05-17T12:26:56.677953+0000","last_peered":"2023-05-17T12:26:56.677953+0000","last_clean":"2023-05-17T12:26:56.677953+0000","last_became_active":"2023-05-17T12:26:54.823976+0000","last_became_peered":"2023-05-17T12:26:54.823976+0000","last_unstale":"2023-05-17T12:26:56.677953+0000","last_undegraded":"2023-05-17T12:26:56.677953+0000","last_fullsized":"2023-05-17T12:26:56.677953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:04:09.096115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677611+0000","last_change":"2023-05-17T12:26:55.308724+0000","last_active":"2023-05-17T12:26:56.677611+0000","last_peered":"2023-05-17T12:26:56.677611+0000","last_clean":"2023-05-17T12:26:56.677611+0000","last_became_active":"2023-05-17T12:26:55.308488+0000","last_became_peered":"2023-05-17T12:26:55.308488+0000","last_unstale":"2023-05-17T12:26:56.677611+0000","last_undegraded":"2023-05-17T12:26:56.677611+0000","last_fullsized":"2023-05-17T12:26:56.677611+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:22:47.817778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.678045+0000","last_change":"2023-05-17T12:26:54.821568+0000","last_active":"2023-05-17T12:26:56.678045+0000","last_peered":"2023-05-17T12:26:56.678045+0000","last_clean":"2023-05-17T12:26:56.678045+0000","last_became_active":"2023-05-17T12:26:54.820976+0000","last_became_peered":"2023-05-17T12:26:54.820976+0000","last_unstale":"2023-05-17T12:26:56.678045+0000","last_undegraded":"2023-05-17T12:26:56.678045+0000","last_fullsized":"2023-05-17T12:26:56.678045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-19T00:14:39.843494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290843+0000","last_change":"2023-05-17T12:26:55.306200+0000","last_active":"2023-05-17T12:26:56.290843+0000","last_peered":"2023-05-17T12:26:56.290843+0000","last_clean":"2023-05-17T12:26:56.290843+0000","last_became_active":"2023-05-17T12:26:55.305927+0000","last_became_peered":"2023-05-17T12:26:55.305927+0000","last_unstale":"2023-05-17T12:26:56.290843+0000","last_undegraded":"2023-05-17T12:26:56.290843+0000","last_fullsized":"2023-05-17T12:26:56.290843+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:20:56.171898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292500+0000","last_change":"2023-05-17T12:26:54.826218+0000","last_active":"2023-05-17T12:26:56.292500+0000","last_peered":"2023-05-17T12:26:56.292500+0000","last_clean":"2023-05-17T12:26:56.292500+0000","last_became_active":"2023-05-17T12:26:54.825702+0000","last_became_peered":"2023-05-17T12:26:54.825702+0000","last_unstale":"2023-05-17T12:26:56.292500+0000","last_undegraded":"2023-05-17T12:26:56.292500+0000","last_fullsized":"2023-05-17T12:26:56.292500+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:30:19.606678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.319054+0000","last_change":"2023-05-17T12:26:55.309540+0000","last_active":"2023-05-17T12:26:55.319054+0000","last_peered":"2023-05-17T12:26:55.319054+0000","last_clean":"2023-05-17T12:26:55.319054+0000","last_became_active":"2023-05-17T12:26:55.309238+0000","last_became_peered":"2023-05-17T12:26:55.309238+0000","last_unstale":"2023-05-17T12:26:55.319054+0000","last_undegraded":"2023-05-17T12:26:55.319054+0000","last_fullsized":"2023-05-17T12:26:55.319054+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T12:38:49.454146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.297761+0000","last_change":"2023-05-17T12:26:54.823367+0000","last_active":"2023-05-17T12:26:55.297761+0000","last_peered":"2023-05-17T12:26:55.297761+0000","last_clean":"2023-05-17T12:26:55.297761+0000","last_became_active":"2023-05-17T12:26:54.823083+0000","last_became_peered":"2023-05-17T12:26:54.823083+0000","last_unstale":"2023-05-17T12:26:55.297761+0000","last_undegraded":"2023-05-17T12:26:55.297761+0000","last_fullsized":"2023-05-17T12:26:55.297761+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:15:14.487874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320580+0000","last_change":"2023-05-17T12:26:55.308581+0000","last_active":"2023-05-17T12:26:55.320580+0000","last_peered":"2023-05-17T12:26:55.320580+0000","last_clean":"2023-05-17T12:26:55.320580+0000","last_became_active":"2023-05-17T12:26:55.308293+0000","last_became_peered":"2023-05-17T12:26:55.308293+0000","last_unstale":"2023-05-17T12:26:55.320580+0000","last_undegraded":"2023-05-17T12:26:55.320580+0000","last_fullsized":"2023-05-17T12:26:55.320580+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T18:34:19.280405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.287598+0000","last_change":"2023-05-17T12:26:54.824933+0000","last_active":"2023-05-17T12:26:55.287598+0000","last_peered":"2023-05-17T12:26:55.287598+0000","last_clean":"2023-05-17T12:26:55.287598+0000","last_became_active":"2023-05-17T12:26:54.824608+0000","last_became_peered":"2023-05-17T12:26:54.824608+0000","last_unstale":"2023-05-17T12:26:55.287598+0000","last_undegraded":"2023-05-17T12:26:55.287598+0000","last_fullsized":"2023-05-17T12:26:55.287598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:56:33.198529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292096+0000","last_change":"2023-05-17T12:26:55.304122+0000","last_active":"2023-05-17T12:26:56.292096+0000","last_peered":"2023-05-17T12:26:56.292096+0000","last_clean":"2023-05-17T12:26:56.292096+0000","last_became_active":"2023-05-17T12:26:55.303840+0000","last_became_peered":"2023-05-17T12:26:55.303840+0000","last_unstale":"2023-05-17T12:26:56.292096+0000","last_undegraded":"2023-05-17T12:26:56.292096+0000","last_fullsized":"2023-05-17T12:26:56.292096+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:40:10.778893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.299084+0000","last_change":"2023-05-17T12:26:54.824724+0000","last_active":"2023-05-17T12:26:55.299084+0000","last_peered":"2023-05-17T12:26:55.299084+0000","last_clean":"2023-05-17T12:26:55.299084+0000","last_became_active":"2023-05-17T12:26:54.824479+0000","last_became_peered":"2023-05-17T12:26:54.824479+0000","last_unstale":"2023-05-17T12:26:55.299084+0000","last_undegraded":"2023-05-17T12:26:55.299084+0000","last_fullsized":"2023-05-17T12:26:55.299084+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:00:38.924919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290792+0000","last_change":"2023-05-17T12:24:55.792670+0000","last_active":"2023-05-17T12:26:56.290792+0000","last_peered":"2023-05-17T12:26:56.290792+0000","last_clean":"2023-05-17T12:26:56.290792+0000","last_became_active":"2023-05-17T12:24:55.792363+0000","last_became_peered":"2023-05-17T12:24:55.792363+0000","last_unstale":"2023-05-17T12:26:56.290792+0000","last_undegraded":"2023-05-17T12:26:56.290792+0000","last_fullsized":"2023-05-17T12:26:56.290792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:03:13.015221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.318558+0000","last_change":"2023-05-17T12:26:55.316368+0000","last_active":"2023-05-17T12:26:55.318558+0000","last_peered":"2023-05-17T12:26:55.318558+0000","last_clean":"2023-05-17T12:26:55.318558+0000","last_became_active":"2023-05-17T12:26:55.315480+0000","last_became_peered":"2023-05-17T12:26:55.315480+0000","last_unstale":"2023-05-17T12:26:55.318558+0000","last_undegraded":"2023-05-17T12:26:55.318558+0000","last_fullsized":"2023-05-17T12:26:55.318558+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:06:04.199036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:57.005889+0000","last_change":"2023-05-17T12:26:54.819171+0000","last_active":"2023-05-17T12:26:57.005889+0000","last_peered":"2023-05-17T12:26:57.005889+0000","last_clean":"2023-05-17T12:26:57.005889+0000","last_became_active":"2023-05-17T12:26:54.818937+0000","last_became_peered":"2023-05-17T12:26:54.818937+0000","last_unstale":"2023-05-17T12:26:57.005889+0000","last_undegraded":"2023-05-17T12:26:57.005889+0000","last_fullsized":"2023-05-17T12:26:57.005889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:30:19.606678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292653+0000","last_change":"2023-05-17T12:24:55.754074+0000","last_active":"2023-05-17T12:26:56.292653+0000","last_peered":"2023-05-17T12:26:56.292653+0000","last_clean":"2023-05-17T12:26:56.292653+0000","last_became_active":"2023-05-17T12:24:55.753544+0000","last_became_peered":"2023-05-17T12:24:55.753544+0000","last_unstale":"2023-05-17T12:26:56.292653+0000","last_undegraded":"2023-05-17T12:26:56.292653+0000","last_fullsized":"2023-05-17T12:26:56.292653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:31:07.379328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320537+0000","last_change":"2023-05-17T12:26:55.304514+0000","last_active":"2023-05-17T12:26:55.320537+0000","last_peered":"2023-05-17T12:26:55.320537+0000","last_clean":"2023-05-17T12:26:55.320537+0000","last_became_active":"2023-05-17T12:26:55.304229+0000","last_became_peered":"2023-05-17T12:26:55.304229+0000","last_unstale":"2023-05-17T12:26:55.320537+0000","last_undegraded":"2023-05-17T12:26:55.320537+0000","last_fullsized":"2023-05-17T12:26:55.320537+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T23:49:42.570249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.288333+0000","last_change":"2023-05-17T12:26:54.828563+0000","last_active":"2023-05-17T12:26:55.288333+0000","last_peered":"2023-05-17T12:26:55.288333+0000","last_clean":"2023-05-17T12:26:55.288333+0000","last_became_active":"2023-05-17T12:26:54.828318+0000","last_became_peered":"2023-05-17T12:26:54.828318+0000","last_unstale":"2023-05-17T12:26:55.288333+0000","last_undegraded":"2023-05-17T12:26:55.288333+0000","last_fullsized":"2023-05-17T12:26:55.288333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:15:43.601540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.290391+0000","last_change":"2023-05-17T12:24:56.008501+0000","last_active":"2023-05-17T12:26:55.290391+0000","last_peered":"2023-05-17T12:26:55.290391+0000","last_clean":"2023-05-17T12:26:55.290391+0000","last_became_active":"2023-05-17T12:24:56.008203+0000","last_became_peered":"2023-05-17T12:24:56.008203+0000","last_unstale":"2023-05-17T12:26:55.290391+0000","last_undegraded":"2023-05-17T12:26:55.290391+0000","last_fullsized":"2023-05-17T12:26:55.290391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:42:55.959163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.320623+0000","last_change":"2023-05-17T12:26:55.309392+0000","last_active":"2023-05-17T12:26:55.320623+0000","last_peered":"2023-05-17T12:26:55.320623+0000","last_clean":"2023-05-17T12:26:55.320623+0000","last_became_active":"2023-05-17T12:26:55.309076+0000","last_became_peered":"2023-05-17T12:26:55.309076+0000","last_unstale":"2023-05-17T12:26:55.320623+0000","last_undegraded":"2023-05-17T12:26:55.320623+0000","last_fullsized":"2023-05-17T12:26:55.320623+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:11:17.753723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.293187+0000","last_change":"2023-05-17T12:26:54.827181+0000","last_active":"2023-05-17T12:26:56.293187+0000","last_peered":"2023-05-17T12:26:56.293187+0000","last_clean":"2023-05-17T12:26:56.293187+0000","last_became_active":"2023-05-17T12:26:54.826895+0000","last_became_peered":"2023-05-17T12:26:54.826895+0000","last_unstale":"2023-05-17T12:26:56.293187+0000","last_undegraded":"2023-05-17T12:26:56.293187+0000","last_fullsized":"2023-05-17T12:26:56.293187+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:39:29.493064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292626+0000","last_change":"2023-05-17T12:24:55.753963+0000","last_active":"2023-05-17T12:26:56.292626+0000","last_peered":"2023-05-17T12:26:56.292626+0000","last_clean":"2023-05-17T12:26:56.292626+0000","last_became_active":"2023-05-17T12:24:55.753582+0000","last_became_peered":"2023-05-17T12:24:55.753582+0000","last_unstale":"2023-05-17T12:26:56.292626+0000","last_undegraded":"2023-05-17T12:26:56.292626+0000","last_fullsized":"2023-05-17T12:26:56.292626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T19:42:33.932129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":206,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.287715+0000","last_change":"2023-05-17T12:24:48.829166+0000","last_active":"2023-05-17T12:26:55.287715+0000","last_peered":"2023-05-17T12:26:55.287715+0000","last_clean":"2023-05-17T12:26:55.287715+0000","last_became_active":"2023-05-17T12:24:48.828767+0000","last_became_peered":"2023-05-17T12:24:48.828767+0000","last_unstale":"2023-05-17T12:26:55.287715+0000","last_undegraded":"2023-05-17T12:26:55.287715+0000","last_fullsized":"2023-05-17T12:26:55.287715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:47.688706+0000","last_clean_scrub_stamp":"2023-05-17T12:24:47.688706+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T20:39:49.412468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.305296+0000","last_change":"2023-05-17T12:26:55.299291+0000","last_active":"2023-05-17T12:26:55.305296+0000","last_peered":"2023-05-17T12:26:55.305296+0000","last_clean":"2023-05-17T12:26:55.305296+0000","last_became_active":"2023-05-17T12:26:55.298637+0000","last_became_peered":"2023-05-17T12:26:55.298637+0000","last_unstale":"2023-05-17T12:26:55.305296+0000","last_undegraded":"2023-05-17T12:26:55.305296+0000","last_fullsized":"2023-05-17T12:26:55.305296+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:09:57.911700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290801+0000","last_change":"2023-05-17T12:26:54.826202+0000","last_active":"2023-05-17T12:26:56.290801+0000","last_peered":"2023-05-17T12:26:56.290801+0000","last_clean":"2023-05-17T12:26:56.290801+0000","last_became_active":"2023-05-17T12:26:54.825933+0000","last_became_peered":"2023-05-17T12:26:54.825933+0000","last_unstale":"2023-05-17T12:26:56.290801+0000","last_undegraded":"2023-05-17T12:26:56.290801+0000","last_fullsized":"2023-05-17T12:26:56.290801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:07:06.273386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.288000+0000","last_change":"2023-05-17T12:24:55.756595+0000","last_active":"2023-05-17T12:26:55.288000+0000","last_peered":"2023-05-17T12:26:55.288000+0000","last_clean":"2023-05-17T12:26:55.288000+0000","last_became_active":"2023-05-17T12:24:55.756274+0000","last_became_peered":"2023-05-17T12:24:55.756274+0000","last_unstale":"2023-05-17T12:26:55.288000+0000","last_undegraded":"2023-05-17T12:26:55.288000+0000","last_fullsized":"2023-05-17T12:26:55.288000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:21:43.516314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292301+0000","last_change":"2023-05-17T12:26:55.295940+0000","last_active":"2023-05-17T12:26:56.292301+0000","last_peered":"2023-05-17T12:26:56.292301+0000","last_clean":"2023-05-17T12:26:56.292301+0000","last_became_active":"2023-05-17T12:26:55.295657+0000","last_became_peered":"2023-05-17T12:26:55.295657+0000","last_unstale":"2023-05-17T12:26:56.292301+0000","last_undegraded":"2023-05-17T12:26:56.292301+0000","last_fullsized":"2023-05-17T12:26:56.292301+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T15:15:49.406938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.290746+0000","last_change":"2023-05-17T12:26:54.822872+0000","last_active":"2023-05-17T12:26:56.290746+0000","last_peered":"2023-05-17T12:26:56.290746+0000","last_clean":"2023-05-17T12:26:56.290746+0000","last_became_active":"2023-05-17T12:26:54.822671+0000","last_became_peered":"2023-05-17T12:26:54.822671+0000","last_unstale":"2023-05-17T12:26:56.290746+0000","last_undegraded":"2023-05-17T12:26:56.290746+0000","last_fullsized":"2023-05-17T12:26:56.290746+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T16:11:16.748109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.288048+0000","last_change":"2023-05-17T12:24:55.792994+0000","last_active":"2023-05-17T12:26:55.288048+0000","last_peered":"2023-05-17T12:26:55.288048+0000","last_clean":"2023-05-17T12:26:55.288048+0000","last_became_active":"2023-05-17T12:24:55.792597+0000","last_became_peered":"2023-05-17T12:24:55.792597+0000","last_unstale":"2023-05-17T12:26:55.288048+0000","last_undegraded":"2023-05-17T12:26:55.288048+0000","last_fullsized":"2023-05-17T12:26:55.288048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T22:31:49.937880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677973+0000","last_change":"2023-05-17T12:26:55.308191+0000","last_active":"2023-05-17T12:26:56.677973+0000","last_peered":"2023-05-17T12:26:56.677973+0000","last_clean":"2023-05-17T12:26:56.677973+0000","last_became_active":"2023-05-17T12:26:55.307929+0000","last_became_peered":"2023-05-17T12:26:55.307929+0000","last_unstale":"2023-05-17T12:26:56.677973+0000","last_undegraded":"2023-05-17T12:26:56.677973+0000","last_fullsized":"2023-05-17T12:26:56.677973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:40:55.717293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.292547+0000","last_change":"2023-05-17T12:26:54.828862+0000","last_active":"2023-05-17T12:26:56.292547+0000","last_peered":"2023-05-17T12:26:56.292547+0000","last_clean":"2023-05-17T12:26:56.292547+0000","last_became_active":"2023-05-17T12:26:54.828604+0000","last_became_peered":"2023-05-17T12:26:54.828604+0000","last_unstale":"2023-05-17T12:26:56.292547+0000","last_undegraded":"2023-05-17T12:26:56.292547+0000","last_fullsized":"2023-05-17T12:26:56.292547+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:57:36.505407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.291080+0000","last_change":"2023-05-17T12:24:55.755523+0000","last_active":"2023-05-17T12:26:56.291080+0000","last_peered":"2023-05-17T12:26:56.291080+0000","last_clean":"2023-05-17T12:26:56.291080+0000","last_became_active":"2023-05-17T12:24:55.755229+0000","last_became_peered":"2023-05-17T12:24:55.755229+0000","last_unstale":"2023-05-17T12:26:56.291080+0000","last_undegraded":"2023-05-17T12:26:56.291080+0000","last_fullsized":"2023-05-17T12:26:56.291080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T13:42:09.001495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-17T12:26:56.677978+0000","last_change":"2023-05-17T12:26:55.298695+0000","last_active":"2023-05-17T12:26:56.677978+0000","last_peered":"2023-05-17T12:26:56.677978+0000","last_clean":"2023-05-17T12:26:56.677978+0000","last_became_active":"2023-05-17T12:26:55.298419+0000","last_became_peered":"2023-05-17T12:26:55.298419+0000","last_unstale":"2023-05-17T12:26:56.677978+0000","last_undegraded":"2023-05-17T12:26:56.677978+0000","last_fullsized":"2023-05-17T12:26:56.677978+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:54.798718+0000","last_clean_scrub_stamp":"2023-05-17T12:26:54.798718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:33:07.444476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.287301+0000","last_change":"2023-05-17T12:26:54.827969+0000","last_active":"2023-05-17T12:26:55.287301+0000","last_peered":"2023-05-17T12:26:55.287301+0000","last_clean":"2023-05-17T12:26:55.287301+0000","last_became_active":"2023-05-17T12:26:54.827685+0000","last_became_peered":"2023-05-17T12:26:54.827685+0000","last_unstale":"2023-05-17T12:26:55.287301+0000","last_undegraded":"2023-05-17T12:26:55.287301+0000","last_fullsized":"2023-05-17T12:26:55.287301+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:26:53.793104+0000","last_clean_scrub_stamp":"2023-05-17T12:26:53.793104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T21:43:57.977707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-17T12:26:55.296580+0000","last_change":"2023-05-17T12:24:55.755814+0000","last_active":"2023-05-17T12:26:55.296580+0000","last_peered":"2023-05-17T12:26:55.296580+0000","last_clean":"2023-05-17T12:26:55.296580+0000","last_became_active":"2023-05-17T12:24:55.755481+0000","last_became_peered":"2023-05-17T12:24:55.755481+0000","last_unstale":"2023-05-17T12:26:55.296580+0000","last_undegraded":"2023-05-17T12:26:55.296580+0000","last_fullsized":"2023-05-17T12:26:55.296580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-17T12:24:54.733570+0000","last_clean_scrub_stamp":"2023-05-17T12:24:54.733570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-18T17:29:48.962151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9824,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362016,"statfs":{"total":96636764160,"available":96626704384,"internally_reserved":0,"allocated":1073152,"data_stored":802261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.65400000000000003}]},{"osd":1,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.628},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.746}]},{"osd":2,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98099999999999998,"5min":1.085,"15min":1.085},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65900000000000003,"15min":0.66000000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.45800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91600000000000004,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71799999999999997}]},{"osd":5,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73699999999999999,"15min":0.73799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.60899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8608,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363232,"statfs":{"total":96636764160,"available":96627949568,"internally_reserved":0,"allocated":483328,"data_stored":212475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81100000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70199999999999996}]},{"osd":1,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59999999999999998,"15min":0.60299999999999998},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.48199999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83499999999999996,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92700000000000005,"5min":1.083,"15min":1.083},"last":0.498}]},{"osd":3,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.81100000000000005,"15min":0.82999999999999996},"min":{"1min":0.57499999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88100000000000001,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.48599999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1990000000000001,"5min":1.258,"15min":1.258},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66700000000000004,"15min":0.66800000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.751,"15min":0.749},"min":{"1min":0.58799999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1379999999999999,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66600000000000004}]},{"osd":7,"last update":"Wed May 17 12:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.069,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.57299999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.85899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8744,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363096,"statfs":{"total":96636764160,"available":96627810304,"internally_reserved":0,"allocated":491520,"data_stored":218846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.433,"15min":0.443},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52000000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46100000000000002,"15min":0.46899999999999997},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59899999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42099999999999999,"15min":0.42299999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.50900000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.501,"15min":0.505},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.54800000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.44800000000000001}]},{"osd":3,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50700000000000001,"15min":0.51400000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.76000000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":4.2160000000000002,"5min":4.2160000000000002,"15min":4.2160000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.96399999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.755},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.74299999999999999,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.85599999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.68999999999999995}]},{"osd":7,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2310000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.624}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9824,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362016,"statfs":{"total":96636764160,"available":96626704384,"internally_reserved":0,"allocated":1073152,"data_stored":802205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.52600000000000002,"15min":0.54600000000000004},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.88300000000000001,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":0.255},{"interface":"front","average":{"1min":0.44,"5min":0.54800000000000004,"15min":0.56599999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.745,"5min":4.1210000000000004,"15min":4.1210000000000004},"last":0.35199999999999998}]},{"osd":2,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.58699999999999997,"15min":0.60899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65700000000000003,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61899999999999999,"5min":4.1509999999999998,"15min":4.1509999999999998},"last":0.502}]},{"osd":3,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.63800000000000001,"15min":0.66600000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":4.3200000000000003,"15min":4.3200000000000003},"last":0.442}]},{"osd":4,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.85999999999999999,"15min":0.89400000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.81999999999999995,"5min":4.0250000000000004,"15min":4.0250000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":1.1479999999999999,"15min":1.23},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.84399999999999997,"5min":12.159000000000001,"15min":12.159000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":1.1359999999999999,"15min":1.2130000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.873,"5min":12.124000000000001,"15min":12.124000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.874,"15min":0.91000000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.90400000000000003,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.60899999999999999}]},{"osd":6,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.88200000000000001,"15min":0.92000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.871,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.876,"15min":0.91200000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90700000000000003,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed May 17 12:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93700000000000006,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":1.155,"15min":1.2390000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.85899999999999999,"5min":12.077999999999999,"15min":12.077999999999999},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":491520,"data_stored":213389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.23999999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.77200000000000002,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.435},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.93000000000000005,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.47799999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.9710000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85399999999999998,"5min":1.363,"15min":1.363},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0249999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.496}]},{"osd":4,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.81899999999999995,"5min":1.196,"15min":1.196},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81899999999999995,"15min":0.81299999999999994},"min":{"1min":0.48399999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.3029999999999999,"5min":3.3029999999999999,"15min":3.3029999999999999},"last":0.89000000000000001}]},{"osd":5,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.80300000000000005,"15min":0.81699999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97199999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.875},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.91100000000000003,"15min":0.94099999999999995},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98299999999999998,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":0.80300000000000005}]},{"osd":6,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.84799999999999998},"min":{"1min":0.51900000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97199999999999998,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.76600000000000001}]},{"osd":7,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.82899999999999996,"15min":0.84299999999999997},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0880000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.81999999999999995,"15min":0.83399999999999996},"min":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92800000000000005,"5min":1.704,"15min":1.704},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8752,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363088,"statfs":{"total":96636764160,"available":96627802112,"internally_reserved":0,"allocated":499712,"data_stored":219414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":1.3200000000000001,"15min":1.47},"min":{"1min":0.27700000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.56100000000000005,"5min":19.986999999999998,"15min":19.986999999999998},"last":0.313},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.65900000000000003,"15min":0.69899999999999995},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":5.1710000000000003,"15min":5.1710000000000003},"last":0.41099999999999998}]},{"osd":1,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":1.4319999999999999,"15min":1.6020000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.47999999999999998,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.443,"5min":1.391,"15min":1.5489999999999999},"min":{"1min":0.30299999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":19.956,"15min":19.956},"last":0.39200000000000002}]},{"osd":2,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":1.0189999999999999,"15min":1.109},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60299999999999998,"5min":11.821999999999999,"15min":11.821999999999999},"last":0.439},{"interface":"front","average":{"1min":0.51200000000000001,"5min":1.429,"15min":1.5820000000000001},"min":{"1min":0.441,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67300000000000004,"5min":19.914999999999999,"15min":19.914999999999999},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.94599999999999995,"15min":0.98399999999999999},"min":{"1min":0.59399999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95099999999999996,"5min":5.1120000000000001,"15min":5.1120000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.266,"15min":1.3660000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.88400000000000001,"5min":11.914999999999999,"15min":11.914999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":1.167,"15min":1.2490000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85899999999999999,"5min":9.0489999999999995,"15min":9.0489999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":1.002,"15min":1.056},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90700000000000003,"5min":5.1440000000000001,"15min":5.1440000000000001},"last":0.62}]},{"osd":6,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":1.272,"15min":1.365},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3740000000000001,"5min":11.874000000000001,"15min":11.874000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":1.1299999999999999,"15min":1.202},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.85599999999999998,"5min":9.0939999999999994,"15min":9.0939999999999994},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed May 17 12:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.96699999999999997,"15min":1.0089999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3400000000000001,"5min":5.0709999999999997,"15min":5.0709999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":1.286,"15min":1.381},"min":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.85699999999999998,"5min":11.949,"15min":11.949},"last":0.66600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8816,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363024,"statfs":{"total":96636764160,"available":96627736576,"internally_reserved":0,"allocated":499712,"data_stored":220340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.83699999999999997}]},{"osd":1,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93100000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72099999999999997,"15min":0.73399999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84899999999999998,"5min":1.129,"15min":1.129},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90000000000000002,"5min":1.149,"15min":1.149},"last":0.76500000000000001}]},{"osd":3,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84899999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.81200000000000006,"5min":1.228,"15min":1.228},"last":0.72799999999999998}]},{"osd":5,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.84799999999999998}]},{"osd":6,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75700000000000001,"15min":0.76200000000000001},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68000000000000005,"15min":0.68200000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Wed May 17 12:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.877},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95199999999999996,"5min":1.024,"15min":1.024},"last":0.92400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":491520,"data_stored":218846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.1419999999999999,"15min":1.2290000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81499999999999995,"5min":9.8559999999999999,"15min":9.8559999999999999},"last":9.7949999999999999},{"interface":"front","average":{"1min":0.628,"5min":1.1719999999999999,"15min":1.262},"min":{"1min":0.51100000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.79700000000000004,"5min":9.8179999999999996,"15min":9.8179999999999996},"last":14.616}]},{"osd":1,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":1.2310000000000001,"15min":1.327},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88100000000000001,"5min":10.776,"15min":10.776},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.623,"5min":1.258,"15min":1.3640000000000001},"min":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.872,"5min":10.823,"15min":10.823},"last":15.311999999999999}]},{"osd":2,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":1.272,"15min":1.3759999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.88300000000000001,"5min":9.7769999999999992,"15min":9.7769999999999992},"last":15.122},{"interface":"front","average":{"1min":0.63900000000000001,"5min":1.244,"15min":1.345},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.77800000000000002,"5min":10.013999999999999,"15min":10.013999999999999},"last":2.3420000000000001}]},{"osd":3,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":1.278,"15min":1.3879999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.76700000000000002,"5min":10.884,"15min":10.884},"last":2.6360000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":1.333,"15min":1.4450000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.84499999999999997,"5min":10.965999999999999,"15min":10.965999999999999},"last":15.077}]},{"osd":4,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.64700000000000002,"15min":0.66200000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":2.754},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.70599999999999996,"15min":0.72499999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.77300000000000002,"5min":1.649,"15min":1.649},"last":0.97799999999999998}]},{"osd":6,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.79800000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":15.515000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85399999999999998,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":2.798}]},{"osd":7,"last update":"Wed May 17 12:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.78400000000000003,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.87,"5min":1.458,"15min":1.458},"last":15.260999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-17T12:27:00.086 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-17T12:27:00.087 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-17T12:27:00.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.307+0000 7f4cae7ff700 1 Processor -- start 2023-05-17T12:27:00.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.307+0000 7f4cae7ff700 1 -- start start 2023-05-17T12:27:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.308+0000 7f4cae7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ca815c840 0x7f4ca806b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.308+0000 7f4cae7ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ca806b0b0 0x7f4ca80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.308+0000 7f4cae7ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca80cd6b0 con 0x7f4ca806c330 2023-05-17T12:27:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.308+0000 7f4cae7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca80cdf50 con 0x7f4ca815c840 2023-05-17T12:27:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.308+0000 7f4cae7ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca80cf860 con 0x7f4ca806b0b0 2023-05-17T12:27:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.309+0000 7f4ca7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ca815c840 0x7f4ca806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.309+0000 7f4ca7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ca815c840 0x7f4ca806b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46302/0 (socket says 172.21.15.88:46302) 2023-05-17T12:27:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.309+0000 7f4ca7fff700 1 -- 172.21.15.88:0/3007215924 learned_addr learned my addr 172.21.15.88:0/3007215924 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.309+0000 7f4c9f7fe700 1 --2- 172.21.15.88:0/3007215924 >> v2:172.21.15.187:3300/0 conn(0x7f4ca806b0b0 0x7f4ca80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.309+0000 7f4ca7fff700 1 -- 172.21.15.88:0/3007215924 >> v2:172.21.15.187:3300/0 conn(0x7f4ca806b0b0 msgr2=0x7f4ca80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.309+0000 7f4ca7fff700 1 --2- 172.21.15.88:0/3007215924 >> v2:172.21.15.187:3300/0 conn(0x7f4ca806b0b0 0x7f4ca80cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.309+0000 7f4ca7fff700 1 -- 172.21.15.88:0/3007215924 >> v1:172.21.15.187:6789/0 conn(0x7f4ca806c330 legacy=0x7f4ca8160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.309+0000 7f4ca7fff700 1 -- 172.21.15.88:0/3007215924 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca80b2460 con 0x7f4ca815c840 2023-05-17T12:27:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.309+0000 7f4ca7fff700 1 --2- 172.21.15.88:0/3007215924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 0x7f4ca806b940 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80cead0 tx=0x7f4c9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec82622895eeddf1 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4ca77fe700 1 -- 172.21.15.88:0/3007215924 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800e070 con 0x7f4ca815c840 2023-05-17T12:27:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4ca77fe700 1 -- 172.21.15.88:0/3007215924 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9800b910 con 0x7f4ca815c840 2023-05-17T12:27:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4ca77fe700 1 -- 172.21.15.88:0/3007215924 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800bcc0 con 0x7f4ca815c840 2023-05-17T12:27:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4cae7ff700 1 -- 172.21.15.88:0/3007215924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 msgr2=0x7f4ca806b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4cae7ff700 1 --2- 172.21.15.88:0/3007215924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 0x7f4ca806b940 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80cead0 tx=0x7f4c9800b330 comp rx=0 tx=0).stop 2023-05-17T12:27:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4cae7ff700 1 -- 172.21.15.88:0/3007215924 shutdown_connections 2023-05-17T12:27:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4cae7ff700 1 --2- 172.21.15.88:0/3007215924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 0x7f4ca806b940 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4cae7ff700 1 --2- 172.21.15.88:0/3007215924 >> v2:172.21.15.187:3300/0 conn(0x7f4ca806b0b0 0x7f4ca80cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4cae7ff700 1 -- 172.21.15.88:0/3007215924 >> 172.21.15.88:0/3007215924 conn(0x7f4ca80d3060 msgr2=0x7f4ca80d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4cae7ff700 1 -- 172.21.15.88:0/3007215924 shutdown_connections 2023-05-17T12:27:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.310+0000 7f4cae7ff700 1 -- 172.21.15.88:0/3007215924 wait complete. 2023-05-17T12:27:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.312+0000 7f4cae7ff700 1 Processor -- start 2023-05-17T12:27:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.312+0000 7f4cae7ff700 1 -- start start 2023-05-17T12:27:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4cae7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ca806b0b0 0x7f4ca81e2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4cae7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ca806c330 0x7f4ca80b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4cae7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 0x7f4ca81e3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4cae7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81e1bd0 con 0x7f4ca815c840 2023-05-17T12:27:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4cae7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81e1e70 con 0x7f4ca806b0b0 2023-05-17T12:27:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4cae7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81e2150 con 0x7f4ca806c330 2023-05-17T12:27:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4cacd9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 0x7f4ca81e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4cacd9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 0x7f4ca81e3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46310/0 (socket says 172.21.15.88:46310) 2023-05-17T12:27:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4cacd9c700 1 -- 172.21.15.88:0/1782357157 learned_addr learned my addr 172.21.15.88:0/1782357157 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:00.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4ca7fff700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ca806b0b0 0x7f4ca81e2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.313+0000 7f4c9f7fe700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ca806c330 0x7f4ca80b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4cacd9c700 1 -- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ca806c330 msgr2=0x7f4ca80b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4cacd9c700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ca806c330 0x7f4ca80b7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4cacd9c700 1 -- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ca806b0b0 msgr2=0x7f4ca81e2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4cacd9c700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ca806b0b0 0x7f4ca81e2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4cacd9c700 1 -- 172.21.15.88:0/1782357157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c98009b30 con 0x7f4ca815c840 2023-05-17T12:27:00.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4cacd9c700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 0x7f4ca81e3880 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000c500 tx=0x7f4ca000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4ca57fa700 1 -- 172.21.15.88:0/1782357157 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00052d0 con 0x7f4ca815c840 2023-05-17T12:27:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4ca57fa700 1 -- 172.21.15.88:0/1782357157 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca0005430 con 0x7f4ca815c840 2023-05-17T12:27:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca80cd900 con 0x7f4ca815c840 2023-05-17T12:27:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4ca57fa700 1 -- 172.21.15.88:0/1782357157 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00038c0 con 0x7f4ca815c840 2023-05-17T12:27:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.314+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca80b2740 con 0x7f4ca815c840 2023-05-17T12:27:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.316+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca80cdbe0 con 0x7f4ca815c840 2023-05-17T12:27:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.319+0000 7f4ca57fa700 1 -- 172.21.15.88:0/1782357157 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ca0003a20 con 0x7f4ca815c840 2023-05-17T12:27:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.320+0000 7f4ca57fa700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4c8806ace0 0x7f4c8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.320+0000 7f4ca57fa700 1 -- 172.21.15.88:0/1782357157 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4ca0088dc0 con 0x7f4ca815c840 2023-05-17T12:27:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.321+0000 7f4ca7fff700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4c8806ace0 0x7f4c8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.321+0000 7f4ca7fff700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4c8806ace0 0x7f4c8806d190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c98000f80 tx=0x7f4c98009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.323+0000 7f4ca57fa700 1 -- 172.21.15.88:0/1782357157 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4ca0053d10 con 0x7f4ca815c840 2023-05-17T12:27:00.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.595+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4ca81e2670 con 0x7f4ca815c840 2023-05-17T12:27:00.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.599+0000 7f4ca57fa700 1 -- 172.21.15.88:0/1782357157 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4ca81e2670 con 0x7f4ca815c840 2023-05-17T12:27:00.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4c8806ace0 msgr2=0x7f4c8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4c8806ace0 0x7f4c8806d190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c98000f80 tx=0x7f4c98009000 comp rx=0 tx=0).stop 2023-05-17T12:27:00.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 msgr2=0x7f4ca81e3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 0x7f4ca81e3880 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000c500 tx=0x7f4ca000c810 comp rx=0 tx=0).stop 2023-05-17T12:27:00.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 shutdown_connections 2023-05-17T12:27:00.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f4c8806ace0 0x7f4c8806d190 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ca815c840 0x7f4ca81e3880 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ca806b0b0 0x7f4ca81e2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 --2- 172.21.15.88:0/1782357157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ca806c330 0x7f4ca80b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 >> 172.21.15.88:0/1782357157 conn(0x7f4ca80d3060 msgr2=0x7f4ca806c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:00.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 shutdown_connections 2023-05-17T12:27:00.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.602+0000 7f4cae7ff700 1 -- 172.21.15.88:0/1782357157 wait complete. 2023-05-17T12:27:00.608 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.0 2023-05-17T12:27:00.622 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-17T12:27:00.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.803+0000 7f0a6c3ff700 1 Processor -- start 2023-05-17T12:27:00.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.803+0000 7f0a6c3ff700 1 -- start start 2023-05-17T12:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.804+0000 7f0a6c3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6406ca40 0x7f0a6406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.804+0000 7f0a6c3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a640cd6b0 con 0x7f0a6406b0b0 2023-05-17T12:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.804+0000 7f0a6c3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a640b2460 con 0x7f0a6415c840 2023-05-17T12:27:00.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.804+0000 7f0a6c3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a640cdf50 con 0x7f0a6406ca40 2023-05-17T12:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.804+0000 7f0a6999a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0a6406b0b0 0x7f0a6406c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41330/0 (socket says 172.21.15.88:41330) 2023-05-17T12:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.804+0000 7f0a6999a700 1 -- 172.21.15.88:0/3113773881 learned_addr learned my addr 172.21.15.88:0/3113773881 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:27:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.805+0000 7f0a6a99c700 1 --2- 172.21.15.88:0/3113773881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6406ca40 0x7f0a6406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.805+0000 7f0a69199700 1 -- 172.21.15.88:0/3113773881 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714397744 0 0) 0x7f0a640cd6b0 con 0x7f0a6406b0b0 2023-05-17T12:27:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.805+0000 7f0a69199700 1 -- 172.21.15.88:0/3113773881 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a500035b0 con 0x7f0a6406b0b0 2023-05-17T12:27:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.805+0000 7f0a69199700 1 -- 172.21.15.88:0/3113773881 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645294343 0 0) 0x7f0a640b2460 con 0x7f0a6415c840 2023-05-17T12:27:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.805+0000 7f0a69199700 1 -- 172.21.15.88:0/3113773881 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a640cd6b0 con 0x7f0a6415c840 2023-05-17T12:27:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.805+0000 7f0a69199700 1 -- 172.21.15.88:0/3113773881 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3813661449 0 0) 0x7f0a500035b0 con 0x7f0a6406b0b0 2023-05-17T12:27:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.805+0000 7f0a6a99c700 1 -- 172.21.15.88:0/3113773881 >> v1:172.21.15.187:6789/0 conn(0x7f0a6415c840 legacy=0x7f0a640cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.805+0000 7f0a6a99c700 1 -- 172.21.15.88:0/3113773881 >> v1:172.21.15.88:6789/0 conn(0x7f0a6406b0b0 legacy=0x7f0a6406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.805+0000 7f0a6a99c700 1 -- 172.21.15.88:0/3113773881 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a640b2740 con 0x7f0a6406ca40 2023-05-17T12:27:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a6a99c700 1 --2- 172.21.15.88:0/3113773881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6406ca40 0x7f0a6406b940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009dc0 tx=0x7f0a5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1731c4912e9fa7 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a69199700 1 -- 172.21.15.88:0/3113773881 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00e070 con 0x7f0a6406ca40 2023-05-17T12:27:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a69199700 1 -- 172.21.15.88:0/3113773881 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c003a20 con 0x7f0a6406ca40 2023-05-17T12:27:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a69199700 1 -- 172.21.15.88:0/3113773881 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54001670 con 0x7f0a6406ca40 2023-05-17T12:27:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/3113773881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6406ca40 msgr2=0x7f0a6406b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a6c3ff700 1 --2- 172.21.15.88:0/3113773881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6406ca40 0x7f0a6406b940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009dc0 tx=0x7f0a5c00b330 comp rx=0 tx=0).stop 2023-05-17T12:27:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/3113773881 shutdown_connections 2023-05-17T12:27:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a6c3ff700 1 --2- 172.21.15.88:0/3113773881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6406ca40 0x7f0a6406b940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/3113773881 >> 172.21.15.88:0/3113773881 conn(0x7f0a640d3060 msgr2=0x7f0a640d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:00.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.806+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/3113773881 shutdown_connections 2023-05-17T12:27:00.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.807+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/3113773881 wait complete. 2023-05-17T12:27:00.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.808+0000 7f0a6c3ff700 1 Processor -- start 2023-05-17T12:27:00.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.808+0000 7f0a6c3ff700 1 -- start start 2023-05-17T12:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.809+0000 7f0a6c3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a6406b0b0 0x7f0a64152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.809+0000 7f0a6c3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a6406ca40 0x7f0a641f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.809+0000 7f0a6c3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6415c840 0x7f0a641f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.809+0000 7f0a6c3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64153660 con 0x7f0a6406b0b0 2023-05-17T12:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.809+0000 7f0a6c3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64152a50 con 0x7f0a6406ca40 2023-05-17T12:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.809+0000 7f0a6c3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64152d30 con 0x7f0a6415c840 2023-05-17T12:27:00.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.809+0000 7f0a6a19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a6406b0b0 0x7f0a64152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.809+0000 7f0a6a19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a6406b0b0 0x7f0a64152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46314/0 (socket says 172.21.15.88:46314) 2023-05-17T12:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.809+0000 7f0a6a19b700 1 -- 172.21.15.88:0/609510644 learned_addr learned my addr 172.21.15.88:0/609510644 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a6a99c700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6415c840 0x7f0a641f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a6999a700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a6406ca40 0x7f0a641f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a6a19b700 1 -- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6415c840 msgr2=0x7f0a641f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a6a19b700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6415c840 0x7f0a641f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a6a19b700 1 -- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a6406ca40 msgr2=0x7f0a641f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a6a19b700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a6406ca40 0x7f0a641f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a6a19b700 1 -- 172.21.15.88:0/609510644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c009a70 con 0x7f0a6406b0b0 2023-05-17T12:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a6a19b700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a6406b0b0 0x7f0a64152060 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000c520 tx=0x7f0a6000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a5affd700 1 -- 172.21.15.88:0/609510644 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600052d0 con 0x7f0a6406b0b0 2023-05-17T12:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a5affd700 1 -- 172.21.15.88:0/609510644 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a60005430 con 0x7f0a6406b0b0 2023-05-17T12:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a640cdbe0 con 0x7f0a6406b0b0 2023-05-17T12:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.810+0000 7f0a5affd700 1 -- 172.21.15.88:0/609510644 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600038c0 con 0x7f0a6406b0b0 2023-05-17T12:27:00.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.811+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a640cd900 con 0x7f0a6406b0b0 2023-05-17T12:27:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.811+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6415cc10 con 0x7f0a6406b0b0 2023-05-17T12:27:00.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.812+0000 7f0a5affd700 1 -- 172.21.15.88:0/609510644 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a60003a20 con 0x7f0a6406b0b0 2023-05-17T12:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.813+0000 7f0a5affd700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0a4806ace0 0x7f0a4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.814+0000 7f0a5affd700 1 -- 172.21.15.88:0/609510644 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0a60088a50 con 0x7f0a6406b0b0 2023-05-17T12:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.814+0000 7f0a6999a700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0a4806ace0 0x7f0a4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:00.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.814+0000 7f0a6999a700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0a4806ace0 0x7f0a4806d190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0a64153d90 tx=0x7f0a54001670 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:00.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:00.818+0000 7f0a5affd700 1 -- 172.21.15.88:0/609510644 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0a600539b0 con 0x7f0a6406b0b0 2023-05-17T12:27:01.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.055+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a64153940 con 0x7f0a6406b0b0 2023-05-17T12:27:01.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.056+0000 7f0a5affd700 1 -- 172.21.15.88:0/609510644 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f0a60056fd0 con 0x7f0a6406b0b0 2023-05-17T12:27:01.060 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:27:01.060 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6836/907915818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":907915818},{"type":"v1","addr":"172.21.15.187:6836","nonce":907915818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5054,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3236077070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6835","nonce":3236077070},{"type":"v1","addr":"172.21.15.187:6837","nonce":3236077070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2500925233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":2500925233},{"type":"v1","addr":"172.21.15.88:6835","nonce":2500925233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-17T12:26:55.279357+0000","modified":"2023-05-17T12:26:58.296235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5392},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5392":{"gid":5392,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.88:6833/3964515495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3964515495},{"type":"v1","addr":"172.21.15.88:6833","nonce":3964515495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-17T12:27:01.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0a4806ace0 msgr2=0x7f0a4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0a4806ace0 0x7f0a4806d190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0a64153d90 tx=0x7f0a54001670 comp rx=0 tx=0).stop 2023-05-17T12:27:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a6406b0b0 msgr2=0x7f0a64152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a6406b0b0 0x7f0a64152060 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000c520 tx=0x7f0a6000c830 comp rx=0 tx=0).stop 2023-05-17T12:27:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 shutdown_connections 2023-05-17T12:27:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f0a4806ace0 0x7f0a4806d190 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a6415c840 0x7f0a641f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a6406b0b0 0x7f0a64152060 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 --2- 172.21.15.88:0/609510644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a6406ca40 0x7f0a641f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 >> 172.21.15.88:0/609510644 conn(0x7f0a640d3060 msgr2=0x7f0a640cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.058+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 shutdown_connections 2023-05-17T12:27:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.059+0000 7f0a6c3ff700 1 -- 172.21.15.88:0/609510644 wait complete. 2023-05-17T12:27:01.064 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 17 2023-05-17T12:27:01.481 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-17T12:26:55.279357+0000', 'modified': '2023-05-17T12:26:58.296235+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5392}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5392': {'gid': 5392, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.88:6833/3964515495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6832', 'nonce': 3964515495}, {'type': 'v1', 'addr': '172.21.15.88:6833', 'nonce': 3964515495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-17T12:27:01.482 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-17T12:27:01.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-17T12:27:01.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.664+0000 7fefa2dff700 1 Processor -- start 2023-05-17T12:27:01.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.664+0000 7fefa2dff700 1 -- start start 2023-05-17T12:27:01.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.665+0000 7fefa2dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef9c15ca90 0x7fef9c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.665+0000 7fefa2dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fef9c06cc20 0x7fef9c0d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.665+0000 7fefa2dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c161410 con 0x7fef9c160f90 2023-05-17T12:27:01.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.665+0000 7fefa2dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0cde90 con 0x7fef9c15ca90 2023-05-17T12:27:01.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.665+0000 7fefa2dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c15d270 con 0x7fef9c06cc20 2023-05-17T12:27:01.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fefa0b9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef9c15ca90 0x7fef9c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fef9bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fef9c160f90 0x7fef9c06c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34118/0 (socket says 172.21.15.88:34118) 2023-05-17T12:27:01.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fef9bfff700 1 -- 172.21.15.88:0/4122270546 learned_addr learned my addr 172.21.15.88:0/4122270546 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:27:01.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fefa139c700 1 --2- 172.21.15.88:0/4122270546 >> v2:172.21.15.187:3300/0 conn(0x7fef9c06cc20 0x7fef9c0d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fefa0b9b700 1 -- 172.21.15.88:0/4122270546 >> v2:172.21.15.187:3300/0 conn(0x7fef9c06cc20 msgr2=0x7fef9c0d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/4122270546 >> v2:172.21.15.187:3300/0 conn(0x7fef9c06cc20 0x7fef9c0d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fefa0b9b700 1 -- 172.21.15.88:0/4122270546 >> v1:172.21.15.88:6789/0 conn(0x7fef9c160f90 legacy=0x7fef9c06c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fefa0b9b700 1 -- 172.21.15.88:0/4122270546 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c15d550 con 0x7fef9c15ca90 2023-05-17T12:27:01.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fef9b7fe700 1 -- 172.21.15.88:0/4122270546 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349954516 0 0) 0x7fef9c161410 con 0x7fef9c160f90 2023-05-17T12:27:01.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.666+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/4122270546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c15ca90 0x7fef9c0cd800 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fef9c160450 tx=0x7fef90009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6749265b49c7597e server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fef9b7fe700 1 -- 172.21.15.88:0/4122270546 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90011830 con 0x7fef9c15ca90 2023-05-17T12:27:01.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fef9b7fe700 1 -- 172.21.15.88:0/4122270546 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef90011990 con 0x7fef9c15ca90 2023-05-17T12:27:01.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fef9b7fe700 1 -- 172.21.15.88:0/4122270546 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90011d20 con 0x7fef9c15ca90 2023-05-17T12:27:01.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fefa2dff700 1 -- 172.21.15.88:0/4122270546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c15ca90 msgr2=0x7fef9c0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fefa2dff700 1 --2- 172.21.15.88:0/4122270546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c15ca90 0x7fef9c0cd800 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fef9c160450 tx=0x7fef90009b20 comp rx=0 tx=0).stop 2023-05-17T12:27:01.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fefa2dff700 1 -- 172.21.15.88:0/4122270546 shutdown_connections 2023-05-17T12:27:01.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fefa2dff700 1 --2- 172.21.15.88:0/4122270546 >> v2:172.21.15.187:3300/0 conn(0x7fef9c06cc20 0x7fef9c0d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fefa2dff700 1 --2- 172.21.15.88:0/4122270546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c15ca90 0x7fef9c0cd800 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fefa2dff700 1 -- 172.21.15.88:0/4122270546 >> 172.21.15.88:0/4122270546 conn(0x7fef9c0d3ed0 msgr2=0x7fef9c0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:01.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fefa2dff700 1 -- 172.21.15.88:0/4122270546 shutdown_connections 2023-05-17T12:27:01.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.667+0000 7fefa2dff700 1 -- 172.21.15.88:0/4122270546 wait complete. 2023-05-17T12:27:01.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.669+0000 7fefa2dff700 1 Processor -- start 2023-05-17T12:27:01.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.669+0000 7fefa2dff700 1 -- start start 2023-05-17T12:27:01.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.670+0000 7fefa2dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef9c06cc20 0x7fef9c14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.670+0000 7fefa2dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef9c15ca90 0x7fef9c0aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.670+0000 7fefa2dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c160f90 0x7fef9c0b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.670+0000 7fefa2dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c15b860 con 0x7fef9c160f90 2023-05-17T12:27:01.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.670+0000 7fefa2dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c15bc80 con 0x7fef9c06cc20 2023-05-17T12:27:01.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.670+0000 7fefa2dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c15ac70 con 0x7fef9c15ca90 2023-05-17T12:27:01.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.670+0000 7fefa139c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c160f90 0x7fef9c0b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.670+0000 7fefa139c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c160f90 0x7fef9c0b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47636/0 (socket says 172.21.15.88:47636) 2023-05-17T12:27:01.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.670+0000 7fefa139c700 1 -- 172.21.15.88:0/3760986273 learned_addr learned my addr 172.21.15.88:0/3760986273 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:01.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef9c06cc20 0x7fef9c14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fef9bfff700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef9c15ca90 0x7fef9c0aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fefa139c700 1 -- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef9c15ca90 msgr2=0x7fef9c0aa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fefa139c700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef9c15ca90 0x7fef9c0aa2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fefa139c700 1 -- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef9c06cc20 msgr2=0x7fef9c14c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fefa139c700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef9c06cc20 0x7fef9c14c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fefa139c700 1 -- 172.21.15.88:0/3760986273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef900094a0 con 0x7fef9c160f90 2023-05-17T12:27:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef9c06cc20 0x7fef9c14c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:27:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fefa139c700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c160f90 0x7fef9c0b6a10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fef94007e60 tx=0x7fef9400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fef997fa700 1 -- 172.21.15.88:0/3760986273 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9400ee40 con 0x7fef9c160f90 2023-05-17T12:27:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fef997fa700 1 -- 172.21.15.88:0/3760986273 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94014420 con 0x7fef9c160f90 2023-05-17T12:27:01.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fef997fa700 1 -- 172.21.15.88:0/3760986273 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940147d0 con 0x7fef9c160f90 2023-05-17T12:27:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.671+0000 7fefa2dff700 1 -- 172.21.15.88:0/3760986273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c15dd50 con 0x7fef9c160f90 2023-05-17T12:27:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.672+0000 7fefa2dff700 1 -- 172.21.15.88:0/3760986273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c15d830 con 0x7fef9c160f90 2023-05-17T12:27:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.675+0000 7fef997fa700 1 -- 172.21.15.88:0/3760986273 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef94014930 con 0x7fef9c160f90 2023-05-17T12:27:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.676+0000 7fef997fa700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fef8006ace0 0x7fef8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.676+0000 7fef997fa700 1 -- 172.21.15.88:0/3760986273 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fef94089d40 con 0x7fef9c160f90 2023-05-17T12:27:01.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.676+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fef8006ace0 0x7fef8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.677+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fef8006ace0 0x7fef8006d190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fef900090b0 tx=0x7fef90008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.677+0000 7fefb67aab80 1 Processor -- start 2023-05-17T12:27:01.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.677+0000 7fefb67aab80 1 -- start start 2023-05-17T12:27:01.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.678+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 0x55f846be7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.678+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846be37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.678+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846b9af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.678+0000 7fefb67aab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f846b13a50 con 0x55f846bb6960 2023-05-17T12:27:01.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.678+0000 7fefb67aab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f846a89600 con 0x55f846be6f70 2023-05-17T12:27:01.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.678+0000 7fefb67aab80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f846af8790 con 0x55f846b9de80 2023-05-17T12:27:01.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef9bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846be37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef9bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846be37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47646/0 (socket says 172.21.15.88:47646) 2023-05-17T12:27:01.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef9bfff700 1 -- 172.21.15.88:0/329537044 learned_addr learned my addr 172.21.15.88:0/329537044 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:01.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/329537044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 0x55f846be7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fefa139c700 1 --2- 172.21.15.88:0/329537044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846b9af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef9bfff700 1 -- 172.21.15.88:0/329537044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 msgr2=0x55f846b9af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef9bfff700 1 --2- 172.21.15.88:0/329537044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846b9af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef9bfff700 1 -- 172.21.15.88:0/329537044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 msgr2=0x55f846be7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef9bfff700 1 --2- 172.21.15.88:0/329537044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 0x55f846be7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef9bfff700 1 -- 172.21.15.88:0/329537044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8468e5790 con 0x55f846bb6960 2023-05-17T12:27:01.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef9bfff700 1 --2- 172.21.15.88:0/329537044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846be37b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fef88005df0 tx=0x7fef88007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b966a3689d4cc2b8 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef867fc700 1 -- 172.21.15.88:0/329537044 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88014480 con 0x55f846bb6960 2023-05-17T12:27:01.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef867fc700 1 -- 172.21.15.88:0/329537044 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef880145e0 con 0x55f846bb6960 2023-05-17T12:27:01.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.679+0000 7fef867fc700 1 -- 172.21.15.88:0/329537044 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88014990 con 0x55f846bb6960 2023-05-17T12:27:01.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.680+0000 7fefb67aab80 1 -- 172.21.15.88:0/329537044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 msgr2=0x55f846be37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.680+0000 7fefb67aab80 1 --2- 172.21.15.88:0/329537044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846be37b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fef88005df0 tx=0x7fef88007330 comp rx=0 tx=0).stop 2023-05-17T12:27:01.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.680+0000 7fefb67aab80 1 -- 172.21.15.88:0/329537044 shutdown_connections 2023-05-17T12:27:01.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.680+0000 7fefb67aab80 1 --2- 172.21.15.88:0/329537044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846b9af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.680+0000 7fefb67aab80 1 --2- 172.21.15.88:0/329537044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 0x55f846be7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.680+0000 7fefb67aab80 1 --2- 172.21.15.88:0/329537044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846be37b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.680+0000 7fefb67aab80 1 -- 172.21.15.88:0/329537044 >> 172.21.15.88:0/329537044 conn(0x55f846b95480 msgr2=0x55f846be5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:01.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.680+0000 7fefb67aab80 1 -- 172.21.15.88:0/329537044 shutdown_connections 2023-05-17T12:27:01.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.680+0000 7fefb67aab80 1 -- 172.21.15.88:0/329537044 wait complete. 2023-05-17T12:27:01.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.681+0000 7fefb67aab80 1 -- start start 2023-05-17T12:27:01.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.681+0000 7fefb67aab80 1 Processor -- start 2023-05-17T12:27:01.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.682+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846bb6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.682+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846bb6960 0x55f846be2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.682+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846be6f70 0x55f846be3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.682+0000 7fefb67aab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f846af1a60 con 0x55f846be6f70 2023-05-17T12:27:01.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.682+0000 7fefb67aab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f846a8dad0 con 0x55f846bb6960 2023-05-17T12:27:01.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.682+0000 7fefb67aab80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f846a8d770 con 0x55f846b9de80 2023-05-17T12:27:01.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.682+0000 7fefb67aab80 10 client.0 _ll_register_callbacks cb 0x55f846ae9a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T12:27:01.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.682+0000 7fefa139c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846be6f70 0x55f846be3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefa139c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846be6f70 0x55f846be3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47660/0 (socket says 172.21.15.88:47660) 2023-05-17T12:27:01.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefa139c700 1 -- 172.21.15.88:0/1660406255 learned_addr learned my addr 172.21.15.88:0/1660406255 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:01.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846bb6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fef9bfff700 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846bb6960 0x55f846be2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefa139c700 1 -- 172.21.15.88:0/1660406255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 msgr2=0x55f846bb6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefa139c700 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846bb6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefa139c700 1 -- 172.21.15.88:0/1660406255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846bb6960 msgr2=0x55f846be2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefa139c700 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846bb6960 0x55f846be2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefa139c700 1 -- 172.21.15.88:0/1660406255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8800f040 con 0x55f846be6f70 2023-05-17T12:27:01.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fef9bfff700 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846bb6960 0x55f846be2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:27:01.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefa139c700 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846be6f70 0x55f846be3770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fef9400e7c0 tx=0x7fef94060d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb76716dcc5f653 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fef7b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-05-17T12:27:01.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fef7b7fe700 1 -- 172.21.15.88:0/1660406255 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94060820 con 0x55f846be6f70 2023-05-17T12:27:01.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fef7b7fe700 1 -- 172.21.15.88:0/1660406255 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fef94060980 con 0x55f846be6f70 2023-05-17T12:27:01.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefb67aab80 1 -- 172.21.15.88:0/1660406255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f846b92a90 con 0x55f846be6f70 2023-05-17T12:27:01.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fef7b7fe700 1 -- 172.21.15.88:0/1660406255 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef9405cb80 con 0x55f846be6f70 2023-05-17T12:27:01.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefb67aab80 10 client.5838 fetch_fsmap learned FSMap version 17 2023-05-17T12:27:01.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.683+0000 7fefb67aab80 1 -- 172.21.15.88:0/1660406255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f846ab82e0 con 0x55f846be6f70 2023-05-17T12:27:01.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.684+0000 7fef7b7fe700 1 -- 172.21.15.88:0/1660406255 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f846b92a90 con 0x55f846be6f70 2023-05-17T12:27:01.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.684+0000 7fef7b7fe700 1 -- 172.21.15.88:0/1660406255 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fef9405cce0 con 0x55f846be6f70 2023-05-17T12:27:01.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.684+0000 7fefb67aab80 10 client.5838 fetch_fsmap finished waiting for FSMap version 17 2023-05-17T12:27:01.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.684+0000 7fefb67aab80 10 client.5838 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-17T12:27:01.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.684+0000 7fefb67aab80 20 client.5838 populate_metadata read hostname 'smithi088' 2023-05-17T12:27:01.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.684+0000 7fefb67aab80 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] conn(0x55f846bf7850 0x55f846bf7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.684+0000 7fefb67aab80 4 client.5838 mds_command: new command op to 5392 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-17T12:27:01.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.684+0000 7fefb67aab80 1 -- 172.21.15.88:0/1660406255 --> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f846b6f4b0 con 0x55f846bf7850 2023-05-17T12:27:01.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.684+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] conn(0x55f846bf7850 0x55f846bf7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.685+0000 7fef7b7fe700 10 client.5838 ms_handle_connect on v2:172.21.15.88:6832/3964515495 2023-05-17T12:27:01.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.685+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] conn(0x55f846bf7850 0x55f846bf7c20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=501a15bf00ac5ef9 server_cookie=38a150806ad3c408 in_seq=0 out_seq=0 2023-05-17T12:27:01.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.685+0000 7fef7b7fe700 1 -- 172.21.15.88:0/1660406255 <== mds.0 v2:172.21.15.88:6832/3964515495 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f846b6f4b0 con 0x55f846bf7850 2023-05-17T12:27:01.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.685+0000 7fef7b7fe700 10 client.5838 handle_command_reply: tid=0 2023-05-17T12:27:01.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.685+0000 7fefb67aab80 1 client.5838 shutdown 2023-05-17T12:27:01.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 -- 172.21.15.88:0/1660406255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846be6f70 msgr2=0x55f846be3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846be6f70 0x55f846be3770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fef9400e7c0 tx=0x7fef94060d30 comp rx=0 tx=0).stop 2023-05-17T12:27:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 -- 172.21.15.88:0/1660406255 shutdown_connections 2023-05-17T12:27:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] conn(0x55f846bf7850 0x55f846bf7c20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846be6f70 0x55f846be3770 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846bb6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fef7b7fe700 0 client.5838 ms_handle_reset on v2:172.21.15.88:6832/3964515495 2023-05-17T12:27:01.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 --2- 172.21.15.88:0/1660406255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846bb6960 0x55f846be2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 -- 172.21.15.88:0/1660406255 >> 172.21.15.88:0/1660406255 conn(0x55f846b95480 msgr2=0x55f846be7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 -- 172.21.15.88:0/1660406255 shutdown_connections 2023-05-17T12:27:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 1 -- 172.21.15.88:0/1660406255 wait complete. 2023-05-17T12:27:01.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.686+0000 7fefb67aab80 20 client.5838 trim_cache size 0 max 16384 2023-05-17T12:27:01.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.703+0000 7fefb67aab80 1 Processor -- start 2023-05-17T12:27:01.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.704+0000 7fefb67aab80 1 -- start start 2023-05-17T12:27:01.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.704+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846b9de80 0x55f846b9c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.704+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846b9ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.704+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846be6f70 0x55f846bdb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.704+0000 7fefb67aab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8468e6390 con 0x55f846bb6960 2023-05-17T12:27:01.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.704+0000 7fefb67aab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f846bcb320 con 0x55f846b9de80 2023-05-17T12:27:01.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.704+0000 7fefb67aab80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f846bdc4b0 con 0x55f846be6f70 2023-05-17T12:27:01.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef9bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846b9ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef9bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846b9ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47662/0 (socket says 172.21.15.88:47662) 2023-05-17T12:27:01.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef9bfff700 1 -- 172.21.15.88:0/2146398018 learned_addr learned my addr 172.21.15.88:0/2146398018 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:01.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/2146398018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846b9de80 0x55f846b9c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fefa139c700 1 --2- 172.21.15.88:0/2146398018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846be6f70 0x55f846bdb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef9bfff700 1 -- 172.21.15.88:0/2146398018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846be6f70 msgr2=0x55f846bdb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef9bfff700 1 --2- 172.21.15.88:0/2146398018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846be6f70 0x55f846bdb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef9bfff700 1 -- 172.21.15.88:0/2146398018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846b9de80 msgr2=0x55f846b9c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef9bfff700 1 --2- 172.21.15.88:0/2146398018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846b9de80 0x55f846b9c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef9bfff700 1 -- 172.21.15.88:0/2146398018 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f846ab8030 con 0x55f846bb6960 2023-05-17T12:27:01.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef9bfff700 1 --2- 172.21.15.88:0/2146398018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846b9ce00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fef88000f60 tx=0x7fef88011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a880e0972830eaae server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.705+0000 7fef86ffd700 1 -- 172.21.15.88:0/2146398018 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88014480 con 0x55f846bb6960 2023-05-17T12:27:01.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fef86ffd700 1 -- 172.21.15.88:0/2146398018 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8800b040 con 0x55f846bb6960 2023-05-17T12:27:01.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fef86ffd700 1 -- 172.21.15.88:0/2146398018 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88004ab0 con 0x55f846bb6960 2023-05-17T12:27:01.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fefb67aab80 1 -- 172.21.15.88:0/2146398018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 msgr2=0x55f846b9ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fefb67aab80 1 --2- 172.21.15.88:0/2146398018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846b9ce00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fef88000f60 tx=0x7fef88011000 comp rx=0 tx=0).stop 2023-05-17T12:27:01.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fefb67aab80 1 -- 172.21.15.88:0/2146398018 shutdown_connections 2023-05-17T12:27:01.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fefb67aab80 1 --2- 172.21.15.88:0/2146398018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846be6f70 0x55f846bdb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fefb67aab80 1 --2- 172.21.15.88:0/2146398018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846b9de80 0x55f846b9c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fefb67aab80 1 --2- 172.21.15.88:0/2146398018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846b9ce00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fefb67aab80 1 -- 172.21.15.88:0/2146398018 >> 172.21.15.88:0/2146398018 conn(0x55f846b95480 msgr2=0x55f846b969f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:01.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fefb67aab80 1 -- 172.21.15.88:0/2146398018 shutdown_connections 2023-05-17T12:27:01.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.706+0000 7fefb67aab80 1 -- 172.21.15.88:0/2146398018 wait complete. 2023-05-17T12:27:01.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.707+0000 7fefb67aab80 1 -- start start 2023-05-17T12:27:01.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.707+0000 7fefb67aab80 1 Processor -- start 2023-05-17T12:27:01.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846c469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846ba0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fefb67aab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 0x55f846ba0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fefb67aab80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f846b9b850 con 0x55f846bb6960 2023-05-17T12:27:01.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fefb67aab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f846bf40b0 con 0x55f846be6f70 2023-05-17T12:27:01.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fefb67aab80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f846b9bd40 con 0x55f846b9de80 2023-05-17T12:27:01.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fefb67aab80 10 client.0 _ll_register_callbacks cb 0x7fef9405c920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-17T12:27:01.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fef9bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846ba0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fef9bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846ba0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47670/0 (socket says 172.21.15.88:47670) 2023-05-17T12:27:01.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fef9bfff700 1 -- 172.21.15.88:0/3613903096 learned_addr learned my addr 172.21.15.88:0/3613903096 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:01.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846c469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.708+0000 7fefa139c700 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 0x55f846ba0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef9bfff700 1 -- 172.21.15.88:0/3613903096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 msgr2=0x55f846c469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef9bfff700 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846c469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef9bfff700 1 -- 172.21.15.88:0/3613903096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 msgr2=0x55f846ba0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef9bfff700 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 0x55f846ba0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef9bfff700 1 -- 172.21.15.88:0/3613903096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8468e5790 con 0x55f846bb6960 2023-05-17T12:27:01.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef9bfff700 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846ba0640 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fef88013000 tx=0x7fef88000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e78d11105772 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef7b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-05-17T12:27:01.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef7b7fe700 1 -- 172.21.15.88:0/3613903096 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88014480 con 0x55f846bb6960 2023-05-17T12:27:01.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef7b7fe700 1 -- 172.21.15.88:0/3613903096 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fef88014d10 con 0x55f846bb6960 2023-05-17T12:27:01.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fefb67aab80 1 -- 172.21.15.88:0/3613903096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef880145e0 con 0x55f846bb6960 2023-05-17T12:27:01.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fef7b7fe700 1 -- 172.21.15.88:0/3613903096 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef88004870 con 0x55f846bb6960 2023-05-17T12:27:01.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fefb67aab80 10 client.5844 fetch_fsmap learned FSMap version 17 2023-05-17T12:27:01.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.709+0000 7fefb67aab80 1 -- 172.21.15.88:0/3613903096 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f846a9eb10 con 0x55f846bb6960 2023-05-17T12:27:01.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fef7b7fe700 1 -- 172.21.15.88:0/3613903096 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef880145e0 con 0x55f846bb6960 2023-05-17T12:27:01.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fef7b7fe700 1 -- 172.21.15.88:0/3613903096 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fef880049d0 con 0x55f846bb6960 2023-05-17T12:27:01.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fefb67aab80 10 client.5844 fetch_fsmap finished waiting for FSMap version 17 2023-05-17T12:27:01.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fefb67aab80 10 client.5844 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-17T12:27:01.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fefb67aab80 20 client.5844 populate_metadata read hostname 'smithi088' 2023-05-17T12:27:01.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fefb67aab80 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] conn(0x55f846c4c8a0 0x55f846c4cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fefb67aab80 4 client.5844 mds_command: new command op to 5392 tid=0[{"prefix": "status"}] 2023-05-17T12:27:01.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fefb67aab80 1 -- 172.21.15.88:0/3613903096 --> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f846aeaba0 con 0x55f846c4c8a0 2023-05-17T12:27:01.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] conn(0x55f846c4c8a0 0x55f846c4cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fef7b7fe700 10 client.5844 ms_handle_connect on v2:172.21.15.88:6832/3964515495 2023-05-17T12:27:01.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.710+0000 7fefa0b9b700 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] conn(0x55f846c4c8a0 0x55f846c4cc70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faf757a51d5cd9e8 server_cookie=2a30ff3fc4c7f56e in_seq=0 out_seq=0 2023-05-17T12:27:01.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fef7b7fe700 1 -- 172.21.15.88:0/3613903096 <== mds.0 v2:172.21.15.88:6832/3964515495 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f846aeaba0 con 0x55f846c4c8a0 2023-05-17T12:27:01.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fef7b7fe700 10 client.5844 handle_command_reply: tid=0 2023-05-17T12:27:01.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 client.5844 shutdown 2023-05-17T12:27:01.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 -- 172.21.15.88:0/3613903096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 msgr2=0x55f846ba0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846ba0640 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fef88013000 tx=0x7fef88000ed0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 -- 172.21.15.88:0/3613903096 shutdown_connections 2023-05-17T12:27:01.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.88:6832/3964515495,v1:172.21.15.88:6833/3964515495] conn(0x55f846c4c8a0 0x55f846c4cc70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f846be6f70 0x55f846ba0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55f846b9de80 0x55f846c469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fef7b7fe700 0 client.5844 ms_handle_reset on v2:172.21.15.88:6832/3964515495 2023-05-17T12:27:01.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 --2- 172.21.15.88:0/3613903096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55f846bb6960 0x55f846ba0640 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 -- 172.21.15.88:0/3613903096 >> 172.21.15.88:0/3613903096 conn(0x55f846b95480 msgr2=0x55f846b9c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:01.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 -- 172.21.15.88:0/3613903096 shutdown_connections 2023-05-17T12:27:01.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 1 -- 172.21.15.88:0/3613903096 wait complete. 2023-05-17T12:27:01.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.711+0000 7fefb67aab80 20 client.5844 trim_cache size 0 max 16384 2023-05-17T12:27:01.725 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-05-17T12:27:01.725 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "5fe2c233-5aa8-47bb-8675-a47cef3664c7", 2023-05-17T12:27:01.726 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-05-17T12:27:01.726 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 5392, 2023-05-17T12:27:01.726 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-05-17T12:27:01.726 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-05-17T12:27:01.726 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-05-17T12:27:01.726 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 6.4297025320000003, 2023-05-17T12:27:01.726 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 17, 2023-05-17T12:27:01.726 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 42, 2023-05-17T12:27:01.727 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 42, 2023-05-17T12:27:01.727 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 14.711397879 2023-05-17T12:27:01.727 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-05-17T12:27:01.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 -- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fef8006ace0 msgr2=0x7fef8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fef8006ace0 0x7fef8006d190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fef900090b0 tx=0x7fef90008030 comp rx=0 tx=0).stop 2023-05-17T12:27:01.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 -- 172.21.15.88:0/3760986273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c160f90 msgr2=0x7fef9c0b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c160f90 0x7fef9c0b6a10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fef94007e60 tx=0x7fef9400e3c0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 -- 172.21.15.88:0/3760986273 shutdown_connections 2023-05-17T12:27:01.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7fef8006ace0 0x7fef8006d190 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef9c160f90 0x7fef9c0b6a10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef9c06cc20 0x7fef9c14c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 --2- 172.21.15.88:0/3760986273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fef9c15ca90 0x7fef9c0aa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 -- 172.21.15.88:0/3760986273 >> 172.21.15.88:0/3760986273 conn(0x7fef9c0d3ed0 msgr2=0x7fef9c0b87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:01.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 -- 172.21.15.88:0/3760986273 shutdown_connections 2023-05-17T12:27:01.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.712+0000 7fefa2dff700 1 -- 172.21.15.88:0/3760986273 wait complete. 2023-05-17T12:27:01.732 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-17T12:27:01.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.915+0000 7f8126fff700 1 Processor -- start 2023-05-17T12:27:01.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.915+0000 7f8126fff700 1 -- start start 2023-05-17T12:27:01.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.917+0000 7f8126fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f812015c840 0x7f812006b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.917+0000 7f8126fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006b0b0 0x7f81200cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.917+0000 7f8126fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81200cd6b0 con 0x7f812006c330 2023-05-17T12:27:01.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.917+0000 7f8126fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81200cdf50 con 0x7f812015c840 2023-05-17T12:27:01.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.917+0000 7f8126fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200cf860 con 0x7f812006b0b0 2023-05-17T12:27:01.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f8124d9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f812015c840 0x7f812006b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f812559c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f812006c330 0x7f8120160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:43530/0 (socket says 172.21.15.88:43530) 2023-05-17T12:27:01.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f812559c700 1 -- 172.21.15.88:0/1156869774 learned_addr learned my addr 172.21.15.88:0/1156869774 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:27:01.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f811ffff700 1 --2- 172.21.15.88:0/1156869774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006b0b0 0x7f81200cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f8124d9b700 1 -- 172.21.15.88:0/1156869774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006b0b0 msgr2=0x7f81200cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:01.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f8124d9b700 1 --2- 172.21.15.88:0/1156869774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006b0b0 0x7f81200cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f8124d9b700 1 -- 172.21.15.88:0/1156869774 >> v1:172.21.15.187:6789/0 conn(0x7f812006c330 legacy=0x7f8120160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f8124d9b700 1 -- 172.21.15.88:0/1156869774 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200b2460 con 0x7f812015c840 2023-05-17T12:27:01.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f811ffff700 1 --2- 172.21.15.88:0/1156869774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006b0b0 0x7f81200cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-17T12:27:01.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f811f7fe700 1 -- 172.21.15.88:0/1156869774 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940660760 0 0) 0x7f81200cd6b0 con 0x7f812006c330 2023-05-17T12:27:01.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.918+0000 7f8124d9b700 1 --2- 172.21.15.88:0/1156869774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f812015c840 0x7f812006b940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8114009840 tx=0x7f8114009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a8c608a61fc1a9a server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f811f7fe700 1 -- 172.21.15.88:0/1156869774 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114011830 con 0x7f812015c840 2023-05-17T12:27:01.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f811f7fe700 1 -- 172.21.15.88:0/1156869774 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114011990 con 0x7f812015c840 2023-05-17T12:27:01.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f811f7fe700 1 -- 172.21.15.88:0/1156869774 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114011d20 con 0x7f812015c840 2023-05-17T12:27:01.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f8126fff700 1 -- 172.21.15.88:0/1156869774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f812015c840 msgr2=0x7f812006b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f8126fff700 1 --2- 172.21.15.88:0/1156869774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f812015c840 0x7f812006b940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8114009840 tx=0x7f8114009b50 comp rx=0 tx=0).stop 2023-05-17T12:27:01.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f8126fff700 1 -- 172.21.15.88:0/1156869774 shutdown_connections 2023-05-17T12:27:01.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f8126fff700 1 --2- 172.21.15.88:0/1156869774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f812015c840 0x7f812006b940 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f8126fff700 1 --2- 172.21.15.88:0/1156869774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006b0b0 0x7f81200cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f8126fff700 1 -- 172.21.15.88:0/1156869774 >> 172.21.15.88:0/1156869774 conn(0x7f81200d3060 msgr2=0x7f81200d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f8126fff700 1 -- 172.21.15.88:0/1156869774 shutdown_connections 2023-05-17T12:27:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.919+0000 7f8126fff700 1 -- 172.21.15.88:0/1156869774 wait complete. 2023-05-17T12:27:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.921+0000 7f8126fff700 1 Processor -- start 2023-05-17T12:27:01.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.921+0000 7f8126fff700 1 -- start start 2023-05-17T12:27:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.922+0000 7f8126fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812006b0b0 0x7f8120157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.922+0000 7f8126fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006c330 0x7f81200b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.922+0000 7f8126fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f812015c840 0x7f81201f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.922+0000 7f8126fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81201f6450 con 0x7f812006b0b0 2023-05-17T12:27:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.922+0000 7f8126fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812015e200 con 0x7f812015c840 2023-05-17T12:27:01.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.922+0000 7f8126fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8120157b80 con 0x7f812006c330 2023-05-17T12:27:01.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.922+0000 7f8124d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812006b0b0 0x7f8120157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f8124d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812006b0b0 0x7f8120157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47676/0 (socket says 172.21.15.88:47676) 2023-05-17T12:27:01.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f8124d9b700 1 -- 172.21.15.88:0/4014387119 learned_addr learned my addr 172.21.15.88:0/4014387119 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:01.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f811ffff700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006c330 0x7f81200b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f812559c700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f812015c840 0x7f81201f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f8124d9b700 1 -- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006c330 msgr2=0x7f81200b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f8124d9b700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006c330 0x7f81200b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f8124d9b700 1 -- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f812015c840 msgr2=0x7f81201f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f8124d9b700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f812015c840 0x7f81201f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f8124d9b700 1 -- 172.21.15.88:0/4014387119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c0094a0 con 0x7f812006b0b0 2023-05-17T12:27:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f8124d9b700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812006b0b0 0x7f8120157640 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8114009fd0 tx=0x7f8114004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f811d7fa700 1 -- 172.21.15.88:0/4014387119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140036a0 con 0x7f812006b0b0 2023-05-17T12:27:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f811d7fa700 1 -- 172.21.15.88:0/4014387119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811401e070 con 0x7f812006b0b0 2023-05-17T12:27:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.923+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81140094a0 con 0x7f812006b0b0 2023-05-17T12:27:01.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.924+0000 7f811d7fa700 1 -- 172.21.15.88:0/4014387119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114003a40 con 0x7f812006b0b0 2023-05-17T12:27:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.924+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81200cd900 con 0x7f812006b0b0 2023-05-17T12:27:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.925+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81200b2740 con 0x7f812006b0b0 2023-05-17T12:27:01.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.925+0000 7f811d7fa700 1 -- 172.21.15.88:0/4014387119 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8114003ba0 con 0x7f812006b0b0 2023-05-17T12:27:01.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.927+0000 7f811d7fa700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f810406ace0 0x7f810406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:01.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.927+0000 7f811d7fa700 1 -- 172.21.15.88:0/4014387119 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f811408a5b0 con 0x7f812006b0b0 2023-05-17T12:27:01.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.928+0000 7f811ffff700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f810406ace0 0x7f810406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:01.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.928+0000 7f811ffff700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f810406ace0 0x7f810406d190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d70 tx=0x7f810c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:01.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:01.931+0000 7f811d7fa700 1 -- 172.21.15.88:0/4014387119 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f81140555b0 con 0x7f812006b0b0 2023-05-17T12:27:02.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.166+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81200cdbe0 con 0x7f812006b0b0 2023-05-17T12:27:02.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.166+0000 7f811d7fa700 1 -- 172.21.15.88:0/4014387119 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8114058bd0 con 0x7f812006b0b0 2023-05-17T12:27:02.170 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-17T12:27:02.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.168+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f810406ace0 msgr2=0x7f810406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.168+0000 7f8126fff700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f810406ace0 0x7f810406d190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d70 tx=0x7f810c009210 comp rx=0 tx=0).stop 2023-05-17T12:27:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.168+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812006b0b0 msgr2=0x7f8120157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.168+0000 7f8126fff700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812006b0b0 0x7f8120157640 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8114009fd0 tx=0x7f8114004750 comp rx=0 tx=0).stop 2023-05-17T12:27:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.169+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 shutdown_connections 2023-05-17T12:27:02.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.169+0000 7f8126fff700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f810406ace0 0x7f810406d190 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:02.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.169+0000 7f8126fff700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f812015c840 0x7f81201f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:02.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.169+0000 7f8126fff700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f812006b0b0 0x7f8120157640 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:02.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.169+0000 7f8126fff700 1 --2- 172.21.15.88:0/4014387119 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f812006c330 0x7f81200b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:02.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.169+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 >> 172.21.15.88:0/4014387119 conn(0x7f81200d3060 msgr2=0x7f81200cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:02.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.169+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 shutdown_connections 2023-05-17T12:27:02.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:02.169+0000 7f8126fff700 1 -- 172.21.15.88:0/4014387119 wait complete. 2023-05-17T12:27:02.189 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-17T12:27:02.190 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-17T12:27:02.190 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-05-17T12:27:02.190 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-17T12:27:02.190 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-17T12:27:02.191 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-17T12:27:02.191 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-17T12:27:02.191 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-17T12:27:02.192 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T12:27:02.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:02.192 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-05-17T12:27:02.235 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-17T12:27:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-17T12:27:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-05-17T12:27:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:27:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-05-17T12:27:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:27:02.236 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:27:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:27:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-05-17T12:27:02.237 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:27:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-05-17T12:27:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-05-17T12:27:02.237 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-17T12:27:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-05-17T12:27:02.238 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-17T12:27:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-05-17T12:27:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-17T12:27:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42068sec preferred_lft 42068sec 2023-05-17T12:27:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-05-17T12:27:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:27:02.238 INFO:teuthology.orchestra.run.smithi088.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-17T12:27:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 2e:41:a6:3f:56:eb brd ff:ff:ff:ff:ff:ff 2023-05-17T12:27:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-17T12:27:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:27:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::cc3f:4cff:fe8d:24eb/64 scope link 2023-05-17T12:27:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:27:02.239 INFO:teuthology.orchestra.run.smithi088.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T12:27:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 2e:41:a6:3f:56:eb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-17T12:27:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::2c41:a6ff:fe3f:56eb/64 scope link 2023-05-17T12:27:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:27:02.240 INFO:teuthology.orchestra.run.smithi088.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-17T12:27:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 62:5c:79:20:af:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-17T12:27:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::605c:79ff:fe20:af5a/64 scope link 2023-05-17T12:27:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-05-17T12:27:02.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:02.241 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-17T12:27:02.336 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-05-17T12:27:02.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:02.340 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-05-17T12:27:02.384 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-05-17T12:27:02.384 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-17T12:27:02.385 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-17T12:27:02.385 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-17T12:27:02.385 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-17T12:27:02.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:02.386 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-05-17T12:27:02.386 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-05-17T12:27:02.387 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-17T12:27:02.387 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-17T12:27:02.388 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-17T12:27:02.388 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-05-17T12:27:02.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:02.576 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-05-17T12:27:02.618 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-17T12:27:02.618 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-17T12:27:02.618 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-17T12:27:02.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:02.619 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-05-17T12:27:02.722 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-17T12:27:02.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:27:02.723 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-17T12:27:02.764 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-17T12:27:02.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-17T12:27:02.765 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-17T12:27:02.846 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-05-17T12:27:02.949 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:27:02.950 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:27:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:27:03.013 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:27:03.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:03.014 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-05-17T12:27:03.055 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-17T12:27:03.056 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-17T12:27:03.099 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-05-17T12:27:03.164 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-17T12:27:03.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-17T12:27:03.226 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-17T12:27:03.228 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-17T12:27:03.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:03.229 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-05-17T12:27:03.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2023-05-17T12:27:03.252+0000 7f50f0a775c0 -1 init, newargv = 0x564a2b879220 newargc=15 2023-05-17T12:27:03.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[153279]: starting ceph client 2023-05-17T12:27:03.264 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[153279]: starting fuse 2023-05-17T12:27:03.275 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-05-17T12:27:03.276 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-05-17T12:27:03.276 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-17T12:27:03.277 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-05-17T12:27:03.277 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-05-17T12:27:03.277 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-05-17T12:27:03.277 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-05-17T12:27:03.278 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:27:03.278 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-05-17T12:27:03.278 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-17T12:27:03.279 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-05-17T12:27:03.279 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-17T12:27:03.279 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:27:03.280 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-05-17T12:27:03.280 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-05-17T12:27:03.280 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-05-17T12:27:03.280 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-05-17T12:27:03.281 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:27:03.281 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-05-17T12:27:03.281 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-17T12:27:03.282 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-17T12:27:03.282 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-17T12:27:03.282 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-05-17T12:27:03.283 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-05-17T12:27:03.283 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-05-17T12:27:03.283 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-17T12:27:03.283 DEBUG:teuthology.orchestra.run.smithi088:> 2023-05-17T12:27:03.284 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.0")) 2023-05-17T12:27:03.284 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-05-17T12:27:03.450 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.153279.asok 2023-05-17T12:27:03.629 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.153279.asok 2023-05-17T12:27:03.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:03.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.153279.asok status 2023-05-17T12:27:03.844 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-05-17T12:27:03.845 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-05-17T12:27:03.845 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb", 2023-05-17T12:27:03.845 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev)", 2023-05-17T12:27:03.845 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2023-05-17T12:27:03.845 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-05-17T12:27:03.846 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-17T12:27:03.846 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "153279", 2023-05-17T12:27:03.846 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-05-17T12:27:03.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:27:03.846 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-05-17T12:27:03.846 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-05-17T12:27:03.846 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 5850, 2023-05-17T12:27:03.847 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-05-17T12:27:03.847 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-05-17T12:27:03.847 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-05-17T12:27:03.847 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5850 2023-05-17T12:27:03.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:27:03.848 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-05-17T12:27:03.848 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-05-17T12:27:03.848 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-05-17T12:27:03.848 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 3985700601 2023-05-17T12:27:03.848 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-05-17T12:27:03.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:27:03.848 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-05-17T12:27:03.849 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-05-17T12:27:03.849 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-05-17T12:27:03.849 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 3985700601 2023-05-17T12:27:03.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-05-17T12:27:03.849 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.5850 192.168.0.1:0/3985700601", 2023-05-17T12:27:03.849 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/3985700601", 2023-05-17T12:27:03.849 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-05-17T12:27:03.849 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 17, 2023-05-17T12:27:03.850 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 42, 2023-05-17T12:27:03.850 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-05-17T12:27:03.850 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-05-17T12:27:03.850 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-05-17T12:27:03.850 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-05-17T12:27:03.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:03.858 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-05-17T12:27:03.858 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-17T12:27:03.900 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-05-17T12:27:03.900 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-17T12:27:03.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:03.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-17T12:27:04.003 DEBUG:teuthology.orchestra.run.smithi088:> mktemp -d --suffix=xfstests-dev 2023-05-17T12:27:04.044 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.buK0S8bWYQxfstests-dev 2023-05-17T12:27:04.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:04.045 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.buK0S8bWYQxfstests-dev) 2023-05-17T12:27:04.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:04.149 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.buK0S8bWYQxfstests-dev) 2023-05-17T12:27:04.196 INFO:teuthology.orchestra.run.smithi088.stderr:Cloning into '/tmp/tmp.buK0S8bWYQxfstests-dev'... 2023-05-17T12:27:05.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:05.030 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-05-17T12:27:05.079 DEBUG:teuthology.orchestra.run.smithi088:> mktemp -d --suffix=test 2023-05-17T12:27:05.120 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.3n61ha2sIstest 2023-05-17T12:27:05.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:27:05.121 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-05-17T12:27:05.205 DEBUG:teuthology.orchestra.run.smithi088:> mktemp -d --suffix=scratch 2023-05-17T12:27:05.285 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.phQfFMpS6rscratch 2023-05-17T12:27:05.286 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-05-17T12:27:05.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-05-17T12:27:06.248 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:05:23 ago on Wed 17 May 2023 12:21:43 PM UTC. 2023-05-17T12:27:07.247 INFO:teuthology.orchestra.run.smithi088.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-05-17T12:27:07.248 INFO:teuthology.orchestra.run.smithi088.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-05-17T12:27:07.249 INFO:teuthology.orchestra.run.smithi088.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-05-17T12:27:07.250 INFO:teuthology.orchestra.run.smithi088.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-05-17T12:27:07.251 INFO:teuthology.orchestra.run.smithi088.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-05-17T12:27:07.252 INFO:teuthology.orchestra.run.smithi088.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-05-17T12:27:07.254 INFO:teuthology.orchestra.run.smithi088.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-05-17T12:27:07.255 INFO:teuthology.orchestra.run.smithi088.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-05-17T12:27:07.257 INFO:teuthology.orchestra.run.smithi088.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-05-17T12:27:07.258 INFO:teuthology.orchestra.run.smithi088.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-05-17T12:27:07.259 INFO:teuthology.orchestra.run.smithi088.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-05-17T12:27:07.260 INFO:teuthology.orchestra.run.smithi088.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-05-17T12:27:07.261 INFO:teuthology.orchestra.run.smithi088.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-05-17T12:27:07.262 INFO:teuthology.orchestra.run.smithi088.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-05-17T12:27:07.263 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-17T12:27:07.264 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-17T12:27:07.265 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-17T12:27:07.266 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-17T12:27:07.267 INFO:teuthology.orchestra.run.smithi088.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-05-17T12:27:07.267 INFO:teuthology.orchestra.run.smithi088.stdout:Package libuuid-devel-2.32.1-41.el8.x86_64 is already installed. 2023-05-17T12:27:07.268 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-05-17T12:27:07.270 INFO:teuthology.orchestra.run.smithi088.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-05-17T12:27:07.274 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-17T12:27:07.422 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-05-17T12:27:07.424 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2023-05-17T12:27:07.424 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-05-17T12:27:07.424 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2023-05-17T12:27:07.424 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-05-17T12:27:07.425 INFO:teuthology.orchestra.run.smithi088.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-05-17T12:27:07.425 INFO:teuthology.orchestra.run.smithi088.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-05-17T12:27:07.425 INFO:teuthology.orchestra.run.smithi088.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-05-17T12:27:07.425 INFO:teuthology.orchestra.run.smithi088.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-05-17T12:27:07.425 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-05-17T12:27:07.425 INFO:teuthology.orchestra.run.smithi088.stdout: daxctl-libs x86_64 71.1-4.el8 baseos 42 k 2023-05-17T12:27:07.425 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-05-17T12:27:07.426 INFO:teuthology.orchestra.run.smithi088.stdout: ndctl-libs x86_64 71.1-4.el8 baseos 80 k 2023-05-17T12:27:07.426 INFO:teuthology.orchestra.run.smithi088.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-05-17T12:27:07.426 INFO:teuthology.orchestra.run.smithi088.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-05-17T12:27:07.426 INFO:teuthology.orchestra.run.smithi088.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-05-17T12:27:07.426 INFO:teuthology.orchestra.run.smithi088.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-05-17T12:27:07.426 INFO:teuthology.orchestra.run.smithi088.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-05-17T12:27:07.426 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2023-05-17T12:27:07.426 INFO:teuthology.orchestra.run.smithi088.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-05-17T12:27:07.427 INFO:teuthology.orchestra.run.smithi088.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-05-17T12:27:07.427 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling module streams: 2023-05-17T12:27:07.427 INFO:teuthology.orchestra.run.smithi088.stdout: python27 2.7 2023-05-17T12:27:07.427 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:27:07.427 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-05-17T12:27:07.427 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2023-05-17T12:27:07.427 INFO:teuthology.orchestra.run.smithi088.stdout:Install 14 Packages 2023-05-17T12:27:07.427 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:27:07.428 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 11 M 2023-05-17T12:27:07.428 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 40 M 2023-05-17T12:27:07.428 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-05-17T12:27:15.339 INFO:teuthology.orchestra.run.smithi088.stdout:(1/14): libpmemblk-1.6.1-1.el8.x86_64.rpm 167 kB/s | 92 kB 00:00 2023-05-17T12:27:15.497 INFO:teuthology.orchestra.run.smithi088.stdout:(2/14): python2-2.7.18-12.module_el8+299+aa6e9a 156 kB/s | 110 kB 00:00 2023-05-17T12:27:15.989 INFO:teuthology.orchestra.run.smithi088.stdout:(3/14): fio-3.19-4.el8.x86_64.rpm 448 kB/s | 538 kB 00:01 2023-05-17T12:27:17.504 INFO:teuthology.orchestra.run.smithi088.stdout:(4/14): python2-pip-wheel-9.0.3-19.module_el8+2 589 kB/s | 892 kB 00:01 2023-05-17T12:27:17.782 INFO:teuthology.orchestra.run.smithi088.stdout:(5/14): python2-pip-9.0.3-19.module_el8+299+aa6 815 kB/s | 1.8 MB 00:02 2023-05-17T12:27:18.265 INFO:teuthology.orchestra.run.smithi088.stdout:(6/14): python2-libs-2.7.18-12.module_el8+299+a 2.2 MB/s | 6.5 MB 00:02 2023-05-17T12:27:18.657 INFO:teuthology.orchestra.run.smithi088.stdout:(7/14): python2-setuptools-39.0.1-13.module_el8 609 kB/s | 702 kB 00:01 2023-05-17T12:27:18.682 INFO:teuthology.orchestra.run.smithi088.stdout:(8/14): python2-setuptools-wheel-39.0.1-13.modu 319 kB/s | 287 kB 00:00 2023-05-17T12:27:18.757 INFO:teuthology.orchestra.run.smithi088.stdout:(9/14): python2-wheel-wheel-0.31.1-3.module_el8 90 kB/s | 44 kB 00:00 2023-05-17T12:27:18.949 INFO:teuthology.orchestra.run.smithi088.stdout:(10/14): daxctl-libs-71.1-4.el8.x86_64.rpm 143 kB/s | 42 kB 00:00 2023-05-17T12:27:19.283 INFO:teuthology.orchestra.run.smithi088.stdout:(11/14): dump-0.4-0.36.b46.el8.x86_64.rpm 273 kB/s | 164 kB 00:00 2023-05-17T12:27:19.400 INFO:teuthology.orchestra.run.smithi088.stdout:(12/14): ndctl-libs-71.1-4.el8.x86_64.rpm 124 kB/s | 80 kB 00:00 2023-05-17T12:27:19.575 INFO:teuthology.orchestra.run.smithi088.stdout:(13/14): rmt-1.5.3-13.el8.x86_64.rpm 82 kB/s | 51 kB 00:00 2023-05-17T12:27:19.608 INFO:teuthology.orchestra.run.smithi088.stdout:(14/14): indent-2.2.13-2.el8.x86_64.rpm 574 kB/s | 187 kB 00:00 2023-05-17T12:27:19.609 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-05-17T12:27:19.609 INFO:teuthology.orchestra.run.smithi088.stdout:Total 958 kB/s | 11 MB 00:12 2023-05-17T12:27:19.906 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-05-17T12:27:19.934 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-05-17T12:27:19.934 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-05-17T12:27:20.173 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-05-17T12:27:20.178 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-05-17T12:27:20.777 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-05-17T12:27:20.973 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : daxctl-libs-71.1-4.el8.x86_64 1/14 2023-05-17T12:27:21.055 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: daxctl-libs-71.1-4.el8.x86_64 1/14 2023-05-17T12:27:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ndctl-libs-71.1-4.el8.x86_64 2/14 2023-05-17T12:27:21.333 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ndctl-libs-71.1-4.el8.x86_64 2/14 2023-05-17T12:27:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/14 2023-05-17T12:27:21.566 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/14 2023-05-17T12:27:21.728 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 4/14 2023-05-17T12:27:21.894 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 5/14 2023-05-17T12:27:23.379 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/14 2023-05-17T12:27:24.237 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 7/14 2023-05-17T12:27:24.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:27:24.598 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:27:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 8/14 2023-05-17T12:27:24.887 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 9/14 2023-05-17T12:27:25.054 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 10/14 2023-05-17T12:27:25.094 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 10/14 2023-05-17T12:27:25.397 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 11/14 2023-05-17T12:27:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fio-3.19-4.el8.x86_64 12/14 2023-05-17T12:27:25.876 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : indent-2.2.13-2.el8.x86_64 13/14 2023-05-17T12:27:26.047 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 14/14 2023-05-17T12:27:26.462 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 14/14 2023-05-17T12:27:26.463 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fio-3.19-4.el8.x86_64 1/14 2023-05-17T12:27:26.463 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/14 2023-05-17T12:27:26.463 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/14 2023-05-17T12:27:26.463 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/14 2023-05-17T12:27:26.463 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/14 2023-05-17T12:27:26.464 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/14 2023-05-17T12:27:26.464 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/14 2023-05-17T12:27:26.464 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/14 2023-05-17T12:27:26.464 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/14 2023-05-17T12:27:26.464 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : daxctl-libs-71.1-4.el8.x86_64 10/14 2023-05-17T12:27:26.465 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/14 2023-05-17T12:27:26.465 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ndctl-libs-71.1-4.el8.x86_64 12/14 2023-05-17T12:27:26.465 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/14 2023-05-17T12:27:27.233 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : indent-2.2.13-2.el8.x86_64 14/14 2023-05-17T12:27:27.234 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:27:27.234 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-05-17T12:27:27.234 INFO:teuthology.orchestra.run.smithi088.stdout: daxctl-libs-71.1-4.el8.x86_64 2023-05-17T12:27:27.234 INFO:teuthology.orchestra.run.smithi088.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-05-17T12:27:27.234 INFO:teuthology.orchestra.run.smithi088.stdout: fio-3.19-4.el8.x86_64 2023-05-17T12:27:27.234 INFO:teuthology.orchestra.run.smithi088.stdout: indent-2.2.13-2.el8.x86_64 2023-05-17T12:27:27.234 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-05-17T12:27:27.235 INFO:teuthology.orchestra.run.smithi088.stdout: ndctl-libs-71.1-4.el8.x86_64 2023-05-17T12:27:27.235 INFO:teuthology.orchestra.run.smithi088.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-05-17T12:27:27.235 INFO:teuthology.orchestra.run.smithi088.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-05-17T12:27:27.235 INFO:teuthology.orchestra.run.smithi088.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-05-17T12:27:27.235 INFO:teuthology.orchestra.run.smithi088.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-05-17T12:27:27.235 INFO:teuthology.orchestra.run.smithi088.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-05-17T12:27:27.235 INFO:teuthology.orchestra.run.smithi088.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-05-17T12:27:27.235 INFO:teuthology.orchestra.run.smithi088.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-05-17T12:27:27.236 INFO:teuthology.orchestra.run.smithi088.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-05-17T12:27:27.236 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:27:27.236 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-05-17T12:27:27.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo useradd -m fsgqa 2023-05-17T12:27:27.603 INFO:teuthology.orchestra.run.smithi088.stderr:useradd: user 'fsgqa' already exists 2023-05-17T12:27:27.605 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-17T12:27:27.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo groupadd fsgqa 2023-05-17T12:27:27.666 INFO:teuthology.orchestra.run.smithi088.stderr:groupadd: group 'fsgqa' already exists 2023-05-17T12:27:27.668 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-17T12:27:27.668 DEBUG:teuthology.orchestra.run.smithi088:> sudo useradd fsgqa2 2023-05-17T12:27:28.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo useradd 123456-fsgqa 2023-05-17T12:27:29.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-17T12:27:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.697+0000 7f1842bff700 1 Processor -- start 2023-05-17T12:27:29.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.697+0000 7f1842bff700 1 -- start start 2023-05-17T12:27:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.698+0000 7f1842bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f183c1595e0 0x7f183c070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.698+0000 7f1842bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c0ce2a0 0x7f183c0ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:29.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.698+0000 7f1842bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183c1599b0 con 0x7f183c071370 2023-05-17T12:27:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.698+0000 7f1842bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183c0717e0 con 0x7f183c1595e0 2023-05-17T12:27:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.698+0000 7f1842bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c15e000 con 0x7f183c0ce2a0 2023-05-17T12:27:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.698+0000 7f184099b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f183c1595e0 0x7f183c070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f184099b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f183c1595e0 0x7f183c070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43336/0 (socket says 172.21.15.88:43336) 2023-05-17T12:27:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f184099b700 1 -- 172.21.15.88:0/2380691675 learned_addr learned my addr 172.21.15.88:0/2380691675 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:29.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f184119c700 1 --2- 172.21.15.88:0/2380691675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c0ce2a0 0x7f183c0ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:29.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f184099b700 1 -- 172.21.15.88:0/2380691675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c0ce2a0 msgr2=0x7f183c0ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-17T12:27:29.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f184099b700 1 --2- 172.21.15.88:0/2380691675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c0ce2a0 0x7f183c0ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f184099b700 1 -- 172.21.15.88:0/2380691675 >> v1:172.21.15.187:6789/0 conn(0x7f183c071370 legacy=0x7f183c0cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:29.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f184099b700 1 -- 172.21.15.88:0/2380691675 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c0cca80 con 0x7f183c1595e0 2023-05-17T12:27:29.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f184099b700 1 --2- 172.21.15.88:0/2380691675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 0x7f183c070e30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f18300098f0 tx=0x7f1830009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4873991298c007c3 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:29.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f183b7fe700 1 -- 172.21.15.88:0/2380691675 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830011830 con 0x7f183c1595e0 2023-05-17T12:27:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f183b7fe700 1 -- 172.21.15.88:0/2380691675 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830011990 con 0x7f183c1595e0 2023-05-17T12:27:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.699+0000 7f183b7fe700 1 -- 172.21.15.88:0/2380691675 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830011d20 con 0x7f183c1595e0 2023-05-17T12:27:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.700+0000 7f1842bff700 1 -- 172.21.15.88:0/2380691675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 msgr2=0x7f183c070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.700+0000 7f1842bff700 1 --2- 172.21.15.88:0/2380691675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 0x7f183c070e30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f18300098f0 tx=0x7f1830009c00 comp rx=0 tx=0).stop 2023-05-17T12:27:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.700+0000 7f1842bff700 1 -- 172.21.15.88:0/2380691675 shutdown_connections 2023-05-17T12:27:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.700+0000 7f1842bff700 1 --2- 172.21.15.88:0/2380691675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c0ce2a0 0x7f183c0ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.700+0000 7f1842bff700 1 --2- 172.21.15.88:0/2380691675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 0x7f183c070e30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.700+0000 7f1842bff700 1 -- 172.21.15.88:0/2380691675 >> 172.21.15.88:0/2380691675 conn(0x7f183c0ced10 msgr2=0x7f183c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.700+0000 7f1842bff700 1 -- 172.21.15.88:0/2380691675 shutdown_connections 2023-05-17T12:27:29.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.700+0000 7f1842bff700 1 -- 172.21.15.88:0/2380691675 wait complete. 2023-05-17T12:27:29.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.702+0000 7f1842bff700 1 Processor -- start 2023-05-17T12:27:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.702+0000 7f1842bff700 1 -- start start 2023-05-17T12:27:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.703+0000 7f1842bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c071370 0x7f183c1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.703+0000 7f1842bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f183c0ce2a0 0x7f183c0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.703+0000 7f1842bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 0x7f183c0af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.703+0000 7f1842bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c15a590 con 0x7f183c1595e0 2023-05-17T12:27:29.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.703+0000 7f1842bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0b3780 con 0x7f183c0ce2a0 2023-05-17T12:27:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.703+0000 7f1842bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0b3a60 con 0x7f183c071370 2023-05-17T12:27:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.703+0000 7f184119c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 0x7f183c0af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.703+0000 7f184119c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 0x7f183c0af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43340/0 (socket says 172.21.15.88:43340) 2023-05-17T12:27:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.703+0000 7f184119c700 1 -- 172.21.15.88:0/1244155635 learned_addr learned my addr 172.21.15.88:0/1244155635 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f184099b700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c071370 0x7f183c1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f183bfff700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f183c0ce2a0 0x7f183c0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f184119c700 1 -- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c071370 msgr2=0x7f183c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:29.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f184119c700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c071370 0x7f183c1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f184119c700 1 -- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f183c0ce2a0 msgr2=0x7f183c0b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f184119c700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f183c0ce2a0 0x7f183c0b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f184119c700 1 -- 172.21.15.88:0/1244155635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830009550 con 0x7f183c1595e0 2023-05-17T12:27:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f183bfff700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f183c0ce2a0 0x7f183c0b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-17T12:27:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f184119c700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 0x7f183c0af920 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f183400efc0 tx=0x7f183400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f18397fa700 1 -- 172.21.15.88:0/1244155635 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834009ca0 con 0x7f183c1595e0 2023-05-17T12:27:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f18397fa700 1 -- 172.21.15.88:0/1244155635 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183400f040 con 0x7f183c1595e0 2023-05-17T12:27:29.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c0cd040 con 0x7f183c1595e0 2023-05-17T12:27:29.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f18397fa700 1 -- 172.21.15.88:0/1244155635 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834014480 con 0x7f183c1595e0 2023-05-17T12:27:29.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.704+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c0ccd60 con 0x7f183c1595e0 2023-05-17T12:27:29.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.706+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c0cd320 con 0x7f183c1595e0 2023-05-17T12:27:29.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.707+0000 7f18397fa700 1 -- 172.21.15.88:0/1244155635 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18340145e0 con 0x7f183c1595e0 2023-05-17T12:27:29.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.708+0000 7f18397fa700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f182006ace0 0x7f182006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:29.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.708+0000 7f18397fa700 1 -- 172.21.15.88:0/1244155635 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f183408a330 con 0x7f183c1595e0 2023-05-17T12:27:29.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.708+0000 7f184099b700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f182006ace0 0x7f182006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:29.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.709+0000 7f184099b700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f182006ace0 0x7f182006d190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1830014040 tx=0x7f1830008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:29.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.712+0000 7f18397fa700 1 -- 172.21.15.88:0/1244155635 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1834058c90 con 0x7f183c1595e0 2023-05-17T12:27:29.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.980+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f183c06bbd0 con 0x7f183c1595e0 2023-05-17T12:27:29.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.981+0000 7f18397fa700 1 -- 172.21.15.88:0/1244155635 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f1834058820 con 0x7f183c1595e0 2023-05-17T12:27:29.984 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:27:29.984 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":1,"fsid":"5fe2c233-5aa8-47bb-8675-a47cef3664c7","modified":"2023-05-17T12:23:56.269459Z","created":"2023-05-17T12:23:56.269459Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3301","nonce":0},{"type":"v1","addr":"172.21.15.187:6790","nonce":0}]},"addr":"172.21.15.187:6790/0","public_addr":"172.21.15.187:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-17T12:27:29.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f182006ace0 msgr2=0x7f182006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:29.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f182006ace0 0x7f182006d190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1830014040 tx=0x7f1830008030 comp rx=0 tx=0).stop 2023-05-17T12:27:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 msgr2=0x7f183c0af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 0x7f183c0af920 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f183400efc0 tx=0x7f183400c3a0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 shutdown_connections 2023-05-17T12:27:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f182006ace0 0x7f182006d190 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f183c1595e0 0x7f183c0af920 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f183c071370 0x7f183c1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 --2- 172.21.15.88:0/1244155635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f183c0ce2a0 0x7f183c0b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 >> 172.21.15.88:0/1244155635 conn(0x7f183c0ced10 msgr2=0x7f183c0cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:29.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 shutdown_connections 2023-05-17T12:27:29.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:29.983+0000 7f1842bff700 1 -- 172.21.15.88:0/1244155635 wait complete. 2023-05-17T12:27:29.988 INFO:teuthology.orchestra.run.smithi088.stderr:dumped monmap epoch 1 2023-05-17T12:27:30.003 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-05-17T12:27:30.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.186+0000 7f2c99bff700 1 Processor -- start 2023-05-17T12:27:30.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.186+0000 7f2c99bff700 1 -- start start 2023-05-17T12:27:30.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.187+0000 7f2c99bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c9406ca40 0x7f2c9406b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:30.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.187+0000 7f2c99bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940cd6b0 con 0x7f2c9406b0b0 2023-05-17T12:27:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.187+0000 7f2c99bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940b2460 con 0x7f2c9415c840 2023-05-17T12:27:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.187+0000 7f2c99bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940cdf50 con 0x7f2c9406ca40 2023-05-17T12:27:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.188+0000 7f2c93fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c9406ca40 0x7f2c9406b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.188+0000 7f2c8bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2c9406b0b0 0x7f2c9406c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34062/0 (socket says 172.21.15.88:34062) 2023-05-17T12:27:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.188+0000 7f2c93fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c9406ca40 0x7f2c9406b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43346/0 (socket says 172.21.15.88:43346) 2023-05-17T12:27:30.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.188+0000 7f2c8bfff700 1 -- 172.21.15.88:0/1209730270 learned_addr learned my addr 172.21.15.88:0/1209730270 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-05-17T12:27:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.188+0000 7f2c93fff700 1 -- 172.21.15.88:0/1209730270 >> v1:172.21.15.187:6789/0 conn(0x7f2c9415c840 legacy=0x7f2c940cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.188+0000 7f2c93fff700 1 -- 172.21.15.88:0/1209730270 >> v1:172.21.15.88:6789/0 conn(0x7f2c9406b0b0 legacy=0x7f2c9406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.188+0000 7f2c93fff700 1 -- 172.21.15.88:0/1209730270 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940b2740 con 0x7f2c9406ca40 2023-05-17T12:27:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.188+0000 7f2c93fff700 1 --2- 172.21.15.88:0/1209730270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406ca40 0x7f2c9406b940 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009d90 tx=0x7f2c8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a32dbb0d922e70 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c92ffd700 1 -- 172.21.15.88:0/1209730270 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00e070 con 0x7f2c9406ca40 2023-05-17T12:27:30.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c92ffd700 1 -- 172.21.15.88:0/1209730270 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c00bbd0 con 0x7f2c9406ca40 2023-05-17T12:27:30.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c92ffd700 1 -- 172.21.15.88:0/1209730270 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c012430 con 0x7f2c9406ca40 2023-05-17T12:27:30.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c99bff700 1 -- 172.21.15.88:0/1209730270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406ca40 msgr2=0x7f2c9406b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:30.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c99bff700 1 --2- 172.21.15.88:0/1209730270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406ca40 0x7f2c9406b940 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009d90 tx=0x7f2c8c00b330 comp rx=0 tx=0).stop 2023-05-17T12:27:30.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c99bff700 1 -- 172.21.15.88:0/1209730270 shutdown_connections 2023-05-17T12:27:30.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c99bff700 1 --2- 172.21.15.88:0/1209730270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406ca40 0x7f2c9406b940 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:30.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c99bff700 1 -- 172.21.15.88:0/1209730270 >> 172.21.15.88:0/1209730270 conn(0x7f2c940d3060 msgr2=0x7f2c940d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:30.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c99bff700 1 -- 172.21.15.88:0/1209730270 shutdown_connections 2023-05-17T12:27:30.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.189+0000 7f2c99bff700 1 -- 172.21.15.88:0/1209730270 wait complete. 2023-05-17T12:27:30.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.191+0000 7f2c99bff700 1 Processor -- start 2023-05-17T12:27:30.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.191+0000 7f2c99bff700 1 -- start start 2023-05-17T12:27:30.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.192+0000 7f2c99bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406b0b0 0x7f2c94160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:30.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.192+0000 7f2c99bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c9406ca40 0x7f2c94155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:30.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.192+0000 7f2c99bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c9415c840 0x7f2c940b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:30.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.192+0000 7f2c99bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9415e380 con 0x7f2c9406b0b0 2023-05-17T12:27:30.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.192+0000 7f2c99bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9415d700 con 0x7f2c9406ca40 2023-05-17T12:27:30.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.192+0000 7f2c99bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9415d9e0 con 0x7f2c9415c840 2023-05-17T12:27:30.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.192+0000 7f2c937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406b0b0 0x7f2c94160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:30.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.192+0000 7f2c937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406b0b0 0x7f2c94160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43350/0 (socket says 172.21.15.88:43350) 2023-05-17T12:27:30.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c937fe700 1 -- 172.21.15.88:0/4077647554 learned_addr learned my addr 172.21.15.88:0/4077647554 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-05-17T12:27:30.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c93fff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c9415c840 0x7f2c940b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:30.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c8bfff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c9406ca40 0x7f2c94155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:30.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c937fe700 1 -- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c9415c840 msgr2=0x7f2c940b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:30.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c937fe700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c9415c840 0x7f2c940b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:30.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c937fe700 1 -- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c9406ca40 msgr2=0x7f2c94155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:30.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c937fe700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c9406ca40 0x7f2c94155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:30.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c937fe700 1 -- 172.21.15.88:0/4077647554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c009a70 con 0x7f2c9406b0b0 2023-05-17T12:27:30.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c8bfff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c9406ca40 0x7f2c94155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-17T12:27:30.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c937fe700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406b0b0 0x7f2c94160940 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c4e0 tx=0x7f2c8400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:30.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c90ff9700 1 -- 172.21.15.88:0/4077647554 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c840052d0 con 0x7f2c9406b0b0 2023-05-17T12:27:30.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c90ff9700 1 -- 172.21.15.88:0/4077647554 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c84005430 con 0x7f2c9406b0b0 2023-05-17T12:27:30.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c940cdbe0 con 0x7f2c9406b0b0 2023-05-17T12:27:30.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c90ff9700 1 -- 172.21.15.88:0/4077647554 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c840038c0 con 0x7f2c9406b0b0 2023-05-17T12:27:30.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.193+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c940cd900 con 0x7f2c9406b0b0 2023-05-17T12:27:30.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.195+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9415cc10 con 0x7f2c9406b0b0 2023-05-17T12:27:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.196+0000 7f2c90ff9700 1 -- 172.21.15.88:0/4077647554 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c84003a20 con 0x7f2c9406b0b0 2023-05-17T12:27:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.197+0000 7f2c90ff9700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c7406ace0 0x7f2c7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-17T12:27:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.197+0000 7f2c90ff9700 1 -- 172.21.15.88:0/4077647554 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2c84088a70 con 0x7f2c9406b0b0 2023-05-17T12:27:30.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.198+0000 7f2c8bfff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c7406ace0 0x7f2c7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-17T12:27:30.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.198+0000 7f2c8bfff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c7406ace0 0x7f2c7406d190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c94157690 tx=0x7f2c7c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-17T12:27:30.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.201+0000 7f2c90ff9700 1 -- 172.21.15.88:0/4077647554 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2c840539d0 con 0x7f2c9406b0b0 2023-05-17T12:27:30.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.478+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f2c94074530 con 0x7f2c9406b0b0 2023-05-17T12:27:30.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.478+0000 7f2c90ff9700 1 -- 172.21.15.88:0/4077647554 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) v1 ==== 82+0+151 (secure 0 0 0) 0x7f2c840170b0 con 0x7f2c9406b0b0 2023-05-17T12:27:30.482 INFO:teuthology.orchestra.run.smithi088.stdout:[client.admin] 2023-05-17T12:27:30.482 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBcx2RkErskJBAAMcDoKQHBdwUg8T39t5Of7g== 2023-05-17T12:27:30.482 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow *" 2023-05-17T12:27:30.483 INFO:teuthology.orchestra.run.smithi088.stdout: caps mgr = "allow *" 2023-05-17T12:27:30.483 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow *" 2023-05-17T12:27:30.483 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow *" 2023-05-17T12:27:30.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.480+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c7406ace0 msgr2=0x7f2c7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:30.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.480+0000 7f2c99bff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c7406ace0 0x7f2c7406d190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c94157690 tx=0x7f2c7c009040 comp rx=0 tx=0).stop 2023-05-17T12:27:30.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.480+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406b0b0 msgr2=0x7f2c94160940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-17T12:27:30.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.480+0000 7f2c99bff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406b0b0 0x7f2c94160940 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c4e0 tx=0x7f2c8400c7f0 comp rx=0 tx=0).stop 2023-05-17T12:27:30.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.480+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 shutdown_connections 2023-05-17T12:27:30.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.480+0000 7f2c99bff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:6832/2490620069,v1:172.21.15.187:6833/2490620069] conn(0x7f2c7406ace0 0x7f2c7406d190 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.481+0000 7f2c99bff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c9415c840 0x7f2c940b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.481+0000 7f2c99bff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c9406b0b0 0x7f2c94160940 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.481+0000 7f2c99bff700 1 --2- 172.21.15.88:0/4077647554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c9406ca40 0x7f2c94155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-17T12:27:30.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.481+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 >> 172.21.15.88:0/4077647554 conn(0x7f2c940d3060 msgr2=0x7f2c94156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-17T12:27:30.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.481+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 shutdown_connections 2023-05-17T12:27:30.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-05-17T12:27:30.481+0000 7f2c99bff700 1 -- 172.21.15.88:0/4077647554 wait complete. 2023-05-17T12:27:30.501 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-05-17T12:27:30.543 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.nGy26JbJgy 2023-05-17T12:27:30.543 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:27:30.544 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/tmp/tmp.nGy26JbJgy 2023-05-17T12:27:30.623 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:27:30.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/tmp/tmp.buK0S8bWYQxfstests-dev/local.config 2023-05-17T12:27:30.725 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.3n61ha2sIstest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.phQfFMpS6rscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.88:6789 -k /tmp/tmp.nGy26JbJgy --client_mountpoint /test" 2023-05-17T12:27:30.726 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T12:27:30.726 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/tmp/tmp.buK0S8bWYQxfstests-dev/ceph.exclude 2023-05-17T12:27:30.826 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo make) 2023-05-17T12:27:30.948 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize -cfi 2023-05-17T12:27:31.436 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: putting auxiliary files in '.'. 2023-05-17T12:27:31.436 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: copying file './config.guess' 2023-05-17T12:27:31.444 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: copying file './config.sub' 2023-05-17T12:27:31.454 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: copying file './install-sh' 2023-05-17T12:27:31.463 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: copying file './ltmain.sh' 2023-05-17T12:27:31.518 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-17T12:27:31.518 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-17T12:27:31.530 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-17T12:27:31.541 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-17T12:27:31.552 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-17T12:27:31.564 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-17T12:27:31.578 INFO:teuthology.orchestra.run.smithi088.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-17T12:27:31.581 INFO:teuthology.orchestra.run.smithi088.stdout:cp include/install-sh . 2023-05-17T12:27:31.583 INFO:teuthology.orchestra.run.smithi088.stdout:aclocal -I m4 2023-05-17T12:27:32.808 INFO:teuthology.orchestra.run.smithi088.stdout:autoheader 2023-05-17T12:27:33.161 INFO:teuthology.orchestra.run.smithi088.stdout:autoconf 2023-05-17T12:27:33.360 INFO:teuthology.orchestra.run.smithi088.stdout:./configure \ 2023-05-17T12:27:33.360 INFO:teuthology.orchestra.run.smithi088.stdout: --libexecdir=/usr/lib \ 2023-05-17T12:27:33.360 INFO:teuthology.orchestra.run.smithi088.stdout: --exec_prefix=/var/lib 2023-05-17T12:27:33.928 INFO:teuthology.orchestra.run.smithi088.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-17T12:27:33.929 INFO:teuthology.orchestra.run.smithi088.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-17T12:27:33.932 INFO:teuthology.orchestra.run.smithi088.stdout:checking how to print strings... printf 2023-05-17T12:27:33.932 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gcc... gcc 2023-05-17T12:27:34.113 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether the C compiler works... yes 2023-05-17T12:27:34.114 INFO:teuthology.orchestra.run.smithi088.stdout:checking for C compiler default output file name... a.out 2023-05-17T12:27:34.161 INFO:teuthology.orchestra.run.smithi088.stdout:checking for suffix of executables... 2023-05-17T12:27:34.225 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether we are cross compiling... no 2023-05-17T12:27:34.260 INFO:teuthology.orchestra.run.smithi088.stdout:checking for suffix of object files... o 2023-05-17T12:27:34.292 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether we are using the GNU C compiler... yes 2023-05-17T12:27:34.324 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether gcc accepts -g... yes 2023-05-17T12:27:34.370 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gcc option to accept ISO C89... none needed 2023-05-17T12:27:34.376 INFO:teuthology.orchestra.run.smithi088.stdout:checking for a sed that does not truncate output... /bin/sed 2023-05-17T12:27:34.381 INFO:teuthology.orchestra.run.smithi088.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-05-17T12:27:34.383 INFO:teuthology.orchestra.run.smithi088.stdout:checking for egrep... /bin/grep -E 2023-05-17T12:27:34.386 INFO:teuthology.orchestra.run.smithi088.stdout:checking for fgrep... /bin/grep -F 2023-05-17T12:27:34.393 INFO:teuthology.orchestra.run.smithi088.stdout:checking for ld used by gcc... /bin/ld 2023-05-17T12:27:34.397 INFO:teuthology.orchestra.run.smithi088.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-05-17T12:27:34.404 INFO:teuthology.orchestra.run.smithi088.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-05-17T12:27:34.440 INFO:teuthology.orchestra.run.smithi088.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-05-17T12:27:34.441 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether ln -s works... yes 2023-05-17T12:27:34.453 INFO:teuthology.orchestra.run.smithi088.stdout:checking the maximum length of command line arguments... 1572864 2023-05-17T12:27:34.458 INFO:teuthology.orchestra.run.smithi088.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-17T12:27:34.459 INFO:teuthology.orchestra.run.smithi088.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-17T12:27:34.459 INFO:teuthology.orchestra.run.smithi088.stdout:checking for /bin/ld option to reload object files... -r 2023-05-17T12:27:34.459 INFO:teuthology.orchestra.run.smithi088.stdout:checking for objdump... objdump 2023-05-17T12:27:34.460 INFO:teuthology.orchestra.run.smithi088.stdout:checking how to recognize dependent libraries... pass_all 2023-05-17T12:27:34.460 INFO:teuthology.orchestra.run.smithi088.stdout:checking for dlltool... no 2023-05-17T12:27:34.461 INFO:teuthology.orchestra.run.smithi088.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-17T12:27:34.461 INFO:teuthology.orchestra.run.smithi088.stdout:checking for ar... ar 2023-05-17T12:27:34.512 INFO:teuthology.orchestra.run.smithi088.stdout:checking for archiver @FILE support... @ 2023-05-17T12:27:34.512 INFO:teuthology.orchestra.run.smithi088.stdout:checking for strip... strip 2023-05-17T12:27:34.513 INFO:teuthology.orchestra.run.smithi088.stdout:checking for ranlib... ranlib 2023-05-17T12:27:34.513 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gawk... gawk 2023-05-17T12:27:34.616 INFO:teuthology.orchestra.run.smithi088.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-05-17T12:27:34.618 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sysroot... no 2023-05-17T12:27:34.625 INFO:teuthology.orchestra.run.smithi088.stdout:checking for a working dd... /bin/dd 2023-05-17T12:27:34.631 INFO:teuthology.orchestra.run.smithi088.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-05-17T12:27:34.658 INFO:teuthology.orchestra.run.smithi088.stdout:checking for mt... no 2023-05-17T12:27:34.663 INFO:teuthology.orchestra.run.smithi088.stdout:checking if : is a manifest tool... no 2023-05-17T12:27:34.719 INFO:teuthology.orchestra.run.smithi088.stdout:checking how to run the C preprocessor... gcc -E 2023-05-17T12:27:34.962 INFO:teuthology.orchestra.run.smithi088.stdout:checking for ANSI C header files... yes 2023-05-17T12:27:35.002 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/types.h... yes 2023-05-17T12:27:35.053 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/stat.h... yes 2023-05-17T12:27:35.102 INFO:teuthology.orchestra.run.smithi088.stdout:checking for stdlib.h... yes 2023-05-17T12:27:35.152 INFO:teuthology.orchestra.run.smithi088.stdout:checking for string.h... yes 2023-05-17T12:27:35.202 INFO:teuthology.orchestra.run.smithi088.stdout:checking for memory.h... yes 2023-05-17T12:27:35.251 INFO:teuthology.orchestra.run.smithi088.stdout:checking for strings.h... yes 2023-05-17T12:27:35.305 INFO:teuthology.orchestra.run.smithi088.stdout:checking for inttypes.h... yes 2023-05-17T12:27:35.357 INFO:teuthology.orchestra.run.smithi088.stdout:checking for stdint.h... yes 2023-05-17T12:27:35.412 INFO:teuthology.orchestra.run.smithi088.stdout:checking for unistd.h... yes 2023-05-17T12:27:35.464 INFO:teuthology.orchestra.run.smithi088.stdout:checking for dlfcn.h... yes 2023-05-17T12:27:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:checking for objdir... .libs 2023-05-17T12:27:35.599 INFO:teuthology.orchestra.run.smithi088.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-17T12:27:35.599 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-17T12:27:35.634 INFO:teuthology.orchestra.run.smithi088.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-17T12:27:35.700 INFO:teuthology.orchestra.run.smithi088.stdout:checking if gcc static flag -static works... no 2023-05-17T12:27:35.749 INFO:teuthology.orchestra.run.smithi088.stdout:checking if gcc supports -c -o file.o... yes 2023-05-17T12:27:35.749 INFO:teuthology.orchestra.run.smithi088.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-17T12:27:35.763 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-17T12:27:35.810 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether -lc should be explicitly linked in... no 2023-05-17T12:27:35.904 INFO:teuthology.orchestra.run.smithi088.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-17T12:27:35.904 INFO:teuthology.orchestra.run.smithi088.stdout:checking how to hardcode library paths into programs... immediate 2023-05-17T12:27:35.916 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether stripping libraries is possible... yes 2023-05-17T12:27:35.916 INFO:teuthology.orchestra.run.smithi088.stdout:checking if libtool supports shared libraries... yes 2023-05-17T12:27:35.917 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether to build shared libraries... yes 2023-05-17T12:27:35.917 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether to build static libraries... yes 2023-05-17T12:27:35.927 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gcc... (cached) gcc 2023-05-17T12:27:35.962 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-05-17T12:27:35.963 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-17T12:27:35.963 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-05-17T12:27:35.963 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gmake... /usr/bin/gmake 2023-05-17T12:27:35.963 INFO:teuthology.orchestra.run.smithi088.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-05-17T12:27:35.964 INFO:teuthology.orchestra.run.smithi088.stdout:checking for tar... /bin/tar 2023-05-17T12:27:35.964 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gzip... /bin/gzip 2023-05-17T12:27:35.978 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether gcc -MM is supported... yes 2023-05-17T12:27:35.979 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sort... /bin/sort 2023-05-17T12:27:35.979 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether ln -s works... yes 2023-05-17T12:27:35.980 INFO:teuthology.orchestra.run.smithi088.stdout:checking for rpm... /bin/rpm 2023-05-17T12:27:35.987 INFO:teuthology.orchestra.run.smithi088.stdout:checking for rpmbuild... no 2023-05-17T12:27:36.038 INFO:teuthology.orchestra.run.smithi088.stdout:checking assert.h usability... yes 2023-05-17T12:27:36.053 INFO:teuthology.orchestra.run.smithi088.stdout:checking assert.h presence... yes 2023-05-17T12:27:36.053 INFO:teuthology.orchestra.run.smithi088.stdout:checking for assert.h... yes 2023-05-17T12:27:36.106 INFO:teuthology.orchestra.run.smithi088.stdout:checking bstring.h usability... no 2023-05-17T12:27:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:checking bstring.h presence... no 2023-05-17T12:27:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:checking for bstring.h... no 2023-05-17T12:27:36.174 INFO:teuthology.orchestra.run.smithi088.stdout:checking libgen.h usability... yes 2023-05-17T12:27:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:checking libgen.h presence... yes 2023-05-17T12:27:36.190 INFO:teuthology.orchestra.run.smithi088.stdout:checking for libgen.h... yes 2023-05-17T12:27:36.255 INFO:teuthology.orchestra.run.smithi088.stdout:checking dirent.h usability... yes 2023-05-17T12:27:36.271 INFO:teuthology.orchestra.run.smithi088.stdout:checking dirent.h presence... yes 2023-05-17T12:27:36.271 INFO:teuthology.orchestra.run.smithi088.stdout:checking for dirent.h... yes 2023-05-17T12:27:36.348 INFO:teuthology.orchestra.run.smithi088.stdout:checking errno.h usability... yes 2023-05-17T12:27:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:checking errno.h presence... yes 2023-05-17T12:27:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:checking for errno.h... yes 2023-05-17T12:27:36.427 INFO:teuthology.orchestra.run.smithi088.stdout:checking malloc.h usability... yes 2023-05-17T12:27:36.444 INFO:teuthology.orchestra.run.smithi088.stdout:checking malloc.h presence... yes 2023-05-17T12:27:36.444 INFO:teuthology.orchestra.run.smithi088.stdout:checking for malloc.h... yes 2023-05-17T12:27:36.496 INFO:teuthology.orchestra.run.smithi088.stdout:checking uuid.h usability... no 2023-05-17T12:27:36.518 INFO:teuthology.orchestra.run.smithi088.stdout:checking uuid.h presence... no 2023-05-17T12:27:36.519 INFO:teuthology.orchestra.run.smithi088.stdout:checking for uuid.h... no 2023-05-17T12:27:36.577 INFO:teuthology.orchestra.run.smithi088.stdout:checking uuid/uuid.h usability... yes 2023-05-17T12:27:36.595 INFO:teuthology.orchestra.run.smithi088.stdout:checking uuid/uuid.h presence... yes 2023-05-17T12:27:36.596 INFO:teuthology.orchestra.run.smithi088.stdout:checking for uuid/uuid.h... yes 2023-05-17T12:27:36.648 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/uuid.h usability... no 2023-05-17T12:27:36.670 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/uuid.h presence... no 2023-05-17T12:27:36.670 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/uuid.h... no 2023-05-17T12:27:36.718 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/file.h usability... yes 2023-05-17T12:27:36.733 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/file.h presence... yes 2023-05-17T12:27:36.734 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/file.h... yes 2023-05-17T12:27:36.788 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/fcntl.h usability... yes 2023-05-17T12:27:36.804 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/fcntl.h presence... yes 2023-05-17T12:27:36.804 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/fcntl.h... yes 2023-05-17T12:27:36.856 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/syssgi.h usability... no 2023-05-17T12:27:36.878 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/syssgi.h presence... no 2023-05-17T12:27:36.878 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/syssgi.h... no 2023-05-17T12:27:36.950 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/param.h usability... yes 2023-05-17T12:27:36.970 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/param.h presence... yes 2023-05-17T12:27:36.970 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/param.h... yes 2023-05-17T12:27:36.982 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/stat.h... (cached) yes 2023-05-17T12:27:37.040 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/statvfs.h usability... yes 2023-05-17T12:27:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/statvfs.h presence... yes 2023-05-17T12:27:37.056 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/statvfs.h... yes 2023-05-17T12:27:37.109 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/time.h usability... yes 2023-05-17T12:27:37.125 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/time.h presence... yes 2023-05-17T12:27:37.126 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/time.h... yes 2023-05-17T12:27:37.190 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/ioctl.h usability... yes 2023-05-17T12:27:37.205 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/ioctl.h presence... yes 2023-05-17T12:27:37.206 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/ioctl.h... yes 2023-05-17T12:27:37.263 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/wait.h usability... yes 2023-05-17T12:27:37.281 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/wait.h presence... yes 2023-05-17T12:27:37.281 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/wait.h... yes 2023-05-17T12:27:37.293 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/types.h... (cached) yes 2023-05-17T12:27:37.306 INFO:teuthology.orchestra.run.smithi088.stdout:checking for strings.h... (cached) yes 2023-05-17T12:27:37.361 INFO:teuthology.orchestra.run.smithi088.stdout:checking err.h usability... yes 2023-05-17T12:27:37.376 INFO:teuthology.orchestra.run.smithi088.stdout:checking err.h presence... yes 2023-05-17T12:27:37.376 INFO:teuthology.orchestra.run.smithi088.stdout:checking for err.h... yes 2023-05-17T12:27:37.430 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/falloc.h usability... yes 2023-05-17T12:27:37.444 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/falloc.h presence... yes 2023-05-17T12:27:37.445 INFO:teuthology.orchestra.run.smithi088.stdout:checking for linux/falloc.h... yes 2023-05-17T12:27:37.497 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-05-17T12:27:37.520 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-05-17T12:27:37.520 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/fs/xfs_fsops.h... no 2023-05-17T12:27:37.566 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/fs/xfs_itable.h usability... no 2023-05-17T12:27:37.588 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/fs/xfs_itable.h presence... no 2023-05-17T12:27:37.589 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/fs/xfs_itable.h... no 2023-05-17T12:27:37.634 INFO:teuthology.orchestra.run.smithi088.stdout:checking xfs/platform_defs.h usability... no 2023-05-17T12:27:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:checking xfs/platform_defs.h presence... no 2023-05-17T12:27:37.657 INFO:teuthology.orchestra.run.smithi088.stdout:checking for xfs/platform_defs.h... no 2023-05-17T12:27:37.701 INFO:teuthology.orchestra.run.smithi088.stdout:checking btrfs/ioctl.h usability... no 2023-05-17T12:27:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:checking btrfs/ioctl.h presence... no 2023-05-17T12:27:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:checking for btrfs/ioctl.h... no 2023-05-17T12:27:37.769 INFO:teuthology.orchestra.run.smithi088.stdout:checking cifs/ioctl.h usability... no 2023-05-17T12:27:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:checking cifs/ioctl.h presence... no 2023-05-17T12:27:37.791 INFO:teuthology.orchestra.run.smithi088.stdout:checking for cifs/ioctl.h... no 2023-05-17T12:27:37.838 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/mman.h usability... yes 2023-05-17T12:27:37.854 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/mman.h presence... yes 2023-05-17T12:27:37.855 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/mman.h... yes 2023-05-17T12:27:37.889 INFO:teuthology.orchestra.run.smithi088.stdout:checking for xfs/xfs_log_format.h... no 2023-05-17T12:27:37.952 INFO:teuthology.orchestra.run.smithi088.stdout:checking for uuid_compare... no 2023-05-17T12:27:38.006 INFO:teuthology.orchestra.run.smithi088.stdout:checking for uuid_compare in -luuid... yes 2023-05-17T12:27:38.092 INFO:teuthology.orchestra.run.smithi088.stdout:checking for xfs/xfs.h... yes 2023-05-17T12:27:38.121 INFO:teuthology.orchestra.run.smithi088.stdout:checking for xfs/libxfs.h... no 2023-05-17T12:27:38.156 INFO:teuthology.orchestra.run.smithi088.stdout:checking whether xlog_assign_lsn is declared... no 2023-05-17T12:27:38.205 INFO:teuthology.orchestra.run.smithi088.stdout:checking for xfs/xqm.h... yes 2023-05-17T12:27:38.281 INFO:teuthology.orchestra.run.smithi088.stdout:checking xfsctl from xfs/xfs.h... ok 2023-05-17T12:27:38.325 INFO:teuthology.orchestra.run.smithi088.stdout:checking xfs/handle.h usability... yes 2023-05-17T12:27:38.339 INFO:teuthology.orchestra.run.smithi088.stdout:checking xfs/handle.h presence... yes 2023-05-17T12:27:38.339 INFO:teuthology.orchestra.run.smithi088.stdout:checking for xfs/handle.h... yes 2023-05-17T12:27:38.405 INFO:teuthology.orchestra.run.smithi088.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-05-17T12:27:38.455 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/acl.h usability... yes 2023-05-17T12:27:38.472 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/acl.h presence... yes 2023-05-17T12:27:38.472 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/acl.h... yes 2023-05-17T12:27:38.527 INFO:teuthology.orchestra.run.smithi088.stdout:checking acl/libacl.h usability... yes 2023-05-17T12:27:38.544 INFO:teuthology.orchestra.run.smithi088.stdout:checking acl/libacl.h presence... yes 2023-05-17T12:27:38.545 INFO:teuthology.orchestra.run.smithi088.stdout:checking for acl/libacl.h... yes 2023-05-17T12:27:38.601 INFO:teuthology.orchestra.run.smithi088.stdout:checking for acl_init in -lacl... yes 2023-05-17T12:27:38.644 INFO:teuthology.orchestra.run.smithi088.stdout:checking gdbm-ndbm.h usability... no 2023-05-17T12:27:38.666 INFO:teuthology.orchestra.run.smithi088.stdout:checking gdbm-ndbm.h presence... no 2023-05-17T12:27:38.666 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gdbm-ndbm.h... no 2023-05-17T12:27:38.706 INFO:teuthology.orchestra.run.smithi088.stdout:checking gdbm/ndbm.h usability... no 2023-05-17T12:27:38.729 INFO:teuthology.orchestra.run.smithi088.stdout:checking gdbm/ndbm.h presence... no 2023-05-17T12:27:38.729 INFO:teuthology.orchestra.run.smithi088.stdout:checking for gdbm/ndbm.h... no 2023-05-17T12:27:38.769 INFO:teuthology.orchestra.run.smithi088.stdout:checking ndbm.h usability... no 2023-05-17T12:27:38.791 INFO:teuthology.orchestra.run.smithi088.stdout:checking ndbm.h presence... no 2023-05-17T12:27:38.791 INFO:teuthology.orchestra.run.smithi088.stdout:checking for ndbm.h... no 2023-05-17T12:27:38.836 INFO:teuthology.orchestra.run.smithi088.stdout:checking libaio.h usability... yes 2023-05-17T12:27:38.856 INFO:teuthology.orchestra.run.smithi088.stdout:checking libaio.h presence... yes 2023-05-17T12:27:38.857 INFO:teuthology.orchestra.run.smithi088.stdout:checking for libaio.h... yes 2023-05-17T12:27:38.899 INFO:teuthology.orchestra.run.smithi088.stdout:checking liburing.h usability... no 2023-05-17T12:27:38.922 INFO:teuthology.orchestra.run.smithi088.stdout:checking liburing.h presence... no 2023-05-17T12:27:38.922 INFO:teuthology.orchestra.run.smithi088.stdout:checking for liburing.h... no 2023-05-17T12:27:38.962 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/capability.h usability... no 2023-05-17T12:27:38.984 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/capability.h presence... no 2023-05-17T12:27:38.985 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/capability.h... no 2023-05-17T12:27:39.026 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/fiemap.h usability... yes 2023-05-17T12:27:39.042 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/fiemap.h presence... yes 2023-05-17T12:27:39.042 INFO:teuthology.orchestra.run.smithi088.stdout:checking for linux/fiemap.h... yes 2023-05-17T12:27:39.100 INFO:teuthology.orchestra.run.smithi088.stdout:checking for fallocate... yes 2023-05-17T12:27:39.161 INFO:teuthology.orchestra.run.smithi088.stdout:checking for open_by_handle_at... yes 2023-05-17T12:27:39.211 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/prctl.h usability... yes 2023-05-17T12:27:39.227 INFO:teuthology.orchestra.run.smithi088.stdout:checking sys/prctl.h presence... yes 2023-05-17T12:27:39.227 INFO:teuthology.orchestra.run.smithi088.stdout:checking for sys/prctl.h... yes 2023-05-17T12:27:39.272 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/fs.h usability... yes 2023-05-17T12:27:39.288 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/fs.h presence... yes 2023-05-17T12:27:39.289 INFO:teuthology.orchestra.run.smithi088.stdout:checking for linux/fs.h... yes 2023-05-17T12:27:39.328 INFO:teuthology.orchestra.run.smithi088.stdout:checking btrfsutil.h usability... no 2023-05-17T12:27:39.351 INFO:teuthology.orchestra.run.smithi088.stdout:checking btrfsutil.h presence... no 2023-05-17T12:27:39.351 INFO:teuthology.orchestra.run.smithi088.stdout:checking for btrfsutil.h... no 2023-05-17T12:27:39.421 INFO:teuthology.orchestra.run.smithi088.stdout:checking for copy_file_range... yes 2023-05-17T12:27:39.481 INFO:teuthology.orchestra.run.smithi088.stdout:checking for SEEK_DATA... yes 2023-05-17T12:27:39.558 INFO:teuthology.orchestra.run.smithi088.stdout:checking for BMV_OF_SHARED... yes 2023-05-17T12:27:39.620 INFO:teuthology.orchestra.run.smithi088.stdout:checking for nftw... yes 2023-05-17T12:27:39.684 INFO:teuthology.orchestra.run.smithi088.stdout:checking for RLIMIT_NOFILE... yes 2023-05-17T12:27:39.720 INFO:teuthology.orchestra.run.smithi088.stdout:checking for FIEXCHANGE_RANGE... no 2023-05-17T12:27:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:checking for renameat2... yes 2023-05-17T12:27:39.837 INFO:teuthology.orchestra.run.smithi088.stdout:checking for reallocarray... yes 2023-05-17T12:27:39.866 INFO:teuthology.orchestra.run.smithi088.stdout:checking for struct mount_attr... no 2023-05-17T12:27:39.943 INFO:teuthology.orchestra.run.smithi088.stdout:checking for struct btrfs_qgroup_limit... yes 2023-05-17T12:27:40.012 INFO:teuthology.orchestra.run.smithi088.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-05-17T12:27:40.081 INFO:teuthology.orchestra.run.smithi088.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-05-17T12:27:40.149 INFO:teuthology.orchestra.run.smithi088.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-05-17T12:27:40.218 INFO:teuthology.orchestra.run.smithi088.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-05-17T12:27:40.286 INFO:teuthology.orchestra.run.smithi088.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-05-17T12:27:40.355 INFO:teuthology.orchestra.run.smithi088.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-05-17T12:27:40.406 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/btrfs.h usability... yes 2023-05-17T12:27:40.421 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/btrfs.h presence... yes 2023-05-17T12:27:40.421 INFO:teuthology.orchestra.run.smithi088.stdout:checking for linux/btrfs.h... yes 2023-05-17T12:27:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/btrfs_tree.h usability... yes 2023-05-17T12:27:40.495 INFO:teuthology.orchestra.run.smithi088.stdout:checking linux/btrfs_tree.h presence... yes 2023-05-17T12:27:40.495 INFO:teuthology.orchestra.run.smithi088.stdout:checking for linux/btrfs_tree.h... yes 2023-05-17T12:27:40.561 INFO:teuthology.orchestra.run.smithi088.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-05-17T12:27:40.589 INFO:teuthology.orchestra.run.smithi088.stdout:configure: creating ./config.status 2023-05-17T12:27:41.400 INFO:teuthology.orchestra.run.smithi088.stdout:config.status: creating include/builddefs 2023-05-17T12:27:41.426 INFO:teuthology.orchestra.run.smithi088.stdout:config.status: creating include/config.h 2023-05-17T12:27:41.446 INFO:teuthology.orchestra.run.smithi088.stdout:config.status: executing libtool commands 2023-05-17T12:27:41.520 INFO:teuthology.orchestra.run.smithi088.stdout:Building include 2023-05-17T12:27:41.527 INFO:teuthology.orchestra.run.smithi088.stdout:Building lib 2023-05-17T12:27:41.533 INFO:teuthology.orchestra.run.smithi088.stdout: [LTDEP] 2023-05-17T12:27:41.728 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] dataascii.lo 2023-05-17T12:27:41.919 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] databin.lo 2023-05-17T12:27:42.143 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] datapid.lo 2023-05-17T12:27:42.321 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] file_lock.lo 2023-05-17T12:27:42.547 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] forker.lo 2023-05-17T12:27:42.753 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] pattern.lo 2023-05-17T12:27:42.944 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] open_flags.lo 2023-05-17T12:27:43.161 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] random_range.lo 2023-05-17T12:27:43.463 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] string_to_tokens.lo 2023-05-17T12:27:43.638 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] str_to_bytes.lo 2023-05-17T12:27:43.842 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] tlibio.lo 2023-05-17T12:27:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] write_log.lo 2023-05-17T12:27:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] random.lo 2023-05-17T12:27:44.661 INFO:teuthology.orchestra.run.smithi088.stdout: [LD] 2023-05-17T12:27:44.781 INFO:teuthology.orchestra.run.smithi088.stdout:Building ltp 2023-05-17T12:27:44.787 INFO:teuthology.orchestra.run.smithi088.stdout: [DEP] 2023-05-17T12:27:45.006 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] doio 2023-05-17T12:27:45.729 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fsstress 2023-05-17T12:27:47.081 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fsx 2023-05-17T12:27:48.006 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] growfiles 2023-05-17T12:27:48.586 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] iogen 2023-05-17T12:27:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-stress 2023-05-17T12:27:49.518 INFO:teuthology.orchestra.run.smithi088.stdout:Building src 2023-05-17T12:27:49.527 INFO:teuthology.orchestra.run.smithi088.stdout: [DEP] 2023-05-17T12:27:51.907 INFO:teuthology.orchestra.run.smithi088.stdout: [DEP] 2023-05-17T12:27:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: [DEP] 2023-05-17T12:27:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: [DEP] 2023-05-17T12:27:52.306 INFO:teuthology.orchestra.run.smithi088.stdout: [DEP] 2023-05-17T12:27:52.344 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] dirstress 2023-05-17T12:27:52.667 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fill 2023-05-17T12:27:52.904 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fill2 2023-05-17T12:27:53.216 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] getpagesize 2023-05-17T12:27:53.435 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] holes 2023-05-17T12:27:53.715 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] lstat64 2023-05-17T12:27:53.982 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] nametest 2023-05-17T12:27:54.305 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] permname 2023-05-17T12:27:54.594 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] randholes 2023-05-17T12:27:54.864 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:27:54.868 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:27:54.928 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] runas 2023-05-17T12:27:55.190 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] truncfile 2023-05-17T12:27:55.456 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] usemem 2023-05-17T12:27:55.690 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] mmapcat 2023-05-17T12:27:55.924 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] append_reader 2023-05-17T12:27:56.161 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] append_writer 2023-05-17T12:27:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] dirperf 2023-05-17T12:27:56.702 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] metaperf 2023-05-17T12:27:57.037 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] devzero 2023-05-17T12:27:57.299 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] feature 2023-05-17T12:27:57.602 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] alloc 2023-05-17T12:27:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fault 2023-05-17T12:27:58.151 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fstest 2023-05-17T12:27:58.472 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_access_root 2023-05-17T12:27:58.711 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] godown 2023-05-17T12:27:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] resvtest 2023-05-17T12:27:59.240 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] writemod 2023-05-17T12:27:59.473 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] writev_on_pagefault 2023-05-17T12:27:59.720 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] makeextents 2023-05-17T12:27:59.986 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] itrash 2023-05-17T12:28:00.224 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] rename 2023-05-17T12:28:00.448 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] multi_open_unlink 2023-05-17T12:28:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] unwritten_sync 2023-05-17T12:28:00.965 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] genhashnames 2023-05-17T12:28:01.235 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_holes 2023-05-17T12:28:01.467 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mmap_writev 2023-05-17T12:28:01.699 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_truncate_cmtime 2023-05-17T12:28:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] dirhash_collide 2023-05-17T12:28:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_rename_overwrite 2023-05-17T12:28:02.435 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] holetest 2023-05-17T12:28:02.736 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_truncate_self 2023-05-17T12:28:02.962 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] af_unix 2023-05-17T12:28:03.199 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mmap_stale_pmd 2023-05-17T12:28:03.436 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mmap_cow_race 2023-05-17T12:28:03.685 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mmap_fallocate 2023-05-17T12:28:03.920 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fsync-err 2023-05-17T12:28:04.189 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mmap_write_ro 2023-05-17T12:28:04.426 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_ext4_dax_journal_corruption 2023-05-17T12:28:04.669 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_ext4_dax_inline_corruption 2023-05-17T12:28:04.911 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_ofd_locks 2023-05-17T12:28:05.195 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mmap_collision 2023-05-17T12:28:05.477 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] mmap-write-concurrent 2023-05-17T12:28:05.732 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_get_file_time 2023-05-17T12:28:05.966 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_create_short_dirs 2023-05-17T12:28:06.215 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_create_long_dirs 2023-05-17T12:28:06.464 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_enospc 2023-05-17T12:28:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mmap_writev_overlap 2023-05-17T12:28:06.989 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] checkpoint_journal 2023-05-17T12:28:07.229 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] mmap-rw-fault 2023-05-17T12:28:07.498 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] allocstale 2023-05-17T12:28:07.755 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mmap_cow_memory_failure 2023-05-17T12:28:08.010 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fake-dump-rootino 2023-05-17T12:28:08.244 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] dio-buf-fault 2023-05-17T12:28:08.484 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] xfsctl 2023-05-17T12:28:08.759 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] bstat 2023-05-17T12:28:09.047 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mtab 2023-05-17T12:28:09.315 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] getdevicesize 2023-05-17T12:28:09.543 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] preallo_rw_pattern_reader 2023-05-17T12:28:09.789 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] preallo_rw_pattern_writer 2023-05-17T12:28:10.035 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] ftrunc 2023-05-17T12:28:10.270 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] trunc 2023-05-17T12:28:10.517 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fs_perms 2023-05-17T12:28:10.765 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] testx 2023-05-17T12:28:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] looptest 2023-05-17T12:28:11.255 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] locktest 2023-05-17T12:28:11.643 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] unwritten_mmap 2023-05-17T12:28:11.894 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] bulkstat_unlink_test 2023-05-17T12:28:12.180 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] deduperace 2023-05-17T12:28:12.457 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] bulkstat_unlink_test_modified 2023-05-17T12:28:12.741 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_dir_offset 2023-05-17T12:28:12.975 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_futimens 2023-05-17T12:28:13.199 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_immutable 2023-05-17T12:28:13.871 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] stale_handle 2023-05-17T12:28:14.130 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] pwrite_mmap_blocked 2023-05-17T12:28:14.371 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_dir_offset2 2023-05-17T12:28:14.648 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] seek_sanity_test 2023-05-17T12:28:15.142 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] seek_copy_test 2023-05-17T12:28:15.405 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_readdir_1 2023-05-17T12:28:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_readdir_2 2023-05-17T12:28:15.875 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fsync-tester 2023-05-17T12:28:16.205 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] nsexec 2023-05-17T12:28:16.466 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] cloner 2023-05-17T12:28:16.727 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] renameat2 2023-05-17T12:28:16.981 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_getcwd 2023-05-17T12:28:17.224 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] e4compact 2023-05-17T12:28:17.512 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] test-nextquota 2023-05-17T12:28:17.770 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] punch-alternating 2023-05-17T12:28:18.030 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] attr-list-by-handle-cursor-test 2023-05-17T12:28:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] listxattr 2023-05-17T12:28:18.518 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] dio-interleaved 2023-05-17T12:28:18.763 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_dir_type 2023-05-17T12:28:19.004 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] dio-invalidate-cache 2023-05-17T12:28:19.292 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] stat_test 2023-05-17T12:28:19.672 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_encrypted_d_revalidate 2023-05-17T12:28:19.923 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] attr_replace_test 2023-05-17T12:28:20.172 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] swapon 2023-05-17T12:28:20.422 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] mkswap 2023-05-17T12:28:20.658 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_attr_corruption 2023-05-17T12:28:20.894 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_open_tmpfiles 2023-05-17T12:28:21.162 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fscrypt-crypt-util 2023-05-17T12:28:21.864 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] bulkstat_null_ocount 2023-05-17T12:28:22.110 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] splice-test 2023-05-17T12:28:22.375 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] chprojid_fail 2023-05-17T12:28:22.625 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] detached_mounts_propagation 2023-05-17T12:28:22.898 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] ext4_resize 2023-05-17T12:28:23.132 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_readdir_3 2023-05-17T12:28:23.414 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] splice2pipe 2023-05-17T12:28:23.663 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] uuid_ioctl 2023-05-17T12:28:23.904 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fiemap-tester 2023-05-17T12:28:24.258 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_stripealign 2023-05-17T12:28:24.499 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] open_by_handle 2023-05-17T12:28:24.833 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] t_mmap_dio 2023-05-17T12:28:25.052 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:28:25.056 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:28:25.083 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] xfsfind 2023-05-17T12:28:25.365 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] fssum 2023-05-17T12:28:25.875 INFO:teuthology.orchestra.run.smithi088.stdout:Building log-writes 2023-05-17T12:28:25.885 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] replay-log 2023-05-17T12:28:26.281 INFO:teuthology.orchestra.run.smithi088.stdout:Building perf 2023-05-17T12:28:26.287 INFO:teuthology.orchestra.run.smithi088.stdout:Building aio-dio-regress 2023-05-17T12:28:26.298 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-append-write-fallocate-race 2023-05-17T12:28:26.561 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-fcntl-race 2023-05-17T12:28:26.813 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-subblock-eof-read 2023-05-17T12:28:27.047 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-append-write-read-race 2023-05-17T12:28:27.312 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-invalidate-readahead 2023-05-17T12:28:27.568 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-hole-filling-race 2023-05-17T12:28:27.808 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-05-17T12:28:28.034 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-last-ref-held-by-io 2023-05-17T12:28:28.296 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-cycle-write 2023-05-17T12:28:28.570 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-extend-stat 2023-05-17T12:28:28.824 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-05-17T12:28:29.045 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-invalidate-failure 2023-05-17T12:28:29.295 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aiodio_sparse2 2023-05-17T12:28:29.600 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aiocp 2023-05-17T12:28:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-cow-race 2023-05-17T12:28:30.157 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-write-verify 2023-05-17T12:28:30.437 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] aio-dio-eof-race 2023-05-17T12:28:30.710 INFO:teuthology.orchestra.run.smithi088.stdout:Building vfs 2023-05-17T12:28:30.720 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] vfstest 2023-05-17T12:28:32.708 INFO:teuthology.orchestra.run.smithi088.stdout: [CC] mount-idmapped 2023-05-17T12:28:33.175 INFO:teuthology.orchestra.run.smithi088.stdout:Building m4 2023-05-17T12:28:33.181 INFO:teuthology.orchestra.run.smithi088.stdout:Building common 2023-05-17T12:28:33.188 INFO:teuthology.orchestra.run.smithi088.stdout:Building tests 2023-05-17T12:28:33.198 INFO:teuthology.orchestra.run.smithi088.stdout:Building perf 2023-05-17T12:28:33.207 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/perf/group.list 2023-05-17T12:28:33.233 INFO:teuthology.orchestra.run.smithi088.stdout:Building ext4 2023-05-17T12:28:33.243 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/ext4/group.list 2023-05-17T12:28:33.328 INFO:teuthology.orchestra.run.smithi088.stdout:Building ocfs2 2023-05-17T12:28:33.337 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/ocfs2/group.list 2023-05-17T12:28:33.368 INFO:teuthology.orchestra.run.smithi088.stdout:Building overlay 2023-05-17T12:28:33.378 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/overlay/group.list 2023-05-17T12:28:33.465 INFO:teuthology.orchestra.run.smithi088.stdout:Building cifs 2023-05-17T12:28:33.475 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/cifs/group.list 2023-05-17T12:28:33.503 INFO:teuthology.orchestra.run.smithi088.stdout:Building generic 2023-05-17T12:28:33.515 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/generic/group.list 2023-05-17T12:28:33.740 INFO:teuthology.orchestra.run.smithi088.stdout:Building shared 2023-05-17T12:28:33.749 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/shared/group.list 2023-05-17T12:28:33.788 INFO:teuthology.orchestra.run.smithi088.stdout:Building nfs 2023-05-17T12:28:33.797 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/nfs/group.list 2023-05-17T12:28:33.830 INFO:teuthology.orchestra.run.smithi088.stdout:Building f2fs 2023-05-17T12:28:33.839 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/f2fs/group.list 2023-05-17T12:28:33.878 INFO:teuthology.orchestra.run.smithi088.stdout:Building udf 2023-05-17T12:28:33.888 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/udf/group.list 2023-05-17T12:28:33.914 INFO:teuthology.orchestra.run.smithi088.stdout:Building ceph 2023-05-17T12:28:33.923 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/ceph/group.list 2023-05-17T12:28:33.957 INFO:teuthology.orchestra.run.smithi088.stdout:Building xfs 2023-05-17T12:28:33.968 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/xfs/group.list 2023-05-17T12:28:34.196 INFO:teuthology.orchestra.run.smithi088.stdout:Building btrfs 2023-05-17T12:28:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/btrfs/group.list 2023-05-17T12:28:34.339 INFO:teuthology.orchestra.run.smithi088.stdout:Building tmpfs 2023-05-17T12:28:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/tmpfs/group.list 2023-05-17T12:28:34.379 INFO:teuthology.orchestra.run.smithi088.stdout:Building selftest 2023-05-17T12:28:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/selftest/group.list 2023-05-17T12:28:34.419 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo make install) 2023-05-17T12:28:34.504 INFO:teuthology.orchestra.run.smithi088.stdout:Building include 2023-05-17T12:28:34.510 INFO:teuthology.orchestra.run.smithi088.stdout:Building lib 2023-05-17T12:28:34.518 INFO:teuthology.orchestra.run.smithi088.stdout:Building ltp 2023-05-17T12:28:34.525 INFO:teuthology.orchestra.run.smithi088.stdout:Building src 2023-05-17T12:28:34.583 INFO:teuthology.orchestra.run.smithi088.stdout:Building log-writes 2023-05-17T12:28:34.590 INFO:teuthology.orchestra.run.smithi088.stdout:Building perf 2023-05-17T12:28:34.597 INFO:teuthology.orchestra.run.smithi088.stdout:Building aio-dio-regress 2023-05-17T12:28:34.604 INFO:teuthology.orchestra.run.smithi088.stdout:Building vfs 2023-05-17T12:28:34.611 INFO:teuthology.orchestra.run.smithi088.stdout:Building m4 2023-05-17T12:28:34.618 INFO:teuthology.orchestra.run.smithi088.stdout:Building common 2023-05-17T12:28:34.625 INFO:teuthology.orchestra.run.smithi088.stdout:Building tests 2023-05-17T12:28:34.634 INFO:teuthology.orchestra.run.smithi088.stdout:Building perf 2023-05-17T12:28:34.643 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/perf/group.list 2023-05-17T12:28:34.670 INFO:teuthology.orchestra.run.smithi088.stdout:Building ext4 2023-05-17T12:28:34.680 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/ext4/group.list 2023-05-17T12:28:34.765 INFO:teuthology.orchestra.run.smithi088.stdout:Building ocfs2 2023-05-17T12:28:34.774 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/ocfs2/group.list 2023-05-17T12:28:34.805 INFO:teuthology.orchestra.run.smithi088.stdout:Building overlay 2023-05-17T12:28:34.814 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/overlay/group.list 2023-05-17T12:28:34.900 INFO:teuthology.orchestra.run.smithi088.stdout:Building cifs 2023-05-17T12:28:34.910 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/cifs/group.list 2023-05-17T12:28:34.939 INFO:teuthology.orchestra.run.smithi088.stdout:Building generic 2023-05-17T12:28:34.950 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/generic/group.list 2023-05-17T12:28:35.168 INFO:teuthology.orchestra.run.smithi088.stdout:Building shared 2023-05-17T12:28:35.178 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/shared/group.list 2023-05-17T12:28:35.217 INFO:teuthology.orchestra.run.smithi088.stdout:Building nfs 2023-05-17T12:28:35.226 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/nfs/group.list 2023-05-17T12:28:35.259 INFO:teuthology.orchestra.run.smithi088.stdout:Building f2fs 2023-05-17T12:28:35.269 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/f2fs/group.list 2023-05-17T12:28:35.308 INFO:teuthology.orchestra.run.smithi088.stdout:Building udf 2023-05-17T12:28:35.317 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/udf/group.list 2023-05-17T12:28:35.344 INFO:teuthology.orchestra.run.smithi088.stdout:Building ceph 2023-05-17T12:28:35.353 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/ceph/group.list 2023-05-17T12:28:35.386 INFO:teuthology.orchestra.run.smithi088.stdout:Building xfs 2023-05-17T12:28:35.397 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/xfs/group.list 2023-05-17T12:28:35.620 INFO:teuthology.orchestra.run.smithi088.stdout:Building btrfs 2023-05-17T12:28:35.630 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/btrfs/group.list 2023-05-17T12:28:35.760 INFO:teuthology.orchestra.run.smithi088.stdout:Building tmpfs 2023-05-17T12:28:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/tmpfs/group.list 2023-05-17T12:28:35.800 INFO:teuthology.orchestra.run.smithi088.stdout:Building selftest 2023-05-17T12:28:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: [GROUP] /tmp/tmp.buK0S8bWYQxfstests-dev/tests/selftest/group.list 2023-05-17T12:28:35.836 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-05-17T12:28:35.839 INFO:teuthology.orchestra.run.smithi088.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-17T12:28:35.839 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-05-17T12:28:35.842 INFO:teuthology.orchestra.run.smithi088.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-17T12:28:35.842 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-05-17T12:28:35.845 INFO:teuthology.orchestra.run.smithi088.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-05-17T12:28:35.867 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-05-17T12:28:36.028 INFO:teuthology.orchestra.run.smithi088.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-05-17T12:28:36.049 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-05-17T12:28:36.078 INFO:teuthology.orchestra.run.smithi088.stdout:Building log-writes 2023-05-17T12:28:36.085 INFO:teuthology.orchestra.run.smithi088.stdout:Building perf 2023-05-17T12:28:36.092 INFO:teuthology.orchestra.run.smithi088.stdout:Building aio-dio-regress 2023-05-17T12:28:36.099 INFO:teuthology.orchestra.run.smithi088.stdout:Building vfs 2023-05-17T12:28:36.104 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake -C log-writes install 2023-05-17T12:28:36.107 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-05-17T12:28:36.128 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-05-17T12:28:36.149 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake -C perf install 2023-05-17T12:28:36.152 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-05-17T12:28:36.173 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-05-17T12:28:36.227 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-05-17T12:28:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-05-17T12:28:36.251 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-05-17T12:28:36.379 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake -C vfs install 2023-05-17T12:28:36.381 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-05-17T12:28:36.405 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-05-17T12:28:36.431 INFO:teuthology.orchestra.run.smithi088.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-05-17T12:28:36.452 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-05-17T12:28:39.177 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-05-17T12:28:39.381 INFO:teuthology.orchestra.run.smithi088.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-05-17T12:28:39.433 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-05-17T12:28:39.435 INFO:teuthology.orchestra.run.smithi088.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-17T12:28:39.436 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-05-17T12:28:39.438 INFO:teuthology.orchestra.run.smithi088.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-05-17T12:28:39.459 INFO:teuthology.orchestra.run.smithi088.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-05-17T12:28:39.776 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-05-17T12:28:39.778 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/btrfs/ install 2023-05-17T12:28:39.782 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-05-17T12:28:39.804 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-05-17T12:28:41.711 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-05-17T12:28:41.732 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 014.out 016.out 175.out 193.out 240.out 069.out 282.out 015.out 280.out 140.out 258.out 008.out 004.out 199.out 233.out 194.out 055.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 225.out 096.out 125.out 078.out 152.out 103.out 264.out 243.out 192.out 148.out 075.out 178.out 284.out 052.out 256.out 207.out 228.out 276.out 183.out 094.out 046.out 273.out 265.out 251.out 209.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 128.out 232.out 165.out 026.out 021.out 035.out 221.out 087.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 242.out 187.out 220.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 084.out 129.out 029.out 229.out 254.out 111.out 011.out 155.out 275.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 114.out 138.out 095.out 038.out 145.out 160.out 137.out 091.out 081.out 071.out 061.out 085.out 067.out 200.out 100.out 025.out 286.out 269.out 039.out 196.out 098.out 090.out 080.out 070.out 060.out 208.out 009.out 167.out 217.out 120.out 191.out 133.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 281.out 241.out 235.out 253.out 257.out 124.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 153.out 097.out 283.out 236.out 186.out 053.out 164.out 154.out 239.out 189.out 139.out 267.out 141.out 214.out 005.out 223.out 028.out 150.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 180.out 036.out 198.out 108.out 190.out 173.out 050.out 105.out 106.out 291.out 185.out 037.out 088.out 285.out 123.out 056.out 201.out 019.out 001.out 086.out 142.out 237.out 151.out 231.out 024.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 073.out 099.out 082.out 030.out 203.out 003.out 076.out 245.out 074.out 222.out 159.out 249.out 122.out 234.out 022.out 174.out 006.out 045.out 290.out 299.out 224.out 181.out 271.out 149.out 064.out 077.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 049.out 226.out 126.out /var/lib/xfstests/tests/btrfs 2023-05-17T12:28:43.647 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/ceph/ install 2023-05-17T12:28:43.649 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-05-17T12:28:43.670 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-05-17T12:28:43.717 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-05-17T12:28:43.738 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-05-17T12:28:43.785 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/cifs/ install 2023-05-17T12:28:43.787 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-05-17T12:28:43.808 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-05-17T12:28:43.830 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-05-17T12:28:43.851 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-05-17T12:28:43.872 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/ext4/ install 2023-05-17T12:28:43.875 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-05-17T12:28:43.896 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-05-17T12:28:44.355 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-05-17T12:28:44.376 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-05-17T12:28:44.857 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/f2fs/ install 2023-05-17T12:28:44.859 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-05-17T12:28:44.880 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-05-17T12:28:44.908 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-05-17T12:28:44.929 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-05-17T12:28:44.957 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/generic/ install 2023-05-17T12:28:44.963 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-05-17T12:28:44.983 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-05-17T12:28:49.777 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-05-17T12:28:49.799 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 531.out 243.out 592.out 282.out 272.out 472.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 622.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 566.out 295.out 390.out 497.out 160.out 291.out 274.out 061.out 239.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 030.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 667.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 280.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 433.out 704.out 108.out 504.out 404.out 104.out 655.out 021.out 452.out 457.out 297.out 393.out 333.out 599.out 476.out 535.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 436.out 485.out 120.out 175.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 167.out 724.out 206.out 352.out 663.out 394.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 715.out 279.out 544.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 075.out 684.out 674.out 550.out 052.out 062.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 688.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 244.out 385.out 005.out 336.out 150.out 579.out 236.out 505.out 405.out 342.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 691.out 305.out 105.out 263.out 144.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 634.out 560.out 581.out 166.out 707.out 461.out 381.out 445.out 307.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 613.out 326.out 082.out 480.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 487.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 378.out 004.out 458.out 534.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 173.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 376.out 431.out 635.out 288.out 722.out 331.out 128.out 377.out 713.out 513.out 554.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 310.out 427.out 259.out 210.out 449.out 327.out 330.out 110.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 643.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 245.out 522.out 422.out 624.out 322.out 222.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 565.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 141.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 012.out 195.out 388.out 682.out 483.out 397.out 070.out 596.out 720.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 142.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 301.out 010.out 001.out 096.out 495.out 048.out 665.out 589.out 095.out 697.out 145.out 641.out 464.out 491.out 081.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 169.out 090.out 080.out 708.out 608.out 508.out 409.out 309.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 304.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 548.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out /var/lib/xfstests/tests/generic 2023-05-17T12:28:54.642 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/nfs/ install 2023-05-17T12:28:54.644 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-05-17T12:28:54.665 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-05-17T12:28:54.685 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-05-17T12:28:54.706 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-05-17T12:28:54.727 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/ocfs2/ install 2023-05-17T12:28:54.730 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-05-17T12:28:54.751 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-05-17T12:28:54.772 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-05-17T12:28:54.792 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-05-17T12:28:54.814 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/overlay/ install 2023-05-17T12:28:54.817 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-05-17T12:28:54.838 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-05-17T12:28:55.206 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:28:55.211 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:28:55.483 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-05-17T12:28:55.504 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-05-17T12:28:56.147 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/perf/ install 2023-05-17T12:28:56.149 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-05-17T12:28:56.170 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-05-17T12:28:56.192 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-05-17T12:28:56.213 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-05-17T12:28:56.234 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/selftest/ install 2023-05-17T12:28:56.237 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-05-17T12:28:56.258 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-05-17T12:28:56.311 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-05-17T12:28:56.332 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-05-17T12:28:56.386 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/shared/ install 2023-05-17T12:28:56.389 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-05-17T12:28:56.410 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-05-17T12:28:56.444 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-05-17T12:28:56.465 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-05-17T12:28:56.500 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/tmpfs/ install 2023-05-17T12:28:56.503 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-05-17T12:28:56.524 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-05-17T12:28:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-05-17T12:28:56.566 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-05-17T12:28:56.587 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/udf/ install 2023-05-17T12:28:56.589 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-05-17T12:28:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-05-17T12:28:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-05-17T12:28:56.652 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-05-17T12:28:56.673 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.buK0S8bWYQxfstests-dev/tests/xfs/ install 2023-05-17T12:28:56.679 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-05-17T12:28:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-05-17T12:29:01.224 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-05-17T12:29:01.245 INFO:teuthology.orchestra.run.smithi088.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 262.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 388.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 363.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 219.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 725.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out /var/lib/xfstests/tests/xfs 2023-05-17T12:29:05.829 INFO:teuthology.orchestra.run.smithi088.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-05-17T12:29:05.850 INFO:teuthology.orchestra.run.smithi088.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-05-17T12:29:05.871 INFO:teuthology.orchestra.run.smithi088.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-05-17T12:29:05.892 INFO:teuthology.orchestra.run.smithi088.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-05-17T12:29:05.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T12:29:05.917 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec ls tests/generic) 2023-05-17T12:29:05.961 INFO:teuthology.orchestra.run.smithi088.stdout:001 2023-05-17T12:29:05.961 INFO:teuthology.orchestra.run.smithi088.stdout:001.out 2023-05-17T12:29:05.961 INFO:teuthology.orchestra.run.smithi088.stdout:002 2023-05-17T12:29:05.962 INFO:teuthology.orchestra.run.smithi088.stdout:002.out 2023-05-17T12:29:05.962 INFO:teuthology.orchestra.run.smithi088.stdout:003 2023-05-17T12:29:05.962 INFO:teuthology.orchestra.run.smithi088.stdout:003.out 2023-05-17T12:29:05.962 INFO:teuthology.orchestra.run.smithi088.stdout:004 2023-05-17T12:29:05.962 INFO:teuthology.orchestra.run.smithi088.stdout:004.out 2023-05-17T12:29:05.962 INFO:teuthology.orchestra.run.smithi088.stdout:005 2023-05-17T12:29:05.963 INFO:teuthology.orchestra.run.smithi088.stdout:005.out 2023-05-17T12:29:05.963 INFO:teuthology.orchestra.run.smithi088.stdout:006 2023-05-17T12:29:05.963 INFO:teuthology.orchestra.run.smithi088.stdout:006.out 2023-05-17T12:29:05.963 INFO:teuthology.orchestra.run.smithi088.stdout:007 2023-05-17T12:29:05.963 INFO:teuthology.orchestra.run.smithi088.stdout:007.out 2023-05-17T12:29:05.963 INFO:teuthology.orchestra.run.smithi088.stdout:008 2023-05-17T12:29:05.964 INFO:teuthology.orchestra.run.smithi088.stdout:008.out 2023-05-17T12:29:05.964 INFO:teuthology.orchestra.run.smithi088.stdout:009 2023-05-17T12:29:05.964 INFO:teuthology.orchestra.run.smithi088.stdout:009.out 2023-05-17T12:29:05.965 INFO:teuthology.orchestra.run.smithi088.stdout:010 2023-05-17T12:29:05.965 INFO:teuthology.orchestra.run.smithi088.stdout:010.out 2023-05-17T12:29:05.965 INFO:teuthology.orchestra.run.smithi088.stdout:011 2023-05-17T12:29:05.966 INFO:teuthology.orchestra.run.smithi088.stdout:011.out 2023-05-17T12:29:05.966 INFO:teuthology.orchestra.run.smithi088.stdout:012 2023-05-17T12:29:05.966 INFO:teuthology.orchestra.run.smithi088.stdout:012.out 2023-05-17T12:29:05.966 INFO:teuthology.orchestra.run.smithi088.stdout:013 2023-05-17T12:29:05.967 INFO:teuthology.orchestra.run.smithi088.stdout:013.out 2023-05-17T12:29:05.967 INFO:teuthology.orchestra.run.smithi088.stdout:014 2023-05-17T12:29:05.967 INFO:teuthology.orchestra.run.smithi088.stdout:014.out 2023-05-17T12:29:05.967 INFO:teuthology.orchestra.run.smithi088.stdout:015 2023-05-17T12:29:05.968 INFO:teuthology.orchestra.run.smithi088.stdout:015.out 2023-05-17T12:29:05.968 INFO:teuthology.orchestra.run.smithi088.stdout:016 2023-05-17T12:29:05.968 INFO:teuthology.orchestra.run.smithi088.stdout:016.out 2023-05-17T12:29:05.969 INFO:teuthology.orchestra.run.smithi088.stdout:017 2023-05-17T12:29:05.969 INFO:teuthology.orchestra.run.smithi088.stdout:017.out 2023-05-17T12:29:05.969 INFO:teuthology.orchestra.run.smithi088.stdout:018 2023-05-17T12:29:05.969 INFO:teuthology.orchestra.run.smithi088.stdout:018.out 2023-05-17T12:29:05.970 INFO:teuthology.orchestra.run.smithi088.stdout:019 2023-05-17T12:29:05.970 INFO:teuthology.orchestra.run.smithi088.stdout:019.out 2023-05-17T12:29:05.970 INFO:teuthology.orchestra.run.smithi088.stdout:020 2023-05-17T12:29:05.971 INFO:teuthology.orchestra.run.smithi088.stdout:020.out 2023-05-17T12:29:05.971 INFO:teuthology.orchestra.run.smithi088.stdout:021 2023-05-17T12:29:05.971 INFO:teuthology.orchestra.run.smithi088.stdout:021.out 2023-05-17T12:29:05.971 INFO:teuthology.orchestra.run.smithi088.stdout:022 2023-05-17T12:29:05.972 INFO:teuthology.orchestra.run.smithi088.stdout:022.out 2023-05-17T12:29:05.972 INFO:teuthology.orchestra.run.smithi088.stdout:023 2023-05-17T12:29:05.972 INFO:teuthology.orchestra.run.smithi088.stdout:023.out 2023-05-17T12:29:05.972 INFO:teuthology.orchestra.run.smithi088.stdout:024 2023-05-17T12:29:05.973 INFO:teuthology.orchestra.run.smithi088.stdout:024.out 2023-05-17T12:29:05.973 INFO:teuthology.orchestra.run.smithi088.stdout:025 2023-05-17T12:29:05.973 INFO:teuthology.orchestra.run.smithi088.stdout:025.out 2023-05-17T12:29:05.973 INFO:teuthology.orchestra.run.smithi088.stdout:026 2023-05-17T12:29:05.973 INFO:teuthology.orchestra.run.smithi088.stdout:026.out 2023-05-17T12:29:05.973 INFO:teuthology.orchestra.run.smithi088.stdout:027 2023-05-17T12:29:05.974 INFO:teuthology.orchestra.run.smithi088.stdout:027.out 2023-05-17T12:29:05.974 INFO:teuthology.orchestra.run.smithi088.stdout:028 2023-05-17T12:29:05.974 INFO:teuthology.orchestra.run.smithi088.stdout:028.out 2023-05-17T12:29:05.974 INFO:teuthology.orchestra.run.smithi088.stdout:029 2023-05-17T12:29:05.974 INFO:teuthology.orchestra.run.smithi088.stdout:029.out 2023-05-17T12:29:05.974 INFO:teuthology.orchestra.run.smithi088.stdout:030 2023-05-17T12:29:05.974 INFO:teuthology.orchestra.run.smithi088.stdout:030.out 2023-05-17T12:29:05.975 INFO:teuthology.orchestra.run.smithi088.stdout:031 2023-05-17T12:29:05.975 INFO:teuthology.orchestra.run.smithi088.stdout:031.out 2023-05-17T12:29:05.975 INFO:teuthology.orchestra.run.smithi088.stdout:032 2023-05-17T12:29:05.975 INFO:teuthology.orchestra.run.smithi088.stdout:032.out 2023-05-17T12:29:05.975 INFO:teuthology.orchestra.run.smithi088.stdout:033 2023-05-17T12:29:05.975 INFO:teuthology.orchestra.run.smithi088.stdout:033.out 2023-05-17T12:29:05.975 INFO:teuthology.orchestra.run.smithi088.stdout:034 2023-05-17T12:29:05.976 INFO:teuthology.orchestra.run.smithi088.stdout:034.out 2023-05-17T12:29:05.976 INFO:teuthology.orchestra.run.smithi088.stdout:035 2023-05-17T12:29:05.976 INFO:teuthology.orchestra.run.smithi088.stdout:035.cfg 2023-05-17T12:29:05.976 INFO:teuthology.orchestra.run.smithi088.stdout:035.out.default 2023-05-17T12:29:05.976 INFO:teuthology.orchestra.run.smithi088.stdout:035.out.nfs 2023-05-17T12:29:05.976 INFO:teuthology.orchestra.run.smithi088.stdout:036 2023-05-17T12:29:05.976 INFO:teuthology.orchestra.run.smithi088.stdout:036.out 2023-05-17T12:29:05.977 INFO:teuthology.orchestra.run.smithi088.stdout:037 2023-05-17T12:29:05.977 INFO:teuthology.orchestra.run.smithi088.stdout:037.out 2023-05-17T12:29:05.977 INFO:teuthology.orchestra.run.smithi088.stdout:038 2023-05-17T12:29:05.977 INFO:teuthology.orchestra.run.smithi088.stdout:038.out 2023-05-17T12:29:05.977 INFO:teuthology.orchestra.run.smithi088.stdout:039 2023-05-17T12:29:05.977 INFO:teuthology.orchestra.run.smithi088.stdout:039.out 2023-05-17T12:29:05.977 INFO:teuthology.orchestra.run.smithi088.stdout:040 2023-05-17T12:29:05.978 INFO:teuthology.orchestra.run.smithi088.stdout:040.out 2023-05-17T12:29:05.978 INFO:teuthology.orchestra.run.smithi088.stdout:041 2023-05-17T12:29:05.978 INFO:teuthology.orchestra.run.smithi088.stdout:041.out 2023-05-17T12:29:05.978 INFO:teuthology.orchestra.run.smithi088.stdout:042 2023-05-17T12:29:05.978 INFO:teuthology.orchestra.run.smithi088.stdout:042.out 2023-05-17T12:29:05.978 INFO:teuthology.orchestra.run.smithi088.stdout:043 2023-05-17T12:29:05.978 INFO:teuthology.orchestra.run.smithi088.stdout:043.out 2023-05-17T12:29:05.979 INFO:teuthology.orchestra.run.smithi088.stdout:044 2023-05-17T12:29:05.979 INFO:teuthology.orchestra.run.smithi088.stdout:044.out 2023-05-17T12:29:05.979 INFO:teuthology.orchestra.run.smithi088.stdout:045 2023-05-17T12:29:05.979 INFO:teuthology.orchestra.run.smithi088.stdout:045.out 2023-05-17T12:29:05.979 INFO:teuthology.orchestra.run.smithi088.stdout:046 2023-05-17T12:29:05.979 INFO:teuthology.orchestra.run.smithi088.stdout:046.out 2023-05-17T12:29:05.979 INFO:teuthology.orchestra.run.smithi088.stdout:047 2023-05-17T12:29:05.980 INFO:teuthology.orchestra.run.smithi088.stdout:047.out 2023-05-17T12:29:05.980 INFO:teuthology.orchestra.run.smithi088.stdout:048 2023-05-17T12:29:05.980 INFO:teuthology.orchestra.run.smithi088.stdout:048.out 2023-05-17T12:29:05.980 INFO:teuthology.orchestra.run.smithi088.stdout:049 2023-05-17T12:29:05.980 INFO:teuthology.orchestra.run.smithi088.stdout:049.out 2023-05-17T12:29:05.980 INFO:teuthology.orchestra.run.smithi088.stdout:050 2023-05-17T12:29:05.980 INFO:teuthology.orchestra.run.smithi088.stdout:050.cfg 2023-05-17T12:29:05.981 INFO:teuthology.orchestra.run.smithi088.stdout:050.out.default 2023-05-17T12:29:05.981 INFO:teuthology.orchestra.run.smithi088.stdout:050.out.nojournal 2023-05-17T12:29:05.981 INFO:teuthology.orchestra.run.smithi088.stdout:050.out.xfsquota 2023-05-17T12:29:05.981 INFO:teuthology.orchestra.run.smithi088.stdout:051 2023-05-17T12:29:05.981 INFO:teuthology.orchestra.run.smithi088.stdout:051.out 2023-05-17T12:29:05.982 INFO:teuthology.orchestra.run.smithi088.stdout:052 2023-05-17T12:29:05.982 INFO:teuthology.orchestra.run.smithi088.stdout:052.out 2023-05-17T12:29:05.982 INFO:teuthology.orchestra.run.smithi088.stdout:053 2023-05-17T12:29:05.983 INFO:teuthology.orchestra.run.smithi088.stdout:053.out 2023-05-17T12:29:05.983 INFO:teuthology.orchestra.run.smithi088.stdout:054 2023-05-17T12:29:05.983 INFO:teuthology.orchestra.run.smithi088.stdout:054.out 2023-05-17T12:29:05.983 INFO:teuthology.orchestra.run.smithi088.stdout:055 2023-05-17T12:29:05.983 INFO:teuthology.orchestra.run.smithi088.stdout:055.out 2023-05-17T12:29:05.983 INFO:teuthology.orchestra.run.smithi088.stdout:056 2023-05-17T12:29:05.983 INFO:teuthology.orchestra.run.smithi088.stdout:056.out 2023-05-17T12:29:05.984 INFO:teuthology.orchestra.run.smithi088.stdout:057 2023-05-17T12:29:05.984 INFO:teuthology.orchestra.run.smithi088.stdout:057.out 2023-05-17T12:29:05.984 INFO:teuthology.orchestra.run.smithi088.stdout:058 2023-05-17T12:29:05.984 INFO:teuthology.orchestra.run.smithi088.stdout:058.out 2023-05-17T12:29:05.984 INFO:teuthology.orchestra.run.smithi088.stdout:059 2023-05-17T12:29:05.984 INFO:teuthology.orchestra.run.smithi088.stdout:059.out 2023-05-17T12:29:05.984 INFO:teuthology.orchestra.run.smithi088.stdout:060 2023-05-17T12:29:05.985 INFO:teuthology.orchestra.run.smithi088.stdout:060.out 2023-05-17T12:29:05.985 INFO:teuthology.orchestra.run.smithi088.stdout:061 2023-05-17T12:29:05.985 INFO:teuthology.orchestra.run.smithi088.stdout:061.out 2023-05-17T12:29:05.985 INFO:teuthology.orchestra.run.smithi088.stdout:062 2023-05-17T12:29:05.985 INFO:teuthology.orchestra.run.smithi088.stdout:062.out 2023-05-17T12:29:05.985 INFO:teuthology.orchestra.run.smithi088.stdout:063 2023-05-17T12:29:05.985 INFO:teuthology.orchestra.run.smithi088.stdout:063.out 2023-05-17T12:29:05.986 INFO:teuthology.orchestra.run.smithi088.stdout:064 2023-05-17T12:29:05.986 INFO:teuthology.orchestra.run.smithi088.stdout:064.out 2023-05-17T12:29:05.986 INFO:teuthology.orchestra.run.smithi088.stdout:065 2023-05-17T12:29:05.986 INFO:teuthology.orchestra.run.smithi088.stdout:065.out 2023-05-17T12:29:05.986 INFO:teuthology.orchestra.run.smithi088.stdout:066 2023-05-17T12:29:05.986 INFO:teuthology.orchestra.run.smithi088.stdout:066.out 2023-05-17T12:29:05.986 INFO:teuthology.orchestra.run.smithi088.stdout:067 2023-05-17T12:29:05.986 INFO:teuthology.orchestra.run.smithi088.stdout:067.out 2023-05-17T12:29:05.987 INFO:teuthology.orchestra.run.smithi088.stdout:068 2023-05-17T12:29:05.987 INFO:teuthology.orchestra.run.smithi088.stdout:068.out 2023-05-17T12:29:05.987 INFO:teuthology.orchestra.run.smithi088.stdout:069 2023-05-17T12:29:05.987 INFO:teuthology.orchestra.run.smithi088.stdout:069.out 2023-05-17T12:29:05.987 INFO:teuthology.orchestra.run.smithi088.stdout:070 2023-05-17T12:29:05.987 INFO:teuthology.orchestra.run.smithi088.stdout:070.out 2023-05-17T12:29:05.988 INFO:teuthology.orchestra.run.smithi088.stdout:071 2023-05-17T12:29:05.988 INFO:teuthology.orchestra.run.smithi088.stdout:071.out 2023-05-17T12:29:05.988 INFO:teuthology.orchestra.run.smithi088.stdout:072 2023-05-17T12:29:05.988 INFO:teuthology.orchestra.run.smithi088.stdout:072.out 2023-05-17T12:29:05.988 INFO:teuthology.orchestra.run.smithi088.stdout:073 2023-05-17T12:29:05.988 INFO:teuthology.orchestra.run.smithi088.stdout:073.out 2023-05-17T12:29:05.988 INFO:teuthology.orchestra.run.smithi088.stdout:074 2023-05-17T12:29:05.989 INFO:teuthology.orchestra.run.smithi088.stdout:074.out 2023-05-17T12:29:05.989 INFO:teuthology.orchestra.run.smithi088.stdout:075 2023-05-17T12:29:05.989 INFO:teuthology.orchestra.run.smithi088.stdout:075.out 2023-05-17T12:29:05.989 INFO:teuthology.orchestra.run.smithi088.stdout:076 2023-05-17T12:29:05.989 INFO:teuthology.orchestra.run.smithi088.stdout:076.out 2023-05-17T12:29:05.989 INFO:teuthology.orchestra.run.smithi088.stdout:077 2023-05-17T12:29:05.989 INFO:teuthology.orchestra.run.smithi088.stdout:077.out 2023-05-17T12:29:05.990 INFO:teuthology.orchestra.run.smithi088.stdout:078 2023-05-17T12:29:05.990 INFO:teuthology.orchestra.run.smithi088.stdout:078.out 2023-05-17T12:29:05.990 INFO:teuthology.orchestra.run.smithi088.stdout:079 2023-05-17T12:29:05.990 INFO:teuthology.orchestra.run.smithi088.stdout:079.out 2023-05-17T12:29:05.990 INFO:teuthology.orchestra.run.smithi088.stdout:080 2023-05-17T12:29:05.990 INFO:teuthology.orchestra.run.smithi088.stdout:080.out 2023-05-17T12:29:05.990 INFO:teuthology.orchestra.run.smithi088.stdout:081 2023-05-17T12:29:05.991 INFO:teuthology.orchestra.run.smithi088.stdout:081.out 2023-05-17T12:29:05.991 INFO:teuthology.orchestra.run.smithi088.stdout:082 2023-05-17T12:29:05.991 INFO:teuthology.orchestra.run.smithi088.stdout:082.out 2023-05-17T12:29:05.991 INFO:teuthology.orchestra.run.smithi088.stdout:083 2023-05-17T12:29:05.991 INFO:teuthology.orchestra.run.smithi088.stdout:083.out 2023-05-17T12:29:05.991 INFO:teuthology.orchestra.run.smithi088.stdout:084 2023-05-17T12:29:05.991 INFO:teuthology.orchestra.run.smithi088.stdout:084.out 2023-05-17T12:29:05.991 INFO:teuthology.orchestra.run.smithi088.stdout:085 2023-05-17T12:29:05.992 INFO:teuthology.orchestra.run.smithi088.stdout:085.out 2023-05-17T12:29:05.992 INFO:teuthology.orchestra.run.smithi088.stdout:086 2023-05-17T12:29:05.992 INFO:teuthology.orchestra.run.smithi088.stdout:086.out 2023-05-17T12:29:05.992 INFO:teuthology.orchestra.run.smithi088.stdout:087 2023-05-17T12:29:05.992 INFO:teuthology.orchestra.run.smithi088.stdout:087.out 2023-05-17T12:29:05.992 INFO:teuthology.orchestra.run.smithi088.stdout:088 2023-05-17T12:29:05.993 INFO:teuthology.orchestra.run.smithi088.stdout:088.out 2023-05-17T12:29:05.993 INFO:teuthology.orchestra.run.smithi088.stdout:089 2023-05-17T12:29:05.993 INFO:teuthology.orchestra.run.smithi088.stdout:089.out 2023-05-17T12:29:05.993 INFO:teuthology.orchestra.run.smithi088.stdout:090 2023-05-17T12:29:05.993 INFO:teuthology.orchestra.run.smithi088.stdout:090.out 2023-05-17T12:29:05.993 INFO:teuthology.orchestra.run.smithi088.stdout:091 2023-05-17T12:29:05.993 INFO:teuthology.orchestra.run.smithi088.stdout:091.out 2023-05-17T12:29:05.993 INFO:teuthology.orchestra.run.smithi088.stdout:092 2023-05-17T12:29:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:092.out 2023-05-17T12:29:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:093 2023-05-17T12:29:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:093.out 2023-05-17T12:29:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:094 2023-05-17T12:29:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:094.out 2023-05-17T12:29:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:095 2023-05-17T12:29:05.994 INFO:teuthology.orchestra.run.smithi088.stdout:095.out 2023-05-17T12:29:05.995 INFO:teuthology.orchestra.run.smithi088.stdout:096 2023-05-17T12:29:05.995 INFO:teuthology.orchestra.run.smithi088.stdout:096.out 2023-05-17T12:29:05.995 INFO:teuthology.orchestra.run.smithi088.stdout:097 2023-05-17T12:29:05.995 INFO:teuthology.orchestra.run.smithi088.stdout:097.out 2023-05-17T12:29:05.995 INFO:teuthology.orchestra.run.smithi088.stdout:098 2023-05-17T12:29:05.995 INFO:teuthology.orchestra.run.smithi088.stdout:098.out 2023-05-17T12:29:05.995 INFO:teuthology.orchestra.run.smithi088.stdout:099 2023-05-17T12:29:05.996 INFO:teuthology.orchestra.run.smithi088.stdout:099.out 2023-05-17T12:29:05.996 INFO:teuthology.orchestra.run.smithi088.stdout:100 2023-05-17T12:29:05.996 INFO:teuthology.orchestra.run.smithi088.stdout:100.out 2023-05-17T12:29:05.996 INFO:teuthology.orchestra.run.smithi088.stdout:101 2023-05-17T12:29:05.996 INFO:teuthology.orchestra.run.smithi088.stdout:101.out 2023-05-17T12:29:05.996 INFO:teuthology.orchestra.run.smithi088.stdout:102 2023-05-17T12:29:05.996 INFO:teuthology.orchestra.run.smithi088.stdout:102.out 2023-05-17T12:29:05.997 INFO:teuthology.orchestra.run.smithi088.stdout:103 2023-05-17T12:29:05.997 INFO:teuthology.orchestra.run.smithi088.stdout:103.out 2023-05-17T12:29:05.997 INFO:teuthology.orchestra.run.smithi088.stdout:104 2023-05-17T12:29:05.997 INFO:teuthology.orchestra.run.smithi088.stdout:104.out 2023-05-17T12:29:05.997 INFO:teuthology.orchestra.run.smithi088.stdout:105 2023-05-17T12:29:05.997 INFO:teuthology.orchestra.run.smithi088.stdout:105.out 2023-05-17T12:29:05.997 INFO:teuthology.orchestra.run.smithi088.stdout:106 2023-05-17T12:29:05.998 INFO:teuthology.orchestra.run.smithi088.stdout:106.out 2023-05-17T12:29:05.998 INFO:teuthology.orchestra.run.smithi088.stdout:107 2023-05-17T12:29:05.998 INFO:teuthology.orchestra.run.smithi088.stdout:107.out 2023-05-17T12:29:05.998 INFO:teuthology.orchestra.run.smithi088.stdout:108 2023-05-17T12:29:05.998 INFO:teuthology.orchestra.run.smithi088.stdout:108.out 2023-05-17T12:29:05.998 INFO:teuthology.orchestra.run.smithi088.stdout:109 2023-05-17T12:29:05.998 INFO:teuthology.orchestra.run.smithi088.stdout:109.out 2023-05-17T12:29:05.998 INFO:teuthology.orchestra.run.smithi088.stdout:110 2023-05-17T12:29:05.999 INFO:teuthology.orchestra.run.smithi088.stdout:110.out 2023-05-17T12:29:05.999 INFO:teuthology.orchestra.run.smithi088.stdout:111 2023-05-17T12:29:05.999 INFO:teuthology.orchestra.run.smithi088.stdout:111.out 2023-05-17T12:29:05.999 INFO:teuthology.orchestra.run.smithi088.stdout:112 2023-05-17T12:29:05.999 INFO:teuthology.orchestra.run.smithi088.stdout:112.out 2023-05-17T12:29:05.999 INFO:teuthology.orchestra.run.smithi088.stdout:113 2023-05-17T12:29:06.000 INFO:teuthology.orchestra.run.smithi088.stdout:113.out 2023-05-17T12:29:06.000 INFO:teuthology.orchestra.run.smithi088.stdout:114 2023-05-17T12:29:06.000 INFO:teuthology.orchestra.run.smithi088.stdout:114.out 2023-05-17T12:29:06.000 INFO:teuthology.orchestra.run.smithi088.stdout:115 2023-05-17T12:29:06.000 INFO:teuthology.orchestra.run.smithi088.stdout:115.out 2023-05-17T12:29:06.000 INFO:teuthology.orchestra.run.smithi088.stdout:116 2023-05-17T12:29:06.000 INFO:teuthology.orchestra.run.smithi088.stdout:116.out 2023-05-17T12:29:06.001 INFO:teuthology.orchestra.run.smithi088.stdout:117 2023-05-17T12:29:06.001 INFO:teuthology.orchestra.run.smithi088.stdout:117.out 2023-05-17T12:29:06.001 INFO:teuthology.orchestra.run.smithi088.stdout:118 2023-05-17T12:29:06.001 INFO:teuthology.orchestra.run.smithi088.stdout:118.out 2023-05-17T12:29:06.001 INFO:teuthology.orchestra.run.smithi088.stdout:119 2023-05-17T12:29:06.001 INFO:teuthology.orchestra.run.smithi088.stdout:119.out 2023-05-17T12:29:06.001 INFO:teuthology.orchestra.run.smithi088.stdout:120 2023-05-17T12:29:06.002 INFO:teuthology.orchestra.run.smithi088.stdout:120.out 2023-05-17T12:29:06.002 INFO:teuthology.orchestra.run.smithi088.stdout:121 2023-05-17T12:29:06.002 INFO:teuthology.orchestra.run.smithi088.stdout:121.out 2023-05-17T12:29:06.002 INFO:teuthology.orchestra.run.smithi088.stdout:122 2023-05-17T12:29:06.002 INFO:teuthology.orchestra.run.smithi088.stdout:122.out 2023-05-17T12:29:06.002 INFO:teuthology.orchestra.run.smithi088.stdout:123 2023-05-17T12:29:06.002 INFO:teuthology.orchestra.run.smithi088.stdout:123.out 2023-05-17T12:29:06.002 INFO:teuthology.orchestra.run.smithi088.stdout:124 2023-05-17T12:29:06.003 INFO:teuthology.orchestra.run.smithi088.stdout:124.out 2023-05-17T12:29:06.003 INFO:teuthology.orchestra.run.smithi088.stdout:125 2023-05-17T12:29:06.003 INFO:teuthology.orchestra.run.smithi088.stdout:125.out 2023-05-17T12:29:06.003 INFO:teuthology.orchestra.run.smithi088.stdout:126 2023-05-17T12:29:06.003 INFO:teuthology.orchestra.run.smithi088.stdout:126.out 2023-05-17T12:29:06.003 INFO:teuthology.orchestra.run.smithi088.stdout:127 2023-05-17T12:29:06.004 INFO:teuthology.orchestra.run.smithi088.stdout:127.out 2023-05-17T12:29:06.004 INFO:teuthology.orchestra.run.smithi088.stdout:128 2023-05-17T12:29:06.004 INFO:teuthology.orchestra.run.smithi088.stdout:128.out 2023-05-17T12:29:06.004 INFO:teuthology.orchestra.run.smithi088.stdout:129 2023-05-17T12:29:06.004 INFO:teuthology.orchestra.run.smithi088.stdout:129.out 2023-05-17T12:29:06.005 INFO:teuthology.orchestra.run.smithi088.stdout:130 2023-05-17T12:29:06.005 INFO:teuthology.orchestra.run.smithi088.stdout:130.out 2023-05-17T12:29:06.005 INFO:teuthology.orchestra.run.smithi088.stdout:131 2023-05-17T12:29:06.005 INFO:teuthology.orchestra.run.smithi088.stdout:131.out 2023-05-17T12:29:06.005 INFO:teuthology.orchestra.run.smithi088.stdout:132 2023-05-17T12:29:06.005 INFO:teuthology.orchestra.run.smithi088.stdout:132.out 2023-05-17T12:29:06.005 INFO:teuthology.orchestra.run.smithi088.stdout:133 2023-05-17T12:29:06.006 INFO:teuthology.orchestra.run.smithi088.stdout:133.out 2023-05-17T12:29:06.006 INFO:teuthology.orchestra.run.smithi088.stdout:134 2023-05-17T12:29:06.006 INFO:teuthology.orchestra.run.smithi088.stdout:134.out 2023-05-17T12:29:06.006 INFO:teuthology.orchestra.run.smithi088.stdout:135 2023-05-17T12:29:06.006 INFO:teuthology.orchestra.run.smithi088.stdout:135.out 2023-05-17T12:29:06.006 INFO:teuthology.orchestra.run.smithi088.stdout:136 2023-05-17T12:29:06.006 INFO:teuthology.orchestra.run.smithi088.stdout:136.out 2023-05-17T12:29:06.006 INFO:teuthology.orchestra.run.smithi088.stdout:137 2023-05-17T12:29:06.007 INFO:teuthology.orchestra.run.smithi088.stdout:137.out 2023-05-17T12:29:06.007 INFO:teuthology.orchestra.run.smithi088.stdout:138 2023-05-17T12:29:06.007 INFO:teuthology.orchestra.run.smithi088.stdout:138.out 2023-05-17T12:29:06.007 INFO:teuthology.orchestra.run.smithi088.stdout:139 2023-05-17T12:29:06.007 INFO:teuthology.orchestra.run.smithi088.stdout:139.out 2023-05-17T12:29:06.007 INFO:teuthology.orchestra.run.smithi088.stdout:140 2023-05-17T12:29:06.007 INFO:teuthology.orchestra.run.smithi088.stdout:140.out 2023-05-17T12:29:06.008 INFO:teuthology.orchestra.run.smithi088.stdout:141 2023-05-17T12:29:06.008 INFO:teuthology.orchestra.run.smithi088.stdout:141.out 2023-05-17T12:29:06.008 INFO:teuthology.orchestra.run.smithi088.stdout:142 2023-05-17T12:29:06.008 INFO:teuthology.orchestra.run.smithi088.stdout:142.out 2023-05-17T12:29:06.008 INFO:teuthology.orchestra.run.smithi088.stdout:143 2023-05-17T12:29:06.008 INFO:teuthology.orchestra.run.smithi088.stdout:143.out 2023-05-17T12:29:06.008 INFO:teuthology.orchestra.run.smithi088.stdout:144 2023-05-17T12:29:06.009 INFO:teuthology.orchestra.run.smithi088.stdout:144.out 2023-05-17T12:29:06.009 INFO:teuthology.orchestra.run.smithi088.stdout:145 2023-05-17T12:29:06.009 INFO:teuthology.orchestra.run.smithi088.stdout:145.out 2023-05-17T12:29:06.009 INFO:teuthology.orchestra.run.smithi088.stdout:146 2023-05-17T12:29:06.009 INFO:teuthology.orchestra.run.smithi088.stdout:146.out 2023-05-17T12:29:06.009 INFO:teuthology.orchestra.run.smithi088.stdout:147 2023-05-17T12:29:06.009 INFO:teuthology.orchestra.run.smithi088.stdout:147.out 2023-05-17T12:29:06.010 INFO:teuthology.orchestra.run.smithi088.stdout:148 2023-05-17T12:29:06.010 INFO:teuthology.orchestra.run.smithi088.stdout:148.out 2023-05-17T12:29:06.010 INFO:teuthology.orchestra.run.smithi088.stdout:149 2023-05-17T12:29:06.010 INFO:teuthology.orchestra.run.smithi088.stdout:149.out 2023-05-17T12:29:06.010 INFO:teuthology.orchestra.run.smithi088.stdout:150 2023-05-17T12:29:06.010 INFO:teuthology.orchestra.run.smithi088.stdout:150.out 2023-05-17T12:29:06.010 INFO:teuthology.orchestra.run.smithi088.stdout:151 2023-05-17T12:29:06.011 INFO:teuthology.orchestra.run.smithi088.stdout:151.out 2023-05-17T12:29:06.011 INFO:teuthology.orchestra.run.smithi088.stdout:152 2023-05-17T12:29:06.011 INFO:teuthology.orchestra.run.smithi088.stdout:152.out 2023-05-17T12:29:06.011 INFO:teuthology.orchestra.run.smithi088.stdout:153 2023-05-17T12:29:06.012 INFO:teuthology.orchestra.run.smithi088.stdout:153.out 2023-05-17T12:29:06.012 INFO:teuthology.orchestra.run.smithi088.stdout:154 2023-05-17T12:29:06.012 INFO:teuthology.orchestra.run.smithi088.stdout:154.out 2023-05-17T12:29:06.012 INFO:teuthology.orchestra.run.smithi088.stdout:155 2023-05-17T12:29:06.013 INFO:teuthology.orchestra.run.smithi088.stdout:155.out 2023-05-17T12:29:06.013 INFO:teuthology.orchestra.run.smithi088.stdout:156 2023-05-17T12:29:06.013 INFO:teuthology.orchestra.run.smithi088.stdout:156.out 2023-05-17T12:29:06.014 INFO:teuthology.orchestra.run.smithi088.stdout:157 2023-05-17T12:29:06.014 INFO:teuthology.orchestra.run.smithi088.stdout:157.out 2023-05-17T12:29:06.014 INFO:teuthology.orchestra.run.smithi088.stdout:158 2023-05-17T12:29:06.014 INFO:teuthology.orchestra.run.smithi088.stdout:158.out 2023-05-17T12:29:06.015 INFO:teuthology.orchestra.run.smithi088.stdout:159 2023-05-17T12:29:06.015 INFO:teuthology.orchestra.run.smithi088.stdout:159.out 2023-05-17T12:29:06.015 INFO:teuthology.orchestra.run.smithi088.stdout:160 2023-05-17T12:29:06.016 INFO:teuthology.orchestra.run.smithi088.stdout:160.out 2023-05-17T12:29:06.016 INFO:teuthology.orchestra.run.smithi088.stdout:161 2023-05-17T12:29:06.016 INFO:teuthology.orchestra.run.smithi088.stdout:161.out 2023-05-17T12:29:06.017 INFO:teuthology.orchestra.run.smithi088.stdout:162 2023-05-17T12:29:06.017 INFO:teuthology.orchestra.run.smithi088.stdout:162.out 2023-05-17T12:29:06.017 INFO:teuthology.orchestra.run.smithi088.stdout:163 2023-05-17T12:29:06.018 INFO:teuthology.orchestra.run.smithi088.stdout:163.out 2023-05-17T12:29:06.018 INFO:teuthology.orchestra.run.smithi088.stdout:164 2023-05-17T12:29:06.018 INFO:teuthology.orchestra.run.smithi088.stdout:164.out 2023-05-17T12:29:06.018 INFO:teuthology.orchestra.run.smithi088.stdout:165 2023-05-17T12:29:06.019 INFO:teuthology.orchestra.run.smithi088.stdout:165.out 2023-05-17T12:29:06.019 INFO:teuthology.orchestra.run.smithi088.stdout:166 2023-05-17T12:29:06.019 INFO:teuthology.orchestra.run.smithi088.stdout:166.out 2023-05-17T12:29:06.020 INFO:teuthology.orchestra.run.smithi088.stdout:167 2023-05-17T12:29:06.020 INFO:teuthology.orchestra.run.smithi088.stdout:167.out 2023-05-17T12:29:06.020 INFO:teuthology.orchestra.run.smithi088.stdout:168 2023-05-17T12:29:06.020 INFO:teuthology.orchestra.run.smithi088.stdout:168.out 2023-05-17T12:29:06.020 INFO:teuthology.orchestra.run.smithi088.stdout:169 2023-05-17T12:29:06.021 INFO:teuthology.orchestra.run.smithi088.stdout:169.out 2023-05-17T12:29:06.021 INFO:teuthology.orchestra.run.smithi088.stdout:170 2023-05-17T12:29:06.021 INFO:teuthology.orchestra.run.smithi088.stdout:170.out 2023-05-17T12:29:06.022 INFO:teuthology.orchestra.run.smithi088.stdout:171 2023-05-17T12:29:06.022 INFO:teuthology.orchestra.run.smithi088.stdout:171.out 2023-05-17T12:29:06.022 INFO:teuthology.orchestra.run.smithi088.stdout:172 2023-05-17T12:29:06.023 INFO:teuthology.orchestra.run.smithi088.stdout:172.out 2023-05-17T12:29:06.023 INFO:teuthology.orchestra.run.smithi088.stdout:173 2023-05-17T12:29:06.023 INFO:teuthology.orchestra.run.smithi088.stdout:173.out 2023-05-17T12:29:06.023 INFO:teuthology.orchestra.run.smithi088.stdout:174 2023-05-17T12:29:06.023 INFO:teuthology.orchestra.run.smithi088.stdout:174.out 2023-05-17T12:29:06.023 INFO:teuthology.orchestra.run.smithi088.stdout:175 2023-05-17T12:29:06.024 INFO:teuthology.orchestra.run.smithi088.stdout:175.out 2023-05-17T12:29:06.024 INFO:teuthology.orchestra.run.smithi088.stdout:176 2023-05-17T12:29:06.024 INFO:teuthology.orchestra.run.smithi088.stdout:176.out 2023-05-17T12:29:06.024 INFO:teuthology.orchestra.run.smithi088.stdout:177 2023-05-17T12:29:06.024 INFO:teuthology.orchestra.run.smithi088.stdout:177.out 2023-05-17T12:29:06.024 INFO:teuthology.orchestra.run.smithi088.stdout:178 2023-05-17T12:29:06.025 INFO:teuthology.orchestra.run.smithi088.stdout:178.out 2023-05-17T12:29:06.025 INFO:teuthology.orchestra.run.smithi088.stdout:179 2023-05-17T12:29:06.025 INFO:teuthology.orchestra.run.smithi088.stdout:179.out 2023-05-17T12:29:06.025 INFO:teuthology.orchestra.run.smithi088.stdout:180 2023-05-17T12:29:06.025 INFO:teuthology.orchestra.run.smithi088.stdout:180.out 2023-05-17T12:29:06.025 INFO:teuthology.orchestra.run.smithi088.stdout:181 2023-05-17T12:29:06.025 INFO:teuthology.orchestra.run.smithi088.stdout:181.out 2023-05-17T12:29:06.025 INFO:teuthology.orchestra.run.smithi088.stdout:182 2023-05-17T12:29:06.026 INFO:teuthology.orchestra.run.smithi088.stdout:182.out 2023-05-17T12:29:06.026 INFO:teuthology.orchestra.run.smithi088.stdout:183 2023-05-17T12:29:06.026 INFO:teuthology.orchestra.run.smithi088.stdout:183.out 2023-05-17T12:29:06.026 INFO:teuthology.orchestra.run.smithi088.stdout:184 2023-05-17T12:29:06.026 INFO:teuthology.orchestra.run.smithi088.stdout:184.out 2023-05-17T12:29:06.026 INFO:teuthology.orchestra.run.smithi088.stdout:185 2023-05-17T12:29:06.026 INFO:teuthology.orchestra.run.smithi088.stdout:185.out 2023-05-17T12:29:06.027 INFO:teuthology.orchestra.run.smithi088.stdout:186 2023-05-17T12:29:06.027 INFO:teuthology.orchestra.run.smithi088.stdout:186.out 2023-05-17T12:29:06.027 INFO:teuthology.orchestra.run.smithi088.stdout:187 2023-05-17T12:29:06.027 INFO:teuthology.orchestra.run.smithi088.stdout:187.out 2023-05-17T12:29:06.027 INFO:teuthology.orchestra.run.smithi088.stdout:188 2023-05-17T12:29:06.027 INFO:teuthology.orchestra.run.smithi088.stdout:188.out 2023-05-17T12:29:06.027 INFO:teuthology.orchestra.run.smithi088.stdout:189 2023-05-17T12:29:06.028 INFO:teuthology.orchestra.run.smithi088.stdout:189.out 2023-05-17T12:29:06.028 INFO:teuthology.orchestra.run.smithi088.stdout:190 2023-05-17T12:29:06.028 INFO:teuthology.orchestra.run.smithi088.stdout:190.out 2023-05-17T12:29:06.028 INFO:teuthology.orchestra.run.smithi088.stdout:191 2023-05-17T12:29:06.028 INFO:teuthology.orchestra.run.smithi088.stdout:191.out 2023-05-17T12:29:06.028 INFO:teuthology.orchestra.run.smithi088.stdout:192 2023-05-17T12:29:06.028 INFO:teuthology.orchestra.run.smithi088.stdout:192.out 2023-05-17T12:29:06.029 INFO:teuthology.orchestra.run.smithi088.stdout:193 2023-05-17T12:29:06.029 INFO:teuthology.orchestra.run.smithi088.stdout:193.out 2023-05-17T12:29:06.029 INFO:teuthology.orchestra.run.smithi088.stdout:194 2023-05-17T12:29:06.029 INFO:teuthology.orchestra.run.smithi088.stdout:194.out 2023-05-17T12:29:06.029 INFO:teuthology.orchestra.run.smithi088.stdout:195 2023-05-17T12:29:06.029 INFO:teuthology.orchestra.run.smithi088.stdout:195.out 2023-05-17T12:29:06.029 INFO:teuthology.orchestra.run.smithi088.stdout:196 2023-05-17T12:29:06.030 INFO:teuthology.orchestra.run.smithi088.stdout:196.out 2023-05-17T12:29:06.030 INFO:teuthology.orchestra.run.smithi088.stdout:197 2023-05-17T12:29:06.030 INFO:teuthology.orchestra.run.smithi088.stdout:197.out 2023-05-17T12:29:06.030 INFO:teuthology.orchestra.run.smithi088.stdout:198 2023-05-17T12:29:06.030 INFO:teuthology.orchestra.run.smithi088.stdout:198.out 2023-05-17T12:29:06.030 INFO:teuthology.orchestra.run.smithi088.stdout:199 2023-05-17T12:29:06.030 INFO:teuthology.orchestra.run.smithi088.stdout:199.out 2023-05-17T12:29:06.031 INFO:teuthology.orchestra.run.smithi088.stdout:200 2023-05-17T12:29:06.031 INFO:teuthology.orchestra.run.smithi088.stdout:200.out 2023-05-17T12:29:06.031 INFO:teuthology.orchestra.run.smithi088.stdout:201 2023-05-17T12:29:06.031 INFO:teuthology.orchestra.run.smithi088.stdout:201.out 2023-05-17T12:29:06.031 INFO:teuthology.orchestra.run.smithi088.stdout:202 2023-05-17T12:29:06.031 INFO:teuthology.orchestra.run.smithi088.stdout:202.out 2023-05-17T12:29:06.031 INFO:teuthology.orchestra.run.smithi088.stdout:203 2023-05-17T12:29:06.031 INFO:teuthology.orchestra.run.smithi088.stdout:203.out 2023-05-17T12:29:06.032 INFO:teuthology.orchestra.run.smithi088.stdout:204 2023-05-17T12:29:06.032 INFO:teuthology.orchestra.run.smithi088.stdout:204.out 2023-05-17T12:29:06.032 INFO:teuthology.orchestra.run.smithi088.stdout:205 2023-05-17T12:29:06.032 INFO:teuthology.orchestra.run.smithi088.stdout:205.out 2023-05-17T12:29:06.032 INFO:teuthology.orchestra.run.smithi088.stdout:206 2023-05-17T12:29:06.032 INFO:teuthology.orchestra.run.smithi088.stdout:206.out 2023-05-17T12:29:06.033 INFO:teuthology.orchestra.run.smithi088.stdout:207 2023-05-17T12:29:06.033 INFO:teuthology.orchestra.run.smithi088.stdout:207.out 2023-05-17T12:29:06.033 INFO:teuthology.orchestra.run.smithi088.stdout:208 2023-05-17T12:29:06.033 INFO:teuthology.orchestra.run.smithi088.stdout:208.out 2023-05-17T12:29:06.033 INFO:teuthology.orchestra.run.smithi088.stdout:209 2023-05-17T12:29:06.033 INFO:teuthology.orchestra.run.smithi088.stdout:209.out 2023-05-17T12:29:06.033 INFO:teuthology.orchestra.run.smithi088.stdout:210 2023-05-17T12:29:06.034 INFO:teuthology.orchestra.run.smithi088.stdout:210.out 2023-05-17T12:29:06.034 INFO:teuthology.orchestra.run.smithi088.stdout:211 2023-05-17T12:29:06.034 INFO:teuthology.orchestra.run.smithi088.stdout:211.out 2023-05-17T12:29:06.034 INFO:teuthology.orchestra.run.smithi088.stdout:212 2023-05-17T12:29:06.034 INFO:teuthology.orchestra.run.smithi088.stdout:212.out 2023-05-17T12:29:06.035 INFO:teuthology.orchestra.run.smithi088.stdout:213 2023-05-17T12:29:06.035 INFO:teuthology.orchestra.run.smithi088.stdout:213.out 2023-05-17T12:29:06.035 INFO:teuthology.orchestra.run.smithi088.stdout:214 2023-05-17T12:29:06.035 INFO:teuthology.orchestra.run.smithi088.stdout:214.out 2023-05-17T12:29:06.035 INFO:teuthology.orchestra.run.smithi088.stdout:215 2023-05-17T12:29:06.035 INFO:teuthology.orchestra.run.smithi088.stdout:215.out 2023-05-17T12:29:06.036 INFO:teuthology.orchestra.run.smithi088.stdout:216 2023-05-17T12:29:06.036 INFO:teuthology.orchestra.run.smithi088.stdout:216.out 2023-05-17T12:29:06.036 INFO:teuthology.orchestra.run.smithi088.stdout:217 2023-05-17T12:29:06.036 INFO:teuthology.orchestra.run.smithi088.stdout:217.out 2023-05-17T12:29:06.036 INFO:teuthology.orchestra.run.smithi088.stdout:218 2023-05-17T12:29:06.036 INFO:teuthology.orchestra.run.smithi088.stdout:218.out 2023-05-17T12:29:06.037 INFO:teuthology.orchestra.run.smithi088.stdout:219 2023-05-17T12:29:06.037 INFO:teuthology.orchestra.run.smithi088.stdout:219.out 2023-05-17T12:29:06.037 INFO:teuthology.orchestra.run.smithi088.stdout:220 2023-05-17T12:29:06.037 INFO:teuthology.orchestra.run.smithi088.stdout:220.out 2023-05-17T12:29:06.037 INFO:teuthology.orchestra.run.smithi088.stdout:221 2023-05-17T12:29:06.037 INFO:teuthology.orchestra.run.smithi088.stdout:221.out 2023-05-17T12:29:06.037 INFO:teuthology.orchestra.run.smithi088.stdout:222 2023-05-17T12:29:06.038 INFO:teuthology.orchestra.run.smithi088.stdout:222.out 2023-05-17T12:29:06.038 INFO:teuthology.orchestra.run.smithi088.stdout:223 2023-05-17T12:29:06.038 INFO:teuthology.orchestra.run.smithi088.stdout:223.out 2023-05-17T12:29:06.038 INFO:teuthology.orchestra.run.smithi088.stdout:224 2023-05-17T12:29:06.038 INFO:teuthology.orchestra.run.smithi088.stdout:224.out 2023-05-17T12:29:06.038 INFO:teuthology.orchestra.run.smithi088.stdout:225 2023-05-17T12:29:06.038 INFO:teuthology.orchestra.run.smithi088.stdout:225.out 2023-05-17T12:29:06.038 INFO:teuthology.orchestra.run.smithi088.stdout:226 2023-05-17T12:29:06.039 INFO:teuthology.orchestra.run.smithi088.stdout:226.out 2023-05-17T12:29:06.039 INFO:teuthology.orchestra.run.smithi088.stdout:227 2023-05-17T12:29:06.039 INFO:teuthology.orchestra.run.smithi088.stdout:227.out 2023-05-17T12:29:06.039 INFO:teuthology.orchestra.run.smithi088.stdout:228 2023-05-17T12:29:06.039 INFO:teuthology.orchestra.run.smithi088.stdout:228.out 2023-05-17T12:29:06.039 INFO:teuthology.orchestra.run.smithi088.stdout:229 2023-05-17T12:29:06.039 INFO:teuthology.orchestra.run.smithi088.stdout:229.out 2023-05-17T12:29:06.040 INFO:teuthology.orchestra.run.smithi088.stdout:230 2023-05-17T12:29:06.040 INFO:teuthology.orchestra.run.smithi088.stdout:230.out 2023-05-17T12:29:06.040 INFO:teuthology.orchestra.run.smithi088.stdout:231 2023-05-17T12:29:06.040 INFO:teuthology.orchestra.run.smithi088.stdout:231.out 2023-05-17T12:29:06.041 INFO:teuthology.orchestra.run.smithi088.stdout:232 2023-05-17T12:29:06.041 INFO:teuthology.orchestra.run.smithi088.stdout:232.out 2023-05-17T12:29:06.041 INFO:teuthology.orchestra.run.smithi088.stdout:233 2023-05-17T12:29:06.041 INFO:teuthology.orchestra.run.smithi088.stdout:233.out 2023-05-17T12:29:06.041 INFO:teuthology.orchestra.run.smithi088.stdout:234 2023-05-17T12:29:06.041 INFO:teuthology.orchestra.run.smithi088.stdout:234.out 2023-05-17T12:29:06.041 INFO:teuthology.orchestra.run.smithi088.stdout:235 2023-05-17T12:29:06.042 INFO:teuthology.orchestra.run.smithi088.stdout:235.out 2023-05-17T12:29:06.042 INFO:teuthology.orchestra.run.smithi088.stdout:236 2023-05-17T12:29:06.042 INFO:teuthology.orchestra.run.smithi088.stdout:236.out 2023-05-17T12:29:06.042 INFO:teuthology.orchestra.run.smithi088.stdout:237 2023-05-17T12:29:06.042 INFO:teuthology.orchestra.run.smithi088.stdout:237.out 2023-05-17T12:29:06.042 INFO:teuthology.orchestra.run.smithi088.stdout:238 2023-05-17T12:29:06.043 INFO:teuthology.orchestra.run.smithi088.stdout:238.out 2023-05-17T12:29:06.043 INFO:teuthology.orchestra.run.smithi088.stdout:239 2023-05-17T12:29:06.043 INFO:teuthology.orchestra.run.smithi088.stdout:239.out 2023-05-17T12:29:06.043 INFO:teuthology.orchestra.run.smithi088.stdout:240 2023-05-17T12:29:06.043 INFO:teuthology.orchestra.run.smithi088.stdout:240.out 2023-05-17T12:29:06.043 INFO:teuthology.orchestra.run.smithi088.stdout:241 2023-05-17T12:29:06.043 INFO:teuthology.orchestra.run.smithi088.stdout:241.out 2023-05-17T12:29:06.043 INFO:teuthology.orchestra.run.smithi088.stdout:242 2023-05-17T12:29:06.044 INFO:teuthology.orchestra.run.smithi088.stdout:242.out 2023-05-17T12:29:06.044 INFO:teuthology.orchestra.run.smithi088.stdout:243 2023-05-17T12:29:06.044 INFO:teuthology.orchestra.run.smithi088.stdout:243.out 2023-05-17T12:29:06.044 INFO:teuthology.orchestra.run.smithi088.stdout:244 2023-05-17T12:29:06.044 INFO:teuthology.orchestra.run.smithi088.stdout:244.out 2023-05-17T12:29:06.044 INFO:teuthology.orchestra.run.smithi088.stdout:245 2023-05-17T12:29:06.045 INFO:teuthology.orchestra.run.smithi088.stdout:245.out 2023-05-17T12:29:06.045 INFO:teuthology.orchestra.run.smithi088.stdout:246 2023-05-17T12:29:06.045 INFO:teuthology.orchestra.run.smithi088.stdout:246.out 2023-05-17T12:29:06.045 INFO:teuthology.orchestra.run.smithi088.stdout:247 2023-05-17T12:29:06.045 INFO:teuthology.orchestra.run.smithi088.stdout:247.out 2023-05-17T12:29:06.045 INFO:teuthology.orchestra.run.smithi088.stdout:248 2023-05-17T12:29:06.045 INFO:teuthology.orchestra.run.smithi088.stdout:248.out 2023-05-17T12:29:06.046 INFO:teuthology.orchestra.run.smithi088.stdout:249 2023-05-17T12:29:06.046 INFO:teuthology.orchestra.run.smithi088.stdout:249.out 2023-05-17T12:29:06.046 INFO:teuthology.orchestra.run.smithi088.stdout:250 2023-05-17T12:29:06.046 INFO:teuthology.orchestra.run.smithi088.stdout:250.out 2023-05-17T12:29:06.046 INFO:teuthology.orchestra.run.smithi088.stdout:251 2023-05-17T12:29:06.046 INFO:teuthology.orchestra.run.smithi088.stdout:251.out 2023-05-17T12:29:06.046 INFO:teuthology.orchestra.run.smithi088.stdout:252 2023-05-17T12:29:06.046 INFO:teuthology.orchestra.run.smithi088.stdout:252.out 2023-05-17T12:29:06.047 INFO:teuthology.orchestra.run.smithi088.stdout:253 2023-05-17T12:29:06.047 INFO:teuthology.orchestra.run.smithi088.stdout:253.out 2023-05-17T12:29:06.047 INFO:teuthology.orchestra.run.smithi088.stdout:254 2023-05-17T12:29:06.047 INFO:teuthology.orchestra.run.smithi088.stdout:254.out 2023-05-17T12:29:06.047 INFO:teuthology.orchestra.run.smithi088.stdout:255 2023-05-17T12:29:06.047 INFO:teuthology.orchestra.run.smithi088.stdout:255.out 2023-05-17T12:29:06.048 INFO:teuthology.orchestra.run.smithi088.stdout:256 2023-05-17T12:29:06.048 INFO:teuthology.orchestra.run.smithi088.stdout:256.out 2023-05-17T12:29:06.048 INFO:teuthology.orchestra.run.smithi088.stdout:257 2023-05-17T12:29:06.048 INFO:teuthology.orchestra.run.smithi088.stdout:257.out 2023-05-17T12:29:06.048 INFO:teuthology.orchestra.run.smithi088.stdout:258 2023-05-17T12:29:06.048 INFO:teuthology.orchestra.run.smithi088.stdout:258.out 2023-05-17T12:29:06.049 INFO:teuthology.orchestra.run.smithi088.stdout:259 2023-05-17T12:29:06.049 INFO:teuthology.orchestra.run.smithi088.stdout:259.out 2023-05-17T12:29:06.049 INFO:teuthology.orchestra.run.smithi088.stdout:260 2023-05-17T12:29:06.049 INFO:teuthology.orchestra.run.smithi088.stdout:260.out 2023-05-17T12:29:06.049 INFO:teuthology.orchestra.run.smithi088.stdout:261 2023-05-17T12:29:06.049 INFO:teuthology.orchestra.run.smithi088.stdout:261.out 2023-05-17T12:29:06.050 INFO:teuthology.orchestra.run.smithi088.stdout:262 2023-05-17T12:29:06.050 INFO:teuthology.orchestra.run.smithi088.stdout:262.out 2023-05-17T12:29:06.050 INFO:teuthology.orchestra.run.smithi088.stdout:263 2023-05-17T12:29:06.050 INFO:teuthology.orchestra.run.smithi088.stdout:263.out 2023-05-17T12:29:06.050 INFO:teuthology.orchestra.run.smithi088.stdout:264 2023-05-17T12:29:06.050 INFO:teuthology.orchestra.run.smithi088.stdout:264.out 2023-05-17T12:29:06.050 INFO:teuthology.orchestra.run.smithi088.stdout:265 2023-05-17T12:29:06.051 INFO:teuthology.orchestra.run.smithi088.stdout:265.out 2023-05-17T12:29:06.051 INFO:teuthology.orchestra.run.smithi088.stdout:266 2023-05-17T12:29:06.051 INFO:teuthology.orchestra.run.smithi088.stdout:266.out 2023-05-17T12:29:06.051 INFO:teuthology.orchestra.run.smithi088.stdout:267 2023-05-17T12:29:06.051 INFO:teuthology.orchestra.run.smithi088.stdout:267.out 2023-05-17T12:29:06.051 INFO:teuthology.orchestra.run.smithi088.stdout:268 2023-05-17T12:29:06.051 INFO:teuthology.orchestra.run.smithi088.stdout:268.out 2023-05-17T12:29:06.052 INFO:teuthology.orchestra.run.smithi088.stdout:269 2023-05-17T12:29:06.052 INFO:teuthology.orchestra.run.smithi088.stdout:269.out 2023-05-17T12:29:06.052 INFO:teuthology.orchestra.run.smithi088.stdout:270 2023-05-17T12:29:06.052 INFO:teuthology.orchestra.run.smithi088.stdout:270.out 2023-05-17T12:29:06.052 INFO:teuthology.orchestra.run.smithi088.stdout:271 2023-05-17T12:29:06.052 INFO:teuthology.orchestra.run.smithi088.stdout:271.out 2023-05-17T12:29:06.052 INFO:teuthology.orchestra.run.smithi088.stdout:272 2023-05-17T12:29:06.053 INFO:teuthology.orchestra.run.smithi088.stdout:272.out 2023-05-17T12:29:06.053 INFO:teuthology.orchestra.run.smithi088.stdout:273 2023-05-17T12:29:06.053 INFO:teuthology.orchestra.run.smithi088.stdout:273.out 2023-05-17T12:29:06.053 INFO:teuthology.orchestra.run.smithi088.stdout:274 2023-05-17T12:29:06.053 INFO:teuthology.orchestra.run.smithi088.stdout:274.out 2023-05-17T12:29:06.053 INFO:teuthology.orchestra.run.smithi088.stdout:275 2023-05-17T12:29:06.053 INFO:teuthology.orchestra.run.smithi088.stdout:275.out 2023-05-17T12:29:06.054 INFO:teuthology.orchestra.run.smithi088.stdout:276 2023-05-17T12:29:06.054 INFO:teuthology.orchestra.run.smithi088.stdout:276.out 2023-05-17T12:29:06.054 INFO:teuthology.orchestra.run.smithi088.stdout:277 2023-05-17T12:29:06.054 INFO:teuthology.orchestra.run.smithi088.stdout:277.out 2023-05-17T12:29:06.054 INFO:teuthology.orchestra.run.smithi088.stdout:278 2023-05-17T12:29:06.054 INFO:teuthology.orchestra.run.smithi088.stdout:278.out 2023-05-17T12:29:06.055 INFO:teuthology.orchestra.run.smithi088.stdout:279 2023-05-17T12:29:06.055 INFO:teuthology.orchestra.run.smithi088.stdout:279.out 2023-05-17T12:29:06.055 INFO:teuthology.orchestra.run.smithi088.stdout:280 2023-05-17T12:29:06.055 INFO:teuthology.orchestra.run.smithi088.stdout:280.out 2023-05-17T12:29:06.055 INFO:teuthology.orchestra.run.smithi088.stdout:281 2023-05-17T12:29:06.055 INFO:teuthology.orchestra.run.smithi088.stdout:281.out 2023-05-17T12:29:06.055 INFO:teuthology.orchestra.run.smithi088.stdout:282 2023-05-17T12:29:06.055 INFO:teuthology.orchestra.run.smithi088.stdout:282.out 2023-05-17T12:29:06.056 INFO:teuthology.orchestra.run.smithi088.stdout:283 2023-05-17T12:29:06.056 INFO:teuthology.orchestra.run.smithi088.stdout:283.out 2023-05-17T12:29:06.056 INFO:teuthology.orchestra.run.smithi088.stdout:284 2023-05-17T12:29:06.056 INFO:teuthology.orchestra.run.smithi088.stdout:284.out 2023-05-17T12:29:06.056 INFO:teuthology.orchestra.run.smithi088.stdout:285 2023-05-17T12:29:06.056 INFO:teuthology.orchestra.run.smithi088.stdout:285.out 2023-05-17T12:29:06.057 INFO:teuthology.orchestra.run.smithi088.stdout:286 2023-05-17T12:29:06.057 INFO:teuthology.orchestra.run.smithi088.stdout:286.out 2023-05-17T12:29:06.057 INFO:teuthology.orchestra.run.smithi088.stdout:287 2023-05-17T12:29:06.057 INFO:teuthology.orchestra.run.smithi088.stdout:287.out 2023-05-17T12:29:06.057 INFO:teuthology.orchestra.run.smithi088.stdout:288 2023-05-17T12:29:06.057 INFO:teuthology.orchestra.run.smithi088.stdout:288.out 2023-05-17T12:29:06.058 INFO:teuthology.orchestra.run.smithi088.stdout:289 2023-05-17T12:29:06.058 INFO:teuthology.orchestra.run.smithi088.stdout:289.out 2023-05-17T12:29:06.058 INFO:teuthology.orchestra.run.smithi088.stdout:290 2023-05-17T12:29:06.058 INFO:teuthology.orchestra.run.smithi088.stdout:290.out 2023-05-17T12:29:06.058 INFO:teuthology.orchestra.run.smithi088.stdout:291 2023-05-17T12:29:06.058 INFO:teuthology.orchestra.run.smithi088.stdout:291.out 2023-05-17T12:29:06.058 INFO:teuthology.orchestra.run.smithi088.stdout:292 2023-05-17T12:29:06.059 INFO:teuthology.orchestra.run.smithi088.stdout:292.out 2023-05-17T12:29:06.059 INFO:teuthology.orchestra.run.smithi088.stdout:293 2023-05-17T12:29:06.059 INFO:teuthology.orchestra.run.smithi088.stdout:293.out 2023-05-17T12:29:06.059 INFO:teuthology.orchestra.run.smithi088.stdout:294 2023-05-17T12:29:06.059 INFO:teuthology.orchestra.run.smithi088.stdout:294.out 2023-05-17T12:29:06.059 INFO:teuthology.orchestra.run.smithi088.stdout:295 2023-05-17T12:29:06.059 INFO:teuthology.orchestra.run.smithi088.stdout:295.out 2023-05-17T12:29:06.059 INFO:teuthology.orchestra.run.smithi088.stdout:296 2023-05-17T12:29:06.060 INFO:teuthology.orchestra.run.smithi088.stdout:296.out 2023-05-17T12:29:06.060 INFO:teuthology.orchestra.run.smithi088.stdout:297 2023-05-17T12:29:06.060 INFO:teuthology.orchestra.run.smithi088.stdout:297.out 2023-05-17T12:29:06.060 INFO:teuthology.orchestra.run.smithi088.stdout:298 2023-05-17T12:29:06.060 INFO:teuthology.orchestra.run.smithi088.stdout:298.out 2023-05-17T12:29:06.060 INFO:teuthology.orchestra.run.smithi088.stdout:299 2023-05-17T12:29:06.061 INFO:teuthology.orchestra.run.smithi088.stdout:299.out 2023-05-17T12:29:06.061 INFO:teuthology.orchestra.run.smithi088.stdout:300 2023-05-17T12:29:06.061 INFO:teuthology.orchestra.run.smithi088.stdout:300.out 2023-05-17T12:29:06.061 INFO:teuthology.orchestra.run.smithi088.stdout:301 2023-05-17T12:29:06.061 INFO:teuthology.orchestra.run.smithi088.stdout:301.out 2023-05-17T12:29:06.061 INFO:teuthology.orchestra.run.smithi088.stdout:302 2023-05-17T12:29:06.061 INFO:teuthology.orchestra.run.smithi088.stdout:302.out 2023-05-17T12:29:06.062 INFO:teuthology.orchestra.run.smithi088.stdout:303 2023-05-17T12:29:06.062 INFO:teuthology.orchestra.run.smithi088.stdout:303.out 2023-05-17T12:29:06.062 INFO:teuthology.orchestra.run.smithi088.stdout:304 2023-05-17T12:29:06.062 INFO:teuthology.orchestra.run.smithi088.stdout:304.out 2023-05-17T12:29:06.062 INFO:teuthology.orchestra.run.smithi088.stdout:305 2023-05-17T12:29:06.062 INFO:teuthology.orchestra.run.smithi088.stdout:305.out 2023-05-17T12:29:06.062 INFO:teuthology.orchestra.run.smithi088.stdout:306 2023-05-17T12:29:06.063 INFO:teuthology.orchestra.run.smithi088.stdout:306.out 2023-05-17T12:29:06.063 INFO:teuthology.orchestra.run.smithi088.stdout:307 2023-05-17T12:29:06.063 INFO:teuthology.orchestra.run.smithi088.stdout:307.out 2023-05-17T12:29:06.063 INFO:teuthology.orchestra.run.smithi088.stdout:308 2023-05-17T12:29:06.063 INFO:teuthology.orchestra.run.smithi088.stdout:308.out 2023-05-17T12:29:06.063 INFO:teuthology.orchestra.run.smithi088.stdout:309 2023-05-17T12:29:06.063 INFO:teuthology.orchestra.run.smithi088.stdout:309.out 2023-05-17T12:29:06.064 INFO:teuthology.orchestra.run.smithi088.stdout:310 2023-05-17T12:29:06.064 INFO:teuthology.orchestra.run.smithi088.stdout:310.out 2023-05-17T12:29:06.064 INFO:teuthology.orchestra.run.smithi088.stdout:311 2023-05-17T12:29:06.064 INFO:teuthology.orchestra.run.smithi088.stdout:311.out 2023-05-17T12:29:06.064 INFO:teuthology.orchestra.run.smithi088.stdout:312 2023-05-17T12:29:06.064 INFO:teuthology.orchestra.run.smithi088.stdout:312.out 2023-05-17T12:29:06.064 INFO:teuthology.orchestra.run.smithi088.stdout:313 2023-05-17T12:29:06.065 INFO:teuthology.orchestra.run.smithi088.stdout:313.out 2023-05-17T12:29:06.065 INFO:teuthology.orchestra.run.smithi088.stdout:314 2023-05-17T12:29:06.065 INFO:teuthology.orchestra.run.smithi088.stdout:314.out 2023-05-17T12:29:06.065 INFO:teuthology.orchestra.run.smithi088.stdout:315 2023-05-17T12:29:06.065 INFO:teuthology.orchestra.run.smithi088.stdout:315.out 2023-05-17T12:29:06.065 INFO:teuthology.orchestra.run.smithi088.stdout:316 2023-05-17T12:29:06.066 INFO:teuthology.orchestra.run.smithi088.stdout:316.out 2023-05-17T12:29:06.066 INFO:teuthology.orchestra.run.smithi088.stdout:317 2023-05-17T12:29:06.066 INFO:teuthology.orchestra.run.smithi088.stdout:317.out 2023-05-17T12:29:06.066 INFO:teuthology.orchestra.run.smithi088.stdout:318 2023-05-17T12:29:06.066 INFO:teuthology.orchestra.run.smithi088.stdout:318.out 2023-05-17T12:29:06.066 INFO:teuthology.orchestra.run.smithi088.stdout:319 2023-05-17T12:29:06.067 INFO:teuthology.orchestra.run.smithi088.stdout:319.out 2023-05-17T12:29:06.067 INFO:teuthology.orchestra.run.smithi088.stdout:320 2023-05-17T12:29:06.067 INFO:teuthology.orchestra.run.smithi088.stdout:320.out 2023-05-17T12:29:06.067 INFO:teuthology.orchestra.run.smithi088.stdout:321 2023-05-17T12:29:06.067 INFO:teuthology.orchestra.run.smithi088.stdout:321.out 2023-05-17T12:29:06.067 INFO:teuthology.orchestra.run.smithi088.stdout:322 2023-05-17T12:29:06.068 INFO:teuthology.orchestra.run.smithi088.stdout:322.out 2023-05-17T12:29:06.068 INFO:teuthology.orchestra.run.smithi088.stdout:323 2023-05-17T12:29:06.068 INFO:teuthology.orchestra.run.smithi088.stdout:323.out 2023-05-17T12:29:06.068 INFO:teuthology.orchestra.run.smithi088.stdout:324 2023-05-17T12:29:06.068 INFO:teuthology.orchestra.run.smithi088.stdout:324.out 2023-05-17T12:29:06.068 INFO:teuthology.orchestra.run.smithi088.stdout:325 2023-05-17T12:29:06.068 INFO:teuthology.orchestra.run.smithi088.stdout:325.out 2023-05-17T12:29:06.069 INFO:teuthology.orchestra.run.smithi088.stdout:326 2023-05-17T12:29:06.069 INFO:teuthology.orchestra.run.smithi088.stdout:326.out 2023-05-17T12:29:06.069 INFO:teuthology.orchestra.run.smithi088.stdout:327 2023-05-17T12:29:06.069 INFO:teuthology.orchestra.run.smithi088.stdout:327.out 2023-05-17T12:29:06.069 INFO:teuthology.orchestra.run.smithi088.stdout:328 2023-05-17T12:29:06.069 INFO:teuthology.orchestra.run.smithi088.stdout:328.out 2023-05-17T12:29:06.069 INFO:teuthology.orchestra.run.smithi088.stdout:329 2023-05-17T12:29:06.070 INFO:teuthology.orchestra.run.smithi088.stdout:329.out 2023-05-17T12:29:06.070 INFO:teuthology.orchestra.run.smithi088.stdout:330 2023-05-17T12:29:06.070 INFO:teuthology.orchestra.run.smithi088.stdout:330.out 2023-05-17T12:29:06.070 INFO:teuthology.orchestra.run.smithi088.stdout:331 2023-05-17T12:29:06.070 INFO:teuthology.orchestra.run.smithi088.stdout:331.out 2023-05-17T12:29:06.070 INFO:teuthology.orchestra.run.smithi088.stdout:332 2023-05-17T12:29:06.070 INFO:teuthology.orchestra.run.smithi088.stdout:332.out 2023-05-17T12:29:06.071 INFO:teuthology.orchestra.run.smithi088.stdout:333 2023-05-17T12:29:06.071 INFO:teuthology.orchestra.run.smithi088.stdout:333.out 2023-05-17T12:29:06.071 INFO:teuthology.orchestra.run.smithi088.stdout:334 2023-05-17T12:29:06.071 INFO:teuthology.orchestra.run.smithi088.stdout:334.out 2023-05-17T12:29:06.071 INFO:teuthology.orchestra.run.smithi088.stdout:335 2023-05-17T12:29:06.071 INFO:teuthology.orchestra.run.smithi088.stdout:335.out 2023-05-17T12:29:06.071 INFO:teuthology.orchestra.run.smithi088.stdout:336 2023-05-17T12:29:06.071 INFO:teuthology.orchestra.run.smithi088.stdout:336.out 2023-05-17T12:29:06.072 INFO:teuthology.orchestra.run.smithi088.stdout:337 2023-05-17T12:29:06.072 INFO:teuthology.orchestra.run.smithi088.stdout:337.out 2023-05-17T12:29:06.072 INFO:teuthology.orchestra.run.smithi088.stdout:338 2023-05-17T12:29:06.072 INFO:teuthology.orchestra.run.smithi088.stdout:338.out 2023-05-17T12:29:06.072 INFO:teuthology.orchestra.run.smithi088.stdout:339 2023-05-17T12:29:06.072 INFO:teuthology.orchestra.run.smithi088.stdout:339.out 2023-05-17T12:29:06.073 INFO:teuthology.orchestra.run.smithi088.stdout:340 2023-05-17T12:29:06.073 INFO:teuthology.orchestra.run.smithi088.stdout:340.out 2023-05-17T12:29:06.073 INFO:teuthology.orchestra.run.smithi088.stdout:341 2023-05-17T12:29:06.073 INFO:teuthology.orchestra.run.smithi088.stdout:341.out 2023-05-17T12:29:06.073 INFO:teuthology.orchestra.run.smithi088.stdout:342 2023-05-17T12:29:06.073 INFO:teuthology.orchestra.run.smithi088.stdout:342.out 2023-05-17T12:29:06.073 INFO:teuthology.orchestra.run.smithi088.stdout:343 2023-05-17T12:29:06.074 INFO:teuthology.orchestra.run.smithi088.stdout:343.out 2023-05-17T12:29:06.074 INFO:teuthology.orchestra.run.smithi088.stdout:344 2023-05-17T12:29:06.074 INFO:teuthology.orchestra.run.smithi088.stdout:344.out 2023-05-17T12:29:06.074 INFO:teuthology.orchestra.run.smithi088.stdout:345 2023-05-17T12:29:06.075 INFO:teuthology.orchestra.run.smithi088.stdout:345.out 2023-05-17T12:29:06.075 INFO:teuthology.orchestra.run.smithi088.stdout:346 2023-05-17T12:29:06.075 INFO:teuthology.orchestra.run.smithi088.stdout:346.out 2023-05-17T12:29:06.075 INFO:teuthology.orchestra.run.smithi088.stdout:347 2023-05-17T12:29:06.076 INFO:teuthology.orchestra.run.smithi088.stdout:347.out 2023-05-17T12:29:06.076 INFO:teuthology.orchestra.run.smithi088.stdout:348 2023-05-17T12:29:06.076 INFO:teuthology.orchestra.run.smithi088.stdout:348.out 2023-05-17T12:29:06.076 INFO:teuthology.orchestra.run.smithi088.stdout:349 2023-05-17T12:29:06.077 INFO:teuthology.orchestra.run.smithi088.stdout:349.out 2023-05-17T12:29:06.077 INFO:teuthology.orchestra.run.smithi088.stdout:350 2023-05-17T12:29:06.077 INFO:teuthology.orchestra.run.smithi088.stdout:350.out 2023-05-17T12:29:06.077 INFO:teuthology.orchestra.run.smithi088.stdout:351 2023-05-17T12:29:06.077 INFO:teuthology.orchestra.run.smithi088.stdout:351.out 2023-05-17T12:29:06.077 INFO:teuthology.orchestra.run.smithi088.stdout:352 2023-05-17T12:29:06.078 INFO:teuthology.orchestra.run.smithi088.stdout:352.out 2023-05-17T12:29:06.078 INFO:teuthology.orchestra.run.smithi088.stdout:353 2023-05-17T12:29:06.078 INFO:teuthology.orchestra.run.smithi088.stdout:353.out 2023-05-17T12:29:06.078 INFO:teuthology.orchestra.run.smithi088.stdout:354 2023-05-17T12:29:06.078 INFO:teuthology.orchestra.run.smithi088.stdout:354.out 2023-05-17T12:29:06.078 INFO:teuthology.orchestra.run.smithi088.stdout:355 2023-05-17T12:29:06.078 INFO:teuthology.orchestra.run.smithi088.stdout:355.out 2023-05-17T12:29:06.079 INFO:teuthology.orchestra.run.smithi088.stdout:356 2023-05-17T12:29:06.079 INFO:teuthology.orchestra.run.smithi088.stdout:356.out 2023-05-17T12:29:06.079 INFO:teuthology.orchestra.run.smithi088.stdout:357 2023-05-17T12:29:06.079 INFO:teuthology.orchestra.run.smithi088.stdout:357.out 2023-05-17T12:29:06.079 INFO:teuthology.orchestra.run.smithi088.stdout:358 2023-05-17T12:29:06.079 INFO:teuthology.orchestra.run.smithi088.stdout:358.out 2023-05-17T12:29:06.079 INFO:teuthology.orchestra.run.smithi088.stdout:359 2023-05-17T12:29:06.080 INFO:teuthology.orchestra.run.smithi088.stdout:359.out 2023-05-17T12:29:06.080 INFO:teuthology.orchestra.run.smithi088.stdout:360 2023-05-17T12:29:06.080 INFO:teuthology.orchestra.run.smithi088.stdout:360.out 2023-05-17T12:29:06.080 INFO:teuthology.orchestra.run.smithi088.stdout:361 2023-05-17T12:29:06.080 INFO:teuthology.orchestra.run.smithi088.stdout:361.out 2023-05-17T12:29:06.080 INFO:teuthology.orchestra.run.smithi088.stdout:362 2023-05-17T12:29:06.080 INFO:teuthology.orchestra.run.smithi088.stdout:362.out 2023-05-17T12:29:06.080 INFO:teuthology.orchestra.run.smithi088.stdout:363 2023-05-17T12:29:06.081 INFO:teuthology.orchestra.run.smithi088.stdout:363.out 2023-05-17T12:29:06.081 INFO:teuthology.orchestra.run.smithi088.stdout:364 2023-05-17T12:29:06.081 INFO:teuthology.orchestra.run.smithi088.stdout:364.out 2023-05-17T12:29:06.081 INFO:teuthology.orchestra.run.smithi088.stdout:365 2023-05-17T12:29:06.081 INFO:teuthology.orchestra.run.smithi088.stdout:365.out 2023-05-17T12:29:06.081 INFO:teuthology.orchestra.run.smithi088.stdout:366 2023-05-17T12:29:06.081 INFO:teuthology.orchestra.run.smithi088.stdout:366.out 2023-05-17T12:29:06.082 INFO:teuthology.orchestra.run.smithi088.stdout:367 2023-05-17T12:29:06.082 INFO:teuthology.orchestra.run.smithi088.stdout:367.out 2023-05-17T12:29:06.082 INFO:teuthology.orchestra.run.smithi088.stdout:368 2023-05-17T12:29:06.082 INFO:teuthology.orchestra.run.smithi088.stdout:368.out 2023-05-17T12:29:06.082 INFO:teuthology.orchestra.run.smithi088.stdout:369 2023-05-17T12:29:06.082 INFO:teuthology.orchestra.run.smithi088.stdout:369.out 2023-05-17T12:29:06.083 INFO:teuthology.orchestra.run.smithi088.stdout:370 2023-05-17T12:29:06.083 INFO:teuthology.orchestra.run.smithi088.stdout:370.out 2023-05-17T12:29:06.083 INFO:teuthology.orchestra.run.smithi088.stdout:371 2023-05-17T12:29:06.083 INFO:teuthology.orchestra.run.smithi088.stdout:371.out 2023-05-17T12:29:06.083 INFO:teuthology.orchestra.run.smithi088.stdout:372 2023-05-17T12:29:06.083 INFO:teuthology.orchestra.run.smithi088.stdout:372.out 2023-05-17T12:29:06.083 INFO:teuthology.orchestra.run.smithi088.stdout:373 2023-05-17T12:29:06.084 INFO:teuthology.orchestra.run.smithi088.stdout:373.out 2023-05-17T12:29:06.084 INFO:teuthology.orchestra.run.smithi088.stdout:374 2023-05-17T12:29:06.084 INFO:teuthology.orchestra.run.smithi088.stdout:374.out 2023-05-17T12:29:06.084 INFO:teuthology.orchestra.run.smithi088.stdout:375 2023-05-17T12:29:06.084 INFO:teuthology.orchestra.run.smithi088.stdout:375.out 2023-05-17T12:29:06.084 INFO:teuthology.orchestra.run.smithi088.stdout:376 2023-05-17T12:29:06.084 INFO:teuthology.orchestra.run.smithi088.stdout:376.out 2023-05-17T12:29:06.085 INFO:teuthology.orchestra.run.smithi088.stdout:377 2023-05-17T12:29:06.085 INFO:teuthology.orchestra.run.smithi088.stdout:377.out 2023-05-17T12:29:06.085 INFO:teuthology.orchestra.run.smithi088.stdout:378 2023-05-17T12:29:06.085 INFO:teuthology.orchestra.run.smithi088.stdout:378.out 2023-05-17T12:29:06.085 INFO:teuthology.orchestra.run.smithi088.stdout:379 2023-05-17T12:29:06.085 INFO:teuthology.orchestra.run.smithi088.stdout:379.out 2023-05-17T12:29:06.085 INFO:teuthology.orchestra.run.smithi088.stdout:380 2023-05-17T12:29:06.085 INFO:teuthology.orchestra.run.smithi088.stdout:380.out 2023-05-17T12:29:06.086 INFO:teuthology.orchestra.run.smithi088.stdout:381 2023-05-17T12:29:06.086 INFO:teuthology.orchestra.run.smithi088.stdout:381.out 2023-05-17T12:29:06.086 INFO:teuthology.orchestra.run.smithi088.stdout:382 2023-05-17T12:29:06.086 INFO:teuthology.orchestra.run.smithi088.stdout:382.out 2023-05-17T12:29:06.086 INFO:teuthology.orchestra.run.smithi088.stdout:383 2023-05-17T12:29:06.086 INFO:teuthology.orchestra.run.smithi088.stdout:383.out 2023-05-17T12:29:06.086 INFO:teuthology.orchestra.run.smithi088.stdout:384 2023-05-17T12:29:06.087 INFO:teuthology.orchestra.run.smithi088.stdout:384.out 2023-05-17T12:29:06.087 INFO:teuthology.orchestra.run.smithi088.stdout:385 2023-05-17T12:29:06.087 INFO:teuthology.orchestra.run.smithi088.stdout:385.out 2023-05-17T12:29:06.087 INFO:teuthology.orchestra.run.smithi088.stdout:386 2023-05-17T12:29:06.087 INFO:teuthology.orchestra.run.smithi088.stdout:386.out 2023-05-17T12:29:06.087 INFO:teuthology.orchestra.run.smithi088.stdout:387 2023-05-17T12:29:06.087 INFO:teuthology.orchestra.run.smithi088.stdout:387.out 2023-05-17T12:29:06.088 INFO:teuthology.orchestra.run.smithi088.stdout:388 2023-05-17T12:29:06.088 INFO:teuthology.orchestra.run.smithi088.stdout:388.out 2023-05-17T12:29:06.088 INFO:teuthology.orchestra.run.smithi088.stdout:389 2023-05-17T12:29:06.088 INFO:teuthology.orchestra.run.smithi088.stdout:389.out 2023-05-17T12:29:06.088 INFO:teuthology.orchestra.run.smithi088.stdout:390 2023-05-17T12:29:06.088 INFO:teuthology.orchestra.run.smithi088.stdout:390.out 2023-05-17T12:29:06.088 INFO:teuthology.orchestra.run.smithi088.stdout:391 2023-05-17T12:29:06.089 INFO:teuthology.orchestra.run.smithi088.stdout:391.out 2023-05-17T12:29:06.089 INFO:teuthology.orchestra.run.smithi088.stdout:392 2023-05-17T12:29:06.089 INFO:teuthology.orchestra.run.smithi088.stdout:392.out 2023-05-17T12:29:06.089 INFO:teuthology.orchestra.run.smithi088.stdout:393 2023-05-17T12:29:06.089 INFO:teuthology.orchestra.run.smithi088.stdout:393.out 2023-05-17T12:29:06.089 INFO:teuthology.orchestra.run.smithi088.stdout:394 2023-05-17T12:29:06.089 INFO:teuthology.orchestra.run.smithi088.stdout:394.out 2023-05-17T12:29:06.090 INFO:teuthology.orchestra.run.smithi088.stdout:395 2023-05-17T12:29:06.090 INFO:teuthology.orchestra.run.smithi088.stdout:395.out 2023-05-17T12:29:06.090 INFO:teuthology.orchestra.run.smithi088.stdout:396 2023-05-17T12:29:06.090 INFO:teuthology.orchestra.run.smithi088.stdout:396.out 2023-05-17T12:29:06.090 INFO:teuthology.orchestra.run.smithi088.stdout:397 2023-05-17T12:29:06.090 INFO:teuthology.orchestra.run.smithi088.stdout:397.out 2023-05-17T12:29:06.090 INFO:teuthology.orchestra.run.smithi088.stdout:398 2023-05-17T12:29:06.090 INFO:teuthology.orchestra.run.smithi088.stdout:398.out 2023-05-17T12:29:06.091 INFO:teuthology.orchestra.run.smithi088.stdout:399 2023-05-17T12:29:06.091 INFO:teuthology.orchestra.run.smithi088.stdout:399.out 2023-05-17T12:29:06.091 INFO:teuthology.orchestra.run.smithi088.stdout:400 2023-05-17T12:29:06.091 INFO:teuthology.orchestra.run.smithi088.stdout:400.out 2023-05-17T12:29:06.091 INFO:teuthology.orchestra.run.smithi088.stdout:401 2023-05-17T12:29:06.091 INFO:teuthology.orchestra.run.smithi088.stdout:401.out 2023-05-17T12:29:06.091 INFO:teuthology.orchestra.run.smithi088.stdout:402 2023-05-17T12:29:06.092 INFO:teuthology.orchestra.run.smithi088.stdout:402.out 2023-05-17T12:29:06.092 INFO:teuthology.orchestra.run.smithi088.stdout:403 2023-05-17T12:29:06.092 INFO:teuthology.orchestra.run.smithi088.stdout:403.out 2023-05-17T12:29:06.092 INFO:teuthology.orchestra.run.smithi088.stdout:404 2023-05-17T12:29:06.092 INFO:teuthology.orchestra.run.smithi088.stdout:404.out 2023-05-17T12:29:06.092 INFO:teuthology.orchestra.run.smithi088.stdout:405 2023-05-17T12:29:06.092 INFO:teuthology.orchestra.run.smithi088.stdout:405.out 2023-05-17T12:29:06.093 INFO:teuthology.orchestra.run.smithi088.stdout:406 2023-05-17T12:29:06.093 INFO:teuthology.orchestra.run.smithi088.stdout:406.out 2023-05-17T12:29:06.093 INFO:teuthology.orchestra.run.smithi088.stdout:407 2023-05-17T12:29:06.093 INFO:teuthology.orchestra.run.smithi088.stdout:407.out 2023-05-17T12:29:06.093 INFO:teuthology.orchestra.run.smithi088.stdout:408 2023-05-17T12:29:06.093 INFO:teuthology.orchestra.run.smithi088.stdout:408.out 2023-05-17T12:29:06.093 INFO:teuthology.orchestra.run.smithi088.stdout:409 2023-05-17T12:29:06.094 INFO:teuthology.orchestra.run.smithi088.stdout:409.out 2023-05-17T12:29:06.094 INFO:teuthology.orchestra.run.smithi088.stdout:410 2023-05-17T12:29:06.094 INFO:teuthology.orchestra.run.smithi088.stdout:410.out 2023-05-17T12:29:06.094 INFO:teuthology.orchestra.run.smithi088.stdout:411 2023-05-17T12:29:06.094 INFO:teuthology.orchestra.run.smithi088.stdout:411.out 2023-05-17T12:29:06.094 INFO:teuthology.orchestra.run.smithi088.stdout:412 2023-05-17T12:29:06.094 INFO:teuthology.orchestra.run.smithi088.stdout:412.out 2023-05-17T12:29:06.094 INFO:teuthology.orchestra.run.smithi088.stdout:413 2023-05-17T12:29:06.095 INFO:teuthology.orchestra.run.smithi088.stdout:413.out 2023-05-17T12:29:06.095 INFO:teuthology.orchestra.run.smithi088.stdout:414 2023-05-17T12:29:06.095 INFO:teuthology.orchestra.run.smithi088.stdout:414.out 2023-05-17T12:29:06.095 INFO:teuthology.orchestra.run.smithi088.stdout:415 2023-05-17T12:29:06.095 INFO:teuthology.orchestra.run.smithi088.stdout:415.out 2023-05-17T12:29:06.095 INFO:teuthology.orchestra.run.smithi088.stdout:416 2023-05-17T12:29:06.095 INFO:teuthology.orchestra.run.smithi088.stdout:416.out 2023-05-17T12:29:06.096 INFO:teuthology.orchestra.run.smithi088.stdout:417 2023-05-17T12:29:06.096 INFO:teuthology.orchestra.run.smithi088.stdout:417.out 2023-05-17T12:29:06.096 INFO:teuthology.orchestra.run.smithi088.stdout:418 2023-05-17T12:29:06.096 INFO:teuthology.orchestra.run.smithi088.stdout:418.out 2023-05-17T12:29:06.096 INFO:teuthology.orchestra.run.smithi088.stdout:419 2023-05-17T12:29:06.096 INFO:teuthology.orchestra.run.smithi088.stdout:419.out 2023-05-17T12:29:06.096 INFO:teuthology.orchestra.run.smithi088.stdout:420 2023-05-17T12:29:06.097 INFO:teuthology.orchestra.run.smithi088.stdout:420.out 2023-05-17T12:29:06.097 INFO:teuthology.orchestra.run.smithi088.stdout:421 2023-05-17T12:29:06.097 INFO:teuthology.orchestra.run.smithi088.stdout:421.out 2023-05-17T12:29:06.097 INFO:teuthology.orchestra.run.smithi088.stdout:422 2023-05-17T12:29:06.097 INFO:teuthology.orchestra.run.smithi088.stdout:422.out 2023-05-17T12:29:06.097 INFO:teuthology.orchestra.run.smithi088.stdout:423 2023-05-17T12:29:06.097 INFO:teuthology.orchestra.run.smithi088.stdout:423.out 2023-05-17T12:29:06.098 INFO:teuthology.orchestra.run.smithi088.stdout:424 2023-05-17T12:29:06.098 INFO:teuthology.orchestra.run.smithi088.stdout:424.out 2023-05-17T12:29:06.098 INFO:teuthology.orchestra.run.smithi088.stdout:425 2023-05-17T12:29:06.098 INFO:teuthology.orchestra.run.smithi088.stdout:425.out 2023-05-17T12:29:06.098 INFO:teuthology.orchestra.run.smithi088.stdout:426 2023-05-17T12:29:06.098 INFO:teuthology.orchestra.run.smithi088.stdout:426.out 2023-05-17T12:29:06.098 INFO:teuthology.orchestra.run.smithi088.stdout:427 2023-05-17T12:29:06.098 INFO:teuthology.orchestra.run.smithi088.stdout:427.out 2023-05-17T12:29:06.099 INFO:teuthology.orchestra.run.smithi088.stdout:428 2023-05-17T12:29:06.099 INFO:teuthology.orchestra.run.smithi088.stdout:428.out 2023-05-17T12:29:06.099 INFO:teuthology.orchestra.run.smithi088.stdout:429 2023-05-17T12:29:06.099 INFO:teuthology.orchestra.run.smithi088.stdout:429.out 2023-05-17T12:29:06.099 INFO:teuthology.orchestra.run.smithi088.stdout:430 2023-05-17T12:29:06.099 INFO:teuthology.orchestra.run.smithi088.stdout:430.out 2023-05-17T12:29:06.099 INFO:teuthology.orchestra.run.smithi088.stdout:431 2023-05-17T12:29:06.100 INFO:teuthology.orchestra.run.smithi088.stdout:431.out 2023-05-17T12:29:06.100 INFO:teuthology.orchestra.run.smithi088.stdout:432 2023-05-17T12:29:06.100 INFO:teuthology.orchestra.run.smithi088.stdout:432.out 2023-05-17T12:29:06.100 INFO:teuthology.orchestra.run.smithi088.stdout:433 2023-05-17T12:29:06.100 INFO:teuthology.orchestra.run.smithi088.stdout:433.out 2023-05-17T12:29:06.100 INFO:teuthology.orchestra.run.smithi088.stdout:434 2023-05-17T12:29:06.100 INFO:teuthology.orchestra.run.smithi088.stdout:434.out 2023-05-17T12:29:06.101 INFO:teuthology.orchestra.run.smithi088.stdout:435 2023-05-17T12:29:06.101 INFO:teuthology.orchestra.run.smithi088.stdout:435.out 2023-05-17T12:29:06.101 INFO:teuthology.orchestra.run.smithi088.stdout:436 2023-05-17T12:29:06.101 INFO:teuthology.orchestra.run.smithi088.stdout:436.out 2023-05-17T12:29:06.101 INFO:teuthology.orchestra.run.smithi088.stdout:437 2023-05-17T12:29:06.101 INFO:teuthology.orchestra.run.smithi088.stdout:437.out 2023-05-17T12:29:06.101 INFO:teuthology.orchestra.run.smithi088.stdout:438 2023-05-17T12:29:06.101 INFO:teuthology.orchestra.run.smithi088.stdout:438.out 2023-05-17T12:29:06.102 INFO:teuthology.orchestra.run.smithi088.stdout:439 2023-05-17T12:29:06.102 INFO:teuthology.orchestra.run.smithi088.stdout:439.out 2023-05-17T12:29:06.102 INFO:teuthology.orchestra.run.smithi088.stdout:440 2023-05-17T12:29:06.102 INFO:teuthology.orchestra.run.smithi088.stdout:440.out 2023-05-17T12:29:06.102 INFO:teuthology.orchestra.run.smithi088.stdout:441 2023-05-17T12:29:06.102 INFO:teuthology.orchestra.run.smithi088.stdout:441.out 2023-05-17T12:29:06.102 INFO:teuthology.orchestra.run.smithi088.stdout:442 2023-05-17T12:29:06.103 INFO:teuthology.orchestra.run.smithi088.stdout:442.out 2023-05-17T12:29:06.103 INFO:teuthology.orchestra.run.smithi088.stdout:443 2023-05-17T12:29:06.103 INFO:teuthology.orchestra.run.smithi088.stdout:443.out 2023-05-17T12:29:06.103 INFO:teuthology.orchestra.run.smithi088.stdout:444 2023-05-17T12:29:06.103 INFO:teuthology.orchestra.run.smithi088.stdout:444.out 2023-05-17T12:29:06.103 INFO:teuthology.orchestra.run.smithi088.stdout:445 2023-05-17T12:29:06.103 INFO:teuthology.orchestra.run.smithi088.stdout:445.out 2023-05-17T12:29:06.104 INFO:teuthology.orchestra.run.smithi088.stdout:446 2023-05-17T12:29:06.104 INFO:teuthology.orchestra.run.smithi088.stdout:446.out 2023-05-17T12:29:06.104 INFO:teuthology.orchestra.run.smithi088.stdout:447 2023-05-17T12:29:06.104 INFO:teuthology.orchestra.run.smithi088.stdout:447.out 2023-05-17T12:29:06.104 INFO:teuthology.orchestra.run.smithi088.stdout:448 2023-05-17T12:29:06.104 INFO:teuthology.orchestra.run.smithi088.stdout:448.out 2023-05-17T12:29:06.104 INFO:teuthology.orchestra.run.smithi088.stdout:449 2023-05-17T12:29:06.105 INFO:teuthology.orchestra.run.smithi088.stdout:449.out 2023-05-17T12:29:06.105 INFO:teuthology.orchestra.run.smithi088.stdout:450 2023-05-17T12:29:06.105 INFO:teuthology.orchestra.run.smithi088.stdout:450.out 2023-05-17T12:29:06.105 INFO:teuthology.orchestra.run.smithi088.stdout:451 2023-05-17T12:29:06.105 INFO:teuthology.orchestra.run.smithi088.stdout:451.out 2023-05-17T12:29:06.105 INFO:teuthology.orchestra.run.smithi088.stdout:452 2023-05-17T12:29:06.105 INFO:teuthology.orchestra.run.smithi088.stdout:452.out 2023-05-17T12:29:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:453 2023-05-17T12:29:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:453.out 2023-05-17T12:29:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:454 2023-05-17T12:29:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:454.out 2023-05-17T12:29:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:455 2023-05-17T12:29:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:455.out 2023-05-17T12:29:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:456 2023-05-17T12:29:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:456.out 2023-05-17T12:29:06.107 INFO:teuthology.orchestra.run.smithi088.stdout:457 2023-05-17T12:29:06.107 INFO:teuthology.orchestra.run.smithi088.stdout:457.out 2023-05-17T12:29:06.107 INFO:teuthology.orchestra.run.smithi088.stdout:458 2023-05-17T12:29:06.107 INFO:teuthology.orchestra.run.smithi088.stdout:458.out 2023-05-17T12:29:06.107 INFO:teuthology.orchestra.run.smithi088.stdout:459 2023-05-17T12:29:06.107 INFO:teuthology.orchestra.run.smithi088.stdout:459.out 2023-05-17T12:29:06.107 INFO:teuthology.orchestra.run.smithi088.stdout:460 2023-05-17T12:29:06.108 INFO:teuthology.orchestra.run.smithi088.stdout:460.out 2023-05-17T12:29:06.108 INFO:teuthology.orchestra.run.smithi088.stdout:461 2023-05-17T12:29:06.108 INFO:teuthology.orchestra.run.smithi088.stdout:461.out 2023-05-17T12:29:06.108 INFO:teuthology.orchestra.run.smithi088.stdout:462 2023-05-17T12:29:06.108 INFO:teuthology.orchestra.run.smithi088.stdout:462.out 2023-05-17T12:29:06.108 INFO:teuthology.orchestra.run.smithi088.stdout:463 2023-05-17T12:29:06.108 INFO:teuthology.orchestra.run.smithi088.stdout:463.out 2023-05-17T12:29:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:464 2023-05-17T12:29:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:464.out 2023-05-17T12:29:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:465 2023-05-17T12:29:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:465.out 2023-05-17T12:29:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:466 2023-05-17T12:29:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:466.out 2023-05-17T12:29:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:467 2023-05-17T12:29:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:467.out 2023-05-17T12:29:06.110 INFO:teuthology.orchestra.run.smithi088.stdout:468 2023-05-17T12:29:06.110 INFO:teuthology.orchestra.run.smithi088.stdout:468.out 2023-05-17T12:29:06.110 INFO:teuthology.orchestra.run.smithi088.stdout:469 2023-05-17T12:29:06.110 INFO:teuthology.orchestra.run.smithi088.stdout:469.out 2023-05-17T12:29:06.110 INFO:teuthology.orchestra.run.smithi088.stdout:470 2023-05-17T12:29:06.110 INFO:teuthology.orchestra.run.smithi088.stdout:470.out 2023-05-17T12:29:06.110 INFO:teuthology.orchestra.run.smithi088.stdout:471 2023-05-17T12:29:06.111 INFO:teuthology.orchestra.run.smithi088.stdout:471.out 2023-05-17T12:29:06.111 INFO:teuthology.orchestra.run.smithi088.stdout:472 2023-05-17T12:29:06.111 INFO:teuthology.orchestra.run.smithi088.stdout:472.out 2023-05-17T12:29:06.111 INFO:teuthology.orchestra.run.smithi088.stdout:473 2023-05-17T12:29:06.111 INFO:teuthology.orchestra.run.smithi088.stdout:473.out 2023-05-17T12:29:06.111 INFO:teuthology.orchestra.run.smithi088.stdout:474 2023-05-17T12:29:06.111 INFO:teuthology.orchestra.run.smithi088.stdout:474.out 2023-05-17T12:29:06.112 INFO:teuthology.orchestra.run.smithi088.stdout:475 2023-05-17T12:29:06.112 INFO:teuthology.orchestra.run.smithi088.stdout:475.out 2023-05-17T12:29:06.112 INFO:teuthology.orchestra.run.smithi088.stdout:476 2023-05-17T12:29:06.112 INFO:teuthology.orchestra.run.smithi088.stdout:476.out 2023-05-17T12:29:06.112 INFO:teuthology.orchestra.run.smithi088.stdout:477 2023-05-17T12:29:06.112 INFO:teuthology.orchestra.run.smithi088.stdout:477.out 2023-05-17T12:29:06.112 INFO:teuthology.orchestra.run.smithi088.stdout:478 2023-05-17T12:29:06.113 INFO:teuthology.orchestra.run.smithi088.stdout:478.out 2023-05-17T12:29:06.113 INFO:teuthology.orchestra.run.smithi088.stdout:479 2023-05-17T12:29:06.113 INFO:teuthology.orchestra.run.smithi088.stdout:479.out 2023-05-17T12:29:06.113 INFO:teuthology.orchestra.run.smithi088.stdout:480 2023-05-17T12:29:06.113 INFO:teuthology.orchestra.run.smithi088.stdout:480.out 2023-05-17T12:29:06.113 INFO:teuthology.orchestra.run.smithi088.stdout:481 2023-05-17T12:29:06.113 INFO:teuthology.orchestra.run.smithi088.stdout:481.out 2023-05-17T12:29:06.113 INFO:teuthology.orchestra.run.smithi088.stdout:482 2023-05-17T12:29:06.114 INFO:teuthology.orchestra.run.smithi088.stdout:482.out 2023-05-17T12:29:06.114 INFO:teuthology.orchestra.run.smithi088.stdout:483 2023-05-17T12:29:06.114 INFO:teuthology.orchestra.run.smithi088.stdout:483.out 2023-05-17T12:29:06.114 INFO:teuthology.orchestra.run.smithi088.stdout:484 2023-05-17T12:29:06.114 INFO:teuthology.orchestra.run.smithi088.stdout:484.out 2023-05-17T12:29:06.114 INFO:teuthology.orchestra.run.smithi088.stdout:485 2023-05-17T12:29:06.114 INFO:teuthology.orchestra.run.smithi088.stdout:485.out 2023-05-17T12:29:06.115 INFO:teuthology.orchestra.run.smithi088.stdout:486 2023-05-17T12:29:06.115 INFO:teuthology.orchestra.run.smithi088.stdout:486.out 2023-05-17T12:29:06.115 INFO:teuthology.orchestra.run.smithi088.stdout:487 2023-05-17T12:29:06.115 INFO:teuthology.orchestra.run.smithi088.stdout:487.out 2023-05-17T12:29:06.115 INFO:teuthology.orchestra.run.smithi088.stdout:488 2023-05-17T12:29:06.115 INFO:teuthology.orchestra.run.smithi088.stdout:488.out 2023-05-17T12:29:06.115 INFO:teuthology.orchestra.run.smithi088.stdout:489 2023-05-17T12:29:06.116 INFO:teuthology.orchestra.run.smithi088.stdout:489.out 2023-05-17T12:29:06.116 INFO:teuthology.orchestra.run.smithi088.stdout:490 2023-05-17T12:29:06.116 INFO:teuthology.orchestra.run.smithi088.stdout:490.out 2023-05-17T12:29:06.116 INFO:teuthology.orchestra.run.smithi088.stdout:491 2023-05-17T12:29:06.116 INFO:teuthology.orchestra.run.smithi088.stdout:491.out 2023-05-17T12:29:06.116 INFO:teuthology.orchestra.run.smithi088.stdout:492 2023-05-17T12:29:06.116 INFO:teuthology.orchestra.run.smithi088.stdout:492.out 2023-05-17T12:29:06.117 INFO:teuthology.orchestra.run.smithi088.stdout:493 2023-05-17T12:29:06.117 INFO:teuthology.orchestra.run.smithi088.stdout:493.out 2023-05-17T12:29:06.117 INFO:teuthology.orchestra.run.smithi088.stdout:494 2023-05-17T12:29:06.117 INFO:teuthology.orchestra.run.smithi088.stdout:494.out 2023-05-17T12:29:06.117 INFO:teuthology.orchestra.run.smithi088.stdout:495 2023-05-17T12:29:06.117 INFO:teuthology.orchestra.run.smithi088.stdout:495.out 2023-05-17T12:29:06.117 INFO:teuthology.orchestra.run.smithi088.stdout:496 2023-05-17T12:29:06.117 INFO:teuthology.orchestra.run.smithi088.stdout:496.out 2023-05-17T12:29:06.118 INFO:teuthology.orchestra.run.smithi088.stdout:497 2023-05-17T12:29:06.118 INFO:teuthology.orchestra.run.smithi088.stdout:497.out 2023-05-17T12:29:06.118 INFO:teuthology.orchestra.run.smithi088.stdout:498 2023-05-17T12:29:06.118 INFO:teuthology.orchestra.run.smithi088.stdout:498.out 2023-05-17T12:29:06.118 INFO:teuthology.orchestra.run.smithi088.stdout:499 2023-05-17T12:29:06.118 INFO:teuthology.orchestra.run.smithi088.stdout:499.out 2023-05-17T12:29:06.118 INFO:teuthology.orchestra.run.smithi088.stdout:500 2023-05-17T12:29:06.119 INFO:teuthology.orchestra.run.smithi088.stdout:500.out 2023-05-17T12:29:06.119 INFO:teuthology.orchestra.run.smithi088.stdout:501 2023-05-17T12:29:06.119 INFO:teuthology.orchestra.run.smithi088.stdout:501.out 2023-05-17T12:29:06.119 INFO:teuthology.orchestra.run.smithi088.stdout:502 2023-05-17T12:29:06.119 INFO:teuthology.orchestra.run.smithi088.stdout:502.out 2023-05-17T12:29:06.119 INFO:teuthology.orchestra.run.smithi088.stdout:503 2023-05-17T12:29:06.119 INFO:teuthology.orchestra.run.smithi088.stdout:503.out 2023-05-17T12:29:06.120 INFO:teuthology.orchestra.run.smithi088.stdout:504 2023-05-17T12:29:06.120 INFO:teuthology.orchestra.run.smithi088.stdout:504.out 2023-05-17T12:29:06.120 INFO:teuthology.orchestra.run.smithi088.stdout:505 2023-05-17T12:29:06.120 INFO:teuthology.orchestra.run.smithi088.stdout:505.out 2023-05-17T12:29:06.120 INFO:teuthology.orchestra.run.smithi088.stdout:506 2023-05-17T12:29:06.120 INFO:teuthology.orchestra.run.smithi088.stdout:506.out 2023-05-17T12:29:06.120 INFO:teuthology.orchestra.run.smithi088.stdout:507 2023-05-17T12:29:06.121 INFO:teuthology.orchestra.run.smithi088.stdout:507.out 2023-05-17T12:29:06.121 INFO:teuthology.orchestra.run.smithi088.stdout:508 2023-05-17T12:29:06.121 INFO:teuthology.orchestra.run.smithi088.stdout:508.out 2023-05-17T12:29:06.121 INFO:teuthology.orchestra.run.smithi088.stdout:509 2023-05-17T12:29:06.121 INFO:teuthology.orchestra.run.smithi088.stdout:509.out 2023-05-17T12:29:06.121 INFO:teuthology.orchestra.run.smithi088.stdout:510 2023-05-17T12:29:06.121 INFO:teuthology.orchestra.run.smithi088.stdout:510.out 2023-05-17T12:29:06.121 INFO:teuthology.orchestra.run.smithi088.stdout:511 2023-05-17T12:29:06.122 INFO:teuthology.orchestra.run.smithi088.stdout:511.out 2023-05-17T12:29:06.122 INFO:teuthology.orchestra.run.smithi088.stdout:512 2023-05-17T12:29:06.122 INFO:teuthology.orchestra.run.smithi088.stdout:512.out 2023-05-17T12:29:06.122 INFO:teuthology.orchestra.run.smithi088.stdout:513 2023-05-17T12:29:06.122 INFO:teuthology.orchestra.run.smithi088.stdout:513.out 2023-05-17T12:29:06.122 INFO:teuthology.orchestra.run.smithi088.stdout:514 2023-05-17T12:29:06.122 INFO:teuthology.orchestra.run.smithi088.stdout:514.out 2023-05-17T12:29:06.123 INFO:teuthology.orchestra.run.smithi088.stdout:515 2023-05-17T12:29:06.123 INFO:teuthology.orchestra.run.smithi088.stdout:515.out 2023-05-17T12:29:06.123 INFO:teuthology.orchestra.run.smithi088.stdout:516 2023-05-17T12:29:06.123 INFO:teuthology.orchestra.run.smithi088.stdout:516.out 2023-05-17T12:29:06.123 INFO:teuthology.orchestra.run.smithi088.stdout:517 2023-05-17T12:29:06.123 INFO:teuthology.orchestra.run.smithi088.stdout:517.out 2023-05-17T12:29:06.123 INFO:teuthology.orchestra.run.smithi088.stdout:518 2023-05-17T12:29:06.124 INFO:teuthology.orchestra.run.smithi088.stdout:518.out 2023-05-17T12:29:06.124 INFO:teuthology.orchestra.run.smithi088.stdout:519 2023-05-17T12:29:06.124 INFO:teuthology.orchestra.run.smithi088.stdout:519.out 2023-05-17T12:29:06.124 INFO:teuthology.orchestra.run.smithi088.stdout:520 2023-05-17T12:29:06.124 INFO:teuthology.orchestra.run.smithi088.stdout:520.out 2023-05-17T12:29:06.124 INFO:teuthology.orchestra.run.smithi088.stdout:521 2023-05-17T12:29:06.124 INFO:teuthology.orchestra.run.smithi088.stdout:521.out 2023-05-17T12:29:06.124 INFO:teuthology.orchestra.run.smithi088.stdout:522 2023-05-17T12:29:06.125 INFO:teuthology.orchestra.run.smithi088.stdout:522.out 2023-05-17T12:29:06.125 INFO:teuthology.orchestra.run.smithi088.stdout:523 2023-05-17T12:29:06.125 INFO:teuthology.orchestra.run.smithi088.stdout:523.out 2023-05-17T12:29:06.125 INFO:teuthology.orchestra.run.smithi088.stdout:524 2023-05-17T12:29:06.125 INFO:teuthology.orchestra.run.smithi088.stdout:524.out 2023-05-17T12:29:06.125 INFO:teuthology.orchestra.run.smithi088.stdout:525 2023-05-17T12:29:06.125 INFO:teuthology.orchestra.run.smithi088.stdout:525.out 2023-05-17T12:29:06.126 INFO:teuthology.orchestra.run.smithi088.stdout:526 2023-05-17T12:29:06.126 INFO:teuthology.orchestra.run.smithi088.stdout:526.out 2023-05-17T12:29:06.126 INFO:teuthology.orchestra.run.smithi088.stdout:527 2023-05-17T12:29:06.126 INFO:teuthology.orchestra.run.smithi088.stdout:527.out 2023-05-17T12:29:06.126 INFO:teuthology.orchestra.run.smithi088.stdout:528 2023-05-17T12:29:06.126 INFO:teuthology.orchestra.run.smithi088.stdout:528.out 2023-05-17T12:29:06.126 INFO:teuthology.orchestra.run.smithi088.stdout:529 2023-05-17T12:29:06.127 INFO:teuthology.orchestra.run.smithi088.stdout:529.out 2023-05-17T12:29:06.127 INFO:teuthology.orchestra.run.smithi088.stdout:530 2023-05-17T12:29:06.127 INFO:teuthology.orchestra.run.smithi088.stdout:530.out 2023-05-17T12:29:06.127 INFO:teuthology.orchestra.run.smithi088.stdout:531 2023-05-17T12:29:06.127 INFO:teuthology.orchestra.run.smithi088.stdout:531.out 2023-05-17T12:29:06.127 INFO:teuthology.orchestra.run.smithi088.stdout:532 2023-05-17T12:29:06.127 INFO:teuthology.orchestra.run.smithi088.stdout:532.out 2023-05-17T12:29:06.127 INFO:teuthology.orchestra.run.smithi088.stdout:533 2023-05-17T12:29:06.128 INFO:teuthology.orchestra.run.smithi088.stdout:533.out 2023-05-17T12:29:06.128 INFO:teuthology.orchestra.run.smithi088.stdout:534 2023-05-17T12:29:06.128 INFO:teuthology.orchestra.run.smithi088.stdout:534.out 2023-05-17T12:29:06.128 INFO:teuthology.orchestra.run.smithi088.stdout:535 2023-05-17T12:29:06.128 INFO:teuthology.orchestra.run.smithi088.stdout:535.out 2023-05-17T12:29:06.128 INFO:teuthology.orchestra.run.smithi088.stdout:536 2023-05-17T12:29:06.128 INFO:teuthology.orchestra.run.smithi088.stdout:536.out 2023-05-17T12:29:06.129 INFO:teuthology.orchestra.run.smithi088.stdout:537 2023-05-17T12:29:06.129 INFO:teuthology.orchestra.run.smithi088.stdout:537.out 2023-05-17T12:29:06.129 INFO:teuthology.orchestra.run.smithi088.stdout:538 2023-05-17T12:29:06.129 INFO:teuthology.orchestra.run.smithi088.stdout:538.out 2023-05-17T12:29:06.129 INFO:teuthology.orchestra.run.smithi088.stdout:539 2023-05-17T12:29:06.129 INFO:teuthology.orchestra.run.smithi088.stdout:539.out 2023-05-17T12:29:06.129 INFO:teuthology.orchestra.run.smithi088.stdout:540 2023-05-17T12:29:06.130 INFO:teuthology.orchestra.run.smithi088.stdout:540.out 2023-05-17T12:29:06.130 INFO:teuthology.orchestra.run.smithi088.stdout:541 2023-05-17T12:29:06.130 INFO:teuthology.orchestra.run.smithi088.stdout:541.out 2023-05-17T12:29:06.130 INFO:teuthology.orchestra.run.smithi088.stdout:542 2023-05-17T12:29:06.130 INFO:teuthology.orchestra.run.smithi088.stdout:542.out 2023-05-17T12:29:06.130 INFO:teuthology.orchestra.run.smithi088.stdout:543 2023-05-17T12:29:06.130 INFO:teuthology.orchestra.run.smithi088.stdout:543.out 2023-05-17T12:29:06.130 INFO:teuthology.orchestra.run.smithi088.stdout:544 2023-05-17T12:29:06.131 INFO:teuthology.orchestra.run.smithi088.stdout:544.out 2023-05-17T12:29:06.131 INFO:teuthology.orchestra.run.smithi088.stdout:545 2023-05-17T12:29:06.131 INFO:teuthology.orchestra.run.smithi088.stdout:545.out 2023-05-17T12:29:06.131 INFO:teuthology.orchestra.run.smithi088.stdout:546 2023-05-17T12:29:06.131 INFO:teuthology.orchestra.run.smithi088.stdout:546.out 2023-05-17T12:29:06.131 INFO:teuthology.orchestra.run.smithi088.stdout:547 2023-05-17T12:29:06.131 INFO:teuthology.orchestra.run.smithi088.stdout:547.out 2023-05-17T12:29:06.132 INFO:teuthology.orchestra.run.smithi088.stdout:548 2023-05-17T12:29:06.132 INFO:teuthology.orchestra.run.smithi088.stdout:548.out 2023-05-17T12:29:06.132 INFO:teuthology.orchestra.run.smithi088.stdout:549 2023-05-17T12:29:06.132 INFO:teuthology.orchestra.run.smithi088.stdout:549.out 2023-05-17T12:29:06.132 INFO:teuthology.orchestra.run.smithi088.stdout:550 2023-05-17T12:29:06.132 INFO:teuthology.orchestra.run.smithi088.stdout:550.out 2023-05-17T12:29:06.132 INFO:teuthology.orchestra.run.smithi088.stdout:551 2023-05-17T12:29:06.133 INFO:teuthology.orchestra.run.smithi088.stdout:551.out 2023-05-17T12:29:06.133 INFO:teuthology.orchestra.run.smithi088.stdout:552 2023-05-17T12:29:06.133 INFO:teuthology.orchestra.run.smithi088.stdout:552.out 2023-05-17T12:29:06.133 INFO:teuthology.orchestra.run.smithi088.stdout:553 2023-05-17T12:29:06.133 INFO:teuthology.orchestra.run.smithi088.stdout:553.out 2023-05-17T12:29:06.133 INFO:teuthology.orchestra.run.smithi088.stdout:554 2023-05-17T12:29:06.133 INFO:teuthology.orchestra.run.smithi088.stdout:554.out 2023-05-17T12:29:06.134 INFO:teuthology.orchestra.run.smithi088.stdout:555 2023-05-17T12:29:06.134 INFO:teuthology.orchestra.run.smithi088.stdout:555.out 2023-05-17T12:29:06.134 INFO:teuthology.orchestra.run.smithi088.stdout:556 2023-05-17T12:29:06.134 INFO:teuthology.orchestra.run.smithi088.stdout:556.out 2023-05-17T12:29:06.134 INFO:teuthology.orchestra.run.smithi088.stdout:557 2023-05-17T12:29:06.134 INFO:teuthology.orchestra.run.smithi088.stdout:557.out 2023-05-17T12:29:06.134 INFO:teuthology.orchestra.run.smithi088.stdout:558 2023-05-17T12:29:06.134 INFO:teuthology.orchestra.run.smithi088.stdout:558.out 2023-05-17T12:29:06.135 INFO:teuthology.orchestra.run.smithi088.stdout:559 2023-05-17T12:29:06.135 INFO:teuthology.orchestra.run.smithi088.stdout:559.out 2023-05-17T12:29:06.135 INFO:teuthology.orchestra.run.smithi088.stdout:560 2023-05-17T12:29:06.135 INFO:teuthology.orchestra.run.smithi088.stdout:560.out 2023-05-17T12:29:06.135 INFO:teuthology.orchestra.run.smithi088.stdout:561 2023-05-17T12:29:06.135 INFO:teuthology.orchestra.run.smithi088.stdout:561.out 2023-05-17T12:29:06.135 INFO:teuthology.orchestra.run.smithi088.stdout:562 2023-05-17T12:29:06.136 INFO:teuthology.orchestra.run.smithi088.stdout:562.out 2023-05-17T12:29:06.136 INFO:teuthology.orchestra.run.smithi088.stdout:563 2023-05-17T12:29:06.136 INFO:teuthology.orchestra.run.smithi088.stdout:563.out 2023-05-17T12:29:06.136 INFO:teuthology.orchestra.run.smithi088.stdout:564 2023-05-17T12:29:06.136 INFO:teuthology.orchestra.run.smithi088.stdout:564.out 2023-05-17T12:29:06.136 INFO:teuthology.orchestra.run.smithi088.stdout:565 2023-05-17T12:29:06.136 INFO:teuthology.orchestra.run.smithi088.stdout:565.out 2023-05-17T12:29:06.137 INFO:teuthology.orchestra.run.smithi088.stdout:566 2023-05-17T12:29:06.137 INFO:teuthology.orchestra.run.smithi088.stdout:566.out 2023-05-17T12:29:06.137 INFO:teuthology.orchestra.run.smithi088.stdout:567 2023-05-17T12:29:06.137 INFO:teuthology.orchestra.run.smithi088.stdout:567.out 2023-05-17T12:29:06.137 INFO:teuthology.orchestra.run.smithi088.stdout:568 2023-05-17T12:29:06.137 INFO:teuthology.orchestra.run.smithi088.stdout:568.out 2023-05-17T12:29:06.137 INFO:teuthology.orchestra.run.smithi088.stdout:569 2023-05-17T12:29:06.137 INFO:teuthology.orchestra.run.smithi088.stdout:569.out 2023-05-17T12:29:06.138 INFO:teuthology.orchestra.run.smithi088.stdout:570 2023-05-17T12:29:06.138 INFO:teuthology.orchestra.run.smithi088.stdout:570.out 2023-05-17T12:29:06.138 INFO:teuthology.orchestra.run.smithi088.stdout:571 2023-05-17T12:29:06.138 INFO:teuthology.orchestra.run.smithi088.stdout:571.out 2023-05-17T12:29:06.138 INFO:teuthology.orchestra.run.smithi088.stdout:572 2023-05-17T12:29:06.138 INFO:teuthology.orchestra.run.smithi088.stdout:572.out 2023-05-17T12:29:06.138 INFO:teuthology.orchestra.run.smithi088.stdout:573 2023-05-17T12:29:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:573.out 2023-05-17T12:29:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:574 2023-05-17T12:29:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:574.out 2023-05-17T12:29:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:575 2023-05-17T12:29:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:575.out 2023-05-17T12:29:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:576 2023-05-17T12:29:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:576.out 2023-05-17T12:29:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:577 2023-05-17T12:29:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:577.out 2023-05-17T12:29:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:578 2023-05-17T12:29:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:578.out 2023-05-17T12:29:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:579 2023-05-17T12:29:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:579.out 2023-05-17T12:29:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:580 2023-05-17T12:29:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:580.out 2023-05-17T12:29:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:581 2023-05-17T12:29:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:581.out 2023-05-17T12:29:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:582 2023-05-17T12:29:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:582.out 2023-05-17T12:29:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:583 2023-05-17T12:29:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:583.out 2023-05-17T12:29:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:584 2023-05-17T12:29:06.142 INFO:teuthology.orchestra.run.smithi088.stdout:584.out 2023-05-17T12:29:06.142 INFO:teuthology.orchestra.run.smithi088.stdout:585 2023-05-17T12:29:06.142 INFO:teuthology.orchestra.run.smithi088.stdout:585.out 2023-05-17T12:29:06.142 INFO:teuthology.orchestra.run.smithi088.stdout:586 2023-05-17T12:29:06.142 INFO:teuthology.orchestra.run.smithi088.stdout:586.out 2023-05-17T12:29:06.142 INFO:teuthology.orchestra.run.smithi088.stdout:587 2023-05-17T12:29:06.142 INFO:teuthology.orchestra.run.smithi088.stdout:587.out 2023-05-17T12:29:06.143 INFO:teuthology.orchestra.run.smithi088.stdout:588 2023-05-17T12:29:06.143 INFO:teuthology.orchestra.run.smithi088.stdout:588.out 2023-05-17T12:29:06.143 INFO:teuthology.orchestra.run.smithi088.stdout:589 2023-05-17T12:29:06.143 INFO:teuthology.orchestra.run.smithi088.stdout:589.out 2023-05-17T12:29:06.143 INFO:teuthology.orchestra.run.smithi088.stdout:590 2023-05-17T12:29:06.143 INFO:teuthology.orchestra.run.smithi088.stdout:590.out 2023-05-17T12:29:06.143 INFO:teuthology.orchestra.run.smithi088.stdout:591 2023-05-17T12:29:06.143 INFO:teuthology.orchestra.run.smithi088.stdout:591.out 2023-05-17T12:29:06.144 INFO:teuthology.orchestra.run.smithi088.stdout:592 2023-05-17T12:29:06.144 INFO:teuthology.orchestra.run.smithi088.stdout:592.out 2023-05-17T12:29:06.144 INFO:teuthology.orchestra.run.smithi088.stdout:593 2023-05-17T12:29:06.144 INFO:teuthology.orchestra.run.smithi088.stdout:593.out 2023-05-17T12:29:06.144 INFO:teuthology.orchestra.run.smithi088.stdout:594 2023-05-17T12:29:06.144 INFO:teuthology.orchestra.run.smithi088.stdout:594.out 2023-05-17T12:29:06.144 INFO:teuthology.orchestra.run.smithi088.stdout:595 2023-05-17T12:29:06.145 INFO:teuthology.orchestra.run.smithi088.stdout:595.out 2023-05-17T12:29:06.145 INFO:teuthology.orchestra.run.smithi088.stdout:596 2023-05-17T12:29:06.145 INFO:teuthology.orchestra.run.smithi088.stdout:596.out 2023-05-17T12:29:06.145 INFO:teuthology.orchestra.run.smithi088.stdout:597 2023-05-17T12:29:06.145 INFO:teuthology.orchestra.run.smithi088.stdout:597.out 2023-05-17T12:29:06.145 INFO:teuthology.orchestra.run.smithi088.stdout:598 2023-05-17T12:29:06.145 INFO:teuthology.orchestra.run.smithi088.stdout:598.out 2023-05-17T12:29:06.146 INFO:teuthology.orchestra.run.smithi088.stdout:599 2023-05-17T12:29:06.146 INFO:teuthology.orchestra.run.smithi088.stdout:599.out 2023-05-17T12:29:06.146 INFO:teuthology.orchestra.run.smithi088.stdout:600 2023-05-17T12:29:06.146 INFO:teuthology.orchestra.run.smithi088.stdout:600.out 2023-05-17T12:29:06.146 INFO:teuthology.orchestra.run.smithi088.stdout:601 2023-05-17T12:29:06.146 INFO:teuthology.orchestra.run.smithi088.stdout:601.out 2023-05-17T12:29:06.146 INFO:teuthology.orchestra.run.smithi088.stdout:602 2023-05-17T12:29:06.146 INFO:teuthology.orchestra.run.smithi088.stdout:602.out 2023-05-17T12:29:06.147 INFO:teuthology.orchestra.run.smithi088.stdout:603 2023-05-17T12:29:06.147 INFO:teuthology.orchestra.run.smithi088.stdout:603.out 2023-05-17T12:29:06.147 INFO:teuthology.orchestra.run.smithi088.stdout:604 2023-05-17T12:29:06.147 INFO:teuthology.orchestra.run.smithi088.stdout:604.out 2023-05-17T12:29:06.147 INFO:teuthology.orchestra.run.smithi088.stdout:605 2023-05-17T12:29:06.147 INFO:teuthology.orchestra.run.smithi088.stdout:605.out 2023-05-17T12:29:06.147 INFO:teuthology.orchestra.run.smithi088.stdout:606 2023-05-17T12:29:06.148 INFO:teuthology.orchestra.run.smithi088.stdout:606.out 2023-05-17T12:29:06.148 INFO:teuthology.orchestra.run.smithi088.stdout:607 2023-05-17T12:29:06.148 INFO:teuthology.orchestra.run.smithi088.stdout:607.out 2023-05-17T12:29:06.148 INFO:teuthology.orchestra.run.smithi088.stdout:608 2023-05-17T12:29:06.148 INFO:teuthology.orchestra.run.smithi088.stdout:608.out 2023-05-17T12:29:06.148 INFO:teuthology.orchestra.run.smithi088.stdout:609 2023-05-17T12:29:06.148 INFO:teuthology.orchestra.run.smithi088.stdout:609.out 2023-05-17T12:29:06.149 INFO:teuthology.orchestra.run.smithi088.stdout:610 2023-05-17T12:29:06.149 INFO:teuthology.orchestra.run.smithi088.stdout:610.out 2023-05-17T12:29:06.149 INFO:teuthology.orchestra.run.smithi088.stdout:611 2023-05-17T12:29:06.149 INFO:teuthology.orchestra.run.smithi088.stdout:611.out 2023-05-17T12:29:06.149 INFO:teuthology.orchestra.run.smithi088.stdout:612 2023-05-17T12:29:06.149 INFO:teuthology.orchestra.run.smithi088.stdout:612.out 2023-05-17T12:29:06.149 INFO:teuthology.orchestra.run.smithi088.stdout:613 2023-05-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi088.stdout:613.out 2023-05-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi088.stdout:614 2023-05-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi088.stdout:614.out 2023-05-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi088.stdout:615 2023-05-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi088.stdout:615.out 2023-05-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi088.stdout:616 2023-05-17T12:29:06.150 INFO:teuthology.orchestra.run.smithi088.stdout:616.out 2023-05-17T12:29:06.151 INFO:teuthology.orchestra.run.smithi088.stdout:617 2023-05-17T12:29:06.151 INFO:teuthology.orchestra.run.smithi088.stdout:617.out 2023-05-17T12:29:06.151 INFO:teuthology.orchestra.run.smithi088.stdout:618 2023-05-17T12:29:06.151 INFO:teuthology.orchestra.run.smithi088.stdout:618.out 2023-05-17T12:29:06.151 INFO:teuthology.orchestra.run.smithi088.stdout:619 2023-05-17T12:29:06.151 INFO:teuthology.orchestra.run.smithi088.stdout:619.out 2023-05-17T12:29:06.151 INFO:teuthology.orchestra.run.smithi088.stdout:620 2023-05-17T12:29:06.151 INFO:teuthology.orchestra.run.smithi088.stdout:620.out 2023-05-17T12:29:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:621 2023-05-17T12:29:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:621.out 2023-05-17T12:29:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:622 2023-05-17T12:29:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:622.out 2023-05-17T12:29:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:623 2023-05-17T12:29:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:623.out 2023-05-17T12:29:06.152 INFO:teuthology.orchestra.run.smithi088.stdout:624 2023-05-17T12:29:06.153 INFO:teuthology.orchestra.run.smithi088.stdout:624.out 2023-05-17T12:29:06.153 INFO:teuthology.orchestra.run.smithi088.stdout:625 2023-05-17T12:29:06.153 INFO:teuthology.orchestra.run.smithi088.stdout:625.out 2023-05-17T12:29:06.153 INFO:teuthology.orchestra.run.smithi088.stdout:626 2023-05-17T12:29:06.153 INFO:teuthology.orchestra.run.smithi088.stdout:626.out 2023-05-17T12:29:06.153 INFO:teuthology.orchestra.run.smithi088.stdout:627 2023-05-17T12:29:06.153 INFO:teuthology.orchestra.run.smithi088.stdout:627.out 2023-05-17T12:29:06.154 INFO:teuthology.orchestra.run.smithi088.stdout:628 2023-05-17T12:29:06.154 INFO:teuthology.orchestra.run.smithi088.stdout:628.out 2023-05-17T12:29:06.154 INFO:teuthology.orchestra.run.smithi088.stdout:629 2023-05-17T12:29:06.154 INFO:teuthology.orchestra.run.smithi088.stdout:629.out 2023-05-17T12:29:06.154 INFO:teuthology.orchestra.run.smithi088.stdout:630 2023-05-17T12:29:06.154 INFO:teuthology.orchestra.run.smithi088.stdout:630.out 2023-05-17T12:29:06.154 INFO:teuthology.orchestra.run.smithi088.stdout:631 2023-05-17T12:29:06.155 INFO:teuthology.orchestra.run.smithi088.stdout:631.out 2023-05-17T12:29:06.155 INFO:teuthology.orchestra.run.smithi088.stdout:632 2023-05-17T12:29:06.155 INFO:teuthology.orchestra.run.smithi088.stdout:632.out 2023-05-17T12:29:06.155 INFO:teuthology.orchestra.run.smithi088.stdout:633 2023-05-17T12:29:06.155 INFO:teuthology.orchestra.run.smithi088.stdout:633.out 2023-05-17T12:29:06.155 INFO:teuthology.orchestra.run.smithi088.stdout:634 2023-05-17T12:29:06.155 INFO:teuthology.orchestra.run.smithi088.stdout:634.out 2023-05-17T12:29:06.155 INFO:teuthology.orchestra.run.smithi088.stdout:635 2023-05-17T12:29:06.156 INFO:teuthology.orchestra.run.smithi088.stdout:635.out 2023-05-17T12:29:06.156 INFO:teuthology.orchestra.run.smithi088.stdout:636 2023-05-17T12:29:06.156 INFO:teuthology.orchestra.run.smithi088.stdout:636.out 2023-05-17T12:29:06.156 INFO:teuthology.orchestra.run.smithi088.stdout:637 2023-05-17T12:29:06.156 INFO:teuthology.orchestra.run.smithi088.stdout:637.out 2023-05-17T12:29:06.156 INFO:teuthology.orchestra.run.smithi088.stdout:638 2023-05-17T12:29:06.156 INFO:teuthology.orchestra.run.smithi088.stdout:638.out 2023-05-17T12:29:06.157 INFO:teuthology.orchestra.run.smithi088.stdout:639 2023-05-17T12:29:06.157 INFO:teuthology.orchestra.run.smithi088.stdout:639.out 2023-05-17T12:29:06.157 INFO:teuthology.orchestra.run.smithi088.stdout:640 2023-05-17T12:29:06.157 INFO:teuthology.orchestra.run.smithi088.stdout:640.out 2023-05-17T12:29:06.157 INFO:teuthology.orchestra.run.smithi088.stdout:641 2023-05-17T12:29:06.157 INFO:teuthology.orchestra.run.smithi088.stdout:641.out 2023-05-17T12:29:06.157 INFO:teuthology.orchestra.run.smithi088.stdout:642 2023-05-17T12:29:06.158 INFO:teuthology.orchestra.run.smithi088.stdout:642.out 2023-05-17T12:29:06.158 INFO:teuthology.orchestra.run.smithi088.stdout:643 2023-05-17T12:29:06.158 INFO:teuthology.orchestra.run.smithi088.stdout:643.out 2023-05-17T12:29:06.158 INFO:teuthology.orchestra.run.smithi088.stdout:644 2023-05-17T12:29:06.158 INFO:teuthology.orchestra.run.smithi088.stdout:644.out 2023-05-17T12:29:06.158 INFO:teuthology.orchestra.run.smithi088.stdout:645 2023-05-17T12:29:06.158 INFO:teuthology.orchestra.run.smithi088.stdout:645.out 2023-05-17T12:29:06.159 INFO:teuthology.orchestra.run.smithi088.stdout:646 2023-05-17T12:29:06.159 INFO:teuthology.orchestra.run.smithi088.stdout:646.out 2023-05-17T12:29:06.159 INFO:teuthology.orchestra.run.smithi088.stdout:647 2023-05-17T12:29:06.159 INFO:teuthology.orchestra.run.smithi088.stdout:647.out 2023-05-17T12:29:06.159 INFO:teuthology.orchestra.run.smithi088.stdout:648 2023-05-17T12:29:06.159 INFO:teuthology.orchestra.run.smithi088.stdout:648.out 2023-05-17T12:29:06.159 INFO:teuthology.orchestra.run.smithi088.stdout:649 2023-05-17T12:29:06.159 INFO:teuthology.orchestra.run.smithi088.stdout:649.out 2023-05-17T12:29:06.160 INFO:teuthology.orchestra.run.smithi088.stdout:650 2023-05-17T12:29:06.160 INFO:teuthology.orchestra.run.smithi088.stdout:650.out 2023-05-17T12:29:06.160 INFO:teuthology.orchestra.run.smithi088.stdout:651 2023-05-17T12:29:06.160 INFO:teuthology.orchestra.run.smithi088.stdout:651.out 2023-05-17T12:29:06.160 INFO:teuthology.orchestra.run.smithi088.stdout:652 2023-05-17T12:29:06.160 INFO:teuthology.orchestra.run.smithi088.stdout:652.out 2023-05-17T12:29:06.160 INFO:teuthology.orchestra.run.smithi088.stdout:653 2023-05-17T12:29:06.161 INFO:teuthology.orchestra.run.smithi088.stdout:653.out 2023-05-17T12:29:06.161 INFO:teuthology.orchestra.run.smithi088.stdout:654 2023-05-17T12:29:06.161 INFO:teuthology.orchestra.run.smithi088.stdout:654.out 2023-05-17T12:29:06.161 INFO:teuthology.orchestra.run.smithi088.stdout:655 2023-05-17T12:29:06.161 INFO:teuthology.orchestra.run.smithi088.stdout:655.out 2023-05-17T12:29:06.161 INFO:teuthology.orchestra.run.smithi088.stdout:656 2023-05-17T12:29:06.161 INFO:teuthology.orchestra.run.smithi088.stdout:656.out 2023-05-17T12:29:06.162 INFO:teuthology.orchestra.run.smithi088.stdout:657 2023-05-17T12:29:06.162 INFO:teuthology.orchestra.run.smithi088.stdout:657.out 2023-05-17T12:29:06.162 INFO:teuthology.orchestra.run.smithi088.stdout:658 2023-05-17T12:29:06.162 INFO:teuthology.orchestra.run.smithi088.stdout:658.out 2023-05-17T12:29:06.162 INFO:teuthology.orchestra.run.smithi088.stdout:659 2023-05-17T12:29:06.162 INFO:teuthology.orchestra.run.smithi088.stdout:659.out 2023-05-17T12:29:06.162 INFO:teuthology.orchestra.run.smithi088.stdout:660 2023-05-17T12:29:06.163 INFO:teuthology.orchestra.run.smithi088.stdout:660.out 2023-05-17T12:29:06.163 INFO:teuthology.orchestra.run.smithi088.stdout:661 2023-05-17T12:29:06.163 INFO:teuthology.orchestra.run.smithi088.stdout:661.out 2023-05-17T12:29:06.163 INFO:teuthology.orchestra.run.smithi088.stdout:662 2023-05-17T12:29:06.163 INFO:teuthology.orchestra.run.smithi088.stdout:662.out 2023-05-17T12:29:06.163 INFO:teuthology.orchestra.run.smithi088.stdout:663 2023-05-17T12:29:06.163 INFO:teuthology.orchestra.run.smithi088.stdout:663.out 2023-05-17T12:29:06.164 INFO:teuthology.orchestra.run.smithi088.stdout:664 2023-05-17T12:29:06.164 INFO:teuthology.orchestra.run.smithi088.stdout:664.out 2023-05-17T12:29:06.164 INFO:teuthology.orchestra.run.smithi088.stdout:665 2023-05-17T12:29:06.164 INFO:teuthology.orchestra.run.smithi088.stdout:665.out 2023-05-17T12:29:06.164 INFO:teuthology.orchestra.run.smithi088.stdout:666 2023-05-17T12:29:06.164 INFO:teuthology.orchestra.run.smithi088.stdout:666.out 2023-05-17T12:29:06.164 INFO:teuthology.orchestra.run.smithi088.stdout:667 2023-05-17T12:29:06.165 INFO:teuthology.orchestra.run.smithi088.stdout:667.out 2023-05-17T12:29:06.165 INFO:teuthology.orchestra.run.smithi088.stdout:668 2023-05-17T12:29:06.165 INFO:teuthology.orchestra.run.smithi088.stdout:668.out 2023-05-17T12:29:06.165 INFO:teuthology.orchestra.run.smithi088.stdout:669 2023-05-17T12:29:06.165 INFO:teuthology.orchestra.run.smithi088.stdout:669.out 2023-05-17T12:29:06.165 INFO:teuthology.orchestra.run.smithi088.stdout:670 2023-05-17T12:29:06.165 INFO:teuthology.orchestra.run.smithi088.stdout:670.out 2023-05-17T12:29:06.165 INFO:teuthology.orchestra.run.smithi088.stdout:671 2023-05-17T12:29:06.166 INFO:teuthology.orchestra.run.smithi088.stdout:671.out 2023-05-17T12:29:06.166 INFO:teuthology.orchestra.run.smithi088.stdout:672 2023-05-17T12:29:06.166 INFO:teuthology.orchestra.run.smithi088.stdout:672.out 2023-05-17T12:29:06.166 INFO:teuthology.orchestra.run.smithi088.stdout:673 2023-05-17T12:29:06.166 INFO:teuthology.orchestra.run.smithi088.stdout:673.out 2023-05-17T12:29:06.166 INFO:teuthology.orchestra.run.smithi088.stdout:674 2023-05-17T12:29:06.166 INFO:teuthology.orchestra.run.smithi088.stdout:674.out 2023-05-17T12:29:06.167 INFO:teuthology.orchestra.run.smithi088.stdout:675 2023-05-17T12:29:06.167 INFO:teuthology.orchestra.run.smithi088.stdout:675.out 2023-05-17T12:29:06.167 INFO:teuthology.orchestra.run.smithi088.stdout:676 2023-05-17T12:29:06.167 INFO:teuthology.orchestra.run.smithi088.stdout:676.out 2023-05-17T12:29:06.167 INFO:teuthology.orchestra.run.smithi088.stdout:677 2023-05-17T12:29:06.167 INFO:teuthology.orchestra.run.smithi088.stdout:677.out 2023-05-17T12:29:06.167 INFO:teuthology.orchestra.run.smithi088.stdout:678 2023-05-17T12:29:06.168 INFO:teuthology.orchestra.run.smithi088.stdout:678.out 2023-05-17T12:29:06.168 INFO:teuthology.orchestra.run.smithi088.stdout:679 2023-05-17T12:29:06.168 INFO:teuthology.orchestra.run.smithi088.stdout:679.out 2023-05-17T12:29:06.168 INFO:teuthology.orchestra.run.smithi088.stdout:680 2023-05-17T12:29:06.168 INFO:teuthology.orchestra.run.smithi088.stdout:680.out 2023-05-17T12:29:06.168 INFO:teuthology.orchestra.run.smithi088.stdout:681 2023-05-17T12:29:06.168 INFO:teuthology.orchestra.run.smithi088.stdout:681.out 2023-05-17T12:29:06.169 INFO:teuthology.orchestra.run.smithi088.stdout:682 2023-05-17T12:29:06.169 INFO:teuthology.orchestra.run.smithi088.stdout:682.out 2023-05-17T12:29:06.169 INFO:teuthology.orchestra.run.smithi088.stdout:683 2023-05-17T12:29:06.169 INFO:teuthology.orchestra.run.smithi088.stdout:683.out 2023-05-17T12:29:06.169 INFO:teuthology.orchestra.run.smithi088.stdout:684 2023-05-17T12:29:06.169 INFO:teuthology.orchestra.run.smithi088.stdout:684.out 2023-05-17T12:29:06.169 INFO:teuthology.orchestra.run.smithi088.stdout:685 2023-05-17T12:29:06.170 INFO:teuthology.orchestra.run.smithi088.stdout:685.out 2023-05-17T12:29:06.170 INFO:teuthology.orchestra.run.smithi088.stdout:686 2023-05-17T12:29:06.170 INFO:teuthology.orchestra.run.smithi088.stdout:686.out 2023-05-17T12:29:06.170 INFO:teuthology.orchestra.run.smithi088.stdout:687 2023-05-17T12:29:06.170 INFO:teuthology.orchestra.run.smithi088.stdout:687.out 2023-05-17T12:29:06.170 INFO:teuthology.orchestra.run.smithi088.stdout:688 2023-05-17T12:29:06.170 INFO:teuthology.orchestra.run.smithi088.stdout:688.out 2023-05-17T12:29:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:689 2023-05-17T12:29:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:689.out 2023-05-17T12:29:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:690 2023-05-17T12:29:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:690.out 2023-05-17T12:29:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:691 2023-05-17T12:29:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:691.out 2023-05-17T12:29:06.171 INFO:teuthology.orchestra.run.smithi088.stdout:692 2023-05-17T12:29:06.172 INFO:teuthology.orchestra.run.smithi088.stdout:692.out 2023-05-17T12:29:06.172 INFO:teuthology.orchestra.run.smithi088.stdout:693 2023-05-17T12:29:06.172 INFO:teuthology.orchestra.run.smithi088.stdout:693.out 2023-05-17T12:29:06.172 INFO:teuthology.orchestra.run.smithi088.stdout:694 2023-05-17T12:29:06.172 INFO:teuthology.orchestra.run.smithi088.stdout:694.out 2023-05-17T12:29:06.172 INFO:teuthology.orchestra.run.smithi088.stdout:695 2023-05-17T12:29:06.172 INFO:teuthology.orchestra.run.smithi088.stdout:695.out 2023-05-17T12:29:06.173 INFO:teuthology.orchestra.run.smithi088.stdout:696 2023-05-17T12:29:06.173 INFO:teuthology.orchestra.run.smithi088.stdout:696.out 2023-05-17T12:29:06.173 INFO:teuthology.orchestra.run.smithi088.stdout:697 2023-05-17T12:29:06.173 INFO:teuthology.orchestra.run.smithi088.stdout:697.out 2023-05-17T12:29:06.173 INFO:teuthology.orchestra.run.smithi088.stdout:698 2023-05-17T12:29:06.173 INFO:teuthology.orchestra.run.smithi088.stdout:698.out 2023-05-17T12:29:06.173 INFO:teuthology.orchestra.run.smithi088.stdout:699 2023-05-17T12:29:06.174 INFO:teuthology.orchestra.run.smithi088.stdout:699.out 2023-05-17T12:29:06.174 INFO:teuthology.orchestra.run.smithi088.stdout:700 2023-05-17T12:29:06.174 INFO:teuthology.orchestra.run.smithi088.stdout:700.out 2023-05-17T12:29:06.174 INFO:teuthology.orchestra.run.smithi088.stdout:701 2023-05-17T12:29:06.174 INFO:teuthology.orchestra.run.smithi088.stdout:701.out 2023-05-17T12:29:06.174 INFO:teuthology.orchestra.run.smithi088.stdout:702 2023-05-17T12:29:06.174 INFO:teuthology.orchestra.run.smithi088.stdout:702.out 2023-05-17T12:29:06.174 INFO:teuthology.orchestra.run.smithi088.stdout:703 2023-05-17T12:29:06.175 INFO:teuthology.orchestra.run.smithi088.stdout:703.out 2023-05-17T12:29:06.175 INFO:teuthology.orchestra.run.smithi088.stdout:704 2023-05-17T12:29:06.175 INFO:teuthology.orchestra.run.smithi088.stdout:704.out 2023-05-17T12:29:06.175 INFO:teuthology.orchestra.run.smithi088.stdout:705 2023-05-17T12:29:06.175 INFO:teuthology.orchestra.run.smithi088.stdout:705.out 2023-05-17T12:29:06.175 INFO:teuthology.orchestra.run.smithi088.stdout:706 2023-05-17T12:29:06.175 INFO:teuthology.orchestra.run.smithi088.stdout:706.out 2023-05-17T12:29:06.176 INFO:teuthology.orchestra.run.smithi088.stdout:707 2023-05-17T12:29:06.176 INFO:teuthology.orchestra.run.smithi088.stdout:707.out 2023-05-17T12:29:06.176 INFO:teuthology.orchestra.run.smithi088.stdout:708 2023-05-17T12:29:06.176 INFO:teuthology.orchestra.run.smithi088.stdout:708.out 2023-05-17T12:29:06.176 INFO:teuthology.orchestra.run.smithi088.stdout:709 2023-05-17T12:29:06.176 INFO:teuthology.orchestra.run.smithi088.stdout:709.out 2023-05-17T12:29:06.176 INFO:teuthology.orchestra.run.smithi088.stdout:710 2023-05-17T12:29:06.177 INFO:teuthology.orchestra.run.smithi088.stdout:710.out 2023-05-17T12:29:06.177 INFO:teuthology.orchestra.run.smithi088.stdout:711 2023-05-17T12:29:06.177 INFO:teuthology.orchestra.run.smithi088.stdout:711.out 2023-05-17T12:29:06.177 INFO:teuthology.orchestra.run.smithi088.stdout:712 2023-05-17T12:29:06.177 INFO:teuthology.orchestra.run.smithi088.stdout:712.out 2023-05-17T12:29:06.177 INFO:teuthology.orchestra.run.smithi088.stdout:713 2023-05-17T12:29:06.177 INFO:teuthology.orchestra.run.smithi088.stdout:713.out 2023-05-17T12:29:06.177 INFO:teuthology.orchestra.run.smithi088.stdout:714 2023-05-17T12:29:06.178 INFO:teuthology.orchestra.run.smithi088.stdout:714.out 2023-05-17T12:29:06.178 INFO:teuthology.orchestra.run.smithi088.stdout:715 2023-05-17T12:29:06.178 INFO:teuthology.orchestra.run.smithi088.stdout:715.out 2023-05-17T12:29:06.178 INFO:teuthology.orchestra.run.smithi088.stdout:716 2023-05-17T12:29:06.178 INFO:teuthology.orchestra.run.smithi088.stdout:716.out 2023-05-17T12:29:06.178 INFO:teuthology.orchestra.run.smithi088.stdout:717 2023-05-17T12:29:06.178 INFO:teuthology.orchestra.run.smithi088.stdout:717.out 2023-05-17T12:29:06.179 INFO:teuthology.orchestra.run.smithi088.stdout:718 2023-05-17T12:29:06.179 INFO:teuthology.orchestra.run.smithi088.stdout:718.out 2023-05-17T12:29:06.179 INFO:teuthology.orchestra.run.smithi088.stdout:719 2023-05-17T12:29:06.179 INFO:teuthology.orchestra.run.smithi088.stdout:719.out 2023-05-17T12:29:06.179 INFO:teuthology.orchestra.run.smithi088.stdout:720 2023-05-17T12:29:06.179 INFO:teuthology.orchestra.run.smithi088.stdout:720.out 2023-05-17T12:29:06.179 INFO:teuthology.orchestra.run.smithi088.stdout:721 2023-05-17T12:29:06.180 INFO:teuthology.orchestra.run.smithi088.stdout:721.out 2023-05-17T12:29:06.180 INFO:teuthology.orchestra.run.smithi088.stdout:722 2023-05-17T12:29:06.180 INFO:teuthology.orchestra.run.smithi088.stdout:722.out 2023-05-17T12:29:06.180 INFO:teuthology.orchestra.run.smithi088.stdout:723 2023-05-17T12:29:06.180 INFO:teuthology.orchestra.run.smithi088.stdout:723.out 2023-05-17T12:29:06.180 INFO:teuthology.orchestra.run.smithi088.stdout:724 2023-05-17T12:29:06.180 INFO:teuthology.orchestra.run.smithi088.stdout:724.out 2023-05-17T12:29:06.180 INFO:teuthology.orchestra.run.smithi088.stdout:725 2023-05-17T12:29:06.181 INFO:teuthology.orchestra.run.smithi088.stdout:725.out 2023-05-17T12:29:06.181 INFO:teuthology.orchestra.run.smithi088.stdout:726 2023-05-17T12:29:06.181 INFO:teuthology.orchestra.run.smithi088.stdout:726.out 2023-05-17T12:29:06.181 INFO:teuthology.orchestra.run.smithi088.stdout:727 2023-05-17T12:29:06.181 INFO:teuthology.orchestra.run.smithi088.stdout:727.out 2023-05-17T12:29:06.181 INFO:teuthology.orchestra.run.smithi088.stdout:group.list 2023-05-17T12:29:06.181 INFO:teuthology.orchestra.run.smithi088.stdout:Makefile 2023-05-17T12:29:06.182 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-05-17T12:29:06.561 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:29:06.572 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:29:06.572 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:11.761 INFO:teuthology.orchestra.run.smithi088.stdout:generic/001 5s 2023-05-17T12:29:11.773 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/001 2023-05-17T12:29:11.773 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:29:11.779 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:11.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[153279]: fuse finished with error 0 and tester_r 0 2023-05-17T12:29:11.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:29:11.800 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-05-17T12:29:12.187 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:29:12.198 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:29:12.199 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:generic/002 0s 2023-05-17T12:29:12.991 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/002 2023-05-17T12:29:12.992 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:29:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:13.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:29:13.018 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-05-17T12:29:13.436 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:29:13.447 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:29:13.447 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:13.723 INFO:teuthology.orchestra.run.smithi088.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:29:13.732 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/003 2023-05-17T12:29:13.732 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/003 2023-05-17T12:29:13.732 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:29:13.737 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:13.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:29:13.757 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-05-17T12:29:14.141 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:29:14.152 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:29:14.153 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:14.449 INFO:teuthology.orchestra.run.smithi088.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-05-17T12:29:14.458 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/004 2023-05-17T12:29:14.459 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/004 2023-05-17T12:29:14.459 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:29:14.463 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:14.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:29:14.483 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-05-17T12:29:14.866 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:29:14.877 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:29:14.877 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:15.857 INFO:teuthology.orchestra.run.smithi088.stdout:generic/005 1s 2023-05-17T12:29:15.868 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/005 2023-05-17T12:29:15.869 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:29:15.874 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:15.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:29:15.896 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-05-17T12:29:16.311 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:29:16.322 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:29:16.322 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:25.402 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:29:25.407 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:29:54.098 INFO:teuthology.orchestra.run.smithi088.stdout:generic/006 38s 2023-05-17T12:29:54.110 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/006 2023-05-17T12:29:54.110 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:29:54.115 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:54.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:29:54.135 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-05-17T12:29:54.561 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:29:54.572 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:29:54.572 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:29:55.597 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:29:55.602 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:30:25.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:30:25.735 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:30:56.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:30:56.431 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:31:24.939 INFO:teuthology.orchestra.run.smithi088.stdout:generic/007 90s 2023-05-17T12:31:24.950 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/007 2023-05-17T12:31:24.951 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:31:24.956 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:31:24.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:31:24.976 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-05-17T12:31:25.477 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:31:25.489 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:31:25.489 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:31:26.997 INFO:teuthology.orchestra.run.smithi088.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-17T12:31:27.006 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/008 2023-05-17T12:31:27.006 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/008 2023-05-17T12:31:27.006 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:31:27.011 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:31:27.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:31:27.031 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-05-17T12:31:27.427 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:31:27.438 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:31:27.438 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:31:28.983 INFO:teuthology.orchestra.run.smithi088.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-17T12:31:28.991 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/009 2023-05-17T12:31:28.992 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/009 2023-05-17T12:31:28.992 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:31:28.997 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:31:29.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:31:29.016 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-05-17T12:31:29.401 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:31:29.412 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:31:29.412 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:31:29.690 INFO:teuthology.orchestra.run.smithi088.stdout:generic/010 [not run] /tmp/tmp.buK0S8bWYQxfstests-dev/src/dbtest not built 2023-05-17T12:31:29.698 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/010 2023-05-17T12:31:29.699 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/010 2023-05-17T12:31:29.699 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:31:29.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:31:29.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:31:29.723 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-05-17T12:31:30.107 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:31:30.118 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:31:30.119 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:31:31.303 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:31:31.308 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:32:01.500 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:32:01.505 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:32:16.138 INFO:teuthology.orchestra.run.smithi088.stdout:generic/011 46s 2023-05-17T12:32:16.150 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/011 2023-05-17T12:32:16.150 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:32:16.155 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:32:16.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:32:16.175 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-05-17T12:32:16.691 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:32:16.702 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:32:16.702 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:32:18.398 INFO:teuthology.orchestra.run.smithi088.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T12:32:18.406 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/012 2023-05-17T12:32:18.407 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/012 2023-05-17T12:32:18.407 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:32:18.412 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:32:18.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:32:18.475 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-05-17T12:32:18.864 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:32:18.876 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:32:18.876 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:32:31.613 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:32:31.618 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:33:02.935 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:33:02.942 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:33:33.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:33:33.745 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:34:08.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:34:08.792 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:34:12.493 INFO:teuthology.orchestra.run.smithi088.stdout:generic/013 114s 2023-05-17T12:34:15.384 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/013 2023-05-17T12:34:15.385 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:34:15.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:34:15.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:34:15.428 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-05-17T12:34:16.076 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:34:16.089 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:34:16.090 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:34:40.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:34:40.670 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:34:40.842 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T12:34:40.835+0000 7fcc4c1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 198655) UID: 0 2023-05-17T12:34:40.842 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T12:34:40.838+0000 7f36767f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 198655) UID: 0 2023-05-17T12:37:57.827 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:37:57.832 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:38:28.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:38:28.060 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:38:58.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:38:58.597 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:39:10.049 INFO:teuthology.orchestra.run.smithi088.stdout:generic/014 294s 2023-05-17T12:39:10.078 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/014 2023-05-17T12:39:10.079 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:39:10.086 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:10.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:39:10.119 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-05-17T12:39:10.793 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:39:10.812 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:39:10.812 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:11.251 INFO:teuthology.orchestra.run.smithi088.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:39:11.264 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/015 2023-05-17T12:39:11.264 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/015 2023-05-17T12:39:11.264 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:39:11.272 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:11.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:39:11.302 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-05-17T12:39:11.900 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:39:11.917 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:39:11.917 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:14.621 INFO:teuthology.orchestra.run.smithi088.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T12:39:14.632 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/016 2023-05-17T12:39:14.632 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/016 2023-05-17T12:39:14.633 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:39:14.642 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:14.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:39:14.675 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-05-17T12:39:15.544 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:39:15.556 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:39:15.557 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:15.985 INFO:teuthology.orchestra.run.smithi088.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:39:15.998 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/017 2023-05-17T12:39:15.999 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/017 2023-05-17T12:39:15.999 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:39:16.008 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:16.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:39:16.044 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-05-17T12:39:16.654 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:39:16.674 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:39:16.675 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:17.095 INFO:teuthology.orchestra.run.smithi088.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:39:17.107 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/018 2023-05-17T12:39:17.107 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/018 2023-05-17T12:39:17.107 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:39:17.115 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:17.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:39:17.145 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-05-17T12:39:17.739 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:39:17.754 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:39:17.755 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:18.169 INFO:teuthology.orchestra.run.smithi088.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:39:18.183 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/019 2023-05-17T12:39:18.184 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/019 2023-05-17T12:39:18.184 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:39:18.194 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:18.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:39:18.226 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-05-17T12:39:18.823 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:39:18.838 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:39:18.838 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:28.755 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:39:28.762 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:39:41.651 INFO:teuthology.orchestra.run.smithi088.stdout:generic/020 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/020.out.bad) 2023-05-17T12:39:41.660 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/020.out 2023-05-17 12:27:04.799538719 +0000 2023-05-17T12:39:41.660 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/020.out.bad 2023-05-17 12:39:41.645585199 +0000 2023-05-17T12:39:41.660 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -39,27 +39,6 @@ 2023-05-17T12:39:41.661 INFO:teuthology.orchestra.run.smithi088.stdout: user.snrub="fish2\012" 2023-05-17T12:39:41.661 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:41.661 INFO:teuthology.orchestra.run.smithi088.stdout: *** add lots of attributes 2023-05-17T12:39:41.661 INFO:teuthology.orchestra.run.smithi088.stdout: -*** check 2023-05-17T12:39:41.662 INFO:teuthology.orchestra.run.smithi088.stdout: - *** MAX_ATTRS attribute(s) 2023-05-17T12:39:41.662 INFO:teuthology.orchestra.run.smithi088.stdout: -*** remove lots of attributes 2023-05-17T12:39:41.662 INFO:teuthology.orchestra.run.smithi088.stdout: - *** print attributes 2023-05-17T12:39:41.662 INFO:teuthology.orchestra.run.smithi088.stdout: -# file: 2023-05-17T12:39:41.662 INFO:teuthology.orchestra.run.smithi088.stdout: -user.snrub="fish2\012" 2023-05-17T12:39:41.663 INFO:teuthology.orchestra.run.smithi088.stdout: - 2023-05-17T12:39:41.663 INFO:teuthology.orchestra.run.smithi088.stdout: -*** really long value 2023-05-17T12:39:41.663 INFO:teuthology.orchestra.run.smithi088.stdout: -0000000 00 2023-05-17T12:39:41.663 INFO:teuthology.orchestra.run.smithi088.stdout: -* 2023-05-17T12:39:41.663 INFO:teuthology.orchestra.run.smithi088.stdout: -ATTRSIZE 2023-05-17T12:39:41.664 INFO:teuthology.orchestra.run.smithi088.stdout: -*** set/get/remove really long names (expect failure) 2023-05-17T12:39:41.664 INFO:teuthology.orchestra.run.smithi088.stdout: -attr_set: Invalid argument 2023-05-17T12:39:41.664 INFO:teuthology.orchestra.run.smithi088.stdout: -Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-17T12:39:41.665 INFO:teuthology.orchestra.run.smithi088.stdout: -attr_get: Invalid argument 2023-05-17T12:39:41.665 INFO:teuthology.orchestra.run.smithi088.stdout: -Could not get "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-17T12:39:41.665 INFO:teuthology.orchestra.run.smithi088.stdout: -attr_remove: Invalid argument 2023-05-17T12:39:41.665 INFO:teuthology.orchestra.run.smithi088.stdout: -Could not remove "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-17T12:39:41.666 INFO:teuthology.orchestra.run.smithi088.stdout: -*** check final 2023-05-17T12:39:41.666 INFO:teuthology.orchestra.run.smithi088.stdout: - *** print attributes 2023-05-17T12:39:41.666 INFO:teuthology.orchestra.run.smithi088.stdout: -# file: 2023-05-17T12:39:41.666 INFO:teuthology.orchestra.run.smithi088.stdout: -user.snrub="fish2\012" 2023-05-17T12:39:41.667 INFO:teuthology.orchestra.run.smithi088.stdout: - 2023-05-17T12:39:41.668 INFO:teuthology.orchestra.run.smithi088.stdout: -*** delete 2023-05-17T12:39:41.668 INFO:teuthology.orchestra.run.smithi088.stdout: +attr_set: No space left on device 2023-05-17T12:39:41.668 INFO:teuthology.orchestra.run.smithi088.stdout: +Could not set "attribute_2335" for /tmp/tmp.3n61ha2sIstest/attribute_201401 2023-05-17T12:39:41.668 INFO:teuthology.orchestra.run.smithi088.stdout: +!!! failed to add "attribute_2335" 2023-05-17T12:39:41.669 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/020 2023-05-17T12:39:41.670 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/020 2023-05-17T12:39:41.670 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T12:39:41.674 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:41.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T12:39:41.711 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T12:39:41.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T12:39:41.713 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-05-17T12:39:42.551 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:39:42.567 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:39:42.568 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:45.241 INFO:teuthology.orchestra.run.smithi088.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T12:39:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/021 2023-05-17T12:39:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/021 2023-05-17T12:39:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:39:45.256 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:45.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:39:45.294 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-05-17T12:39:46.148 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:39:46.168 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:39:46.168 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:48.894 INFO:teuthology.orchestra.run.smithi088.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T12:39:48.906 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/022 2023-05-17T12:39:48.906 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/022 2023-05-17T12:39:48.906 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:39:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:48.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:39:48.978 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-05-17T12:39:49.785 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:39:49.800 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:39:49.800 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:39:58.958 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:39:58.963 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:40:29.178 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:40:29.183 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:40:59.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:40:59.334 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:41:07.386 INFO:teuthology.orchestra.run.smithi088.stdout:generic/023 78s 2023-05-17T12:41:07.397 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/023 2023-05-17T12:41:07.398 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:07.403 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:07.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:07.432 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-05-17T12:41:08.114 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:08.125 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:08.125 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:08.433 INFO:teuthology.orchestra.run.smithi088.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-05-17T12:41:08.442 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/024 2023-05-17T12:41:08.442 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/024 2023-05-17T12:41:08.442 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:08.447 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:08.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:08.539 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-05-17T12:41:09.142 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:09.153 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:09.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:09.470 INFO:teuthology.orchestra.run.smithi088.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-05-17T12:41:09.478 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/025 2023-05-17T12:41:09.478 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/025 2023-05-17T12:41:09.479 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:09.484 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:09.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:09.533 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-05-17T12:41:10.169 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:10.180 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:10.180 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:10.527 INFO:teuthology.orchestra.run.smithi088.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-17T12:41:10.535 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/026 2023-05-17T12:41:10.536 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/026 2023-05-17T12:41:10.536 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:10.540 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:10.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:10.560 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-05-17T12:41:10.944 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:10.955 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:10.955 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:11.227 INFO:teuthology.orchestra.run.smithi088.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:11.236 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/027 2023-05-17T12:41:11.236 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/027 2023-05-17T12:41:11.236 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:11.241 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:11.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:11.261 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-05-17T12:41:11.657 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:11.668 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:11.668 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:16.981 INFO:teuthology.orchestra.run.smithi088.stdout:generic/028 5s 2023-05-17T12:41:16.993 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/028 2023-05-17T12:41:16.993 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:16.998 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:17.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:17.019 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-05-17T12:41:17.405 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:17.416 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:17.417 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:17.694 INFO:teuthology.orchestra.run.smithi088.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:17.702 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/029 2023-05-17T12:41:17.702 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/029 2023-05-17T12:41:17.702 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:17.707 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:17.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:17.727 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-05-17T12:41:18.103 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:18.114 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:18.115 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:18.391 INFO:teuthology.orchestra.run.smithi088.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:18.399 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/030 2023-05-17T12:41:18.399 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/030 2023-05-17T12:41:18.399 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:18.404 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:18.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:18.425 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-05-17T12:41:18.951 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:18.962 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:18.962 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:19.237 INFO:teuthology.orchestra.run.smithi088.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:19.245 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/031 2023-05-17T12:41:19.245 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/031 2023-05-17T12:41:19.245 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:19.250 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:19.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:19.271 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-05-17T12:41:19.652 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:19.664 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:19.664 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:19.947 INFO:teuthology.orchestra.run.smithi088.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:19.955 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/032 2023-05-17T12:41:19.956 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/032 2023-05-17T12:41:19.956 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:19.961 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:19.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:19.981 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-05-17T12:41:20.363 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:20.374 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:20.374 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:20.652 INFO:teuthology.orchestra.run.smithi088.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:20.660 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/033 2023-05-17T12:41:20.660 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/033 2023-05-17T12:41:20.660 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:20.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:20.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:20.685 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-05-17T12:41:21.072 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:21.083 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:21.084 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:21.402 INFO:teuthology.orchestra.run.smithi088.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:21.410 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/034 2023-05-17T12:41:21.411 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/034 2023-05-17T12:41:21.411 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:21.416 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:21.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:21.435 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-05-17T12:41:21.822 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:21.833 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:21.833 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:22.234 INFO:teuthology.orchestra.run.smithi088.stdout:generic/035 1s 2023-05-17T12:41:22.246 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/035 2023-05-17T12:41:22.246 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:22.251 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:22.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:22.280 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-05-17T12:41:22.947 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:22.958 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:22.958 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:29.498 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:41:29.503 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:41:33.367 INFO:teuthology.orchestra.run.smithi088.stdout:generic/036 11s 2023-05-17T12:41:33.378 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/036 2023-05-17T12:41:33.378 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:33.383 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:33.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:33.466 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-05-17T12:41:34.079 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:34.090 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:34.091 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:34.379 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/037 2023-05-17T12:41:34.379 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/037 2023-05-17T12:41:34.379 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:34.384 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:34.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:34.404 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-05-17T12:41:34.794 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:34.805 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:34.805 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:35.084 INFO:teuthology.orchestra.run.smithi088.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:35.093 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/038 2023-05-17T12:41:35.093 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/038 2023-05-17T12:41:35.093 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:35.098 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:35.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:35.119 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-05-17T12:41:35.511 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:35.522 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:35.522 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:35.823 INFO:teuthology.orchestra.run.smithi088.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:35.832 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/039 2023-05-17T12:41:35.832 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/039 2023-05-17T12:41:35.832 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:35.837 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:35.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:35.858 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-05-17T12:41:36.239 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:36.250 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:36.251 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:36.551 INFO:teuthology.orchestra.run.smithi088.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:36.559 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/040 2023-05-17T12:41:36.559 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/040 2023-05-17T12:41:36.560 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:36.565 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:36.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:36.585 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-05-17T12:41:36.973 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:36.985 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:36.985 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:37.283 INFO:teuthology.orchestra.run.smithi088.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:37.291 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/041 2023-05-17T12:41:37.291 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/041 2023-05-17T12:41:37.291 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:37.296 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:37.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:37.317 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-05-17T12:41:37.699 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:37.711 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:37.711 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:37.989 INFO:teuthology.orchestra.run.smithi088.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:37.997 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/042 2023-05-17T12:41:37.998 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/042 2023-05-17T12:41:37.998 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:38.003 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:38.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:38.023 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-05-17T12:41:38.401 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:38.412 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:38.412 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:38.692 INFO:teuthology.orchestra.run.smithi088.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:38.699 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/043 2023-05-17T12:41:38.699 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/043 2023-05-17T12:41:38.699 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:38.705 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:38.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:38.725 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-05-17T12:41:39.105 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:39.117 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:39.117 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:39.391 INFO:teuthology.orchestra.run.smithi088.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:39.399 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/044 2023-05-17T12:41:39.400 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/044 2023-05-17T12:41:39.400 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:39.405 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:39.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:39.424 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-05-17T12:41:39.807 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:39.818 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:39.819 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:40.092 INFO:teuthology.orchestra.run.smithi088.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:40.100 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/045 2023-05-17T12:41:40.100 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/045 2023-05-17T12:41:40.100 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:40.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:40.125 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-05-17T12:41:40.504 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:40.515 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:40.791 INFO:teuthology.orchestra.run.smithi088.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:40.800 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/046 2023-05-17T12:41:40.800 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/046 2023-05-17T12:41:40.800 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:40.805 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:40.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:40.825 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-05-17T12:41:41.207 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:41.219 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:41.219 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:41.492 INFO:teuthology.orchestra.run.smithi088.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:41.500 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/047 2023-05-17T12:41:41.501 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/047 2023-05-17T12:41:41.501 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:41.506 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:41.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:41.526 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-05-17T12:41:41.914 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:41.925 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:41.925 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:42.205 INFO:teuthology.orchestra.run.smithi088.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:42.213 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/048 2023-05-17T12:41:42.213 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/048 2023-05-17T12:41:42.214 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:42.219 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:42.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:42.239 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-05-17T12:41:42.621 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:42.632 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:42.633 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:42.911 INFO:teuthology.orchestra.run.smithi088.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:42.919 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/049 2023-05-17T12:41:42.920 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/049 2023-05-17T12:41:42.920 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:42.925 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:42.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:42.945 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-05-17T12:41:43.329 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:43.341 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:43.341 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:43.639 INFO:teuthology.orchestra.run.smithi088.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:43.647 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/050 2023-05-17T12:41:43.647 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/050 2023-05-17T12:41:43.647 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:43.652 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:43.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:43.672 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-05-17T12:41:44.054 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:44.065 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:44.065 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:44.345 INFO:teuthology.orchestra.run.smithi088.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:44.354 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/051 2023-05-17T12:41:44.354 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/051 2023-05-17T12:41:44.354 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:44.359 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:44.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:44.380 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-05-17T12:41:44.768 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:44.779 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:44.780 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:45.065 INFO:teuthology.orchestra.run.smithi088.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:45.073 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/052 2023-05-17T12:41:45.074 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/052 2023-05-17T12:41:45.074 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:45.079 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:45.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:45.099 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-05-17T12:41:45.478 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:45.490 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:45.490 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:45.767 INFO:teuthology.orchestra.run.smithi088.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:45.775 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/053 2023-05-17T12:41:45.776 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/053 2023-05-17T12:41:45.776 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:45.781 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:45.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:45.801 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-05-17T12:41:46.188 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:46.199 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:46.200 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:46.479 INFO:teuthology.orchestra.run.smithi088.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:46.487 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/054 2023-05-17T12:41:46.487 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/054 2023-05-17T12:41:46.488 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:46.493 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:46.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:46.513 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-05-17T12:41:46.892 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:46.903 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:46.903 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:47.188 INFO:teuthology.orchestra.run.smithi088.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:47.196 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/055 2023-05-17T12:41:47.197 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/055 2023-05-17T12:41:47.197 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:47.202 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:47.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:47.222 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-05-17T12:41:47.608 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:47.619 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:47.620 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:47.923 INFO:teuthology.orchestra.run.smithi088.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:47.931 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/056 2023-05-17T12:41:47.931 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/056 2023-05-17T12:41:47.932 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:47.937 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:47.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:47.957 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-05-17T12:41:48.340 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:48.351 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:48.351 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:48.654 INFO:teuthology.orchestra.run.smithi088.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:48.663 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/057 2023-05-17T12:41:48.663 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/057 2023-05-17T12:41:48.663 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:48.668 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:48.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:48.689 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-05-17T12:41:49.069 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:49.080 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:49.080 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:50.640 INFO:teuthology.orchestra.run.smithi088.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T12:41:50.648 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/058 2023-05-17T12:41:50.648 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/058 2023-05-17T12:41:50.649 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:50.653 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:50.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:50.701 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-05-17T12:41:51.353 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:51.364 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:51.365 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:51.664 INFO:teuthology.orchestra.run.smithi088.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:51.672 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/059 2023-05-17T12:41:51.672 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/059 2023-05-17T12:41:51.672 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:51.678 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:51.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:51.697 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-05-17T12:41:52.082 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:52.094 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:52.094 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:53.676 INFO:teuthology.orchestra.run.smithi088.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T12:41:53.685 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/060 2023-05-17T12:41:53.685 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/060 2023-05-17T12:41:53.685 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:53.690 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:53.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:53.753 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-05-17T12:41:54.375 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:54.387 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:54.387 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:56.022 INFO:teuthology.orchestra.run.smithi088.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T12:41:56.030 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/061 2023-05-17T12:41:56.030 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/061 2023-05-17T12:41:56.030 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:56.035 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:56.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:56.087 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-05-17T12:41:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:56.744 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:57.019 INFO:teuthology.orchestra.run.smithi088.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:41:57.029 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/062 2023-05-17T12:41:57.030 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/062 2023-05-17T12:41:57.030 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:57.033 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:57.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:57.054 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-05-17T12:41:57.433 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:57.444 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:57.444 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:59.013 INFO:teuthology.orchestra.run.smithi088.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T12:41:59.021 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/063 2023-05-17T12:41:59.021 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/063 2023-05-17T12:41:59.022 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:41:59.027 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:41:59.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:41:59.086 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-05-17T12:41:59.636 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:41:59.641 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:41:59.723 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:41:59.734 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:41:59.735 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:00.013 INFO:teuthology.orchestra.run.smithi088.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:42:00.021 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/064 2023-05-17T12:42:00.022 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/064 2023-05-17T12:42:00.022 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:42:00.027 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:00.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:42:00.047 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-05-17T12:42:00.464 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:42:00.476 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:42:00.476 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:00.774 INFO:teuthology.orchestra.run.smithi088.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:42:00.783 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/065 2023-05-17T12:42:00.783 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/065 2023-05-17T12:42:00.783 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:42:00.789 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:00.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:42:00.808 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-05-17T12:42:01.198 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:42:01.209 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:42:01.209 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:01.512 INFO:teuthology.orchestra.run.smithi088.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:42:01.520 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/066 2023-05-17T12:42:01.520 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/066 2023-05-17T12:42:01.521 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:42:01.526 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:01.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:42:01.546 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-05-17T12:42:01.931 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:42:01.943 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:42:01.944 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:02.254 INFO:teuthology.orchestra.run.smithi088.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:42:02.262 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/067 2023-05-17T12:42:02.262 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/067 2023-05-17T12:42:02.262 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:42:02.268 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:02.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:42:02.288 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-05-17T12:42:02.676 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:42:02.687 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:42:02.687 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:02.987 INFO:teuthology.orchestra.run.smithi088.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:42:02.996 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/068 2023-05-17T12:42:02.996 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/068 2023-05-17T12:42:02.996 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:42:03.001 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:03.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:42:03.022 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-05-17T12:42:03.407 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:42:03.418 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:42:03.418 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:03.692 INFO:teuthology.orchestra.run.smithi088.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:42:03.700 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/069 2023-05-17T12:42:03.700 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/069 2023-05-17T12:42:03.700 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:42:03.705 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:03.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:42:03.726 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-05-17T12:42:04.111 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:42:04.122 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:42:04.122 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:42:29.824 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:42:29.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:42:59.929 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:42:59.934 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:43:16.700 INFO:teuthology.orchestra.run.smithi088.stdout:generic/070 72s 2023-05-17T12:43:16.711 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/070 2023-05-17T12:43:16.711 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:43:16.716 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:43:16.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:43:16.761 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-05-17T12:43:17.401 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:43:17.411 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:43:17.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:43:17.693 INFO:teuthology.orchestra.run.smithi088.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:43:17.701 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/071 2023-05-17T12:43:17.701 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/071 2023-05-17T12:43:17.701 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:43:17.706 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:43:17.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:43:17.726 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-05-17T12:43:18.365 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:43:18.384 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:43:18.384 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:43:20.924 INFO:teuthology.orchestra.run.smithi088.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-05-17T12:43:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/072 2023-05-17T12:43:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/072 2023-05-17T12:43:20.935 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:43:20.942 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:43:20.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:43:20.979 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-05-17T12:43:21.605 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:43:21.621 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:43:21.621 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:43:22.076 INFO:teuthology.orchestra.run.smithi088.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T12:43:22.087 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/073 2023-05-17T12:43:22.087 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/073 2023-05-17T12:43:22.087 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T12:43:22.096 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:43:22.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T12:43:22.133 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-05-17T12:43:22.734 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T12:43:22.751 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T12:43:22.752 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T12:43:30.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:43:30.092 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:44:00.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:44:00.616 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:44:30.893 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:44:30.901 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:45:01.098 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:45:01.107 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:45:31.258 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:45:31.266 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:46:01.445 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:46:01.458 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:46:32.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:46:32.608 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:47:02.950 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:47:02.957 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:47:33.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:47:33.168 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:48:03.896 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:48:03.901 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:48:36.544 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:48:36.550 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:48:36.775 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T12:48:36.773+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232143) UID: 0 2023-05-17T12:48:36.776 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T12:48:36.773+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232143) UID: 0 2023-05-17T12:48:36.783 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T12:48:36.781+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232143) UID: 0 2023-05-17T12:48:36.784 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T12:48:36.782+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232143) UID: 0 2023-05-17T12:53:29.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:53:29.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:53:29.695 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T12:53:29.692+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113836) UID: 0 2023-05-17T12:53:29.696 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T12:53:29.692+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113836) UID: 0 2023-05-17T12:53:29.696 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T12:53:29.692+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113836) UID: 0 2023-05-17T12:53:29.697 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T12:53:29.692+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113836) UID: 0 2023-05-17T12:58:20.064 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:58:20.299 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T12:58:21.333 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T12:58:21.328+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232333) UID: 0 2023-05-17T12:58:21.333 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T12:58:21.328+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232333) UID: 0 2023-05-17T12:58:21.333 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T12:58:21.327+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232333) UID: 0 2023-05-17T12:58:21.335 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T12:58:21.327+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232333) UID: 0 2023-05-17T13:03:32.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:03:32.798 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:03:32.928 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T13:03:32.924+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114006) UID: 0 2023-05-17T13:03:32.929 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T13:03:32.924+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114006) UID: 0 2023-05-17T13:03:32.929 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T13:03:32.924+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114006) UID: 0 2023-05-17T13:03:32.929 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T13:03:32.924+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114006) UID: 0 2023-05-17T13:03:32.974 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T13:03:32.970+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232449) UID: 0 2023-05-17T13:03:32.975 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T13:03:32.970+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232449) UID: 0 2023-05-17T13:03:32.975 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T13:03:32.971+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232449) UID: 0 2023-05-17T13:03:32.976 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T13:03:32.972+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 232449) UID: 0 2023-05-17T13:05:23.265 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T13:05:23.261+0000 7f8a7d9d5700 -1 bdev(0x560d2adec000 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2023-05-17T13:11:01.391 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T13:11:01.385+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114224) UID: 0 2023-05-17T13:11:01.392 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T13:11:01.385+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114224) UID: 0 2023-05-17T13:11:01.392 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T13:11:01.385+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114224) UID: 0 2023-05-17T13:11:01.393 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T13:11:01.385+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114224) UID: 0 2023-05-17T13:11:59.899 INFO:teuthology.orchestra.run.smithi088.stdout:generic/074 1717s 2023-05-17T13:11:59.959 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/074 2023-05-17T13:11:59.959 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:11:59.965 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:00.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:00.020 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-05-17T13:12:01.311 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:12:01.322 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:12:01.322 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:50.421 INFO:teuthology.orchestra.run.smithi088.stdout:generic/075 49s 2023-05-17T13:12:50.433 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/075 2023-05-17T13:12:50.433 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:12:50.438 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:50.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:50.488 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-05-17T13:12:51.172 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:12:51.184 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:12:51.184 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:51.468 INFO:teuthology.orchestra.run.smithi088.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:12:51.477 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/076 2023-05-17T13:12:51.477 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/076 2023-05-17T13:12:51.477 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:12:51.482 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:51.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:51.503 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-05-17T13:12:51.895 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:12:51.906 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:12:51.906 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:52.878 INFO:teuthology.orchestra.run.smithi088.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:12:52.887 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/077 2023-05-17T13:12:52.887 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/077 2023-05-17T13:12:52.887 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:12:52.892 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:52.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:52.913 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-05-17T13:12:53.302 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:12:53.314 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:12:53.314 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:53.645 INFO:teuthology.orchestra.run.smithi088.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-05-17T13:12:53.654 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/078 2023-05-17T13:12:53.654 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/078 2023-05-17T13:12:53.654 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:12:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:53.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:53.697 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-05-17T13:12:54.379 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:12:54.391 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:12:54.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:54.732 INFO:teuthology.orchestra.run.smithi088.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-05-17T13:12:54.741 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/079 2023-05-17T13:12:54.741 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/079 2023-05-17T13:12:54.741 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:12:54.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:54.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:54.766 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-05-17T13:12:55.148 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:12:55.159 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:12:55.159 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:57.534 INFO:teuthology.orchestra.run.smithi088.stdout:generic/080 2s 2023-05-17T13:12:57.546 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/080 2023-05-17T13:12:57.547 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:12:57.552 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:57.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:57.575 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-05-17T13:12:57.966 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:12:57.977 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:12:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:58.258 INFO:teuthology.orchestra.run.smithi088.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:12:58.266 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/081 2023-05-17T13:12:58.267 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/081 2023-05-17T13:12:58.267 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:12:58.272 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:58.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:58.293 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-05-17T13:12:58.680 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:12:58.691 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:12:58.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:58.981 INFO:teuthology.orchestra.run.smithi088.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:12:58.990 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/082 2023-05-17T13:12:58.990 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/082 2023-05-17T13:12:58.990 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:12:58.995 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:59.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:59.015 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-05-17T13:12:59.402 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:12:59.413 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:12:59.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:59.703 INFO:teuthology.orchestra.run.smithi088.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:12:59.711 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/083 2023-05-17T13:12:59.712 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/083 2023-05-17T13:12:59.712 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:12:59.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:12:59.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:12:59.738 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-05-17T13:13:00.121 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:13:00.133 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:13:00.133 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:00.403 INFO:teuthology.orchestra.run.smithi088.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:13:00.411 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/084 2023-05-17T13:13:00.411 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/084 2023-05-17T13:13:00.411 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:13:00.416 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:00.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:13:00.436 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-05-17T13:13:00.820 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:13:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:13:00.832 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:01.191 INFO:teuthology.orchestra.run.smithi088.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:13:01.199 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/085 2023-05-17T13:13:01.199 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/085 2023-05-17T13:13:01.200 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:13:01.205 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:01.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:13:01.225 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-05-17T13:13:01.609 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:13:01.620 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:13:01.620 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:09.620 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:13:09.625 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:13:09.752 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T13:13:09.747+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 239457) UID: 0 2023-05-17T13:13:09.752 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T13:13:09.747+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 239457) UID: 0 2023-05-17T13:13:09.753 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T13:13:09.747+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 239457) UID: 0 2023-05-17T13:13:09.753 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T13:13:09.747+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 239457) UID: 0 2023-05-17T13:13:21.594 INFO:teuthology.orchestra.run.smithi088.stdout:generic/086 20s 2023-05-17T13:13:21.872 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/086 2023-05-17T13:13:21.872 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:13:21.877 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:22.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:13:22.120 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-05-17T13:13:25.666 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:13:25.677 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:13:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:26.447 INFO:teuthology.orchestra.run.smithi088.stdout:generic/087 1s 2023-05-17T13:13:26.460 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/087 2023-05-17T13:13:26.460 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:13:26.466 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:26.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:13:26.507 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-05-17T13:13:27.220 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:13:27.231 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:13:27.231 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:27.633 INFO:teuthology.orchestra.run.smithi088.stdout:generic/088 0s 2023-05-17T13:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/088 2023-05-17T13:13:27.645 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:13:27.650 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:13:27.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:13:27.714 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-05-17T13:13:28.426 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:13:28.437 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:13:28.437 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:17:36.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:17:36.466 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:17:37.257 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T13:17:37.252+0000 7fcc4c1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 240989) UID: 0 2023-05-17T13:17:37.257 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T13:17:37.252+0000 7f36767f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 240989) UID: 0 2023-05-17T13:20:52.253 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:20:52.259 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:21:22.371 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:21:22.375 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:21:52.493 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:21:52.498 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:21:52.590 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T13:21:52.586+0000 7fcc4c1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 241314) UID: 0 2023-05-17T13:21:52.591 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T13:21:52.586+0000 7f36767f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 241314) UID: 0 2023-05-17T13:24:42.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:24:42.129 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:25:12.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:25:12.327 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:25:42.438 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:25:42.443 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:26:12.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:26:12.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:26:42.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:26:42.668 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:26:42.761 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T13:26:42.757+0000 7fcc4c1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 241480) UID: 0 2023-05-17T13:26:42.761 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T13:26:42.757+0000 7f36767f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 241480) UID: 0 2023-05-17T13:29:42.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:29:42.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:30:12.762 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:30:12.766 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:30:42.958 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:30:42.963 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:31:15.074 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:31:15.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:31:45.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:31:45.237 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:31:45.333 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T13:31:45.330+0000 7f36767f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 243660) UID: 0 2023-05-17T13:31:45.334 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T13:31:45.330+0000 7fcc4c1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 243660) UID: 0 2023-05-17T13:33:56.202 INFO:teuthology.orchestra.run.smithi088.stdout:generic/089 1228s 2023-05-17T13:33:56.246 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/089 2023-05-17T13:33:56.247 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:33:56.253 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:33:56.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:33:56.278 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-05-17T13:33:57.279 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:33:57.290 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:33:57.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:33:57.685 INFO:teuthology.orchestra.run.smithi088.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:33:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/090 2023-05-17T13:33:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/090 2023-05-17T13:33:57.693 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:33:57.698 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:33:57.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:33:57.719 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-05-17T13:33:58.115 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:33:58.126 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:33:58.126 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:34:43.340 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:34:43.344 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:35:13.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:35:13.481 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:35:43.580 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:35:43.585 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:36:13.694 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:36:13.699 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:36:19.510 INFO:teuthology.orchestra.run.smithi088.stdout:generic/091 141s 2023-05-17T13:36:19.521 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/091 2023-05-17T13:36:19.522 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:36:19.527 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:19.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:36:19.575 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-05-17T13:36:20.279 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:36:20.290 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:36:20.291 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:20.675 INFO:teuthology.orchestra.run.smithi088.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T13:36:20.683 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/092 2023-05-17T13:36:20.683 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/092 2023-05-17T13:36:20.684 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:36:20.689 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:20.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:36:20.732 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-05-17T13:36:21.418 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:36:21.429 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:36:21.429 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:22.395 INFO:teuthology.orchestra.run.smithi088.stdout:generic/093 1s 2023-05-17T13:36:22.406 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/093 2023-05-17T13:36:22.407 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:36:22.412 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:22.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:36:22.498 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-05-17T13:36:23.153 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:36:23.164 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:36:23.165 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:23.441 INFO:teuthology.orchestra.run.smithi088.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:36:23.450 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/094 2023-05-17T13:36:23.451 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/094 2023-05-17T13:36:23.452 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:36:23.455 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:23.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:36:23.476 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-05-17T13:36:23.861 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:36:23.873 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:36:23.873 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:24.148 INFO:teuthology.orchestra.run.smithi088.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:36:24.157 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/095 2023-05-17T13:36:24.157 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/095 2023-05-17T13:36:24.157 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:36:24.162 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:24.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:36:24.183 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-05-17T13:36:24.573 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:36:24.585 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:36:24.585 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:24.867 INFO:teuthology.orchestra.run.smithi088.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:36:24.876 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/096 2023-05-17T13:36:24.876 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/096 2023-05-17T13:36:24.877 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:36:24.881 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:24.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:36:24.903 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-05-17T13:36:25.289 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:36:25.300 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:36:25.301 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:26.208 INFO:teuthology.orchestra.run.smithi088.stdout:generic/097 1s 2023-05-17T13:36:26.219 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/097 2023-05-17T13:36:26.220 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:36:26.225 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:26.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:36:26.244 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-05-17T13:36:26.632 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:36:26.643 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:36:26.643 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:26.916 INFO:teuthology.orchestra.run.smithi088.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:36:26.924 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/098 2023-05-17T13:36:26.925 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/098 2023-05-17T13:36:26.925 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:36:26.930 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:26.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:36:26.949 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-05-17T13:36:27.337 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:36:27.349 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:36:27.349 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:27.700 INFO:teuthology.orchestra.run.smithi088.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-17T13:36:27.709 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/099 2023-05-17T13:36:27.709 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/099 2023-05-17T13:36:27.709 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:36:27.714 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:27.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:36:27.734 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-05-17T13:36:28.122 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:36:28.133 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:36:28.133 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:36:43.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:36:43.812 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:37:13.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:37:13.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:37:18.272 INFO:teuthology.orchestra.run.smithi088.stdout:generic/100 50s 2023-05-17T13:37:18.284 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/100 2023-05-17T13:37:18.284 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:18.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:18.337 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-05-17T13:37:19.095 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:19.106 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:19.106 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:19.469 INFO:teuthology.orchestra.run.smithi088.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:37:19.477 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/101 2023-05-17T13:37:19.477 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/101 2023-05-17T13:37:19.477 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:19.482 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:19.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:19.502 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-05-17T13:37:19.884 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:19.895 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:20.172 INFO:teuthology.orchestra.run.smithi088.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:37:20.180 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/102 2023-05-17T13:37:20.181 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/102 2023-05-17T13:37:20.181 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:20.186 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:20.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:20.207 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-05-17T13:37:20.599 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:20.610 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:20.610 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:20.887 INFO:teuthology.orchestra.run.smithi088.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:37:20.896 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/103 2023-05-17T13:37:20.896 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/103 2023-05-17T13:37:20.896 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:20.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:20.920 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-05-17T13:37:21.305 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:21.317 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:21.613 INFO:teuthology.orchestra.run.smithi088.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:37:21.621 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/104 2023-05-17T13:37:21.622 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/104 2023-05-17T13:37:21.622 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:21.627 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:21.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:21.647 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-05-17T13:37:22.028 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:22.040 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:22.040 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:22.323 INFO:teuthology.orchestra.run.smithi088.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:37:22.331 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/105 2023-05-17T13:37:22.332 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/105 2023-05-17T13:37:22.332 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:22.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:22.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:22.357 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-05-17T13:37:22.744 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:22.755 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:22.755 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:23.072 INFO:teuthology.orchestra.run.smithi088.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:37:23.080 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/106 2023-05-17T13:37:23.080 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/106 2023-05-17T13:37:23.080 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:23.085 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:23.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:23.105 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-05-17T13:37:23.484 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:23.495 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:23.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:23.809 INFO:teuthology.orchestra.run.smithi088.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:37:23.818 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/107 2023-05-17T13:37:23.818 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/107 2023-05-17T13:37:23.818 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:23.824 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:23.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:23.843 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-05-17T13:37:24.227 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:24.238 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:24.239 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:24.670 INFO:teuthology.orchestra.run.smithi088.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:37:24.678 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/108 2023-05-17T13:37:24.678 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/108 2023-05-17T13:37:24.678 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:24.683 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:24.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:24.703 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-05-17T13:37:25.089 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:25.100 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:25.101 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:25.373 INFO:teuthology.orchestra.run.smithi088.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:37:25.381 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/109 2023-05-17T13:37:25.381 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/109 2023-05-17T13:37:25.381 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:25.387 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:25.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:25.406 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-05-17T13:37:25.790 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:25.802 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:25.802 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:26.165 INFO:teuthology.orchestra.run.smithi088.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T13:37:26.173 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/110 2023-05-17T13:37:26.174 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/110 2023-05-17T13:37:26.174 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:26.179 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:26.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:26.226 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-05-17T13:37:26.910 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:26.922 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:26.922 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:27.278 INFO:teuthology.orchestra.run.smithi088.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T13:37:27.286 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/111 2023-05-17T13:37:27.286 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/111 2023-05-17T13:37:27.286 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:37:27.291 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:27.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:37:27.370 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-05-17T13:37:28.018 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:37:28.029 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:37:28.029 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:37:44.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:37:44.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:37:44.157 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T13:37:44.154+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 270801) UID: 0 2023-05-17T13:37:44.158 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T13:37:44.154+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 270801) UID: 0 2023-05-17T13:37:44.158 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T13:37:44.154+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 270801) UID: 0 2023-05-17T13:37:44.158 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T13:37:44.154+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 270801) UID: 0 2023-05-17T13:38:20.334 INFO:teuthology.orchestra.run.smithi088.stdout:generic/112 52s 2023-05-17T13:38:20.347 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/112 2023-05-17T13:38:20.347 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:38:20.353 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:38:20.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:38:20.394 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-05-17T13:38:21.126 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:38:21.137 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:38:21.137 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:07.906 INFO:teuthology.orchestra.run.smithi088.stdout:generic/113 46s 2023-05-17T13:39:07.918 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/113 2023-05-17T13:39:07.918 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:07.923 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:07.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:07.955 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-05-17T13:39:08.725 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:08.736 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:08.736 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:09.202 INFO:teuthology.orchestra.run.smithi088.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-05-17T13:39:09.210 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/114 2023-05-17T13:39:09.211 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/114 2023-05-17T13:39:09.211 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:09.216 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:09.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:09.236 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-05-17T13:39:09.622 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:09.633 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:09.634 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:10.030 INFO:teuthology.orchestra.run.smithi088.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T13:39:10.038 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/115 2023-05-17T13:39:10.038 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/115 2023-05-17T13:39:10.039 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:10.044 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:10.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:10.064 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-05-17T13:39:10.830 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:10.840 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:10.841 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:11.202 INFO:teuthology.orchestra.run.smithi088.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T13:39:11.210 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/116 2023-05-17T13:39:11.210 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/116 2023-05-17T13:39:11.210 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:11.216 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:11.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:11.236 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-05-17T13:39:11.981 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:11.992 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:11.993 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:12.289 INFO:teuthology.orchestra.run.smithi088.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:39:12.297 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/117 2023-05-17T13:39:12.297 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/117 2023-05-17T13:39:12.297 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:12.303 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:12.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:12.322 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-05-17T13:39:12.726 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:12.737 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:12.737 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:13.096 INFO:teuthology.orchestra.run.smithi088.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T13:39:13.104 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/118 2023-05-17T13:39:13.105 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/118 2023-05-17T13:39:13.105 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:13.110 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:13.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:13.130 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-05-17T13:39:13.900 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:13.911 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:13.912 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:14.271 INFO:teuthology.orchestra.run.smithi088.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T13:39:14.279 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/119 2023-05-17T13:39:14.279 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/119 2023-05-17T13:39:14.279 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:14.285 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:14.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:14.333 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-05-17T13:39:15.090 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:15.101 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:15.101 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:15.397 INFO:teuthology.orchestra.run.smithi088.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:39:15.407 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/120 2023-05-17T13:39:15.407 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/120 2023-05-17T13:39:15.407 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:15.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:15.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:15.435 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-05-17T13:39:15.868 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:15.881 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:15.881 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:16.288 INFO:teuthology.orchestra.run.smithi088.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-17T13:39:16.297 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/121 2023-05-17T13:39:16.297 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/121 2023-05-17T13:39:16.297 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:16.303 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:16.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:16.324 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-05-17T13:39:17.062 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:17.081 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:17.081 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:18.664 INFO:teuthology.orchestra.run.smithi088.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-17T13:39:18.673 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/122 2023-05-17T13:39:18.673 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/122 2023-05-17T13:39:18.673 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:18.678 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:18.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:18.698 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-05-17T13:39:19.476 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:19.487 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:19.488 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:21.862 INFO:teuthology.orchestra.run.smithi088.stdout:generic/123 2s 2023-05-17T13:39:21.874 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/123 2023-05-17T13:39:21.874 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:21.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:21.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:21.926 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-05-17T13:39:22.707 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:22.718 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:22.718 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:23.055 INFO:teuthology.orchestra.run.smithi088.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:39:23.063 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/124 2023-05-17T13:39:23.063 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/124 2023-05-17T13:39:23.063 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:39:23.068 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:39:23.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:39:23.089 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-05-17T13:39:23.480 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:39:23.491 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:39:23.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:40:25.956 INFO:teuthology.orchestra.run.smithi088.stdout:generic/125 62s 2023-05-17T13:40:25.969 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/125 2023-05-17T13:40:25.969 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:40:25.975 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:40:26.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:40:26.048 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-05-17T13:40:26.709 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:40:26.721 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:40:26.721 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:40:27.729 INFO:teuthology.orchestra.run.smithi088.stdout:generic/126 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/126.out.bad) 2023-05-17T13:40:27.734 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/126.out 2023-05-17 12:27:04.814538422 +0000 2023-05-17T13:40:27.734 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/126.out.bad 2023-05-17 13:40:27.721789325 +0000 2023-05-17T13:40:27.734 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,7 +1,7 @@ 2023-05-17T13:40:27.734 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 126 2023-05-17T13:40:27.734 INFO:teuthology.orchestra.run.smithi088.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-05-17T13:40:27.735 INFO:teuthology.orchestra.run.smithi088.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-05-17T13:40:27.735 INFO:teuthology.orchestra.run.smithi088.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-05-17T13:40:27.735 INFO:teuthology.orchestra.run.smithi088.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-05-17T13:40:27.735 INFO:teuthology.orchestra.run.smithi088.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-05-17T13:40:27.735 INFO:teuthology.orchestra.run.smithi088.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-05-17T13:40:27.735 INFO:teuthology.orchestra.run.smithi088.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-05-17T13:40:27.735 INFO:teuthology.orchestra.run.smithi088.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-05-17T13:40:27.736 INFO:teuthology.orchestra.run.smithi088.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-05-17T13:40:27.739 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/126 2023-05-17T13:40:27.739 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/126 2023-05-17T13:40:27.740 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T13:40:27.745 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:40:27.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T13:40:27.764 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T13:40:27.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T13:40:27.764 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-05-17T13:40:28.497 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:40:28.508 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:40:28.509 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:40:49.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:40:49.993 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:41:20.096 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:41:20.101 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:41:50.203 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:41:50.209 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:42:20.316 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:42:20.321 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:42:50.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:42:50.450 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:43:20.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:43:20.545 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:43:50.654 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:43:50.658 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:44:20.800 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:44:20.805 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:44:50.963 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:44:50.968 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:45:22.022 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:45:22.027 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:45:52.197 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:45:52.202 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:46:22.310 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:46:22.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:46:52.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:46:52.445 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:47:22.535 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:47:22.540 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:47:52.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:47:52.637 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:48:22.820 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:48:22.825 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:48:52.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:48:52.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:49:23.038 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:49:23.042 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:49:53.150 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:49:53.155 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:50:23.251 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:50:23.257 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:50:53.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:50:53.361 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:51:23.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:51:23.682 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:51:53.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:51:53.828 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:52:23.927 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:52:23.932 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:52:54.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:52:54.034 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:53:24.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:53:24.148 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:53:54.247 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:53:54.253 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:54:24.347 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:54:24.351 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:54:54.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:54:54.469 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:55:24.568 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:55:24.573 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:55:54.739 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:55:54.744 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:56:14.610 INFO:teuthology.orchestra.run.smithi088.stdout:generic/127 946s 2023-05-17T13:56:14.622 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/127 2023-05-17T13:56:14.623 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:56:14.627 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:14.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:56:14.682 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-05-17T13:56:15.369 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:56:15.380 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:56:15.381 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:15.685 INFO:teuthology.orchestra.run.smithi088.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:56:15.693 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/128 2023-05-17T13:56:15.693 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/128 2023-05-17T13:56:15.693 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:56:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:15.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:56:15.719 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-05-17T13:56:16.115 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:56:16.126 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:56:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:16.404 INFO:teuthology.orchestra.run.smithi088.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:56:16.413 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/129 2023-05-17T13:56:16.413 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/129 2023-05-17T13:56:16.413 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:56:16.418 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:16.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:56:16.438 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-05-17T13:56:16.830 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:56:16.842 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:56:16.842 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:17.121 INFO:teuthology.orchestra.run.smithi088.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:56:17.130 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/130 2023-05-17T13:56:17.130 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/130 2023-05-17T13:56:17.130 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:56:17.135 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:17.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:56:17.155 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-05-17T13:56:17.547 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:56:17.559 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:56:17.559 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:19.266 INFO:teuthology.orchestra.run.smithi088.stdout:generic/131 2s 2023-05-17T13:56:19.725 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/131 2023-05-17T13:56:19.725 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:56:19.739 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:19.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:56:19.763 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-05-17T13:56:20.507 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:56:20.518 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:56:20.518 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:20.798 INFO:teuthology.orchestra.run.smithi088.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T13:56:20.806 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/132 2023-05-17T13:56:20.806 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/132 2023-05-17T13:56:20.807 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T13:56:20.812 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:20.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T13:56:20.831 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-05-17T13:56:21.223 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T13:56:21.235 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T13:56:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T13:56:24.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:56:24.881 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:56:55.109 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:56:55.114 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:57:25.338 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:57:25.343 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T13:57:25.764 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T13:57:25.760+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 282298) UID: 0 2023-05-17T13:57:25.765 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T13:57:25.760+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 282298) UID: 0 2023-05-17T13:57:25.765 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T13:57:25.760+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 282298) UID: 0 2023-05-17T13:57:25.765 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T13:57:25.760+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 282298) UID: 0 2023-05-17T14:00:23.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:00:23.148 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:00:53.305 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:00:53.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:01:21.325 INFO:teuthology.orchestra.run.smithi088.stdout:generic/133 300s 2023-05-17T14:01:21.362 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/133 2023-05-17T14:01:21.363 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:21.367 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:21.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:21.390 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-05-17T14:01:22.386 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:22.397 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:22.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:22.783 INFO:teuthology.orchestra.run.smithi088.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:22.791 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/134 2023-05-17T14:01:22.791 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/134 2023-05-17T14:01:22.791 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:22.796 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:22.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:22.819 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-05-17T14:01:23.408 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:01:23.413 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:01:23.531 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:23.542 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:23.543 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:23.895 INFO:teuthology.orchestra.run.smithi088.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:23.903 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/135 2023-05-17T14:01:23.903 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/135 2023-05-17T14:01:23.903 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:23.908 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:23.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:23.930 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-05-17T14:01:24.361 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:24.372 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:24.372 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:24.749 INFO:teuthology.orchestra.run.smithi088.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:24.757 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/136 2023-05-17T14:01:24.757 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/136 2023-05-17T14:01:24.758 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:24.763 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:24.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:24.782 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-05-17T14:01:25.507 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:25.519 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:25.519 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:25.889 INFO:teuthology.orchestra.run.smithi088.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:25.897 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/137 2023-05-17T14:01:25.897 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/137 2023-05-17T14:01:25.897 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:25.903 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:25.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:25.958 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-05-17T14:01:26.634 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:26.645 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:26.645 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:27.002 INFO:teuthology.orchestra.run.smithi088.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:27.010 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/138 2023-05-17T14:01:27.011 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/138 2023-05-17T14:01:27.011 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:27.016 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:27.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:27.058 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-05-17T14:01:27.761 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:27.771 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:27.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:28.130 INFO:teuthology.orchestra.run.smithi088.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:28.138 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/139 2023-05-17T14:01:28.138 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/139 2023-05-17T14:01:28.139 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:28.144 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:28.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:28.165 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-05-17T14:01:28.880 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:28.891 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:28.891 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:29.253 INFO:teuthology.orchestra.run.smithi088.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:29.261 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/140 2023-05-17T14:01:29.262 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/140 2023-05-17T14:01:29.262 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:29.267 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:29.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:29.295 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-05-17T14:01:30.002 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:30.013 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:30.013 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:30.288 INFO:teuthology.orchestra.run.smithi088.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:30.296 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/141 2023-05-17T14:01:30.297 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/141 2023-05-17T14:01:30.297 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:30.302 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:30.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:30.323 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-05-17T14:01:30.712 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:30.723 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:30.723 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:31.083 INFO:teuthology.orchestra.run.smithi088.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:31.091 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/142 2023-05-17T14:01:31.092 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/142 2023-05-17T14:01:31.092 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:31.097 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:31.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-05-17T14:01:31.814 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:31.825 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:31.825 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:32.179 INFO:teuthology.orchestra.run.smithi088.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:32.187 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/143 2023-05-17T14:01:32.188 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/143 2023-05-17T14:01:32.188 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:32.193 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:32.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:32.220 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-05-17T14:01:32.898 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:32.909 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:32.910 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:33.268 INFO:teuthology.orchestra.run.smithi088.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:33.276 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/144 2023-05-17T14:01:33.276 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/144 2023-05-17T14:01:33.276 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:33.281 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:33.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:33.308 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-05-17T14:01:34.010 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:34.021 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:34.021 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:34.371 INFO:teuthology.orchestra.run.smithi088.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:34.380 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/145 2023-05-17T14:01:34.380 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/145 2023-05-17T14:01:34.380 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:34.385 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:34.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:34.430 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-05-17T14:01:35.094 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:35.105 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:35.105 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:35.459 INFO:teuthology.orchestra.run.smithi088.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:35.467 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/146 2023-05-17T14:01:35.467 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/146 2023-05-17T14:01:35.467 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:35.472 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:35.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:35.494 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-05-17T14:01:36.192 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:36.204 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:36.204 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:36.562 INFO:teuthology.orchestra.run.smithi088.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:36.571 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/147 2023-05-17T14:01:36.571 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/147 2023-05-17T14:01:36.571 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:36.577 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:36.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:36.620 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-05-17T14:01:37.295 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:37.306 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:37.307 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:37.670 INFO:teuthology.orchestra.run.smithi088.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/148 2023-05-17T14:01:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/148 2023-05-17T14:01:37.678 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:37.683 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:37.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:37.704 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-05-17T14:01:38.417 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:38.428 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:38.428 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:38.779 INFO:teuthology.orchestra.run.smithi088.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:38.788 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/149 2023-05-17T14:01:38.788 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/149 2023-05-17T14:01:38.788 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:38.793 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:38.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:38.835 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-05-17T14:01:39.535 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:39.546 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:39.546 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:39.905 INFO:teuthology.orchestra.run.smithi088.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:39.913 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/150 2023-05-17T14:01:39.914 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/150 2023-05-17T14:01:39.914 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:39.919 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:39.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:39.978 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-05-17T14:01:40.625 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:40.637 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:40.637 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:40.992 INFO:teuthology.orchestra.run.smithi088.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:41.000 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/151 2023-05-17T14:01:41.001 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/151 2023-05-17T14:01:41.001 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:41.006 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:41.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:41.034 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-05-17T14:01:41.724 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:41.735 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:41.735 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:42.091 INFO:teuthology.orchestra.run.smithi088.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:42.099 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/152 2023-05-17T14:01:42.099 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/152 2023-05-17T14:01:42.099 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:42.105 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:42.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:42.124 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-05-17T14:01:42.835 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:42.847 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:43.208 INFO:teuthology.orchestra.run.smithi088.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:43.216 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/153 2023-05-17T14:01:43.217 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/153 2023-05-17T14:01:43.217 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:43.222 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:43.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:43.244 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-05-17T14:01:43.946 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:43.957 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:43.958 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:44.308 INFO:teuthology.orchestra.run.smithi088.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:44.316 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/154 2023-05-17T14:01:44.317 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/154 2023-05-17T14:01:44.317 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:44.322 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:44.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:44.363 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-05-17T14:01:45.059 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:45.071 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:45.071 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:45.426 INFO:teuthology.orchestra.run.smithi088.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:45.434 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/155 2023-05-17T14:01:45.434 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/155 2023-05-17T14:01:45.434 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:45.439 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:45.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:45.461 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-05-17T14:01:46.172 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:46.184 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:46.184 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:46.544 INFO:teuthology.orchestra.run.smithi088.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:46.552 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/156 2023-05-17T14:01:46.552 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/156 2023-05-17T14:01:46.552 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:46.557 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:46.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:46.634 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-05-17T14:01:47.297 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:47.308 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:47.669 INFO:teuthology.orchestra.run.smithi088.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:47.677 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/157 2023-05-17T14:01:47.677 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/157 2023-05-17T14:01:47.677 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:47.682 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:47.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:47.724 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-05-17T14:01:48.415 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:48.426 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:48.427 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:48.809 INFO:teuthology.orchestra.run.smithi088.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-17T14:01:48.817 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/158 2023-05-17T14:01:48.817 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/158 2023-05-17T14:01:48.817 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:48.823 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:48.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:48.844 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-05-17T14:01:49.547 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:49.558 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:49.558 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:49.904 INFO:teuthology.orchestra.run.smithi088.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-05-17T14:01:49.912 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/159 2023-05-17T14:01:49.913 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/159 2023-05-17T14:01:49.913 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:49.918 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:49.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:49.938 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-05-17T14:01:50.324 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:50.335 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:50.336 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:50.669 INFO:teuthology.orchestra.run.smithi088.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-05-17T14:01:50.678 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/160 2023-05-17T14:01:50.678 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/160 2023-05-17T14:01:50.678 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:50.683 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:50.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:50.703 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-05-17T14:01:51.097 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:51.107 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:51.108 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:51.653 INFO:teuthology.orchestra.run.smithi088.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:51.661 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/161 2023-05-17T14:01:51.662 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/161 2023-05-17T14:01:51.662 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:51.667 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:51.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:51.687 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-05-17T14:01:52.072 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:52.084 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:52.084 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:52.413 INFO:teuthology.orchestra.run.smithi088.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:52.421 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/162 2023-05-17T14:01:52.421 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/162 2023-05-17T14:01:52.422 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:52.427 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:52.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:52.448 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-05-17T14:01:52.839 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:52.850 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:52.850 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:53.220 INFO:teuthology.orchestra.run.smithi088.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:53.228 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/163 2023-05-17T14:01:53.228 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/163 2023-05-17T14:01:53.228 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:53.233 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:53.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:53.253 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-05-17T14:01:53.529 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:01:53.535 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:01:53.652 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:53.663 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:53.664 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:53.938 INFO:teuthology.orchestra.run.smithi088.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:53.946 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/164 2023-05-17T14:01:53.946 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/164 2023-05-17T14:01:53.946 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:53.951 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:53.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:53.971 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-05-17T14:01:54.400 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:54.411 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:54.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:54.688 INFO:teuthology.orchestra.run.smithi088.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:54.696 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/165 2023-05-17T14:01:54.696 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/165 2023-05-17T14:01:54.696 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:54.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:54.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:54.721 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-05-17T14:01:55.112 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:55.123 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:55.123 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:55.398 INFO:teuthology.orchestra.run.smithi088.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:55.406 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/166 2023-05-17T14:01:55.407 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/166 2023-05-17T14:01:55.407 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:55.412 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:55.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:55.432 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-05-17T14:01:55.820 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:55.832 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:55.832 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:56.109 INFO:teuthology.orchestra.run.smithi088.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:56.117 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/167 2023-05-17T14:01:56.117 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/167 2023-05-17T14:01:56.117 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:56.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:56.142 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-05-17T14:01:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:56.542 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/168 2023-05-17T14:01:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/168 2023-05-17T14:01:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:56.839 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:56.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:56.860 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-05-17T14:01:57.252 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:57.264 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:57.264 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:57.546 INFO:teuthology.orchestra.run.smithi088.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:57.554 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/169 2023-05-17T14:01:57.554 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/169 2023-05-17T14:01:57.554 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:57.559 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:57.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:57.579 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-05-17T14:01:57.966 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:57.977 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:58.266 INFO:teuthology.orchestra.run.smithi088.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:58.274 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/170 2023-05-17T14:01:58.274 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/170 2023-05-17T14:01:58.274 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:58.280 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:58.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:58.301 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-05-17T14:01:58.692 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:58.703 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:58.703 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:59.001 INFO:teuthology.orchestra.run.smithi088.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:59.009 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/171 2023-05-17T14:01:59.009 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/171 2023-05-17T14:01:59.009 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:59.014 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:59.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:59.034 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-05-17T14:01:59.424 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:01:59.435 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:01:59.435 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:59.721 INFO:teuthology.orchestra.run.smithi088.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:01:59.729 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/172 2023-05-17T14:01:59.729 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/172 2023-05-17T14:01:59.729 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:01:59.734 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:01:59.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:01:59.754 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-05-17T14:02:00.142 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:00.153 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:00.153 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:00.439 INFO:teuthology.orchestra.run.smithi088.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:00.447 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/173 2023-05-17T14:02:00.448 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/173 2023-05-17T14:02:00.448 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:00.453 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:00.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:00.473 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-05-17T14:02:00.860 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:00.871 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:00.871 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:01.162 INFO:teuthology.orchestra.run.smithi088.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:01.170 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/174 2023-05-17T14:02:01.171 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/174 2023-05-17T14:02:01.171 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:01.176 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:01.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:01.196 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-05-17T14:02:01.581 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:01.592 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:01.592 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:01.882 INFO:teuthology.orchestra.run.smithi088.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:01.890 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/175 2023-05-17T14:02:01.890 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/175 2023-05-17T14:02:01.891 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:01.896 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:01.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:01.916 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-05-17T14:02:02.304 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:02.320 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:02.320 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:02.598 INFO:teuthology.orchestra.run.smithi088.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:02.606 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/176 2023-05-17T14:02:02.607 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/176 2023-05-17T14:02:02.607 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:02.612 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:02.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:02.631 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-05-17T14:02:03.017 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:03.028 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:03.028 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:03.420 INFO:teuthology.orchestra.run.smithi088.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:03.428 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/177 2023-05-17T14:02:03.428 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/177 2023-05-17T14:02:03.429 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:03.434 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:03.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:03.454 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-05-17T14:02:03.844 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:03.855 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:03.855 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:04.225 INFO:teuthology.orchestra.run.smithi088.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:02:04.233 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/178 2023-05-17T14:02:04.234 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/178 2023-05-17T14:02:04.234 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:04.239 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:04.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:04.296 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-05-17T14:02:04.977 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:04.988 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:04.988 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:05.347 INFO:teuthology.orchestra.run.smithi088.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:02:05.355 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/179 2023-05-17T14:02:05.356 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/179 2023-05-17T14:02:05.356 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:05.361 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:05.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:05.411 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-05-17T14:02:06.103 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:06.114 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:06.115 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:06.467 INFO:teuthology.orchestra.run.smithi088.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:02:06.475 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/180 2023-05-17T14:02:06.476 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/180 2023-05-17T14:02:06.476 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:06.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:06.523 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-05-17T14:02:07.192 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:07.203 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:07.203 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:07.559 INFO:teuthology.orchestra.run.smithi088.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:02:07.568 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/181 2023-05-17T14:02:07.568 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/181 2023-05-17T14:02:07.568 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:07.573 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:07.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:07.595 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-05-17T14:02:08.300 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:08.311 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:08.311 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:08.693 INFO:teuthology.orchestra.run.smithi088.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-17T14:02:08.701 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/182 2023-05-17T14:02:08.702 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/182 2023-05-17T14:02:08.702 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:08.707 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:08.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:08.726 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-05-17T14:02:09.446 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:09.457 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:09.457 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:09.736 INFO:teuthology.orchestra.run.smithi088.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:09.745 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/183 2023-05-17T14:02:09.745 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/183 2023-05-17T14:02:09.745 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:09.750 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:09.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:09.770 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-05-17T14:02:10.159 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:10.171 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:10.171 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:10.545 INFO:teuthology.orchestra.run.smithi088.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/184.out.bad) 2023-05-17T14:02:10.550 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/184.out 2023-05-17 12:27:04.823538243 +0000 2023-05-17T14:02:10.550 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/184.out.bad 2023-05-17 14:02:10.539206506 +0000 2023-05-17T14:02:10.550 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1 +1,2 @@ 2023-05-17T14:02:10.550 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 184 2023-05-17T14:02:10.551 INFO:teuthology.orchestra.run.smithi088.stdout: +/tmp/tmp.buK0S8bWYQxfstests-dev/tests/generic/184: line 23: /tmp/tmp.3n61ha2sIstest/null: Permission denied 2023-05-17T14:02:10.555 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/184 2023-05-17T14:02:10.556 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/184 2023-05-17T14:02:10.556 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:02:10.561 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:10.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:02:10.579 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:02:10.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:02:10.580 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-05-17T14:02:10.974 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:11.265 INFO:teuthology.orchestra.run.smithi088.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:11.273 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/185 2023-05-17T14:02:11.273 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/185 2023-05-17T14:02:11.274 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:11.279 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:11.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:11.299 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-05-17T14:02:11.685 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:11.696 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:11.696 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:11.974 INFO:teuthology.orchestra.run.smithi088.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:11.982 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/186 2023-05-17T14:02:11.983 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/186 2023-05-17T14:02:11.983 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:11.988 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:12.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:12.008 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-05-17T14:02:12.393 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:12.404 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:12.404 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:12.678 INFO:teuthology.orchestra.run.smithi088.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:12.686 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/187 2023-05-17T14:02:12.687 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/187 2023-05-17T14:02:12.687 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:12.692 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:12.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:12.712 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-05-17T14:02:13.096 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:13.107 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:13.107 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/188 2023-05-17T14:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/188 2023-05-17T14:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:13.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:13.433 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-05-17T14:02:13.818 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:13.829 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:14.105 INFO:teuthology.orchestra.run.smithi088.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:14.113 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/189 2023-05-17T14:02:14.113 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/189 2023-05-17T14:02:14.113 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:14.119 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:14.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:14.137 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-05-17T14:02:14.528 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:14.539 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:14.539 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:14.820 INFO:teuthology.orchestra.run.smithi088.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:14.829 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/190 2023-05-17T14:02:14.829 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/190 2023-05-17T14:02:14.829 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:14.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:14.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:14.855 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-05-17T14:02:15.244 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:15.255 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:15.255 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:15.535 INFO:teuthology.orchestra.run.smithi088.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:15.543 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/191 2023-05-17T14:02:15.543 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/191 2023-05-17T14:02:15.543 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:15.548 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:15.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:15.569 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-05-17T14:02:15.961 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:15.972 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:15.972 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:21.556 INFO:teuthology.orchestra.run.smithi088.stdout:generic/192 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/192.out.bad) 2023-05-17T14:02:21.561 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/192.out 2023-05-17 12:27:04.824538223 +0000 2023-05-17T14:02:21.562 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/192.out.bad 2023-05-17 14:02:21.549989492 +0000 2023-05-17T14:02:21.562 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,5 +1,6 @@ 2023-05-17T14:02:21.562 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 192 2023-05-17T14:02:21.562 INFO:teuthology.orchestra.run.smithi088.stdout: sleep for 5 seconds 2023-05-17T14:02:21.562 INFO:teuthology.orchestra.run.smithi088.stdout: test 2023-05-17T14:02:21.562 INFO:teuthology.orchestra.run.smithi088.stdout: -delta1 is in range 2023-05-17T14:02:21.562 INFO:teuthology.orchestra.run.smithi088.stdout: +delta1 has value of 0 2023-05-17T14:02:21.563 INFO:teuthology.orchestra.run.smithi088.stdout: +delta1 is NOT in range 5 .. 7 2023-05-17T14:02:21.563 INFO:teuthology.orchestra.run.smithi088.stdout: delta2 is in range 2023-05-17T14:02:21.567 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/192 2023-05-17T14:02:21.567 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/192 2023-05-17T14:02:21.567 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:02:21.572 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:21.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:02:21.590 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:02:21.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:02:21.591 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-05-17T14:02:21.975 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:21.986 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:21.986 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:23.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:02:23.651 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:02:23.709 INFO:teuthology.orchestra.run.smithi088.stdout:generic/193 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/193.out.bad) 2023-05-17T14:02:23.715 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/193.out 2023-05-17 12:27:04.824538223 +0000 2023-05-17T14:02:23.715 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/193.out.bad 2023-05-17 14:02:23.646948163 +0000 2023-05-17T14:02:23.715 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -24,7 +24,6 @@ 2023-05-17T14:02:23.716 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:23.716 INFO:teuthology.orchestra.run.smithi088.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-05-17T14:02:23.716 INFO:teuthology.orchestra.run.smithi088.stdout: user: chmod a+r on root owned file (should fail) 2023-05-17T14:02:23.716 INFO:teuthology.orchestra.run.smithi088.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-05-17T14:02:23.716 INFO:teuthology.orchestra.run.smithi088.stdout: check that the sgid bit is cleared 2023-05-17T14:02:23.716 INFO:teuthology.orchestra.run.smithi088.stdout: -rw-rw-rw- 2023-05-17T14:02:23.716 INFO:teuthology.orchestra.run.smithi088.stdout: check that suid bit is not cleared 2023-05-17T14:02:23.720 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/193 2023-05-17T14:02:23.721 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/193 2023-05-17T14:02:23.721 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:02:23.726 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:23.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:02:23.767 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:02:23.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:02:23.767 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-05-17T14:02:24.475 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:24.486 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:24.486 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:24.764 INFO:teuthology.orchestra.run.smithi088.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:24.772 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/194 2023-05-17T14:02:24.772 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/194 2023-05-17T14:02:24.773 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:24.778 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:24.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:24.797 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-05-17T14:02:25.195 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:25.206 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:25.207 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:25.483 INFO:teuthology.orchestra.run.smithi088.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:25.491 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/195 2023-05-17T14:02:25.491 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/195 2023-05-17T14:02:25.491 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:25.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:25.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:25.517 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-05-17T14:02:25.905 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:25.917 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:25.917 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:26.200 INFO:teuthology.orchestra.run.smithi088.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:26.208 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/196 2023-05-17T14:02:26.208 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/196 2023-05-17T14:02:26.209 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:26.214 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:26.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:26.234 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-05-17T14:02:26.630 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:26.641 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:26.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:26.922 INFO:teuthology.orchestra.run.smithi088.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:26.931 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/197 2023-05-17T14:02:26.931 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/197 2023-05-17T14:02:26.931 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:26.936 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:26.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:26.957 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-05-17T14:02:27.348 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:27.359 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:27.360 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:28.655 INFO:teuthology.orchestra.run.smithi088.stdout:generic/198 1s 2023-05-17T14:02:28.666 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/198 2023-05-17T14:02:28.666 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:28.671 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:28.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:28.692 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-05-17T14:02:29.452 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:29.463 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:29.463 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:29.744 INFO:teuthology.orchestra.run.smithi088.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:29.752 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/199 2023-05-17T14:02:29.752 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/199 2023-05-17T14:02:29.753 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:29.757 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:29.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:29.778 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-05-17T14:02:30.167 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:30.178 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:30.179 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:30.460 INFO:teuthology.orchestra.run.smithi088.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:30.469 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/200 2023-05-17T14:02:30.469 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/200 2023-05-17T14:02:30.470 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:30.475 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:30.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:30.495 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-05-17T14:02:30.880 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:30.892 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:30.892 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:31.169 INFO:teuthology.orchestra.run.smithi088.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:31.178 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/201 2023-05-17T14:02:31.178 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/201 2023-05-17T14:02:31.178 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:31.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:31.204 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-05-17T14:02:31.600 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:31.611 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:31.612 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:31.893 INFO:teuthology.orchestra.run.smithi088.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:31.902 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/202 2023-05-17T14:02:31.902 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/202 2023-05-17T14:02:31.902 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:31.907 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:31.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:31.927 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-05-17T14:02:32.316 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:32.327 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:32.328 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:32.608 INFO:teuthology.orchestra.run.smithi088.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:32.617 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/203 2023-05-17T14:02:32.617 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/203 2023-05-17T14:02:32.617 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:32.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:32.642 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-05-17T14:02:33.041 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:33.053 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:33.053 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:33.987 INFO:teuthology.orchestra.run.smithi088.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:33.996 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/204 2023-05-17T14:02:33.996 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/204 2023-05-17T14:02:33.997 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:34.003 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:34.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:34.023 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-05-17T14:02:34.410 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:34.421 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:34.421 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:34.713 INFO:teuthology.orchestra.run.smithi088.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:34.721 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/205 2023-05-17T14:02:34.721 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/205 2023-05-17T14:02:34.722 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:34.727 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:34.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:34.747 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-05-17T14:02:35.143 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:35.155 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:35.156 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:35.440 INFO:teuthology.orchestra.run.smithi088.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:02:35.449 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/206 2023-05-17T14:02:35.449 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/206 2023-05-17T14:02:35.449 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:35.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:35.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:35.474 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-05-17T14:02:35.862 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:35.873 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:35.874 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:54.028 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:02:54.033 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:02:57.016 INFO:teuthology.orchestra.run.smithi088.stdout:generic/207 21s 2023-05-17T14:02:57.028 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/207 2023-05-17T14:02:57.028 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:02:57.034 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:02:57.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:02:57.085 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-05-17T14:02:57.761 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:02:57.772 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:02:57.773 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:03:24.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:03:24.146 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:03:54.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:03:54.286 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:04:24.381 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:04:24.387 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:04:54.519 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:04:54.524 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:05:24.621 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:05:24.626 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:05:54.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:05:54.733 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:06:18.390 INFO:teuthology.orchestra.run.smithi088.stdout:generic/208 201s 2023-05-17T14:06:18.401 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/208 2023-05-17T14:06:18.401 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:18.407 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:18.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:18.467 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-05-17T14:06:19.145 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:19.156 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:19.156 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:25.017 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:06:25.022 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:06:29.963 INFO:teuthology.orchestra.run.smithi088.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/209.out.bad) 2023-05-17T14:06:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/209.out 2023-05-17 12:27:04.826538183 +0000 2023-05-17T14:06:29.979 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/209.out.bad 2023-05-17 14:06:29.925104904 +0000 2023-05-17T14:06:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,2 +1,2 @@ 2023-05-17T14:06:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 209 2023-05-17T14:06:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: -test ran for 30 seconds without error 2023-05-17T14:06:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: +reader found old byte at pos 4096 2023-05-17T14:06:29.980 INFO:teuthology.orchestra.run.smithi088.stdout: \ No newline at end of file 2023-05-17T14:06:30.013 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/209 2023-05-17T14:06:30.013 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/209 2023-05-17T14:06:30.013 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:06:30.021 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:30.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:06:30.087 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:06:30.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:06:30.088 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-05-17T14:06:30.591 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:30.603 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:30.603 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:31.040 INFO:teuthology.orchestra.run.smithi088.stdout:generic/210 1s 2023-05-17T14:06:31.051 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/210 2023-05-17T14:06:31.052 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:31.057 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:31.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:31.109 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-05-17T14:06:31.790 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:31.802 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:31.802 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:32.630 INFO:teuthology.orchestra.run.smithi088.stdout:generic/211 1s 2023-05-17T14:06:32.642 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/211 2023-05-17T14:06:32.642 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:32.647 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:32.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:32.668 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-05-17T14:06:33.054 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:33.065 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:33.065 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:33.459 INFO:teuthology.orchestra.run.smithi088.stdout:generic/212 0s 2023-05-17T14:06:33.470 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/212 2023-05-17T14:06:33.470 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:33.475 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:33.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:33.494 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-05-17T14:06:33.890 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:33.901 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:33.902 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:34.573 INFO:teuthology.orchestra.run.smithi088.stdout:generic/213 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/213.out.bad) 2023-05-17T14:06:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/213.out 2023-05-17 12:27:04.827538164 +0000 2023-05-17T14:06:34.578 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/213.out.bad 2023-05-17 14:06:34.567013702 +0000 2023-05-17T14:06:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,4 +1,3 @@ 2023-05-17T14:06:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 213 2023-05-17T14:06:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: We should get: fallocate: No space left on device 2023-05-17T14:06:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-05-17T14:06:34.579 INFO:teuthology.orchestra.run.smithi088.stdout: -fallocate: No space left on device 2023-05-17T14:06:34.584 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/213 2023-05-17T14:06:34.584 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/213 2023-05-17T14:06:34.584 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:06:34.589 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:34.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:06:34.691 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:06:34.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:06:34.692 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-05-17T14:06:35.475 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:35.490 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:35.490 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:36.562 INFO:teuthology.orchestra.run.smithi088.stdout:generic/214 1s 2023-05-17T14:06:36.582 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/214 2023-05-17T14:06:36.583 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:36.590 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:36.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:36.625 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-05-17T14:06:37.495 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:37.515 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:37.515 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:41.632 INFO:teuthology.orchestra.run.smithi088.stdout:generic/215 4s 2023-05-17T14:06:41.651 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/215 2023-05-17T14:06:41.651 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:41.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:41.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:41.696 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-05-17T14:06:42.289 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:42.305 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:42.305 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:42.724 INFO:teuthology.orchestra.run.smithi088.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:42.737 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/216 2023-05-17T14:06:42.737 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/216 2023-05-17T14:06:42.738 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:42.747 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:42.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:42.781 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-05-17T14:06:43.442 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:43.463 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:43.463 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:43.859 INFO:teuthology.orchestra.run.smithi088.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:43.876 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/217 2023-05-17T14:06:43.876 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/217 2023-05-17T14:06:43.877 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:43.884 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:43.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:43.918 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-05-17T14:06:44.505 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:44.523 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:44.524 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:44.962 INFO:teuthology.orchestra.run.smithi088.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:44.975 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/218 2023-05-17T14:06:44.976 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/218 2023-05-17T14:06:44.976 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:44.983 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:45.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:45.018 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-05-17T14:06:45.629 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:45.647 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:45.648 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:46.088 INFO:teuthology.orchestra.run.smithi088.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:46.101 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/219 2023-05-17T14:06:46.101 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/219 2023-05-17T14:06:46.101 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:46.109 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:46.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:46.146 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-05-17T14:06:46.726 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:46.746 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:47.152 INFO:teuthology.orchestra.run.smithi088.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:47.167 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/220 2023-05-17T14:06:47.167 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/220 2023-05-17T14:06:47.168 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:47.174 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:47.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:47.211 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-05-17T14:06:47.783 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:47.799 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:49.309 INFO:teuthology.orchestra.run.smithi088.stdout:generic/221 2s 2023-05-17T14:06:49.327 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/221 2023-05-17T14:06:49.329 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:49.336 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:49.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:49.363 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-05-17T14:06:49.966 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:49.984 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:49.984 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:50.411 INFO:teuthology.orchestra.run.smithi088.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:50.426 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/222 2023-05-17T14:06:50.426 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/222 2023-05-17T14:06:50.426 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:50.434 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:50.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:50.467 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-05-17T14:06:51.071 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:51.083 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:51.083 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:51.479 INFO:teuthology.orchestra.run.smithi088.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:51.492 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/223 2023-05-17T14:06:51.493 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/223 2023-05-17T14:06:51.493 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:51.500 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:51.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:51.532 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-05-17T14:06:52.131 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:52.151 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:52.151 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:52.590 INFO:teuthology.orchestra.run.smithi088.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:52.608 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/224 2023-05-17T14:06:52.608 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/224 2023-05-17T14:06:52.608 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:52.614 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:52.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:52.649 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-05-17T14:06:53.263 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:53.283 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:53.283 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:53.713 INFO:teuthology.orchestra.run.smithi088.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:53.724 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/225 2023-05-17T14:06:53.725 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/225 2023-05-17T14:06:53.725 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:53.732 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:53.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:53.761 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-05-17T14:06:54.356 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:54.372 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:54.372 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:54.811 INFO:teuthology.orchestra.run.smithi088.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:54.826 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/226 2023-05-17T14:06:54.826 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/226 2023-05-17T14:06:54.826 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:54.832 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:54.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:54.862 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-05-17T14:06:55.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:06:55.186 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:06:55.503 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:55.520 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:55.521 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:56.040 INFO:teuthology.orchestra.run.smithi088.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:56.054 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/227 2023-05-17T14:06:56.054 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/227 2023-05-17T14:06:56.054 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:56.061 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:56.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:56.095 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-05-17T14:06:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:56.708 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:57.756 INFO:teuthology.orchestra.run.smithi088.stdout:generic/228 1s 2023-05-17T14:06:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/228 2023-05-17T14:06:57.775 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:57.783 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:57.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:57.816 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-05-17T14:06:58.699 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:58.716 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:58.716 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:59.153 INFO:teuthology.orchestra.run.smithi088.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:06:59.164 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/229 2023-05-17T14:06:59.165 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/229 2023-05-17T14:06:59.165 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:06:59.173 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:06:59.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:06:59.203 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-05-17T14:06:59.812 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:06:59.833 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:06:59.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:00.239 INFO:teuthology.orchestra.run.smithi088.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:07:00.252 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/230 2023-05-17T14:07:00.252 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/230 2023-05-17T14:07:00.253 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:07:00.260 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:00.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:07:00.292 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-05-17T14:07:00.889 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:07:00.909 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:07:00.909 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:01.312 INFO:teuthology.orchestra.run.smithi088.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:07:01.325 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/231 2023-05-17T14:07:01.325 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/231 2023-05-17T14:07:01.325 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:07:01.333 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:01.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:07:01.362 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-05-17T14:07:01.969 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:07:01.983 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:07:01.984 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:02.394 INFO:teuthology.orchestra.run.smithi088.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:07:02.406 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/232 2023-05-17T14:07:02.406 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/232 2023-05-17T14:07:02.406 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:07:02.414 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:02.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:07:02.443 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-05-17T14:07:03.020 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:07:03.036 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:07:03.037 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:03.460 INFO:teuthology.orchestra.run.smithi088.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:07:03.472 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/233 2023-05-17T14:07:03.472 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/233 2023-05-17T14:07:03.472 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:07:03.478 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:03.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:07:03.508 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-05-17T14:07:04.105 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:07:04.121 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:07:04.121 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:04.567 INFO:teuthology.orchestra.run.smithi088.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:07:04.578 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/234 2023-05-17T14:07:04.578 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/234 2023-05-17T14:07:04.578 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:07:04.586 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:04.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:07:04.621 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-05-17T14:07:05.209 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:07:05.227 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:07:05.227 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:05.679 INFO:teuthology.orchestra.run.smithi088.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:07:05.692 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/235 2023-05-17T14:07:05.692 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/235 2023-05-17T14:07:05.692 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:07:05.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:05.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:07:05.734 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-05-17T14:07:06.356 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:07:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:07:06.373 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:07.998 INFO:teuthology.orchestra.run.smithi088.stdout:generic/236 1s 2023-05-17T14:07:08.015 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/236 2023-05-17T14:07:08.015 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:07:08.024 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:08.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:07:08.092 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-05-17T14:07:08.939 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:07:08.956 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:07:08.956 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:09.500 INFO:teuthology.orchestra.run.smithi088.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-17T14:07:09.514 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/237 2023-05-17T14:07:09.514 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/237 2023-05-17T14:07:09.515 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:07:09.523 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:09.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:07:09.555 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-05-17T14:07:10.164 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:07:10.183 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:07:10.184 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:10.595 INFO:teuthology.orchestra.run.smithi088.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:07:10.610 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/238 2023-05-17T14:07:10.610 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/238 2023-05-17T14:07:10.610 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:07:10.620 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:10.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:07:10.649 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-05-17T14:07:11.262 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:07:11.276 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:07:11.277 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:07:26.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:07:26.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:07:57.128 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:07:57.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:08:27.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:08:27.809 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:08:58.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:08:58.041 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:09:29.270 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:09:29.278 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:09:34.414 INFO:teuthology.orchestra.run.smithi088.stdout:generic/239 143s 2023-05-17T14:09:34.430 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/239 2023-05-17T14:09:34.431 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:09:34.439 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:09:34.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:09:34.468 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-05-17T14:09:35.322 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:09:35.341 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:09:35.341 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:09:39.253 INFO:teuthology.orchestra.run.smithi088.stdout:generic/240 4s 2023-05-17T14:09:39.273 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/240 2023-05-17T14:09:39.273 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:09:39.280 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:09:39.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:09:39.313 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-05-17T14:09:40.143 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:09:40.164 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:09:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:09:59.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:09:59.593 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:10:29.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:10:29.748 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:10:54.729 INFO:teuthology.orchestra.run.smithi088.stdout:generic/241 74s 2023-05-17T14:10:54.759 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/241 2023-05-17T14:10:54.759 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:10:54.765 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:10:54.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:10:54.804 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-05-17T14:10:55.732 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:10:55.750 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:10:55.750 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:10:56.204 INFO:teuthology.orchestra.run.smithi088.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:10:56.219 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/242 2023-05-17T14:10:56.219 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/242 2023-05-17T14:10:56.219 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:10:56.228 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:10:56.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:10:56.259 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-05-17T14:10:56.897 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:10:56.919 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:10:56.920 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:10:57.340 INFO:teuthology.orchestra.run.smithi088.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:10:57.352 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/243 2023-05-17T14:10:57.353 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/243 2023-05-17T14:10:57.353 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:10:57.361 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:10:57.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:10:57.395 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-05-17T14:10:57.990 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:10:58.007 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:10:58.007 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:10:58.432 INFO:teuthology.orchestra.run.smithi088.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-17T14:10:58.444 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/244 2023-05-17T14:10:58.445 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/244 2023-05-17T14:10:58.445 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:10:58.452 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:10:58.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:10:58.482 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-05-17T14:10:59.150 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:10:59.171 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:10:59.171 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:10:59.966 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:10:59.972 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:11:00.628 INFO:teuthology.orchestra.run.smithi088.stdout:generic/245 1s 2023-05-17T14:11:00.694 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/245 2023-05-17T14:11:00.694 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:11:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:11:00.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:11:00.739 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-05-17T14:11:01.624 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:11:01.640 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:11:01.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:11:02.206 INFO:teuthology.orchestra.run.smithi088.stdout:generic/246 1s 2023-05-17T14:11:02.230 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/246 2023-05-17T14:11:02.230 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:11:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:11:02.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:11:02.279 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-05-17T14:11:03.340 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:11:03.356 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:11:03.356 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:11:30.799 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:11:30.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:11:55.581 INFO:teuthology.orchestra.run.smithi088.stdout:generic/247 52s 2023-05-17T14:11:55.605 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/247 2023-05-17T14:11:55.605 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:11:55.610 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:11:55.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:11:55.639 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-05-17T14:11:56.359 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:11:56.374 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:11:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:11:57.064 INFO:teuthology.orchestra.run.smithi088.stdout:generic/248 0s 2023-05-17T14:11:57.220 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/248 2023-05-17T14:11:57.220 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:11:57.230 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:11:57.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:11:57.260 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-05-17T14:11:57.889 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:11:57.909 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:11:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:01.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:12:01.633 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:12:02.276 INFO:teuthology.orchestra.run.smithi088.stdout:generic/249 5s 2023-05-17T14:12:02.294 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/249 2023-05-17T14:12:02.294 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:02.301 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:02.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:02.334 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-05-17T14:12:03.270 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:03.291 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:03.291 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:06.274 INFO:teuthology.orchestra.run.smithi088.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:06.288 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/250 2023-05-17T14:12:06.289 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/250 2023-05-17T14:12:06.289 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:06.297 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:06.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:06.335 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-05-17T14:12:06.979 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:06.997 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:06.998 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:07.496 INFO:teuthology.orchestra.run.smithi088.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:07.508 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/251 2023-05-17T14:12:07.508 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/251 2023-05-17T14:12:07.509 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:07.519 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:07.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:07.552 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-05-17T14:12:08.191 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:08.215 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:08.216 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:08.704 INFO:teuthology.orchestra.run.smithi088.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:08.715 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/252 2023-05-17T14:12:08.716 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/252 2023-05-17T14:12:08.716 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:08.725 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:08.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:08.758 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-05-17T14:12:09.371 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:09.389 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:09.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:09.833 INFO:teuthology.orchestra.run.smithi088.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:09.846 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/253 2023-05-17T14:12:09.847 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/253 2023-05-17T14:12:09.847 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:09.856 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:09.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:09.889 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-05-17T14:12:10.528 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:10.542 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:10.543 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:10.949 INFO:teuthology.orchestra.run.smithi088.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:10.964 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/254 2023-05-17T14:12:10.964 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/254 2023-05-17T14:12:10.964 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:11.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:11.006 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-05-17T14:12:11.625 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:11.641 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:11.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:14.481 INFO:teuthology.orchestra.run.smithi088.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T14:12:14.492 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/255 2023-05-17T14:12:14.493 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/255 2023-05-17T14:12:14.493 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:14.506 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:14.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:14.537 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-05-17T14:12:15.452 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:15.472 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:15.473 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:18.298 INFO:teuthology.orchestra.run.smithi088.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:18.311 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/256 2023-05-17T14:12:18.311 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/256 2023-05-17T14:12:18.312 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:18.324 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:18.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:18.360 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-05-17T14:12:18.967 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:18.985 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:18.985 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:21.743 INFO:teuthology.orchestra.run.smithi088.stdout:generic/257 2s 2023-05-17T14:12:21.759 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/257 2023-05-17T14:12:21.760 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:21.768 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:21.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:21.830 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-05-17T14:12:22.709 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:22.726 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:22.726 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:23.270 INFO:teuthology.orchestra.run.smithi088.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/258.out.bad) 2023-05-17T14:12:23.280 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/258.out 2023-05-17 12:27:04.834538025 +0000 2023-05-17T14:12:23.281 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/258.out.bad 2023-05-17 14:12:23.259146303 +0000 2023-05-17T14:12:23.281 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,5 +1,6 @@ 2023-05-17T14:12:23.281 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 258 2023-05-17T14:12:23.282 INFO:teuthology.orchestra.run.smithi088.stdout: Creating file with timestamp of Jan 1, 1960 2023-05-17T14:12:23.282 INFO:teuthology.orchestra.run.smithi088.stdout: Testing for negative seconds since epoch 2023-05-17T14:12:23.282 INFO:teuthology.orchestra.run.smithi088.stdout: -Remounting to flush cache 2023-05-17T14:12:23.282 INFO:teuthology.orchestra.run.smithi088.stdout: -Testing for negative seconds since epoch 2023-05-17T14:12:23.283 INFO:teuthology.orchestra.run.smithi088.stdout: +Timestamp wrapped: 3979351756 2023-05-17T14:12:23.283 INFO:teuthology.orchestra.run.smithi088.stdout: +Timestamp wrapped 2023-05-17T14:12:23.283 INFO:teuthology.orchestra.run.smithi088.stdout: +(see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/258.full for details) 2023-05-17T14:12:23.287 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/258 2023-05-17T14:12:23.287 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/258 2023-05-17T14:12:23.287 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:12:23.296 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:23.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:12:23.320 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:12:23.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:12:23.321 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-05-17T14:12:23.988 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:24.043 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:24.043 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:24.943 INFO:teuthology.orchestra.run.smithi088.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:24.958 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/259 2023-05-17T14:12:24.958 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/259 2023-05-17T14:12:24.958 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:24.963 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:24.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:24.990 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-05-17T14:12:25.596 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:25.609 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:26.079 INFO:teuthology.orchestra.run.smithi088.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:26.090 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/260 2023-05-17T14:12:26.091 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/260 2023-05-17T14:12:26.091 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:26.100 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:26.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:26.138 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-05-17T14:12:26.741 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:26.758 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:26.758 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:27.166 INFO:teuthology.orchestra.run.smithi088.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:27.177 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/261 2023-05-17T14:12:27.177 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/261 2023-05-17T14:12:27.177 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:27.185 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:27.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:27.215 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-05-17T14:12:27.846 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:27.864 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:27.865 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:28.259 INFO:teuthology.orchestra.run.smithi088.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:12:28.269 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/262 2023-05-17T14:12:28.270 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/262 2023-05-17T14:12:28.270 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:12:28.282 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:28.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:12:28.317 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-05-17T14:12:28.923 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:12:28.945 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:12:28.946 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:12:31.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:12:31.798 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:12:32.026 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T14:12:32.021+0000 7fcc4c1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 346193) UID: 0 2023-05-17T14:12:32.026 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T14:12:32.022+0000 7f36767f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 346193) UID: 0 2023-05-17T14:13:32.849 INFO:teuthology.orchestra.run.smithi088.stdout:generic/263 64s 2023-05-17T14:13:32.861 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/263 2023-05-17T14:13:32.862 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:32.868 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:32.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:32.951 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-05-17T14:13:33.657 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:33.668 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:33.669 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:34.023 INFO:teuthology.orchestra.run.smithi088.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:34.030 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/264 2023-05-17T14:13:34.031 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/264 2023-05-17T14:13:34.031 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:34.036 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:34.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:34.056 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-05-17T14:13:34.450 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:34.461 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:34.462 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:35.124 INFO:teuthology.orchestra.run.smithi088.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:35.133 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/265 2023-05-17T14:13:35.133 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/265 2023-05-17T14:13:35.133 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:35.138 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:35.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:35.159 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-05-17T14:13:35.565 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:35.577 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:35.577 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:36.003 INFO:teuthology.orchestra.run.smithi088.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:36.011 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/266 2023-05-17T14:13:36.011 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/266 2023-05-17T14:13:36.011 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:36.016 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:36.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:36.037 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-05-17T14:13:36.470 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:36.481 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:36.482 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:36.862 INFO:teuthology.orchestra.run.smithi088.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:36.870 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/267 2023-05-17T14:13:36.870 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/267 2023-05-17T14:13:36.871 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:36.876 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:36.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:36.897 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-05-17T14:13:37.292 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:37.303 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:37.303 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/268 2023-05-17T14:13:37.665 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/268 2023-05-17T14:13:37.665 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:37.670 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:37.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:37.690 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-05-17T14:13:38.090 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:38.103 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:38.103 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:38.425 INFO:teuthology.orchestra.run.smithi088.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:38.433 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/269 2023-05-17T14:13:38.433 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/269 2023-05-17T14:13:38.434 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:38.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:38.460 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-05-17T14:13:38.889 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:38.900 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:38.900 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:39.204 INFO:teuthology.orchestra.run.smithi088.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-17T14:13:39.212 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/270 2023-05-17T14:13:39.213 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/270 2023-05-17T14:13:39.213 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:39.218 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:39.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:39.240 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-05-17T14:13:39.641 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:39.652 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:39.653 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:39.970 INFO:teuthology.orchestra.run.smithi088.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:39.978 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/271 2023-05-17T14:13:39.978 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/271 2023-05-17T14:13:39.978 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:39.983 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:40.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:40.004 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-05-17T14:13:40.396 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:40.407 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:40.407 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:40.746 INFO:teuthology.orchestra.run.smithi088.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:40.754 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/272 2023-05-17T14:13:40.755 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/272 2023-05-17T14:13:40.755 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:40.780 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:40.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:40.801 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-05-17T14:13:41.192 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:41.205 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:41.205 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:41.493 INFO:teuthology.orchestra.run.smithi088.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:41.501 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/273 2023-05-17T14:13:41.502 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/273 2023-05-17T14:13:41.502 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:41.507 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:41.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:41.529 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-05-17T14:13:41.945 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:41.956 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:41.956 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:42.384 INFO:teuthology.orchestra.run.smithi088.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:42.393 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/274 2023-05-17T14:13:42.393 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/274 2023-05-17T14:13:42.393 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:42.399 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:42.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:42.421 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-05-17T14:13:42.811 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:42.822 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:43.121 INFO:teuthology.orchestra.run.smithi088.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:43.129 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/275 2023-05-17T14:13:43.129 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/275 2023-05-17T14:13:43.130 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:43.135 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:43.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:43.157 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-05-17T14:13:43.556 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:43.569 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:43.569 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:44.102 INFO:teuthology.orchestra.run.smithi088.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:44.111 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/276 2023-05-17T14:13:44.111 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/276 2023-05-17T14:13:44.111 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:44.117 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:44.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:44.139 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-05-17T14:13:44.548 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:44.559 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:44.560 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:44.896 INFO:teuthology.orchestra.run.smithi088.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:44.904 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/277 2023-05-17T14:13:44.904 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/277 2023-05-17T14:13:44.904 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:44.909 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:44.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:44.930 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-05-17T14:13:45.322 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:45.334 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:45.334 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:45.724 INFO:teuthology.orchestra.run.smithi088.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:45.732 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/278 2023-05-17T14:13:45.733 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/278 2023-05-17T14:13:45.733 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:45.738 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:45.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:45.758 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-05-17T14:13:46.148 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:46.159 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:46.159 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:46.484 INFO:teuthology.orchestra.run.smithi088.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/279 2023-05-17T14:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/279 2023-05-17T14:13:46.492 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:46.497 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:46.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:46.517 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-05-17T14:13:46.917 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:46.928 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:46.929 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:47.251 INFO:teuthology.orchestra.run.smithi088.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:47.260 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/280 2023-05-17T14:13:47.260 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/280 2023-05-17T14:13:47.260 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:47.265 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:47.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:47.286 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-05-17T14:13:47.684 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:47.695 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:47.696 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:48.029 INFO:teuthology.orchestra.run.smithi088.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:48.037 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/281 2023-05-17T14:13:48.038 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/281 2023-05-17T14:13:48.038 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:48.043 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:48.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:48.063 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-05-17T14:13:48.459 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:48.470 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:48.471 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:48.873 INFO:teuthology.orchestra.run.smithi088.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:48.882 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/282 2023-05-17T14:13:48.882 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/282 2023-05-17T14:13:48.882 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:48.888 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:48.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:48.909 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-05-17T14:13:49.305 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:49.317 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:49.317 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:49.640 INFO:teuthology.orchestra.run.smithi088.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:49.648 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/283 2023-05-17T14:13:49.649 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/283 2023-05-17T14:13:49.649 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:49.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:49.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:49.675 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-05-17T14:13:50.074 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:50.085 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:50.085 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:50.385 INFO:teuthology.orchestra.run.smithi088.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:13:50.393 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/284 2023-05-17T14:13:50.393 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/284 2023-05-17T14:13:50.393 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:50.437 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:50.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:50.457 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-05-17T14:13:50.859 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:50.870 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:50.870 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:53.509 INFO:teuthology.orchestra.run.smithi088.stdout:generic/285 3s 2023-05-17T14:13:53.521 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/285 2023-05-17T14:13:53.521 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:13:53.526 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:13:53.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:13:53.550 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-05-17T14:13:54.344 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:13:54.356 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:13:54.356 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:50.058 INFO:teuthology.orchestra.run.smithi088.stdout:generic/286 56s 2023-05-17T14:14:50.079 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/286 2023-05-17T14:14:50.080 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:50.085 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:50.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:50.107 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-05-17T14:14:51.100 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:51.111 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:51.111 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:51.403 INFO:teuthology.orchestra.run.smithi088.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:51.412 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/287 2023-05-17T14:14:51.412 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/287 2023-05-17T14:14:51.412 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:51.417 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:51.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:51.438 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-05-17T14:14:51.839 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:51.850 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:51.850 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:52.124 INFO:teuthology.orchestra.run.smithi088.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:52.132 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/288 2023-05-17T14:14:52.133 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/288 2023-05-17T14:14:52.133 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:52.138 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:52.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:52.159 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-05-17T14:14:52.545 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:52.556 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:52.556 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:52.844 INFO:teuthology.orchestra.run.smithi088.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:52.852 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/289 2023-05-17T14:14:52.852 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/289 2023-05-17T14:14:52.852 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:52.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:52.877 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-05-17T14:14:53.264 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:53.274 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:53.274 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:53.555 INFO:teuthology.orchestra.run.smithi088.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:53.563 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/290 2023-05-17T14:14:53.563 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/290 2023-05-17T14:14:53.564 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:53.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:53.588 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-05-17T14:14:53.981 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:53.993 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:53.993 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:54.277 INFO:teuthology.orchestra.run.smithi088.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:54.287 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/291 2023-05-17T14:14:54.287 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/291 2023-05-17T14:14:54.287 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:54.294 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:54.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:54.314 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-05-17T14:14:54.737 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:54.748 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:54.748 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:55.053 INFO:teuthology.orchestra.run.smithi088.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:55.061 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/292 2023-05-17T14:14:55.061 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/292 2023-05-17T14:14:55.061 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:55.067 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:55.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:55.091 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-05-17T14:14:55.535 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:55.548 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:55.548 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:55.859 INFO:teuthology.orchestra.run.smithi088.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:55.869 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/293 2023-05-17T14:14:55.869 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/293 2023-05-17T14:14:55.869 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:55.875 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:55.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:55.897 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-05-17T14:14:56.301 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:56.312 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:56.313 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/294 2023-05-17T14:14:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/294 2023-05-17T14:14:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:56.610 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:56.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:56.632 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-05-17T14:14:57.021 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:57.032 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:57.033 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:57.313 INFO:teuthology.orchestra.run.smithi088.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:57.321 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/295 2023-05-17T14:14:57.321 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/295 2023-05-17T14:14:57.321 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:57.326 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:57.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:57.346 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-05-17T14:14:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:57.745 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:57.745 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:58.022 INFO:teuthology.orchestra.run.smithi088.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:58.031 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/296 2023-05-17T14:14:58.031 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/296 2023-05-17T14:14:58.031 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:58.036 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:58.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:58.057 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-05-17T14:14:58.443 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:58.454 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:58.454 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:58.740 INFO:teuthology.orchestra.run.smithi088.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:58.749 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/297 2023-05-17T14:14:58.749 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/297 2023-05-17T14:14:58.749 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:58.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:58.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:58.773 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-05-17T14:14:59.165 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:59.176 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:59.176 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:59.455 INFO:teuthology.orchestra.run.smithi088.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:14:59.463 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/298 2023-05-17T14:14:59.463 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/298 2023-05-17T14:14:59.463 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:14:59.468 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:14:59.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:14:59.490 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-05-17T14:14:59.880 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:14:59.891 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:14:59.892 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:00.186 INFO:teuthology.orchestra.run.smithi088.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:15:00.194 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/299 2023-05-17T14:15:00.195 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/299 2023-05-17T14:15:00.195 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:00.200 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:00.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:00.220 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-05-17T14:15:00.612 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:00.623 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:00.624 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:00.896 INFO:teuthology.orchestra.run.smithi088.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:15:00.905 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/300 2023-05-17T14:15:00.905 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/300 2023-05-17T14:15:00.905 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:00.910 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:00.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:00.931 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-05-17T14:15:01.319 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:01.330 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:01.331 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:01.609 INFO:teuthology.orchestra.run.smithi088.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:15:01.617 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/301 2023-05-17T14:15:01.618 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/301 2023-05-17T14:15:01.618 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:01.623 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:01.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:01.644 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-05-17T14:15:02.032 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:02.044 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:02.044 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:02.319 INFO:teuthology.orchestra.run.smithi088.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:15:02.327 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/302 2023-05-17T14:15:02.328 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/302 2023-05-17T14:15:02.328 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:02.333 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:02.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:02.353 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-05-17T14:15:02.743 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:02.755 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:02.755 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:03.118 INFO:teuthology.orchestra.run.smithi088.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:15:03.126 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/303 2023-05-17T14:15:03.126 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/303 2023-05-17T14:15:03.126 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:03.131 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:03.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:03.188 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-05-17T14:15:03.856 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:03.867 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:04.247 INFO:teuthology.orchestra.run.smithi088.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-17T14:15:04.255 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/304 2023-05-17T14:15:04.256 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/304 2023-05-17T14:15:04.256 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:04.261 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:04.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:04.280 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-05-17T14:15:04.985 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:04.999 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:05.000 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:05.288 INFO:teuthology.orchestra.run.smithi088.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:15:05.297 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/305 2023-05-17T14:15:05.297 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/305 2023-05-17T14:15:05.297 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:05.302 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:05.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:05.323 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-05-17T14:15:05.709 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:05.721 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:05.721 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:06.005 INFO:teuthology.orchestra.run.smithi088.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:15:06.013 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/306 2023-05-17T14:15:06.013 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/306 2023-05-17T14:15:06.014 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:06.019 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:06.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:06.039 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-05-17T14:15:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:06.444 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:06.445 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:06.726 INFO:teuthology.orchestra.run.smithi088.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:15:06.735 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/307 2023-05-17T14:15:06.735 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/307 2023-05-17T14:15:06.735 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:06.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:06.760 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-05-17T14:15:07.147 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:07.158 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:07.159 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:07.500 INFO:teuthology.orchestra.run.smithi088.stdout:generic/308 0s 2023-05-17T14:15:07.511 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/308 2023-05-17T14:15:07.512 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:07.517 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:07.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:07.536 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-05-17T14:15:07.924 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:07.935 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:07.936 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:09.313 INFO:teuthology.orchestra.run.smithi088.stdout:generic/309 2s 2023-05-17T14:15:09.325 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/309 2023-05-17T14:15:09.325 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:15:09.331 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:09.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:15:09.380 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-05-17T14:15:10.066 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:15:10.077 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:15:10.078 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:15:26.246 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:15:26.252 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:15:56.452 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:15:56.457 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:16:26.573 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:16:26.577 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:16:40.113 INFO:teuthology.orchestra.run.smithi088.stdout:generic/310 90s 2023-05-17T14:16:40.124 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/310 2023-05-17T14:16:40.125 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:40.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:40.172 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-05-17T14:16:41.103 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:41.150 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:41.591 INFO:teuthology.orchestra.run.smithi088.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:16:41.599 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/311 2023-05-17T14:16:41.599 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/311 2023-05-17T14:16:41.599 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:41.605 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:41.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:41.625 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-05-17T14:16:42.009 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:42.021 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:42.021 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:42.342 INFO:teuthology.orchestra.run.smithi088.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:16:42.350 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/312 2023-05-17T14:16:42.350 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/312 2023-05-17T14:16:42.350 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:42.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:42.374 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-05-17T14:16:42.771 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:42.782 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:42.782 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:47.207 INFO:teuthology.orchestra.run.smithi088.stdout:generic/313 5s 2023-05-17T14:16:47.221 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/313 2023-05-17T14:16:47.221 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:47.226 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:47.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:47.247 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-05-17T14:16:47.647 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:47.658 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:47.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:48.516 INFO:teuthology.orchestra.run.smithi088.stdout:generic/314 1s 2023-05-17T14:16:48.528 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/314 2023-05-17T14:16:48.528 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:48.533 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:48.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:48.554 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-05-17T14:16:48.946 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:48.957 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:53.016 INFO:teuthology.orchestra.run.smithi088.stdout:generic/315 5s 2023-05-17T14:16:53.027 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/315 2023-05-17T14:16:53.028 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:53.033 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:53.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:53.066 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-05-17T14:16:53.778 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:53.789 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:53.789 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:55.394 INFO:teuthology.orchestra.run.smithi088.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T14:16:55.403 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/316 2023-05-17T14:16:55.403 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/316 2023-05-17T14:16:55.403 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:55.408 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:55.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:55.433 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-05-17T14:16:56.132 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:56.143 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:56.143 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:56.420 INFO:teuthology.orchestra.run.smithi088.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:16:56.428 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/317 2023-05-17T14:16:56.428 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/317 2023-05-17T14:16:56.428 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:56.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:56.454 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-05-17T14:16:56.849 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:56.860 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:56.861 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:57.141 INFO:teuthology.orchestra.run.smithi088.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:16:57.149 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/318 2023-05-17T14:16:57.149 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/318 2023-05-17T14:16:57.149 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:57.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:57.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:57.173 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-05-17T14:16:57.564 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:57.575 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:57.575 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:57.891 INFO:teuthology.orchestra.run.smithi088.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-17T14:16:57.899 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/319 2023-05-17T14:16:57.899 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/319 2023-05-17T14:16:57.899 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:57.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:57.924 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-05-17T14:16:58.314 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:58.325 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:58.325 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:58.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:16:58.559 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:16:58.607 INFO:teuthology.orchestra.run.smithi088.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:16:58.617 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/320 2023-05-17T14:16:58.617 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/320 2023-05-17T14:16:58.617 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:58.623 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:58.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:58.644 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-05-17T14:16:58.742 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T14:16:58.738+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117433) UID: 0 2023-05-17T14:16:58.743 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T14:16:58.738+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117433) UID: 0 2023-05-17T14:16:58.743 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T14:16:58.738+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117433) UID: 0 2023-05-17T14:16:58.743 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T14:16:58.738+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117433) UID: 0 2023-05-17T14:16:59.030 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:59.041 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:59.041 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:59.346 INFO:teuthology.orchestra.run.smithi088.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:16:59.354 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/321 2023-05-17T14:16:59.355 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/321 2023-05-17T14:16:59.355 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:16:59.360 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:16:59.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:16:59.380 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-05-17T14:16:59.772 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:16:59.783 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:16:59.783 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:17:00.094 INFO:teuthology.orchestra.run.smithi088.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:17:00.102 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/322 2023-05-17T14:17:00.103 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/322 2023-05-17T14:17:00.103 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:17:00.108 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:17:00.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:17:00.127 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-05-17T14:17:00.515 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:17:00.526 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:17:00.526 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:01.728 INFO:teuthology.orchestra.run.smithi088.stdout:generic/323 121s 2023-05-17T14:19:01.740 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/323 2023-05-17T14:19:01.740 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:01.745 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:01.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:01.790 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-05-17T14:19:02.477 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:02.488 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:02.488 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:02.783 INFO:teuthology.orchestra.run.smithi088.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:02.791 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/324 2023-05-17T14:19:02.791 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/324 2023-05-17T14:19:02.792 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:02.797 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:02.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:02.817 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-05-17T14:19:03.208 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:03.219 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:03.220 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:03.518 INFO:teuthology.orchestra.run.smithi088.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:03.526 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/325 2023-05-17T14:19:03.527 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/325 2023-05-17T14:19:03.527 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:03.532 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:03.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:03.551 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-05-17T14:19:03.945 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:03.956 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:03.956 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:04.237 INFO:teuthology.orchestra.run.smithi088.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:04.245 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/326 2023-05-17T14:19:04.245 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/326 2023-05-17T14:19:04.245 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:04.250 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:04.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:04.269 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-05-17T14:19:04.664 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:04.675 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:04.675 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:04.960 INFO:teuthology.orchestra.run.smithi088.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:04.968 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/327 2023-05-17T14:19:04.968 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/327 2023-05-17T14:19:04.968 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:04.973 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:04.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:04.993 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-05-17T14:19:05.387 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:05.398 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:05.398 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:05.682 INFO:teuthology.orchestra.run.smithi088.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:05.691 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/328 2023-05-17T14:19:05.691 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/328 2023-05-17T14:19:05.691 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:05.697 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:05.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:05.716 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-05-17T14:19:06.104 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:06.115 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:06.116 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:06.425 INFO:teuthology.orchestra.run.smithi088.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/329 2023-05-17T14:19:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/329 2023-05-17T14:19:06.433 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:06.438 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:06.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:06.457 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-05-17T14:19:06.848 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:06.859 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:06.859 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:07.138 INFO:teuthology.orchestra.run.smithi088.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:07.147 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/330 2023-05-17T14:19:07.147 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/330 2023-05-17T14:19:07.147 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:07.152 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:07.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:07.172 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-05-17T14:19:07.556 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:07.567 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:07.567 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:07.875 INFO:teuthology.orchestra.run.smithi088.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:07.884 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/331 2023-05-17T14:19:07.884 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/331 2023-05-17T14:19:07.885 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:07.890 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:07.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:07.910 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-05-17T14:19:08.294 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:08.306 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:08.306 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:08.604 INFO:teuthology.orchestra.run.smithi088.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:08.612 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/332 2023-05-17T14:19:08.612 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/332 2023-05-17T14:19:08.612 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:08.617 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:08.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:08.636 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-05-17T14:19:09.030 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:09.041 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:09.041 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:09.319 INFO:teuthology.orchestra.run.smithi088.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:09.327 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/333 2023-05-17T14:19:09.327 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/333 2023-05-17T14:19:09.328 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:09.333 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:09.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:09.351 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-05-17T14:19:09.743 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:09.755 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:09.755 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:10.034 INFO:teuthology.orchestra.run.smithi088.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:10.042 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/334 2023-05-17T14:19:10.042 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/334 2023-05-17T14:19:10.042 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:10.047 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:10.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:10.066 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-05-17T14:19:10.459 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:10.471 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:10.471 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:10.775 INFO:teuthology.orchestra.run.smithi088.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:10.783 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/335 2023-05-17T14:19:10.784 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/335 2023-05-17T14:19:10.784 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:10.789 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:10.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:10.808 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-05-17T14:19:11.196 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:11.207 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:11.207 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:11.512 INFO:teuthology.orchestra.run.smithi088.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:11.520 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/336 2023-05-17T14:19:11.520 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/336 2023-05-17T14:19:11.521 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:11.526 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:11.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:11.545 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-05-17T14:19:11.932 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:11.943 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:11.944 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:12.222 INFO:teuthology.orchestra.run.smithi088.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:12.230 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/337 2023-05-17T14:19:12.230 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/337 2023-05-17T14:19:12.230 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:12.235 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:12.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:12.254 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-05-17T14:19:12.647 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:12.658 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:12.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:12.968 INFO:teuthology.orchestra.run.smithi088.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:12.977 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/338 2023-05-17T14:19:12.977 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/338 2023-05-17T14:19:12.977 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:12.982 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:13.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:13.002 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-05-17T14:19:13.387 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:13.398 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:13.687 INFO:teuthology.orchestra.run.smithi088.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/339 2023-05-17T14:19:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/339 2023-05-17T14:19:13.695 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:13.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:13.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:13.719 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-05-17T14:19:14.107 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:14.118 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:14.119 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:14.401 INFO:teuthology.orchestra.run.smithi088.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:14.409 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/340 2023-05-17T14:19:14.409 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/340 2023-05-17T14:19:14.409 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:14.414 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:14.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:14.433 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-05-17T14:19:14.821 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:14.833 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:14.833 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:15.144 INFO:teuthology.orchestra.run.smithi088.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:15.152 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/341 2023-05-17T14:19:15.153 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/341 2023-05-17T14:19:15.153 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:15.158 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:15.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:15.177 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-05-17T14:19:15.567 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:15.579 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:15.579 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:15.882 INFO:teuthology.orchestra.run.smithi088.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:15.891 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/342 2023-05-17T14:19:15.891 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/342 2023-05-17T14:19:15.891 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:15.896 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:15.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:15.916 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-05-17T14:19:16.306 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:16.318 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:16.318 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:16.625 INFO:teuthology.orchestra.run.smithi088.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:16.633 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/343 2023-05-17T14:19:16.633 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/343 2023-05-17T14:19:16.633 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:16.638 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:16.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:16.658 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-05-17T14:19:17.043 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:17.054 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:17.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:17.330 INFO:teuthology.orchestra.run.smithi088.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:17.339 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/344 2023-05-17T14:19:17.339 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/344 2023-05-17T14:19:17.339 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:17.344 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:17.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:17.364 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-05-17T14:19:17.748 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:17.760 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:17.760 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:18.033 INFO:teuthology.orchestra.run.smithi088.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:18.041 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/345 2023-05-17T14:19:18.042 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/345 2023-05-17T14:19:18.042 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:18.047 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:18.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:18.066 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-05-17T14:19:18.459 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:18.470 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:19.844 INFO:teuthology.orchestra.run.smithi088.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:19.854 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/346 2023-05-17T14:19:19.854 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/346 2023-05-17T14:19:19.854 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:19.860 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:19.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:19.882 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-05-17T14:19:20.284 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:20.296 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:20.296 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:20.651 INFO:teuthology.orchestra.run.smithi088.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:20.660 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/347 2023-05-17T14:19:20.660 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/347 2023-05-17T14:19:20.660 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:20.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:20.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:20.684 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-05-17T14:19:21.077 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:21.088 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:21.089 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:21.397 INFO:teuthology.orchestra.run.smithi088.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:21.405 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/348 2023-05-17T14:19:21.405 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/348 2023-05-17T14:19:21.405 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:21.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:21.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:21.430 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-05-17T14:19:21.817 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:21.828 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:21.829 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:23.461 INFO:teuthology.orchestra.run.smithi088.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-17T14:19:23.469 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/349 2023-05-17T14:19:23.469 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/349 2023-05-17T14:19:23.469 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:23.474 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:23.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:23.494 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-05-17T14:19:23.891 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:23.902 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:23.902 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:26.161 INFO:teuthology.orchestra.run.smithi088.stdout:generic/350 3s 2023-05-17T14:19:26.173 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/350 2023-05-17T14:19:26.173 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:26.178 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:26.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:26.196 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-05-17T14:19:26.589 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:26.600 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:26.601 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:28.176 INFO:teuthology.orchestra.run.smithi088.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-17T14:19:28.184 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/351 2023-05-17T14:19:28.184 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/351 2023-05-17T14:19:28.185 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:28.190 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:28.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:28.220 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-05-17T14:19:28.929 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:28.940 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:28.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:29.226 INFO:teuthology.orchestra.run.smithi088.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:29.234 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/352 2023-05-17T14:19:29.234 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/352 2023-05-17T14:19:29.234 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:29.239 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:29.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:29.258 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-05-17T14:19:29.647 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:29.659 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:29.659 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:29.941 INFO:teuthology.orchestra.run.smithi088.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:29.949 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/353 2023-05-17T14:19:29.950 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/353 2023-05-17T14:19:29.950 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:29.955 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:29.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:29.973 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-05-17T14:19:30.368 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:30.379 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:30.379 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:30.657 INFO:teuthology.orchestra.run.smithi088.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:30.665 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/354 2023-05-17T14:19:30.665 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/354 2023-05-17T14:19:30.666 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:30.671 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:30.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:30.690 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-05-17T14:19:31.076 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:31.086 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:31.086 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:31.935 INFO:teuthology.orchestra.run.smithi088.stdout:generic/355 0s 2023-05-17T14:19:31.947 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/355 2023-05-17T14:19:31.947 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:31.953 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:31.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:31.973 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-05-17T14:19:32.702 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:32.713 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:32.713 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:32.993 INFO:teuthology.orchestra.run.smithi088.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:33.001 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/356 2023-05-17T14:19:33.002 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/356 2023-05-17T14:19:33.002 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:33.007 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:33.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:33.026 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-05-17T14:19:33.420 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:33.432 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:33.432 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:33.713 INFO:teuthology.orchestra.run.smithi088.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:33.721 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/357 2023-05-17T14:19:33.721 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/357 2023-05-17T14:19:33.722 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:33.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:33.746 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-05-17T14:19:34.136 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:34.147 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:34.427 INFO:teuthology.orchestra.run.smithi088.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:34.436 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/358 2023-05-17T14:19:34.436 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/358 2023-05-17T14:19:34.436 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:34.441 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:34.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:34.460 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-05-17T14:19:34.850 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:34.861 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:34.862 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:35.139 INFO:teuthology.orchestra.run.smithi088.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:35.148 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/359 2023-05-17T14:19:35.148 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/359 2023-05-17T14:19:35.148 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:35.154 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:35.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:35.174 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-05-17T14:19:35.564 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:35.576 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:35.576 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:35.965 INFO:teuthology.orchestra.run.smithi088.stdout:generic/360 0s 2023-05-17T14:19:35.976 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/360 2023-05-17T14:19:35.976 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:35.982 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:36.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:36.001 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-05-17T14:19:36.386 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:36.397 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:36.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:36.700 INFO:teuthology.orchestra.run.smithi088.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:36.709 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/361 2023-05-17T14:19:36.709 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/361 2023-05-17T14:19:36.709 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:36.714 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:36.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:36.733 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-05-17T14:19:37.125 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:37.137 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:37.137 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:37.420 INFO:teuthology.orchestra.run.smithi088.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:37.428 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/362 2023-05-17T14:19:37.428 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/362 2023-05-17T14:19:37.428 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:37.434 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:37.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:37.453 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-05-17T14:19:37.842 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:37.853 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:37.854 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:38.129 INFO:teuthology.orchestra.run.smithi088.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:38.137 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/363 2023-05-17T14:19:38.137 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/363 2023-05-17T14:19:38.137 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:38.142 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:38.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:38.162 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-05-17T14:19:38.548 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:38.559 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:38.560 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:38.837 INFO:teuthology.orchestra.run.smithi088.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:38.845 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/364 2023-05-17T14:19:38.845 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/364 2023-05-17T14:19:38.845 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:38.851 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:38.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:38.870 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-05-17T14:19:39.260 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:39.272 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:39.272 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:39.546 INFO:teuthology.orchestra.run.smithi088.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:39.555 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/365 2023-05-17T14:19:39.555 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/365 2023-05-17T14:19:39.555 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:39.560 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:39.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:39.579 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-05-17T14:19:39.973 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:39.985 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:39.985 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:40.260 INFO:teuthology.orchestra.run.smithi088.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:40.269 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/366 2023-05-17T14:19:40.269 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/366 2023-05-17T14:19:40.269 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:40.274 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:40.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:40.294 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-05-17T14:19:40.682 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:40.694 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:40.694 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:40.971 INFO:teuthology.orchestra.run.smithi088.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:40.980 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/367 2023-05-17T14:19:40.980 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/367 2023-05-17T14:19:40.980 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:40.985 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:41.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:41.004 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-05-17T14:19:41.395 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:41.406 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:41.406 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:41.687 INFO:teuthology.orchestra.run.smithi088.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:41.695 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/368 2023-05-17T14:19:41.696 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/368 2023-05-17T14:19:41.696 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:41.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:41.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:41.721 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-05-17T14:19:42.118 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:42.130 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:42.130 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:42.410 INFO:teuthology.orchestra.run.smithi088.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:42.418 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/369 2023-05-17T14:19:42.418 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/369 2023-05-17T14:19:42.418 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:42.423 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:42.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:42.443 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-05-17T14:19:42.837 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:42.848 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:43.123 INFO:teuthology.orchestra.run.smithi088.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:43.131 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/370 2023-05-17T14:19:43.132 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/370 2023-05-17T14:19:43.132 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:43.137 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:43.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:43.156 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-05-17T14:19:43.543 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:43.555 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:43.555 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:43.836 INFO:teuthology.orchestra.run.smithi088.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:43.844 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/371 2023-05-17T14:19:43.844 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/371 2023-05-17T14:19:43.845 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:43.850 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:43.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:43.870 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-05-17T14:19:44.257 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:44.268 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:44.268 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:44.551 INFO:teuthology.orchestra.run.smithi088.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:44.559 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/372 2023-05-17T14:19:44.559 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/372 2023-05-17T14:19:44.559 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:44.565 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:44.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:44.585 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-05-17T14:19:44.980 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:44.991 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:44.992 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:45.277 INFO:teuthology.orchestra.run.smithi088.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:45.285 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/373 2023-05-17T14:19:45.285 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/373 2023-05-17T14:19:45.285 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:45.291 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:45.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:45.310 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-05-17T14:19:45.695 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:45.706 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:45.707 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:45.986 INFO:teuthology.orchestra.run.smithi088.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:45.995 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/374 2023-05-17T14:19:45.995 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/374 2023-05-17T14:19:45.995 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:46.000 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:46.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:46.020 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-05-17T14:19:46.408 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:46.419 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:46.419 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:46.758 INFO:teuthology.orchestra.run.smithi088.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-17T14:19:46.766 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/375 2023-05-17T14:19:46.766 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/375 2023-05-17T14:19:46.766 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:46.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:46.790 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-05-17T14:19:47.178 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:47.189 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:47.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:47.493 INFO:teuthology.orchestra.run.smithi088.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:47.502 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/376 2023-05-17T14:19:47.502 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/376 2023-05-17T14:19:47.502 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:47.507 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:47.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:47.527 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-05-17T14:19:47.925 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:47.936 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:47.937 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:48.222 INFO:teuthology.orchestra.run.smithi088.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:48.230 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/377 2023-05-17T14:19:48.230 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/377 2023-05-17T14:19:48.231 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:48.236 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:48.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:48.255 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-05-17T14:19:48.647 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:48.658 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:48.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:49.268 INFO:teuthology.orchestra.run.smithi088.stdout:generic/378 1s 2023-05-17T14:19:49.280 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/378 2023-05-17T14:19:49.280 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:49.285 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:49.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:49.305 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-05-17T14:19:50.042 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:50.054 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:50.054 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:50.367 INFO:teuthology.orchestra.run.smithi088.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:50.376 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/379 2023-05-17T14:19:50.376 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/379 2023-05-17T14:19:50.376 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:50.381 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:50.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:50.401 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-05-17T14:19:50.792 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:50.803 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:50.803 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:51.088 INFO:teuthology.orchestra.run.smithi088.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:51.096 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/380 2023-05-17T14:19:51.096 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/380 2023-05-17T14:19:51.096 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:51.101 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:51.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:51.121 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-05-17T14:19:51.512 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:51.523 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:51.523 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:51.807 INFO:teuthology.orchestra.run.smithi088.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:51.815 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/381 2023-05-17T14:19:51.815 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/381 2023-05-17T14:19:51.816 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:51.820 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:51.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:51.841 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-05-17T14:19:52.228 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:52.239 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:52.239 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:52.523 INFO:teuthology.orchestra.run.smithi088.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:52.531 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/382 2023-05-17T14:19:52.532 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/382 2023-05-17T14:19:52.532 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:52.537 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:52.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:52.557 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-05-17T14:19:52.943 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:52.954 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:52.955 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:53.231 INFO:teuthology.orchestra.run.smithi088.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:53.239 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/383 2023-05-17T14:19:53.240 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/383 2023-05-17T14:19:53.240 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:53.245 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:53.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:53.265 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-05-17T14:19:53.661 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:53.672 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:53.672 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:53.959 INFO:teuthology.orchestra.run.smithi088.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-17T14:19:53.968 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/384 2023-05-17T14:19:53.968 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/384 2023-05-17T14:19:53.968 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:53.973 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:53.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:53.992 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-05-17T14:19:54.375 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:54.386 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:54.387 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:54.671 INFO:teuthology.orchestra.run.smithi088.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:54.679 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/385 2023-05-17T14:19:54.680 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/385 2023-05-17T14:19:54.680 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:54.685 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:54.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:54.704 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-05-17T14:19:55.092 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:55.104 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:55.104 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:55.384 INFO:teuthology.orchestra.run.smithi088.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-17T14:19:55.392 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/386 2023-05-17T14:19:55.393 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/386 2023-05-17T14:19:55.393 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:55.398 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:55.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:55.417 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-05-17T14:19:55.802 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:55.814 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:55.814 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:56.093 INFO:teuthology.orchestra.run.smithi088.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:56.101 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/387 2023-05-17T14:19:56.101 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/387 2023-05-17T14:19:56.101 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:56.106 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:56.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:56.126 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-05-17T14:19:56.511 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:56.522 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:56.523 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/388 2023-05-17T14:19:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/388 2023-05-17T14:19:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:56.838 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:56.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:56.857 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-05-17T14:19:57.247 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:57.258 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:57.258 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:57.551 INFO:teuthology.orchestra.run.smithi088.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-05-17T14:19:57.559 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/389 2023-05-17T14:19:57.559 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/389 2023-05-17T14:19:57.559 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:57.565 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:57.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:57.584 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-05-17T14:19:57.984 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:57.995 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:57.995 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:58.308 INFO:teuthology.orchestra.run.smithi088.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:19:58.317 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/390 2023-05-17T14:19:58.317 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/390 2023-05-17T14:19:58.317 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:19:58.322 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:19:58.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:19:58.343 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-05-17T14:19:58.728 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:19:58.739 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:19:58.740 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:40.698 INFO:teuthology.orchestra.run.smithi088.stdout:generic/391 42s 2023-05-17T14:20:40.792 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/391 2023-05-17T14:20:40.793 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:40.799 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:40.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:40.965 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-05-17T14:20:42.920 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:42.936 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:42.936 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:43.443 INFO:teuthology.orchestra.run.smithi088.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:43.454 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/392 2023-05-17T14:20:43.455 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/392 2023-05-17T14:20:43.455 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:43.464 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:43.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:43.499 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-05-17T14:20:44.068 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:44.080 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:44.080 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:44.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:20:44.326 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:20:44.364 INFO:teuthology.orchestra.run.smithi088.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:44.373 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/393 2023-05-17T14:20:44.373 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/393 2023-05-17T14:20:44.373 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:44.378 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:44.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:44.399 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-05-17T14:20:44.404 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T14:20:44.400+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117495) UID: 0 2023-05-17T14:20:44.405 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T14:20:44.400+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117495) UID: 0 2023-05-17T14:20:44.405 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T14:20:44.400+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117495) UID: 0 2023-05-17T14:20:44.405 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T14:20:44.401+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117495) UID: 0 2023-05-17T14:20:44.824 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:44.835 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:44.836 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:45.206 INFO:teuthology.orchestra.run.smithi088.stdout:generic/394 1s 2023-05-17T14:20:45.218 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/394 2023-05-17T14:20:45.218 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:45.224 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:45.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:45.304 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-05-17T14:20:46.011 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:46.030 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:46.030 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:46.536 INFO:teuthology.orchestra.run.smithi088.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:46.550 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/395 2023-05-17T14:20:46.550 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/395 2023-05-17T14:20:46.550 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:46.558 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:46.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:46.592 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-05-17T14:20:46.980 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:46.992 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:46.992 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:47.334 INFO:teuthology.orchestra.run.smithi088.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:47.342 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/396 2023-05-17T14:20:47.342 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/396 2023-05-17T14:20:47.343 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:47.348 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:47.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:47.368 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-05-17T14:20:47.755 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:47.766 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:47.767 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:48.141 INFO:teuthology.orchestra.run.smithi088.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:48.150 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/397 2023-05-17T14:20:48.150 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/397 2023-05-17T14:20:48.150 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:48.155 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:48.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:48.177 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-05-17T14:20:48.565 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:48.576 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:48.577 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:48.920 INFO:teuthology.orchestra.run.smithi088.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:48.928 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/398 2023-05-17T14:20:48.929 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/398 2023-05-17T14:20:48.929 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:48.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:48.953 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-05-17T14:20:49.341 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:49.352 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:49.353 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:49.696 INFO:teuthology.orchestra.run.smithi088.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:49.705 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/399 2023-05-17T14:20:49.705 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/399 2023-05-17T14:20:49.705 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:49.710 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:49.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:49.730 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-05-17T14:20:50.113 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:50.125 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:50.125 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:50.403 INFO:teuthology.orchestra.run.smithi088.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-17T14:20:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/400 2023-05-17T14:20:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/400 2023-05-17T14:20:50.412 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:50.417 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:50.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:50.437 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-05-17T14:20:50.820 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:50.831 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:50.831 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:51.114 INFO:teuthology.orchestra.run.smithi088.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:51.123 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/401 2023-05-17T14:20:51.123 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/401 2023-05-17T14:20:51.123 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:51.129 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:51.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:51.149 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-05-17T14:20:51.538 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:51.549 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:51.549 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:51.831 INFO:teuthology.orchestra.run.smithi088.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:51.839 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/402 2023-05-17T14:20:51.839 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/402 2023-05-17T14:20:51.840 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:51.845 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:51.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:51.864 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-05-17T14:20:52.247 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:52.258 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:52.258 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:52.534 INFO:teuthology.orchestra.run.smithi088.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:52.543 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/403 2023-05-17T14:20:52.543 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/403 2023-05-17T14:20:52.543 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:52.548 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:52.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:52.568 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-05-17T14:20:52.957 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:52.969 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:52.969 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:54.554 INFO:teuthology.orchestra.run.smithi088.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-17T14:20:54.562 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/404 2023-05-17T14:20:54.563 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/404 2023-05-17T14:20:54.563 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:54.568 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:54.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:54.606 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-05-17T14:20:55.323 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:55.334 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:55.335 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:55.744 INFO:teuthology.orchestra.run.smithi088.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:55.752 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/405 2023-05-17T14:20:55.753 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/405 2023-05-17T14:20:55.753 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:55.758 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:55.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:55.777 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-05-17T14:20:56.165 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:56.177 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:56.177 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:56.455 INFO:teuthology.orchestra.run.smithi088.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:56.463 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/406 2023-05-17T14:20:56.463 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/406 2023-05-17T14:20:56.464 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:56.469 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:56.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:56.489 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-05-17T14:20:56.879 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:56.890 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:56.890 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:57.261 INFO:teuthology.orchestra.run.smithi088.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:20:57.269 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/407 2023-05-17T14:20:57.270 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/407 2023-05-17T14:20:57.270 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:57.275 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:57.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:57.322 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-05-17T14:20:58.010 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:58.021 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:58.404 INFO:teuthology.orchestra.run.smithi088.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-17T14:20:58.412 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/408 2023-05-17T14:20:58.413 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/408 2023-05-17T14:20:58.413 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:58.418 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:58.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:58.437 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-05-17T14:20:59.170 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:59.181 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:59.182 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:59.469 INFO:teuthology.orchestra.run.smithi088.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:20:59.477 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/409 2023-05-17T14:20:59.477 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/409 2023-05-17T14:20:59.478 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:20:59.483 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:20:59.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:20:59.503 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-05-17T14:20:59.889 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:20:59.900 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:20:59.901 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:00.181 INFO:teuthology.orchestra.run.smithi088.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:00.189 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/410 2023-05-17T14:21:00.190 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/410 2023-05-17T14:21:00.190 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:00.195 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:00.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:00.216 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-05-17T14:21:00.598 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:00.609 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:00.610 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:00.893 INFO:teuthology.orchestra.run.smithi088.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:00.902 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/411 2023-05-17T14:21:00.902 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/411 2023-05-17T14:21:00.902 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:00.907 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:00.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:00.927 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-05-17T14:21:01.315 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:01.327 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:01.327 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:01.609 INFO:teuthology.orchestra.run.smithi088.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:01.617 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/412 2023-05-17T14:21:01.618 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/412 2023-05-17T14:21:01.618 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:01.623 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:01.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:01.643 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-05-17T14:21:02.026 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:02.037 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:02.037 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:02.328 INFO:teuthology.orchestra.run.smithi088.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:02.336 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/413 2023-05-17T14:21:02.337 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/413 2023-05-17T14:21:02.337 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:02.342 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:02.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:02.362 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-05-17T14:21:02.750 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:02.762 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:02.762 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:03.042 INFO:teuthology.orchestra.run.smithi088.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:03.050 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/414 2023-05-17T14:21:03.051 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/414 2023-05-17T14:21:03.051 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:03.056 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:03.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:03.076 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-05-17T14:21:03.460 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:03.471 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:03.471 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:03.749 INFO:teuthology.orchestra.run.smithi088.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:03.758 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/415 2023-05-17T14:21:03.758 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/415 2023-05-17T14:21:03.758 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:03.763 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:03.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:03.783 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-05-17T14:21:04.170 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:04.181 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:04.181 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:04.461 INFO:teuthology.orchestra.run.smithi088.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:04.470 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/416 2023-05-17T14:21:04.470 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/416 2023-05-17T14:21:04.470 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:04.475 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:04.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:04.495 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-05-17T14:21:04.885 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:04.897 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:04.897 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:05.179 INFO:teuthology.orchestra.run.smithi088.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:05.188 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/417 2023-05-17T14:21:05.188 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/417 2023-05-17T14:21:05.188 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:05.193 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:05.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:05.214 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-05-17T14:21:05.600 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:05.611 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:05.611 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:05.942 INFO:teuthology.orchestra.run.smithi088.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-05-17T14:21:05.950 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/418 2023-05-17T14:21:05.950 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/418 2023-05-17T14:21:05.951 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:05.956 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:05.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:05.977 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-05-17T14:21:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:06.373 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:06.710 INFO:teuthology.orchestra.run.smithi088.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:06.718 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/419 2023-05-17T14:21:06.718 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/419 2023-05-17T14:21:06.718 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:06.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:06.743 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-05-17T14:21:07.126 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:07.138 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:07.138 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:08.842 INFO:teuthology.orchestra.run.smithi088.stdout:generic/420 1s 2023-05-17T14:21:08.854 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/420 2023-05-17T14:21:08.854 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:08.859 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:08.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:08.879 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-05-17T14:21:09.624 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:09.635 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:09.636 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:09.988 INFO:teuthology.orchestra.run.smithi088.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:09.997 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/421 2023-05-17T14:21:09.997 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/421 2023-05-17T14:21:09.997 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:10.004 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:10.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:10.022 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-05-17T14:21:10.407 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:10.419 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:10.419 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:10.706 INFO:teuthology.orchestra.run.smithi088.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:10.714 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/422 2023-05-17T14:21:10.714 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/422 2023-05-17T14:21:10.714 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:10.719 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:10.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:10.741 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-05-17T14:21:11.126 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:11.138 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:11.138 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:12.278 INFO:teuthology.orchestra.run.smithi088.stdout:generic/423 0s 2023-05-17T14:21:12.290 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/423 2023-05-17T14:21:12.290 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:12.296 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:12.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:12.342 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-05-17T14:21:13.057 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:13.069 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:13.069 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:13.407 INFO:teuthology.orchestra.run.smithi088.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-05-17T14:21:13.415 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/424 2023-05-17T14:21:13.415 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/424 2023-05-17T14:21:13.415 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:13.420 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:13.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:13.441 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-05-17T14:21:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:13.840 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:13.840 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:14.124 INFO:teuthology.orchestra.run.smithi088.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:21:14.132 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/425 2023-05-17T14:21:14.133 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/425 2023-05-17T14:21:14.133 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:21:14.138 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:21:14.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:21:14.157 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-05-17T14:21:14.546 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:21:14.557 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:21:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:00.138 INFO:teuthology.orchestra.run.smithi088.stdout:generic/426 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/426.out.bad) 2023-05-17T14:22:00.162 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/426.out 2023-05-17 12:27:04.859537529 +0000 2023-05-17T14:22:00.162 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/426.out.bad 2023-05-17 14:22:00.109848976 +0000 2023-05-17T14:22:00.162 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,5 +1,249 @@ 2023-05-17T14:22:00.162 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 426 2023-05-17T14:22:00.162 INFO:teuthology.orchestra.run.smithi088.stdout: test_file_handles TEST_DIR/426-dir -d 2023-05-17T14:22:00.162 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000097) opened an unlinked file! 2023-05-17T14:22:00.163 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000098) opened an unlinked file! 2023-05-17T14:22:00.163 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000099) opened an unlinked file! 2023-05-17T14:22:00.163 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000100) opened an unlinked file! 2023-05-17T14:22:00.163 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000101) opened an unlinked file! 2023-05-17T14:22:00.163 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000102) opened an unlinked file! 2023-05-17T14:22:00.163 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000103) opened an unlinked file! 2023-05-17T14:22:00.163 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000104) opened an unlinked file! 2023-05-17T14:22:00.163 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000105) opened an unlinked file! 2023-05-17T14:22:00.164 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000106) opened an unlinked file! 2023-05-17T14:22:00.164 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000107) opened an unlinked file! 2023-05-17T14:22:00.164 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000108) opened an unlinked file! 2023-05-17T14:22:00.164 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000109) opened an unlinked file! 2023-05-17T14:22:00.164 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000110) opened an unlinked file! 2023-05-17T14:22:00.164 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000111) opened an unlinked file! 2023-05-17T14:22:00.164 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000112) opened an unlinked file! 2023-05-17T14:22:00.165 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000113) opened an unlinked file! 2023-05-17T14:22:00.165 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000114) opened an unlinked file! 2023-05-17T14:22:00.165 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000115) opened an unlinked file! 2023-05-17T14:22:00.165 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000116) opened an unlinked file! 2023-05-17T14:22:00.165 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000117) opened an unlinked file! 2023-05-17T14:22:00.165 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000118) opened an unlinked file! 2023-05-17T14:22:00.165 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000119) opened an unlinked file! 2023-05-17T14:22:00.165 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000120) opened an unlinked file! 2023-05-17T14:22:00.166 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000121) opened an unlinked file! 2023-05-17T14:22:00.166 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000122) opened an unlinked file! 2023-05-17T14:22:00.166 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000123) opened an unlinked file! 2023-05-17T14:22:00.166 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000124) opened an unlinked file! 2023-05-17T14:22:00.166 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000125) opened an unlinked file! 2023-05-17T14:22:00.166 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000126) opened an unlinked file! 2023-05-17T14:22:00.166 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000127) opened an unlinked file! 2023-05-17T14:22:00.166 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000128) opened an unlinked file! 2023-05-17T14:22:00.167 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000129) opened an unlinked file! 2023-05-17T14:22:00.167 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000130) opened an unlinked file! 2023-05-17T14:22:00.167 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000131) opened an unlinked file! 2023-05-17T14:22:00.167 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000132) opened an unlinked file! 2023-05-17T14:22:00.167 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000133) opened an unlinked file! 2023-05-17T14:22:00.167 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000134) opened an unlinked file! 2023-05-17T14:22:00.167 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000135) opened an unlinked file! 2023-05-17T14:22:00.167 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000136) opened an unlinked file! 2023-05-17T14:22:00.168 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000137) opened an unlinked file! 2023-05-17T14:22:00.168 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000138) opened an unlinked file! 2023-05-17T14:22:00.168 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000139) opened an unlinked file! 2023-05-17T14:22:00.168 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000140) opened an unlinked file! 2023-05-17T14:22:00.168 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000141) opened an unlinked file! 2023-05-17T14:22:00.168 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000142) opened an unlinked file! 2023-05-17T14:22:00.168 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000143) opened an unlinked file! 2023-05-17T14:22:00.169 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000144) opened an unlinked file! 2023-05-17T14:22:00.169 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000145) opened an unlinked file! 2023-05-17T14:22:00.169 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000146) opened an unlinked file! 2023-05-17T14:22:00.169 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000147) opened an unlinked file! 2023-05-17T14:22:00.169 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000148) opened an unlinked file! 2023-05-17T14:22:00.169 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000149) opened an unlinked file! 2023-05-17T14:22:00.169 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000150) opened an unlinked file! 2023-05-17T14:22:00.169 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000151) opened an unlinked file! 2023-05-17T14:22:00.170 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000152) opened an unlinked file! 2023-05-17T14:22:00.170 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000153) opened an unlinked file! 2023-05-17T14:22:00.170 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000154) opened an unlinked file! 2023-05-17T14:22:00.170 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000155) opened an unlinked file! 2023-05-17T14:22:00.170 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000156) opened an unlinked file! 2023-05-17T14:22:00.170 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000157) opened an unlinked file! 2023-05-17T14:22:00.170 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000158) opened an unlinked file! 2023-05-17T14:22:00.170 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000159) opened an unlinked file! 2023-05-17T14:22:00.171 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000160) opened an unlinked file! 2023-05-17T14:22:00.171 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000161) opened an unlinked file! 2023-05-17T14:22:00.171 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000162) opened an unlinked file! 2023-05-17T14:22:00.171 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000163) opened an unlinked file! 2023-05-17T14:22:00.171 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000164) opened an unlinked file! 2023-05-17T14:22:00.171 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000165) opened an unlinked file! 2023-05-17T14:22:00.171 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000166) opened an unlinked file! 2023-05-17T14:22:00.171 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000167) opened an unlinked file! 2023-05-17T14:22:00.172 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000168) opened an unlinked file! 2023-05-17T14:22:00.172 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000169) opened an unlinked file! 2023-05-17T14:22:00.172 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000170) opened an unlinked file! 2023-05-17T14:22:00.172 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000171) opened an unlinked file! 2023-05-17T14:22:00.172 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000172) opened an unlinked file! 2023-05-17T14:22:00.172 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000173) opened an unlinked file! 2023-05-17T14:22:00.172 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000174) opened an unlinked file! 2023-05-17T14:22:00.172 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000175) opened an unlinked file! 2023-05-17T14:22:00.173 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000176) opened an unlinked file! 2023-05-17T14:22:00.173 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000177) opened an unlinked file! 2023-05-17T14:22:00.173 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000178) opened an unlinked file! 2023-05-17T14:22:00.173 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000179) opened an unlinked file! 2023-05-17T14:22:00.173 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000180) opened an unlinked file! 2023-05-17T14:22:00.173 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000181) opened an unlinked file! 2023-05-17T14:22:00.173 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000182) opened an unlinked file! 2023-05-17T14:22:00.173 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000183) opened an unlinked file! 2023-05-17T14:22:00.174 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000184) opened an unlinked file! 2023-05-17T14:22:00.174 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000185) opened an unlinked file! 2023-05-17T14:22:00.174 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000186) opened an unlinked file! 2023-05-17T14:22:00.174 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000187) opened an unlinked file! 2023-05-17T14:22:00.174 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000188) opened an unlinked file! 2023-05-17T14:22:00.174 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000189) opened an unlinked file! 2023-05-17T14:22:00.174 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000873) opened an unlinked file! 2023-05-17T14:22:00.175 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000874) opened an unlinked file! 2023-05-17T14:22:00.175 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000875) opened an unlinked file! 2023-05-17T14:22:00.175 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000876) opened an unlinked file! 2023-05-17T14:22:00.175 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000877) opened an unlinked file! 2023-05-17T14:22:00.175 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000878) opened an unlinked file! 2023-05-17T14:22:00.175 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000879) opened an unlinked file! 2023-05-17T14:22:00.175 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000880) opened an unlinked file! 2023-05-17T14:22:00.175 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000881) opened an unlinked file! 2023-05-17T14:22:00.176 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000882) opened an unlinked file! 2023-05-17T14:22:00.176 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000883) opened an unlinked file! 2023-05-17T14:22:00.176 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000884) opened an unlinked file! 2023-05-17T14:22:00.176 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000885) opened an unlinked file! 2023-05-17T14:22:00.176 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000886) opened an unlinked file! 2023-05-17T14:22:00.176 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000887) opened an unlinked file! 2023-05-17T14:22:00.176 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000888) opened an unlinked file! 2023-05-17T14:22:00.176 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000889) opened an unlinked file! 2023-05-17T14:22:00.177 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000890) opened an unlinked file! 2023-05-17T14:22:00.177 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000891) opened an unlinked file! 2023-05-17T14:22:00.177 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000892) opened an unlinked file! 2023-05-17T14:22:00.177 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000893) opened an unlinked file! 2023-05-17T14:22:00.177 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000894) opened an unlinked file! 2023-05-17T14:22:00.177 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000895) opened an unlinked file! 2023-05-17T14:22:00.177 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000896) opened an unlinked file! 2023-05-17T14:22:00.177 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000897) opened an unlinked file! 2023-05-17T14:22:00.178 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000898) opened an unlinked file! 2023-05-17T14:22:00.178 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000899) opened an unlinked file! 2023-05-17T14:22:00.178 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000900) opened an unlinked file! 2023-05-17T14:22:00.178 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000901) opened an unlinked file! 2023-05-17T14:22:00.178 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000902) opened an unlinked file! 2023-05-17T14:22:00.178 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000903) opened an unlinked file! 2023-05-17T14:22:00.178 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000904) opened an unlinked file! 2023-05-17T14:22:00.178 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000905) opened an unlinked file! 2023-05-17T14:22:00.179 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000906) opened an unlinked file! 2023-05-17T14:22:00.179 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000907) opened an unlinked file! 2023-05-17T14:22:00.179 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000908) opened an unlinked file! 2023-05-17T14:22:00.179 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000909) opened an unlinked file! 2023-05-17T14:22:00.179 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000910) opened an unlinked file! 2023-05-17T14:22:00.179 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000911) opened an unlinked file! 2023-05-17T14:22:00.180 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000912) opened an unlinked file! 2023-05-17T14:22:00.180 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000913) opened an unlinked file! 2023-05-17T14:22:00.180 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000914) opened an unlinked file! 2023-05-17T14:22:00.180 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000915) opened an unlinked file! 2023-05-17T14:22:00.180 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000916) opened an unlinked file! 2023-05-17T14:22:00.180 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000917) opened an unlinked file! 2023-05-17T14:22:00.180 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000918) opened an unlinked file! 2023-05-17T14:22:00.181 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000919) opened an unlinked file! 2023-05-17T14:22:00.181 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000920) opened an unlinked file! 2023-05-17T14:22:00.181 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000921) opened an unlinked file! 2023-05-17T14:22:00.181 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000922) opened an unlinked file! 2023-05-17T14:22:00.181 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000923) opened an unlinked file! 2023-05-17T14:22:00.181 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000924) opened an unlinked file! 2023-05-17T14:22:00.181 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000925) opened an unlinked file! 2023-05-17T14:22:00.181 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000926) opened an unlinked file! 2023-05-17T14:22:00.182 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000927) opened an unlinked file! 2023-05-17T14:22:00.182 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000928) opened an unlinked file! 2023-05-17T14:22:00.182 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000929) opened an unlinked file! 2023-05-17T14:22:00.182 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000930) opened an unlinked file! 2023-05-17T14:22:00.182 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000931) opened an unlinked file! 2023-05-17T14:22:00.182 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000932) opened an unlinked file! 2023-05-17T14:22:00.182 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000933) opened an unlinked file! 2023-05-17T14:22:00.182 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000934) opened an unlinked file! 2023-05-17T14:22:00.183 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000935) opened an unlinked file! 2023-05-17T14:22:00.183 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000936) opened an unlinked file! 2023-05-17T14:22:00.183 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000937) opened an unlinked file! 2023-05-17T14:22:00.183 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000938) opened an unlinked file! 2023-05-17T14:22:00.183 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000939) opened an unlinked file! 2023-05-17T14:22:00.183 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000940) opened an unlinked file! 2023-05-17T14:22:00.183 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000941) opened an unlinked file! 2023-05-17T14:22:00.183 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000942) opened an unlinked file! 2023-05-17T14:22:00.184 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000943) opened an unlinked file! 2023-05-17T14:22:00.184 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000944) opened an unlinked file! 2023-05-17T14:22:00.184 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000945) opened an unlinked file! 2023-05-17T14:22:00.184 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000946) opened an unlinked file! 2023-05-17T14:22:00.184 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000947) opened an unlinked file! 2023-05-17T14:22:00.184 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000948) opened an unlinked file! 2023-05-17T14:22:00.184 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000949) opened an unlinked file! 2023-05-17T14:22:00.184 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000950) opened an unlinked file! 2023-05-17T14:22:00.185 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000951) opened an unlinked file! 2023-05-17T14:22:00.185 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000952) opened an unlinked file! 2023-05-17T14:22:00.185 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000953) opened an unlinked file! 2023-05-17T14:22:00.185 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000954) opened an unlinked file! 2023-05-17T14:22:00.185 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000955) opened an unlinked file! 2023-05-17T14:22:00.185 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000956) opened an unlinked file! 2023-05-17T14:22:00.185 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000957) opened an unlinked file! 2023-05-17T14:22:00.185 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000958) opened an unlinked file! 2023-05-17T14:22:00.186 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000959) opened an unlinked file! 2023-05-17T14:22:00.186 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000960) opened an unlinked file! 2023-05-17T14:22:00.186 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000961) opened an unlinked file! 2023-05-17T14:22:00.186 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000962) opened an unlinked file! 2023-05-17T14:22:00.186 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000963) opened an unlinked file! 2023-05-17T14:22:00.186 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000964) opened an unlinked file! 2023-05-17T14:22:00.186 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000965) opened an unlinked file! 2023-05-17T14:22:00.186 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000966) opened an unlinked file! 2023-05-17T14:22:00.187 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000967) opened an unlinked file! 2023-05-17T14:22:00.187 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000968) opened an unlinked file! 2023-05-17T14:22:00.187 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000969) opened an unlinked file! 2023-05-17T14:22:00.187 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000970) opened an unlinked file! 2023-05-17T14:22:00.187 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000971) opened an unlinked file! 2023-05-17T14:22:00.187 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000972) opened an unlinked file! 2023-05-17T14:22:00.187 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000973) opened an unlinked file! 2023-05-17T14:22:00.187 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000974) opened an unlinked file! 2023-05-17T14:22:00.188 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000975) opened an unlinked file! 2023-05-17T14:22:00.188 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000976) opened an unlinked file! 2023-05-17T14:22:00.188 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000977) opened an unlinked file! 2023-05-17T14:22:00.188 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000978) opened an unlinked file! 2023-05-17T14:22:00.188 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000979) opened an unlinked file! 2023-05-17T14:22:00.188 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000980) opened an unlinked file! 2023-05-17T14:22:00.188 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000981) opened an unlinked file! 2023-05-17T14:22:00.188 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000982) opened an unlinked file! 2023-05-17T14:22:00.189 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000983) opened an unlinked file! 2023-05-17T14:22:00.189 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000984) opened an unlinked file! 2023-05-17T14:22:00.189 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000985) opened an unlinked file! 2023-05-17T14:22:00.189 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000986) opened an unlinked file! 2023-05-17T14:22:00.189 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000987) opened an unlinked file! 2023-05-17T14:22:00.189 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000988) opened an unlinked file! 2023-05-17T14:22:00.189 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000989) opened an unlinked file! 2023-05-17T14:22:00.189 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000990) opened an unlinked file! 2023-05-17T14:22:00.190 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000991) opened an unlinked file! 2023-05-17T14:22:00.190 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000992) opened an unlinked file! 2023-05-17T14:22:00.190 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000993) opened an unlinked file! 2023-05-17T14:22:00.190 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000994) opened an unlinked file! 2023-05-17T14:22:00.190 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000995) opened an unlinked file! 2023-05-17T14:22:00.190 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000996) opened an unlinked file! 2023-05-17T14:22:00.190 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000997) opened an unlinked file! 2023-05-17T14:22:00.190 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000998) opened an unlinked file! 2023-05-17T14:22:00.191 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file000999) opened an unlinked file! 2023-05-17T14:22:00.191 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001000) opened an unlinked file! 2023-05-17T14:22:00.191 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001001) opened an unlinked file! 2023-05-17T14:22:00.191 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001002) opened an unlinked file! 2023-05-17T14:22:00.191 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001003) opened an unlinked file! 2023-05-17T14:22:00.191 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001004) opened an unlinked file! 2023-05-17T14:22:00.191 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001005) opened an unlinked file! 2023-05-17T14:22:00.191 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001006) opened an unlinked file! 2023-05-17T14:22:00.192 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001007) opened an unlinked file! 2023-05-17T14:22:00.192 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001008) opened an unlinked file! 2023-05-17T14:22:00.192 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001009) opened an unlinked file! 2023-05-17T14:22:00.192 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001010) opened an unlinked file! 2023-05-17T14:22:00.193 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001011) opened an unlinked file! 2023-05-17T14:22:00.193 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001012) opened an unlinked file! 2023-05-17T14:22:00.193 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001013) opened an unlinked file! 2023-05-17T14:22:00.193 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001014) opened an unlinked file! 2023-05-17T14:22:00.193 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001015) opened an unlinked file! 2023-05-17T14:22:00.193 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001016) opened an unlinked file! 2023-05-17T14:22:00.193 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001017) opened an unlinked file! 2023-05-17T14:22:00.193 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001018) opened an unlinked file! 2023-05-17T14:22:00.194 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001019) opened an unlinked file! 2023-05-17T14:22:00.194 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001020) opened an unlinked file! 2023-05-17T14:22:00.194 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001021) opened an unlinked file! 2023-05-17T14:22:00.194 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001022) opened an unlinked file! 2023-05-17T14:22:00.194 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/426-dir/file001023) opened an unlinked file! 2023-05-17T14:22:00.194 INFO:teuthology.orchestra.run.smithi088.stdout: test_file_handles TEST_DIR/426-dir 2023-05-17T14:22:00.194 INFO:teuthology.orchestra.run.smithi088.stdout: test_file_handles TEST_DIR/426-dir -l 2023-05-17T14:22:00.195 INFO:teuthology.orchestra.run.smithi088.stdout: test_file_handles TEST_DIR/426-dir -u 2023-05-17T14:22:00.195 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/426 2023-05-17T14:22:00.195 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/426 2023-05-17T14:22:00.195 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:22:00.214 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:00.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:22:00.375 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:22:00.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:22:00.376 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-05-17T14:22:01.689 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:01.700 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:01.700 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:02.037 INFO:teuthology.orchestra.run.smithi088.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:22:02.045 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/427 2023-05-17T14:22:02.045 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/427 2023-05-17T14:22:02.045 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:02.050 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:02.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:02.071 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-05-17T14:22:02.464 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:02.475 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:02.475 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:02.831 INFO:teuthology.orchestra.run.smithi088.stdout:generic/428 0s 2023-05-17T14:22:02.843 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/428 2023-05-17T14:22:02.843 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:02.848 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:02.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:02.869 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-05-17T14:22:03.261 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:03.272 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:03.272 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:03.630 INFO:teuthology.orchestra.run.smithi088.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:22:03.639 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/429 2023-05-17T14:22:03.639 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/429 2023-05-17T14:22:03.639 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:03.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:03.664 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-05-17T14:22:04.059 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:04.070 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:04.070 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:04.648 INFO:teuthology.orchestra.run.smithi088.stdout:generic/430 0s 2023-05-17T14:22:04.660 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/430 2023-05-17T14:22:04.660 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:04.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:04.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:04.686 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-05-17T14:22:05.418 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:05.429 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:05.429 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:05.944 INFO:teuthology.orchestra.run.smithi088.stdout:generic/431 0s 2023-05-17T14:22:05.955 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/431 2023-05-17T14:22:05.956 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:05.961 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:05.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:05.982 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-05-17T14:22:06.720 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:06.731 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:07.287 INFO:teuthology.orchestra.run.smithi088.stdout:generic/432 1s 2023-05-17T14:22:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/432 2023-05-17T14:22:07.298 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:07.303 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:07.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:07.325 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-05-17T14:22:08.035 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:08.047 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:08.047 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:08.529 INFO:teuthology.orchestra.run.smithi088.stdout:generic/433 0s 2023-05-17T14:22:08.541 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/433 2023-05-17T14:22:08.541 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:08.546 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:08.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:08.566 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-05-17T14:22:09.299 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:09.310 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:09.310 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:09.789 INFO:teuthology.orchestra.run.smithi088.stdout:generic/434 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/434.out.bad) 2023-05-17T14:22:09.794 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/434.out 2023-05-17 12:27:04.860537509 +0000 2023-05-17T14:22:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/434.out.bad 2023-05-17 14:22:09.782659198 +0000 2023-05-17T14:22:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -9,6 +9,6 @@ 2023-05-17T14:22:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: copy_range: Bad file descriptor 2023-05-17T14:22:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-05-17T14:22:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: Try to copy to a device 2023-05-17T14:22:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: -copy_range: Invalid argument 2023-05-17T14:22:09.795 INFO:teuthology.orchestra.run.smithi088.stdout: +/tmp/tmp.3n61ha2sIstest/test-434/dev1: Permission denied 2023-05-17T14:22:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: Try to copy to a fifo 2023-05-17T14:22:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: copy_range: Invalid argument 2023-05-17T14:22:09.800 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/434 2023-05-17T14:22:09.800 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/434 2023-05-17T14:22:09.800 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:22:09.806 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:09.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:22:09.826 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:22:09.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:22:09.827 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-05-17T14:22:10.555 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:10.566 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:10.567 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:10.910 INFO:teuthology.orchestra.run.smithi088.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:22:10.919 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/435 2023-05-17T14:22:10.919 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/435 2023-05-17T14:22:10.919 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:10.924 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:10.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:10.944 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-05-17T14:22:11.336 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:11.348 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:11.348 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:12.691 INFO:teuthology.orchestra.run.smithi088.stdout:generic/436 1s 2023-05-17T14:22:12.702 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/436 2023-05-17T14:22:12.703 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:12.708 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:12.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:12.729 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-05-17T14:22:13.465 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:13.477 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:13.477 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:14.581 INFO:teuthology.orchestra.run.smithi088.stdout:generic/437 1s 2023-05-17T14:22:14.592 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/437 2023-05-17T14:22:14.593 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:22:14.598 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:22:14.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:22:14.618 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-05-17T14:22:15.013 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:22:15.024 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:22:15.024 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:23:57.516 INFO:teuthology.orchestra.run.smithi088.stdout:generic/438 102s 2023-05-17T14:23:57.527 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/438 2023-05-17T14:23:57.528 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:23:57.533 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:23:57.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:23:57.554 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-05-17T14:23:57.951 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:23:57.963 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:23:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:23:58.255 INFO:teuthology.orchestra.run.smithi088.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:23:58.264 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/439 2023-05-17T14:23:58.264 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/439 2023-05-17T14:23:58.264 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:23:58.269 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:23:58.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:23:58.289 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-05-17T14:23:58.690 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:23:58.701 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:23:58.702 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:23:59.046 INFO:teuthology.orchestra.run.smithi088.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:23:59.054 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/440 2023-05-17T14:23:59.054 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/440 2023-05-17T14:23:59.054 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:23:59.059 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:23:59.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:23:59.079 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-05-17T14:23:59.484 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:23:59.496 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:23:59.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:23:59.867 INFO:teuthology.orchestra.run.smithi088.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:23:59.875 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/441 2023-05-17T14:23:59.875 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/441 2023-05-17T14:23:59.876 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:23:59.881 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:23:59.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:23:59.900 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-05-17T14:24:00.290 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:00.302 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:00.302 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:00.614 INFO:teuthology.orchestra.run.smithi088.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:00.622 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/442 2023-05-17T14:24:00.622 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/442 2023-05-17T14:24:00.622 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:00.628 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:00.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:00.647 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-05-17T14:24:01.039 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:01.050 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:01.051 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:01.392 INFO:teuthology.orchestra.run.smithi088.stdout:generic/443 0s 2023-05-17T14:24:01.403 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/443 2023-05-17T14:24:01.404 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:01.409 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:01.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:01.429 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-05-17T14:24:01.815 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:01.826 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:01.827 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:02.166 INFO:teuthology.orchestra.run.smithi088.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-17T14:24:02.174 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/444 2023-05-17T14:24:02.174 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/444 2023-05-17T14:24:02.174 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:02.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:02.199 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-05-17T14:24:02.587 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:02.599 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:02.599 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:03.855 INFO:teuthology.orchestra.run.smithi088.stdout:generic/445 1s 2023-05-17T14:24:03.866 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/445 2023-05-17T14:24:03.866 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:03.871 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:03.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:03.892 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-05-17T14:24:04.621 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:04.632 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:04.633 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:04.919 INFO:teuthology.orchestra.run.smithi088.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:04.927 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/446 2023-05-17T14:24:04.927 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/446 2023-05-17T14:24:04.927 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:04.932 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:04.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:04.951 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-05-17T14:24:05.336 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:05.348 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:05.348 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:05.630 INFO:teuthology.orchestra.run.smithi088.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:05.638 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/447 2023-05-17T14:24:05.638 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/447 2023-05-17T14:24:05.639 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:05.644 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:05.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:05.664 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-05-17T14:24:06.055 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:06.067 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:06.067 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:07.483 INFO:teuthology.orchestra.run.smithi088.stdout:generic/448 1s 2023-05-17T14:24:07.494 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/448 2023-05-17T14:24:07.495 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:07.500 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:07.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:07.553 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-05-17T14:24:08.254 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:08.265 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:08.266 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:08.565 INFO:teuthology.orchestra.run.smithi088.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:08.573 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/449 2023-05-17T14:24:08.574 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/449 2023-05-17T14:24:08.574 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:08.579 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:08.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:08.598 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-05-17T14:24:08.985 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:08.996 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:08.997 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:10.406 INFO:teuthology.orchestra.run.smithi088.stdout:generic/450 1s 2023-05-17T14:24:10.418 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/450 2023-05-17T14:24:10.418 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:10.423 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:10.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:10.443 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-05-17T14:24:11.168 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:11.180 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:11.180 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:11.731 INFO:teuthology.orchestra.run.smithi088.stdout:generic/451 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/451.out.bad) 2023-05-17T14:24:11.736 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/451.out 2023-05-17 12:27:04.863537450 +0000 2023-05-17T14:24:11.737 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/451.out.bad 2023-05-17 14:24:11.725265128 +0000 2023-05-17T14:24:11.737 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,2 +1,5 @@ 2023-05-17T14:24:11.737 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 451 2023-05-17T14:24:11.737 INFO:teuthology.orchestra.run.smithi088.stdout: +get stale data from buffer read 2023-05-17T14:24:11.737 INFO:teuthology.orchestra.run.smithi088.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-05-17T14:24:11.737 INFO:teuthology.orchestra.run.smithi088.stdout: +000a0000 2023-05-17T14:24:11.737 INFO:teuthology.orchestra.run.smithi088.stdout: Silence is golden 2023-05-17T14:24:11.742 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/451 2023-05-17T14:24:11.742 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/451 2023-05-17T14:24:11.742 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:24:11.747 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:11.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:24:11.766 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:24:11.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:24:11.767 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-05-17T14:24:12.489 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:12.502 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:12.502 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:12.789 INFO:teuthology.orchestra.run.smithi088.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:12.797 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/452 2023-05-17T14:24:12.798 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/452 2023-05-17T14:24:12.798 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:12.803 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:12.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:12.823 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-05-17T14:24:13.217 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:13.229 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:13.229 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:13.767 INFO:teuthology.orchestra.run.smithi088.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:13.776 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/453 2023-05-17T14:24:13.776 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/453 2023-05-17T14:24:13.776 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:13.781 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:13.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:13.801 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-05-17T14:24:14.186 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:14.197 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:14.197 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:14.620 INFO:teuthology.orchestra.run.smithi088.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:14.628 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/454 2023-05-17T14:24:14.628 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/454 2023-05-17T14:24:14.628 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:14.633 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:14.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:14.653 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-05-17T14:24:15.047 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:15.058 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:15.058 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:16.138 INFO:teuthology.orchestra.run.smithi088.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:16.146 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/455 2023-05-17T14:24:16.146 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/455 2023-05-17T14:24:16.146 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:16.151 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:16.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:16.170 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-05-17T14:24:16.559 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:16.571 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:16.571 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:16.889 INFO:teuthology.orchestra.run.smithi088.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:16.897 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/456 2023-05-17T14:24:16.898 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/456 2023-05-17T14:24:16.898 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:16.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:16.922 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-05-17T14:24:17.310 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:17.321 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:17.322 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:17.714 INFO:teuthology.orchestra.run.smithi088.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:17.722 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/457 2023-05-17T14:24:17.722 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/457 2023-05-17T14:24:17.723 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:17.728 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:17.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:17.747 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-05-17T14:24:18.136 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:18.148 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:18.148 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:18.426 INFO:teuthology.orchestra.run.smithi088.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:18.434 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/458 2023-05-17T14:24:18.434 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/458 2023-05-17T14:24:18.434 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:18.439 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:18.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:18.459 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-05-17T14:24:18.853 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:18.864 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:18.865 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:19.250 INFO:teuthology.orchestra.run.smithi088.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:19.258 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/459 2023-05-17T14:24:19.258 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/459 2023-05-17T14:24:19.258 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:19.263 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:19.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:19.283 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-05-17T14:24:19.670 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:19.681 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:19.681 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:19.959 INFO:teuthology.orchestra.run.smithi088.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:19.968 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/460 2023-05-17T14:24:19.968 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/460 2023-05-17T14:24:19.968 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:19.974 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:19.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:19.993 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-05-17T14:24:20.383 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:20.394 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:20.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:20.673 INFO:teuthology.orchestra.run.smithi088.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:20.682 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/461 2023-05-17T14:24:20.682 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/461 2023-05-17T14:24:20.682 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:20.687 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:20.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:20.707 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-05-17T14:24:21.097 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:21.108 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:21.108 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:21.398 INFO:teuthology.orchestra.run.smithi088.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:21.406 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/462 2023-05-17T14:24:21.406 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/462 2023-05-17T14:24:21.407 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:21.412 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:21.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:21.431 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-05-17T14:24:21.821 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:21.832 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:21.832 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:22.213 INFO:teuthology.orchestra.run.smithi088.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T14:24:22.221 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/463 2023-05-17T14:24:22.222 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/463 2023-05-17T14:24:22.222 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:22.227 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:22.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:22.263 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-05-17T14:24:22.961 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:22.972 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:22.972 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:23.258 INFO:teuthology.orchestra.run.smithi088.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:23.267 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/464 2023-05-17T14:24:23.267 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/464 2023-05-17T14:24:23.267 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:23.272 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:23.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:23.292 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-05-17T14:24:23.686 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:23.697 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:23.697 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:26.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:24:26.227 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:24:39.236 INFO:teuthology.orchestra.run.smithi088.stdout:generic/465 16s 2023-05-17T14:24:39.315 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/465 2023-05-17T14:24:39.316 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:39.324 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:39.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:39.393 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-05-17T14:24:39.945 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:39.956 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:39.957 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:40.263 INFO:teuthology.orchestra.run.smithi088.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:40.271 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/466 2023-05-17T14:24:40.271 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/466 2023-05-17T14:24:40.271 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:40.276 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:40.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:40.296 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-05-17T14:24:40.678 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:40.689 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:40.689 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:50.442 INFO:teuthology.orchestra.run.smithi088.stdout:generic/467 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/467.out.bad) 2023-05-17T14:24:50.465 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/467.out 2023-05-17 12:27:04.865537410 +0000 2023-05-17T14:24:50.465 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/467.out.bad 2023-05-17 14:24:50.428504346 +0000 2023-05-17T14:24:50.465 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,5 +1,15 @@ 2023-05-17T14:24:50.465 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 467 2023-05-17T14:24:50.465 INFO:teuthology.orchestra.run.smithi088.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-05-17T14:24:50.465 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000000) opened an unlinked file! 2023-05-17T14:24:50.466 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000001) opened an unlinked file! 2023-05-17T14:24:50.466 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000002) opened an unlinked file! 2023-05-17T14:24:50.466 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000003) opened an unlinked file! 2023-05-17T14:24:50.466 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000004) opened an unlinked file! 2023-05-17T14:24:50.466 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000005) opened an unlinked file! 2023-05-17T14:24:50.466 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000006) opened an unlinked file! 2023-05-17T14:24:50.466 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000007) opened an unlinked file! 2023-05-17T14:24:50.467 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000008) opened an unlinked file! 2023-05-17T14:24:50.467 INFO:teuthology.orchestra.run.smithi088.stdout: +open_by_handle(/tmp/tmp.3n61ha2sIstest/467-dir/file000009) opened an unlinked file! 2023-05-17T14:24:50.467 INFO:teuthology.orchestra.run.smithi088.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-05-17T14:24:50.467 INFO:teuthology.orchestra.run.smithi088.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-05-17T14:24:50.467 INFO:teuthology.orchestra.run.smithi088.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-05-17T14:24:50.482 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/467 2023-05-17T14:24:50.482 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/467 2023-05-17T14:24:50.482 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:24:50.510 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:50.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:24:50.670 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:24:50.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:24:50.671 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-05-17T14:24:51.952 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:51.963 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:52.307 INFO:teuthology.orchestra.run.smithi088.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:52.315 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/468 2023-05-17T14:24:52.315 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/468 2023-05-17T14:24:52.315 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:52.320 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:52.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:52.341 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-05-17T14:24:52.744 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:52.755 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:52.756 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:55.580 INFO:teuthology.orchestra.run.smithi088.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-17T14:24:55.589 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/469 2023-05-17T14:24:55.589 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/469 2023-05-17T14:24:55.589 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:55.594 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:55.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:55.615 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-05-17T14:24:56.340 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:56.351 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:56.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:24:56.487 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:24:56.759 INFO:teuthology.orchestra.run.smithi088.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:56.767 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/470 2023-05-17T14:24:56.768 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/470 2023-05-17T14:24:56.768 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:56.773 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:56.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:56.792 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-05-17T14:24:57.178 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:57.189 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:57.190 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:57.595 INFO:teuthology.orchestra.run.smithi088.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-05-17T14:24:57.603 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/471 2023-05-17T14:24:57.603 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/471 2023-05-17T14:24:57.603 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:57.608 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:57.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:57.629 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-05-17T14:24:58.357 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:58.368 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:58.369 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:58.665 INFO:teuthology.orchestra.run.smithi088.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:24:58.673 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/472 2023-05-17T14:24:58.674 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/472 2023-05-17T14:24:58.674 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:58.679 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:58.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:58.699 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-05-17T14:24:59.091 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:59.102 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:59.102 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:59.472 INFO:teuthology.orchestra.run.smithi088.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-17T14:24:59.480 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/473 2023-05-17T14:24:59.480 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/473 2023-05-17T14:24:59.480 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:24:59.486 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:24:59.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:24:59.505 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-05-17T14:24:59.893 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:24:59.905 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:24:59.905 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:00.194 INFO:teuthology.orchestra.run.smithi088.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:00.202 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/474 2023-05-17T14:25:00.202 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/474 2023-05-17T14:25:00.202 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:00.207 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:00.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:00.227 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-05-17T14:25:00.621 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:00.633 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:00.633 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:00.967 INFO:teuthology.orchestra.run.smithi088.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:00.975 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/475 2023-05-17T14:25:00.975 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/475 2023-05-17T14:25:00.976 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:00.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:01.000 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-05-17T14:25:01.386 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:01.397 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:01.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:01.690 INFO:teuthology.orchestra.run.smithi088.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:01.698 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/476 2023-05-17T14:25:01.698 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/476 2023-05-17T14:25:01.698 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:01.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:01.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:01.724 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-05-17T14:25:02.111 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:02.122 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:09.779 INFO:teuthology.orchestra.run.smithi088.stdout:generic/477 7s 2023-05-17T14:25:09.870 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/477 2023-05-17T14:25:09.870 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:09.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:09.954 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-05-17T14:25:11.031 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:11.043 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:13.929 INFO:teuthology.orchestra.run.smithi088.stdout:generic/478 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/478.out.bad) 2023-05-17T14:25:13.934 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/478.out 2023-05-17 12:27:04.867537371 +0000 2023-05-17T14:25:13.935 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/478.out.bad 2023-05-17 14:25:13.923042479 +0000 2023-05-17T14:25:13.935 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -10,7 +10,7 @@ 2023-05-17T14:25:13.935 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.935 INFO:teuthology.orchestra.run.smithi088.stdout: get wrlck 2023-05-17T14:25:13.935 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.935 INFO:teuthology.orchestra.run.smithi088.stdout: -lock could be placed 2023-05-17T14:25:13.936 INFO:teuthology.orchestra.run.smithi088.stdout: +get wrlck 2023-05-17T14:25:13.936 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.936 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.936 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.936 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -25,7 +25,7 @@ 2023-05-17T14:25:13.936 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.936 INFO:teuthology.orchestra.run.smithi088.stdout: get wrlck 2023-05-17T14:25:13.937 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.937 INFO:teuthology.orchestra.run.smithi088.stdout: -lock could be placed 2023-05-17T14:25:13.937 INFO:teuthology.orchestra.run.smithi088.stdout: +get wrlck 2023-05-17T14:25:13.937 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.940 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.940 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.940 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -37,7 +37,7 @@ 2023-05-17T14:25:13.940 INFO:teuthology.orchestra.run.smithi088.stdout: get rdlck 2023-05-17T14:25:13.940 INFO:teuthology.orchestra.run.smithi088.stdout: get rdlck 2023-05-17T14:25:13.940 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.941 INFO:teuthology.orchestra.run.smithi088.stdout: -lock could be placed 2023-05-17T14:25:13.941 INFO:teuthology.orchestra.run.smithi088.stdout: +get rdlck 2023-05-17T14:25:13.941 INFO:teuthology.orchestra.run.smithi088.stdout: get rdlck 2023-05-17T14:25:13.941 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.941 INFO:teuthology.orchestra.run.smithi088.stdout: get rdlck 2023-05-17T14:25:13.941 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -46,7 +46,7 @@ 2023-05-17T14:25:13.941 INFO:teuthology.orchestra.run.smithi088.stdout: get rdlck 2023-05-17T14:25:13.942 INFO:teuthology.orchestra.run.smithi088.stdout: get rdlck 2023-05-17T14:25:13.942 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.942 INFO:teuthology.orchestra.run.smithi088.stdout: -lock could be placed 2023-05-17T14:25:13.942 INFO:teuthology.orchestra.run.smithi088.stdout: +get rdlck 2023-05-17T14:25:13.942 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.942 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.942 INFO:teuthology.orchestra.run.smithi088.stdout: lock could be placed 2023-05-17T14:25:13.943 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/478 2023-05-17T14:25:13.943 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/478 2023-05-17T14:25:13.943 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:25:13.946 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:13.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:25:13.965 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:25:13.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:25:13.966 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-05-17T14:25:14.374 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:14.386 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:14.386 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:14.742 INFO:teuthology.orchestra.run.smithi088.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:14.751 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/479 2023-05-17T14:25:14.751 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/479 2023-05-17T14:25:14.751 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:14.756 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:14.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:14.776 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-05-17T14:25:15.167 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:15.178 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:15.178 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:15.505 INFO:teuthology.orchestra.run.smithi088.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:15.513 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/480 2023-05-17T14:25:15.514 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/480 2023-05-17T14:25:15.514 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:15.519 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:15.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:15.538 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-05-17T14:25:15.926 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:15.938 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:16.236 INFO:teuthology.orchestra.run.smithi088.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:16.245 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/481 2023-05-17T14:25:16.245 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/481 2023-05-17T14:25:16.245 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:16.250 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:16.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:16.270 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-05-17T14:25:16.659 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:16.670 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:16.670 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:17.079 INFO:teuthology.orchestra.run.smithi088.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:17.087 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/482 2023-05-17T14:25:17.088 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/482 2023-05-17T14:25:17.088 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:17.093 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:17.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:17.113 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-05-17T14:25:17.501 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:17.512 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:17.513 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:17.819 INFO:teuthology.orchestra.run.smithi088.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:17.828 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/483 2023-05-17T14:25:17.828 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/483 2023-05-17T14:25:17.828 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:17.833 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:17.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:17.852 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-05-17T14:25:18.241 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:18.252 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:18.253 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:18.587 INFO:teuthology.orchestra.run.smithi088.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:18.595 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/484 2023-05-17T14:25:18.595 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/484 2023-05-17T14:25:18.596 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:18.601 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:18.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:18.619 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-05-17T14:25:19.015 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:19.026 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:19.026 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:20.610 INFO:teuthology.orchestra.run.smithi088.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-17T14:25:20.618 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/485 2023-05-17T14:25:20.618 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/485 2023-05-17T14:25:20.619 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:20.624 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:20.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:20.644 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-05-17T14:25:21.380 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:21.391 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:21.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:21.715 INFO:teuthology.orchestra.run.smithi088.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:21.724 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/486 2023-05-17T14:25:21.724 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/486 2023-05-17T14:25:21.724 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:21.729 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:21.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:21.749 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-05-17T14:25:22.145 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:22.156 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:22.156 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:22.460 INFO:teuthology.orchestra.run.smithi088.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:22.468 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/487 2023-05-17T14:25:22.468 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/487 2023-05-17T14:25:22.469 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:22.474 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:22.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:22.493 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-05-17T14:25:22.876 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:22.887 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:22.888 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:23.168 INFO:teuthology.orchestra.run.smithi088.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:23.176 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/488 2023-05-17T14:25:23.176 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/488 2023-05-17T14:25:23.176 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:23.181 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:23.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:23.201 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-05-17T14:25:23.590 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:23.602 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:23.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:23.910 INFO:teuthology.orchestra.run.smithi088.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/489 2023-05-17T14:25:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/489 2023-05-17T14:25:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:23.924 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:23.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:23.943 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-05-17T14:25:24.329 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:24.341 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:24.341 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:25.620 INFO:teuthology.orchestra.run.smithi088.stdout:generic/490 1s 2023-05-17T14:25:25.632 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/490 2023-05-17T14:25:25.632 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:25.637 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:25.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:25.657 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-05-17T14:25:26.402 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:26.413 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:26.413 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:26.693 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:25:26.697 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:25:26.719 INFO:teuthology.orchestra.run.smithi088.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:26.728 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/491 2023-05-17T14:25:26.728 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/491 2023-05-17T14:25:26.728 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:26.734 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:26.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:26.753 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-05-17T14:25:27.181 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:27.193 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:27.193 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:27.471 INFO:teuthology.orchestra.run.smithi088.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:27.480 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/492 2023-05-17T14:25:27.480 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/492 2023-05-17T14:25:27.480 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:27.485 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:27.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:27.505 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-05-17T14:25:27.897 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:27.908 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:27.908 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:28.190 INFO:teuthology.orchestra.run.smithi088.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:28.198 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/493 2023-05-17T14:25:28.198 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/493 2023-05-17T14:25:28.198 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:28.203 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:28.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:28.222 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-05-17T14:25:28.610 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:28.621 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:28.621 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:28.903 INFO:teuthology.orchestra.run.smithi088.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:28.912 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/494 2023-05-17T14:25:28.912 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/494 2023-05-17T14:25:28.912 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:28.917 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:28.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:28.936 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-05-17T14:25:29.329 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:29.340 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:29.340 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:29.618 INFO:teuthology.orchestra.run.smithi088.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:29.626 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/495 2023-05-17T14:25:29.626 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/495 2023-05-17T14:25:29.626 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:29.632 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:29.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:29.651 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-05-17T14:25:30.036 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:30.048 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:30.048 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:30.341 INFO:teuthology.orchestra.run.smithi088.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:30.349 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/496 2023-05-17T14:25:30.350 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/496 2023-05-17T14:25:30.350 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:30.355 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:30.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:30.374 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-05-17T14:25:30.762 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:30.773 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:31.054 INFO:teuthology.orchestra.run.smithi088.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:31.062 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/497 2023-05-17T14:25:31.062 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/497 2023-05-17T14:25:31.062 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:31.068 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:31.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:31.087 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-05-17T14:25:31.473 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:31.485 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:31.796 INFO:teuthology.orchestra.run.smithi088.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:31.805 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/498 2023-05-17T14:25:31.805 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/498 2023-05-17T14:25:31.805 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:31.810 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:31.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:31.829 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-05-17T14:25:32.225 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:32.236 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:32.236 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:32.518 INFO:teuthology.orchestra.run.smithi088.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:32.526 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/499 2023-05-17T14:25:32.527 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/499 2023-05-17T14:25:32.527 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:32.532 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:32.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:32.551 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-05-17T14:25:32.942 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:32.953 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:32.953 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:33.317 INFO:teuthology.orchestra.run.smithi088.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:33.325 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/500 2023-05-17T14:25:33.325 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/500 2023-05-17T14:25:33.326 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:33.331 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:33.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:33.350 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-05-17T14:25:33.739 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:33.751 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:33.751 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:34.067 INFO:teuthology.orchestra.run.smithi088.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:34.076 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/501 2023-05-17T14:25:34.076 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/501 2023-05-17T14:25:34.076 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:34.081 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:34.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:34.101 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-05-17T14:25:34.490 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:34.502 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:34.502 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:34.813 INFO:teuthology.orchestra.run.smithi088.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:34.821 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/502 2023-05-17T14:25:34.821 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/502 2023-05-17T14:25:34.821 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:34.826 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:34.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:34.846 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-05-17T14:25:35.237 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:35.249 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:35.249 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:35.548 INFO:teuthology.orchestra.run.smithi088.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:35.557 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/503 2023-05-17T14:25:35.557 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/503 2023-05-17T14:25:35.557 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:35.562 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:35.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:35.581 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-05-17T14:25:35.974 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:35.986 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:35.986 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:36.353 INFO:teuthology.orchestra.run.smithi088.stdout:generic/504 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/504.out.bad) 2023-05-17T14:25:36.358 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/504.out 2023-05-17 12:27:04.870537311 +0000 2023-05-17T14:25:36.358 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/504.out.bad 2023-05-17 14:25:36.346601406 +0000 2023-05-17T14:25:36.358 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,2 +1,3 @@ 2023-05-17T14:25:36.359 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 504 2023-05-17T14:25:36.359 INFO:teuthology.orchestra.run.smithi088.stdout: +lock info not found 2023-05-17T14:25:36.359 INFO:teuthology.orchestra.run.smithi088.stdout: Silence is golden 2023-05-17T14:25:36.363 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/504 2023-05-17T14:25:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/504 2023-05-17T14:25:36.364 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T14:25:36.369 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:36.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T14:25:36.388 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T14:25:36.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T14:25:36.389 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-05-17T14:25:36.782 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:36.794 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:36.794 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:37.073 INFO:teuthology.orchestra.run.smithi088.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:37.081 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/505 2023-05-17T14:25:37.082 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/505 2023-05-17T14:25:37.082 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:37.087 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:37.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:37.106 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-05-17T14:25:37.504 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:37.515 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:37.516 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:37.802 INFO:teuthology.orchestra.run.smithi088.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:37.811 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/506 2023-05-17T14:25:37.811 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/506 2023-05-17T14:25:37.811 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:37.816 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:37.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:37.836 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-05-17T14:25:38.222 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:38.233 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:38.233 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:38.583 INFO:teuthology.orchestra.run.smithi088.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-05-17T14:25:38.591 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/507 2023-05-17T14:25:38.592 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/507 2023-05-17T14:25:38.592 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:38.597 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:38.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:38.616 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-05-17T14:25:39.004 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:39.016 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:39.016 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:39.315 INFO:teuthology.orchestra.run.smithi088.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-05-17T14:25:39.323 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/508 2023-05-17T14:25:39.324 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/508 2023-05-17T14:25:39.324 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:39.329 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:39.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:39.348 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-05-17T14:25:39.737 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:39.748 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:39.748 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:40.057 INFO:teuthology.orchestra.run.smithi088.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:40.066 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/509 2023-05-17T14:25:40.066 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/509 2023-05-17T14:25:40.066 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:40.071 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:40.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:40.091 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-05-17T14:25:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:40.491 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:40.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:40.805 INFO:teuthology.orchestra.run.smithi088.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:40.813 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/510 2023-05-17T14:25:40.813 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/510 2023-05-17T14:25:40.814 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:40.819 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:40.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:40.837 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-05-17T14:25:41.222 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:41.234 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:41.234 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:41.515 INFO:teuthology.orchestra.run.smithi088.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:41.524 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/511 2023-05-17T14:25:41.524 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/511 2023-05-17T14:25:41.524 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:41.529 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:41.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:41.548 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-05-17T14:25:41.938 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:41.949 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:41.949 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:42.253 INFO:teuthology.orchestra.run.smithi088.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:42.261 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/512 2023-05-17T14:25:42.262 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/512 2023-05-17T14:25:42.262 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:42.267 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:42.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:42.288 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-05-17T14:25:42.681 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:42.693 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:42.693 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:42.976 INFO:teuthology.orchestra.run.smithi088.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:42.984 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/513 2023-05-17T14:25:42.985 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/513 2023-05-17T14:25:42.985 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:42.990 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:43.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:43.009 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-05-17T14:25:43.399 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:43.410 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:43.410 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:43.691 INFO:teuthology.orchestra.run.smithi088.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:43.699 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/514 2023-05-17T14:25:43.699 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/514 2023-05-17T14:25:43.699 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:43.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:43.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:43.723 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-05-17T14:25:44.112 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:44.123 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:44.124 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:44.404 INFO:teuthology.orchestra.run.smithi088.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:44.412 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/515 2023-05-17T14:25:44.413 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/515 2023-05-17T14:25:44.413 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:44.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:44.438 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-05-17T14:25:44.826 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:44.837 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:44.837 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:45.212 INFO:teuthology.orchestra.run.smithi088.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-17T14:25:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/516 2023-05-17T14:25:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/516 2023-05-17T14:25:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:45.226 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:45.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:45.245 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-05-17T14:25:45.982 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:45.994 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:45.994 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:46.272 INFO:teuthology.orchestra.run.smithi088.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:46.281 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/517 2023-05-17T14:25:46.281 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/517 2023-05-17T14:25:46.281 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:46.286 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:46.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:46.306 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-05-17T14:25:46.690 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:46.701 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:46.981 INFO:teuthology.orchestra.run.smithi088.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/518 2023-05-17T14:25:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/518 2023-05-17T14:25:46.989 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:46.995 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:47.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:47.014 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-05-17T14:25:47.405 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:47.416 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:47.416 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:47.696 INFO:teuthology.orchestra.run.smithi088.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:47.704 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/519 2023-05-17T14:25:47.704 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/519 2023-05-17T14:25:47.704 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:47.710 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:47.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:47.728 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-05-17T14:25:48.120 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:48.131 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:48.131 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:48.437 INFO:teuthology.orchestra.run.smithi088.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T14:25:48.445 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/520 2023-05-17T14:25:48.446 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/520 2023-05-17T14:25:48.446 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T14:25:48.451 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:48.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T14:25:48.471 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-05-17T14:25:48.856 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T14:25:48.867 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T14:25:48.867 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T14:25:56.872 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:25:56.876 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:26:26.990 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:26:26.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:26:57.099 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:26:57.103 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:26:57.183 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T14:26:57.180+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117697) UID: 0 2023-05-17T14:26:57.184 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T14:26:57.180+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117697) UID: 0 2023-05-17T14:26:57.184 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T14:26:57.180+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117697) UID: 0 2023-05-17T14:26:57.184 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T14:26:57.180+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117697) UID: 0 2023-05-17T14:30:01.369 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:30:01.373 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:30:31.566 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:30:31.571 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:31:01.676 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:31:01.681 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:31:31.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:31:31.784 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:32:01.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:32:01.898 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:32:31.992 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:32:31.997 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:33:02.289 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:33:02.293 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:33:33.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:33:33.136 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:34:03.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:34:03.254 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:34:33.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:34:33.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:35:03.467 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:35:03.472 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:35:33.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:35:33.592 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:36:03.739 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:36:03.744 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:36:33.859 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:36:33.863 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:37:04.152 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:37:04.157 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:37:34.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:37:34.282 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:38:04.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:38:04.383 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:38:34.510 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:38:34.515 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:39:04.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:39:04.628 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:39:34.785 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:39:34.790 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:40:04.914 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:40:04.920 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:40:35.953 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:40:35.957 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:41:06.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:41:06.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:41:36.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:41:36.325 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:42:06.434 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:42:06.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:42:36.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:42:36.534 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:43:06.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:43:06.664 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:43:36.781 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:43:36.786 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:44:06.902 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:44:06.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:44:37.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:44:37.021 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:45:07.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:45:07.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:45:37.667 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:45:37.672 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:46:07.771 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:46:07.777 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:46:37.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:46:37.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:47:08.136 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:47:08.140 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:47:39.445 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:47:39.449 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:48:09.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:48:09.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:48:39.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:48:39.686 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:49:10.334 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:49:10.339 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:49:40.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:49:40.535 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:50:10.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:50:10.648 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:50:40.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:50:40.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:51:10.921 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:51:10.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:51:41.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:51:41.036 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:11.128 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:11.132 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:41.232 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:52:41.236 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:11.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:11.332 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:53:11.413 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T14:53:11.409+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119075) UID: 0 2023-05-17T14:53:11.414 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T14:53:11.409+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119075) UID: 0 2023-05-17T14:53:11.414 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T14:53:11.409+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119075) UID: 0 2023-05-17T14:53:11.414 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T14:53:11.409+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119075) UID: 0 2023-05-17T14:53:11.432 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T14:53:11.428+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541599) UID: 0 2023-05-17T14:53:11.432 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T14:53:11.428+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541599) UID: 0 2023-05-17T14:53:11.433 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T14:53:11.428+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541599) UID: 0 2023-05-17T14:53:11.433 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T14:53:11.428+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541599) UID: 0 2023-05-17T14:56:08.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:08.828 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:39.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:56:39.125 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:09.222 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:09.227 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:39.335 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:57:39.340 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:09.457 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:09.462 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:39.796 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:58:39.800 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:09.899 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:09.904 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:40.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T14:59:40.035 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:10.142 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:10.146 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:40.240 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:00:40.244 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:10.369 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:10.375 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:40.499 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:01:40.504 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:10.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:10.600 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:40.705 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:02:40.710 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:10.818 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:10.823 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:40.939 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:03:40.943 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:11.051 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:11.056 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:41.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:04:41.158 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:11.260 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:11.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:41.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:05:41.376 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:11.484 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:11.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:41.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:06:41.634 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:11.749 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:11.753 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:41.849 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:07:41.854 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:11.953 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:11.958 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:42.058 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:08:42.063 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:12.652 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:12.657 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:42.789 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:09:42.794 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:12.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:12.940 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:43.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:43.225 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:10:44.350 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T15:10:44.345+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119965) UID: 0 2023-05-17T15:10:44.350 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T15:10:44.346+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119965) UID: 0 2023-05-17T15:10:44.351 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T15:10:44.346+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119965) UID: 0 2023-05-17T15:10:44.383 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T15:10:44.346+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119965) UID: 0 2023-05-17T15:13:29.748 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:13:29.754 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:00.250 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:00.256 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:30.348 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:14:30.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:00.486 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:00.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:30.607 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:15:30.612 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:00.737 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:00.742 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:31.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:16:31.006 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:01.156 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:01.161 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:31.320 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:17:31.325 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:01.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:01.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:31.538 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:18:31.542 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:01.661 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:01.666 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:19:01.750 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T15:19:01.746+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120331) UID: 0 2023-05-17T15:19:01.751 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T15:19:01.746+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120331) UID: 0 2023-05-17T15:19:01.751 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T15:19:01.746+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120331) UID: 0 2023-05-17T15:19:01.751 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T15:19:01.746+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120331) UID: 0 2023-05-17T15:21:57.535 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:21:57.540 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:26.964 INFO:teuthology.orchestra.run.smithi088.stdout:generic/521 3398s 2023-05-17T15:22:26.976 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/521 2023-05-17T15:22:26.976 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T15:22:26.981 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T15:22:27.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T15:22:27.123 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-05-17T15:22:27.661 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:27.665 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:27.744 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T15:22:27.755 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T15:22:27.755 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T15:22:57.768 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:22:57.772 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:27.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:27.878 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:58.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:23:58.180 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:28.304 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:28.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:58.639 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:24:58.643 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:29.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:29.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:59.434 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:25:59.439 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:30.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:26:30.444 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:00.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:00.546 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:27:00.631 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T15:27:00.627+0000 7fcc4c1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 543669) UID: 0 2023-05-17T15:27:00.632 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T15:27:00.627+0000 7f36767f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 543669) UID: 0 2023-05-17T15:29:17.063 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T15:29:17.058+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543689) UID: 0 2023-05-17T15:29:17.078 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T15:29:17.058+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543689) UID: 0 2023-05-17T15:29:17.079 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T15:29:17.058+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543689) UID: 0 2023-05-17T15:29:17.079 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T15:29:17.058+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543689) UID: 0 2023-05-17T15:32:33.516 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:32:33.521 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:33:03.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:33:03.798 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:33:33.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:33:33.902 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:34:04.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:34:04.023 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:34:34.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:34:34.146 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:35:04.246 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:35:04.250 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:35:34.351 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:35:34.356 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:36:04.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:36:04.469 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:36:34.637 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:36:34.642 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:37:05.418 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:37:05.422 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:37:35.521 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:37:35.525 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:38:05.633 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:38:05.637 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:38:35.740 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:38:35.745 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:39:05.902 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:39:05.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:39:36.003 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:39:36.007 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:40:06.107 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:40:06.111 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:40:36.311 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:40:36.315 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:41:06.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:41:06.420 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:41:36.527 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:41:36.532 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:42:06.642 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:42:06.646 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:42:36.755 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:42:36.759 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:43:06.865 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:43:06.869 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:43:36.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:43:36.989 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:43:37.072 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T15:43:37.068+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 544378) UID: 0 2023-05-17T15:43:37.073 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T15:43:37.068+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 544378) UID: 0 2023-05-17T15:43:37.073 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T15:43:37.068+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 544378) UID: 0 2023-05-17T15:43:37.074 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T15:43:37.068+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 544378) UID: 0 2023-05-17T15:46:52.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:46:52.036 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:47:22.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:47:22.146 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:47:52.311 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:47:52.316 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:48:22.474 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:48:22.478 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:48:22.560 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T15:48:22.556+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121514) UID: 0 2023-05-17T15:48:22.560 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T15:48:22.556+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121514) UID: 0 2023-05-17T15:48:22.561 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T15:48:22.556+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121514) UID: 0 2023-05-17T15:48:22.561 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T15:48:22.556+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121514) UID: 0 2023-05-17T15:51:17.963 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:51:17.967 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:51:48.090 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:51:48.141 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:52:18.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:52:18.266 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:52:48.458 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:52:48.462 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:53:18.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:53:18.577 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:53:48.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:53:48.679 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:54:18.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:54:18.800 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:54:48.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:54:48.988 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:55:19.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:55:19.125 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:55:50.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:55:50.378 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:56:20.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:56:20.604 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:56:50.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:56:50.711 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:57:20.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:57:20.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:57:50.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:57:51.003 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:58:21.178 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:58:21.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:58:51.272 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:58:51.276 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:59:21.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:59:21.383 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:59:51.547 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:59:51.551 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T15:59:58.208 INFO:teuthology.orchestra.run.smithi088.stdout:generic/522 2251s 2023-05-17T15:59:58.261 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/522 2023-05-17T15:59:58.261 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T15:59:58.267 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T15:59:58.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T15:59:58.288 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-05-17T15:59:58.832 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T15:59:58.843 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T15:59:58.844 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T15:59:59.158 INFO:teuthology.orchestra.run.smithi088.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T15:59:59.166 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/523 2023-05-17T15:59:59.167 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/523 2023-05-17T15:59:59.167 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T15:59:59.172 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T15:59:59.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T15:59:59.192 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-05-17T15:59:59.592 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T15:59:59.603 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T15:59:59.603 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T15:59:59.876 INFO:teuthology.orchestra.run.smithi088.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T15:59:59.884 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/524 2023-05-17T15:59:59.884 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/524 2023-05-17T15:59:59.884 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T15:59:59.890 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T15:59:59.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T15:59:59.910 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-05-17T16:00:00.305 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:00.316 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:00.316 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:00.592 INFO:teuthology.orchestra.run.smithi088.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:00:00.601 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/525 2023-05-17T16:00:00.601 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/525 2023-05-17T16:00:00.601 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:00.606 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:00.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:00.627 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-05-17T16:00:01.017 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:01.028 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:01.028 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:01.393 INFO:teuthology.orchestra.run.smithi088.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:00:01.401 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/526 2023-05-17T16:00:01.401 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/526 2023-05-17T16:00:01.401 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:01.407 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:01.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:01.427 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-05-17T16:00:01.823 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:01.834 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:01.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:02.135 INFO:teuthology.orchestra.run.smithi088.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:00:02.143 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/527 2023-05-17T16:00:02.144 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/527 2023-05-17T16:00:02.144 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:02.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:02.168 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-05-17T16:00:02.558 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:02.569 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:02.569 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:02.910 INFO:teuthology.orchestra.run.smithi088.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-05-17T16:00:02.918 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/528 2023-05-17T16:00:02.919 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/528 2023-05-17T16:00:02.919 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:02.924 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:02.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:02.944 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-05-17T16:00:03.338 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:03.349 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:03.349 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:03.677 INFO:teuthology.orchestra.run.smithi088.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-17T16:00:03.685 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/529 2023-05-17T16:00:03.685 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/529 2023-05-17T16:00:03.686 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:03.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:03.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:03.710 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-05-17T16:00:04.103 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:04.114 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:04.114 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:04.393 INFO:teuthology.orchestra.run.smithi088.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:00:04.401 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/530 2023-05-17T16:00:04.401 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/530 2023-05-17T16:00:04.401 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:04.406 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:04.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:04.425 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-05-17T16:00:04.813 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:04.825 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:04.825 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:05.104 INFO:teuthology.orchestra.run.smithi088.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:00:05.113 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/531 2023-05-17T16:00:05.113 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/531 2023-05-17T16:00:05.113 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:05.118 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:05.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:05.138 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-05-17T16:00:05.524 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:05.535 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:05.535 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:05.915 INFO:teuthology.orchestra.run.smithi088.stdout:generic/532 0s 2023-05-17T16:00:05.926 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/532 2023-05-17T16:00:05.927 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:05.932 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:05.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:05.951 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-05-17T16:00:06.346 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:06.358 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:07.035 INFO:teuthology.orchestra.run.smithi088.stdout:generic/533 1s 2023-05-17T16:00:07.046 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/533 2023-05-17T16:00:07.046 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:07.052 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:07.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:07.070 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-05-17T16:00:07.459 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:07.471 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:07.471 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:07.771 INFO:teuthology.orchestra.run.smithi088.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:00:07.779 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/534 2023-05-17T16:00:07.780 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/534 2023-05-17T16:00:07.780 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:07.785 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:07.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:07.805 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-05-17T16:00:08.190 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:08.201 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:08.202 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:08.501 INFO:teuthology.orchestra.run.smithi088.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:00:08.509 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/535 2023-05-17T16:00:08.509 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/535 2023-05-17T16:00:08.509 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:08.514 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:08.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:08.535 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-05-17T16:00:08.928 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:08.940 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:08.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:09.221 INFO:teuthology.orchestra.run.smithi088.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:00:09.229 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/536 2023-05-17T16:00:09.229 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/536 2023-05-17T16:00:09.230 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:09.235 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:09.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:09.255 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-05-17T16:00:09.657 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:09.669 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:09.669 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:10.133 INFO:teuthology.orchestra.run.smithi088.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:00:10.142 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/537 2023-05-17T16:00:10.142 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/537 2023-05-17T16:00:10.142 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:00:10.147 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:10.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:00:10.167 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-05-17T16:00:10.553 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:00:10.564 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:00:10.565 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:00:21.693 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:00:21.698 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:00:51.867 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:00:51.872 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:01:21.965 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:01:21.970 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:01:52.069 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:01:52.074 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:02:22.275 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:02:22.279 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:02:22.461 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T16:02:22.457+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 553044) UID: 0 2023-05-17T16:02:22.461 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T16:02:22.458+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 553044) UID: 0 2023-05-17T16:02:22.462 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T16:02:22.458+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 553044) UID: 0 2023-05-17T16:02:22.462 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T16:02:22.458+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 553044) UID: 0 2023-05-17T16:05:14.042 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:05:14.047 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:05:14.126 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T16:05:14.123+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122257) UID: 0 2023-05-17T16:05:14.127 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T16:05:14.123+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122257) UID: 0 2023-05-17T16:05:14.127 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T16:05:14.123+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122257) UID: 0 2023-05-17T16:05:14.128 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T16:05:14.123+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122257) UID: 0 2023-05-17T16:07:58.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:07:58.784 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:08:28.948 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:08:28.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:08:59.053 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:08:59.058 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:09:29.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:09:29.163 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:09:59.903 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:09:59.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:10:30.008 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:10:30.013 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:11:00.135 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:11:00.139 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:11:30.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:11:30.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:12:00.339 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:12:00.344 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:12:30.511 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:12:30.515 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:13:00.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:13:00.639 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:13:30.753 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:13:30.757 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:14:00.916 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:14:00.921 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:14:31.054 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:14:31.059 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:15:01.150 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:15:01.154 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:15:31.247 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:15:31.252 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:16:01.382 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:16:01.387 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:16:31.508 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:16:31.513 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:16:31.597 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T16:16:31.593+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555505) UID: 0 2023-05-17T16:16:31.597 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T16:16:31.593+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555505) UID: 0 2023-05-17T16:16:31.598 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T16:16:31.593+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555505) UID: 0 2023-05-17T16:16:31.598 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T16:16:31.593+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555505) UID: 0 2023-05-17T16:19:36.576 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:19:36.603 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:20:06.803 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:20:06.807 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:20:36.907 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:20:36.912 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:21:07.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:21:07.041 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:21:37.155 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:21:37.159 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:22:07.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:22:07.285 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:22:37.438 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:22:37.443 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:23:07.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:23:07.543 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:23:37.665 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:23:37.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:24:07.986 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:24:07.991 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:24:38.089 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:24:38.094 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:25:08.243 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:25:08.247 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:25:38.347 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:25:38.351 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:26:08.459 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:26:08.463 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:26:38.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:26:38.610 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:27:08.725 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:27:08.729 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:27:38.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:27:38.846 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:28:08.950 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:28:08.954 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:28:39.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:28:39.095 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:29:09.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:29:09.204 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:29:39.734 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:29:39.739 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:30:09.832 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:30:09.836 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:30:39.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:30:39.949 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:31:10.039 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:31:10.044 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:31:40.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:31:40.173 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:32:10.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:32:10.311 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:32:41.202 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:32:41.207 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:33:11.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:33:11.312 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:33:41.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:33:41.434 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:34:11.538 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:34:11.542 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:34:41.667 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:34:41.672 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:35:11.871 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:35:11.876 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:35:41.992 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:35:41.996 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:36:12.102 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:36:12.106 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:36:42.216 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:36:42.220 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:37:12.379 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:37:12.383 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:37:42.491 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:37:42.496 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:38:12.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:38:12.596 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:38:42.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:38:42.696 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:39:12.903 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:39:12.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:39:43.040 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:39:43.045 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:40:13.197 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:40:13.201 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:40:43.369 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:40:43.375 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:41:13.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:41:13.481 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:41:43.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:41:43.694 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:42:13.801 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:42:13.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:42:43.903 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:42:43.908 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:43:14.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:43:14.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:43:44.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:43:44.151 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:44:14.251 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:44:14.256 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:44:44.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:44:44.394 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:45:14.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:45:14.507 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:45:44.607 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:45:44.611 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:46:14.703 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:46:14.707 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:46:44.799 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:46:44.803 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:47:09.347 INFO:teuthology.orchestra.run.smithi088.stdout:generic/538 2819s 2023-05-17T16:47:09.358 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/538 2023-05-17T16:47:09.359 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:09.364 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:09.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:09.410 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-05-17T16:47:10.140 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:10.151 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:10.151 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:12.957 INFO:teuthology.orchestra.run.smithi088.stdout:generic/539 2s 2023-05-17T16:47:12.968 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/539 2023-05-17T16:47:12.969 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:12.974 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:12.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:12.993 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-05-17T16:47:13.730 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:13.742 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:13.742 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:14.055 INFO:teuthology.orchestra.run.smithi088.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:14.064 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/540 2023-05-17T16:47:14.064 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/540 2023-05-17T16:47:14.064 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:14.069 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:14.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:14.088 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-05-17T16:47:14.478 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:14.489 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:14.489 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:14.769 INFO:teuthology.orchestra.run.smithi088.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:14.777 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/541 2023-05-17T16:47:14.777 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/541 2023-05-17T16:47:14.777 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:14.783 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:14.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:14.802 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-05-17T16:47:14.907 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:47:14.911 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:47:15.191 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:15.203 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:15.203 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:15.482 INFO:teuthology.orchestra.run.smithi088.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:15.490 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/542 2023-05-17T16:47:15.490 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/542 2023-05-17T16:47:15.490 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:15.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:15.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:15.514 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-05-17T16:47:15.903 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:15.914 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:15.915 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:16.192 INFO:teuthology.orchestra.run.smithi088.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:16.200 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/543 2023-05-17T16:47:16.200 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/543 2023-05-17T16:47:16.200 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:16.206 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:16.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:16.225 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-05-17T16:47:16.608 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:16.619 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:16.619 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:16.903 INFO:teuthology.orchestra.run.smithi088.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:16.911 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/544 2023-05-17T16:47:16.911 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/544 2023-05-17T16:47:16.912 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:16.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:16.935 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-05-17T16:47:17.325 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:17.336 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:17.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:17.712 INFO:teuthology.orchestra.run.smithi088.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-05-17T16:47:17.720 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/545 2023-05-17T16:47:17.720 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/545 2023-05-17T16:47:17.720 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:17.726 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:17.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:17.745 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-05-17T16:47:18.133 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:18.144 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:18.144 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:18.554 INFO:teuthology.orchestra.run.smithi088.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:18.562 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/546 2023-05-17T16:47:18.562 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/546 2023-05-17T16:47:18.562 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:18.567 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:18.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:18.586 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-05-17T16:47:18.981 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:18.992 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:18.993 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:19.307 INFO:teuthology.orchestra.run.smithi088.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:19.315 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/547 2023-05-17T16:47:19.315 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/547 2023-05-17T16:47:19.315 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:19.321 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:19.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:19.340 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-05-17T16:47:19.734 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:19.745 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:19.745 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:20.089 INFO:teuthology.orchestra.run.smithi088.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:20.097 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/548 2023-05-17T16:47:20.097 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/548 2023-05-17T16:47:20.097 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:20.103 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:20.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:20.121 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-05-17T16:47:20.513 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:20.525 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:20.525 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:20.870 INFO:teuthology.orchestra.run.smithi088.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:20.878 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/549 2023-05-17T16:47:20.878 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/549 2023-05-17T16:47:20.878 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:20.884 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:20.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:20.903 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-05-17T16:47:21.296 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:21.307 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:21.651 INFO:teuthology.orchestra.run.smithi088.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:21.659 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/550 2023-05-17T16:47:21.659 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/550 2023-05-17T16:47:21.659 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:21.665 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:21.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:21.684 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-05-17T16:47:22.071 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:22.082 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:22.082 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:22.357 INFO:teuthology.orchestra.run.smithi088.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:22.365 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/551 2023-05-17T16:47:22.366 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/551 2023-05-17T16:47:22.366 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:22.371 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:22.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:22.393 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-05-17T16:47:22.779 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:22.790 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:22.790 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:23.093 INFO:teuthology.orchestra.run.smithi088.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:23.101 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/552 2023-05-17T16:47:23.101 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/552 2023-05-17T16:47:23.101 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:23.106 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:23.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:23.125 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-05-17T16:47:23.518 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:23.529 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:23.529 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:23.954 INFO:teuthology.orchestra.run.smithi088.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-05-17T16:47:23.962 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/553 2023-05-17T16:47:23.962 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/553 2023-05-17T16:47:23.962 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:23.968 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:24.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:24.032 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-05-17T16:47:24.710 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:24.721 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:24.721 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:24.996 INFO:teuthology.orchestra.run.smithi088.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:25.004 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/554 2023-05-17T16:47:25.004 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/554 2023-05-17T16:47:25.004 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:25.010 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:25.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:25.029 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-05-17T16:47:25.415 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:25.426 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:25.426 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:25.839 INFO:teuthology.orchestra.run.smithi088.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-05-17T16:47:25.847 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/555 2023-05-17T16:47:25.847 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/555 2023-05-17T16:47:25.848 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:25.853 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:25.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:25.936 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-05-17T16:47:26.608 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:26.620 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:26.620 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:26.902 INFO:teuthology.orchestra.run.smithi088.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:26.910 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/556 2023-05-17T16:47:26.911 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/556 2023-05-17T16:47:26.911 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:26.916 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:26.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:26.935 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-05-17T16:47:27.323 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:27.334 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:27.334 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:27.638 INFO:teuthology.orchestra.run.smithi088.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:27.646 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/557 2023-05-17T16:47:27.646 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/557 2023-05-17T16:47:27.647 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:27.652 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:27.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:27.672 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-05-17T16:47:28.063 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:28.074 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:28.074 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:28.396 INFO:teuthology.orchestra.run.smithi088.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:28.404 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/558 2023-05-17T16:47:28.405 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/558 2023-05-17T16:47:28.405 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:28.410 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:28.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:28.429 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-05-17T16:47:28.822 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:28.833 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:28.833 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:29.114 INFO:teuthology.orchestra.run.smithi088.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:29.122 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/559 2023-05-17T16:47:29.122 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/559 2023-05-17T16:47:29.122 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:29.128 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:29.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:29.147 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-05-17T16:47:29.535 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:29.546 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:29.546 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:29.833 INFO:teuthology.orchestra.run.smithi088.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:29.841 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/560 2023-05-17T16:47:29.842 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/560 2023-05-17T16:47:29.842 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:29.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:29.866 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-05-17T16:47:30.258 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:30.270 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:30.270 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:30.552 INFO:teuthology.orchestra.run.smithi088.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:30.560 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/561 2023-05-17T16:47:30.560 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/561 2023-05-17T16:47:30.560 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:30.566 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:30.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:30.585 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-05-17T16:47:30.972 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:30.983 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:30.983 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:31.260 INFO:teuthology.orchestra.run.smithi088.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:31.268 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/562 2023-05-17T16:47:31.269 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/562 2023-05-17T16:47:31.269 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:31.274 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:31.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:31.294 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-05-17T16:47:31.680 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:31.691 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:31.691 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:32.028 INFO:teuthology.orchestra.run.smithi088.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:32.036 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/563 2023-05-17T16:47:32.036 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/563 2023-05-17T16:47:32.036 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:32.042 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:32.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:32.061 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-05-17T16:47:32.452 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:32.463 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:32.464 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-05-17T16:47:33.122 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/564 2023-05-17T16:47:33.122 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/564 2023-05-17T16:47:33.122 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:33.127 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:33.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:33.146 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-05-17T16:47:33.892 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:33.903 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:33.903 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:34.215 INFO:teuthology.orchestra.run.smithi088.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:34.224 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/565 2023-05-17T16:47:34.224 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/565 2023-05-17T16:47:34.224 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:34.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:34.248 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-05-17T16:47:34.643 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:34.654 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:34.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:34.935 INFO:teuthology.orchestra.run.smithi088.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:34.943 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/566 2023-05-17T16:47:34.943 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/566 2023-05-17T16:47:34.943 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:34.949 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:34.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:34.968 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-05-17T16:47:35.355 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:35.366 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:35.366 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:35.649 INFO:teuthology.orchestra.run.smithi088.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:35.657 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/567 2023-05-17T16:47:35.657 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/567 2023-05-17T16:47:35.657 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:35.663 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:35.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:35.682 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-05-17T16:47:36.074 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:36.085 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:36.085 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:36.584 INFO:teuthology.orchestra.run.smithi088.stdout:generic/568 0s 2023-05-17T16:47:36.633 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/568 2023-05-17T16:47:36.633 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:36.651 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:36.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:36.699 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-05-17T16:47:37.244 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:37.256 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:37.256 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:37.615 INFO:teuthology.orchestra.run.smithi088.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:37.623 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/569 2023-05-17T16:47:37.624 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/569 2023-05-17T16:47:37.624 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:37.629 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:37.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:37.648 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-05-17T16:47:38.038 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:38.049 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:38.050 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:38.340 INFO:teuthology.orchestra.run.smithi088.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:38.348 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/570 2023-05-17T16:47:38.348 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/570 2023-05-17T16:47:38.348 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:38.354 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:38.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:38.373 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-05-17T16:47:38.764 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:38.776 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:38.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:45.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:47:45.026 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:47:45.249 INFO:teuthology.orchestra.run.smithi088.stdout:generic/571 7s 2023-05-17T16:47:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/571 2023-05-17T16:47:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:45.267 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:45.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:45.287 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-05-17T16:47:46.016 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:46.028 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:46.028 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:46.307 INFO:teuthology.orchestra.run.smithi088.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:46.316 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/572 2023-05-17T16:47:46.316 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/572 2023-05-17T16:47:46.316 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:46.321 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:46.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:46.341 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-05-17T16:47:46.735 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:46.746 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:46.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:47.046 INFO:teuthology.orchestra.run.smithi088.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/573 2023-05-17T16:47:47.054 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/573 2023-05-17T16:47:47.055 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:47.060 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:47.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:47.079 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-05-17T16:47:47.466 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:47.477 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:47.478 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:47.756 INFO:teuthology.orchestra.run.smithi088.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:47.764 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/574 2023-05-17T16:47:47.764 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/574 2023-05-17T16:47:47.764 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:47.769 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:47.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:47.789 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-05-17T16:47:48.181 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:48.192 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:48.193 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:48.492 INFO:teuthology.orchestra.run.smithi088.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:48.500 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/575 2023-05-17T16:47:48.500 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/575 2023-05-17T16:47:48.500 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:48.505 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:48.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:48.524 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-05-17T16:47:48.941 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:48.952 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:48.952 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:49.323 INFO:teuthology.orchestra.run.smithi088.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:49.331 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/576 2023-05-17T16:47:49.331 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/576 2023-05-17T16:47:49.332 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:49.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:49.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:49.356 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-05-17T16:47:49.742 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:49.753 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:49.753 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:50.041 INFO:teuthology.orchestra.run.smithi088.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:50.050 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/577 2023-05-17T16:47:50.050 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/577 2023-05-17T16:47:50.050 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:50.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:50.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:50.075 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-05-17T16:47:50.469 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:50.480 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:50.480 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:50.863 INFO:teuthology.orchestra.run.smithi088.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T16:47:50.871 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/578 2023-05-17T16:47:50.871 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/578 2023-05-17T16:47:50.871 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:50.876 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:50.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:50.895 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-05-17T16:47:51.632 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:51.643 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:51.643 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:51.961 INFO:teuthology.orchestra.run.smithi088.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:51.969 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/579 2023-05-17T16:47:51.970 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/579 2023-05-17T16:47:51.970 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:51.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:51.994 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-05-17T16:47:52.389 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:52.400 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:52.400 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:52.755 INFO:teuthology.orchestra.run.smithi088.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:52.763 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/580 2023-05-17T16:47:52.764 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/580 2023-05-17T16:47:52.764 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:52.769 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:52.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:52.788 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-05-17T16:47:53.183 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:53.195 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:53.195 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:53.953 INFO:teuthology.orchestra.run.smithi088.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:53.961 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/581 2023-05-17T16:47:53.961 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/581 2023-05-17T16:47:53.961 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:53.966 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:53.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:53.987 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-05-17T16:47:54.385 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:54.396 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:54.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:54.739 INFO:teuthology.orchestra.run.smithi088.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:54.748 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/582 2023-05-17T16:47:54.748 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/582 2023-05-17T16:47:54.748 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:54.753 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:54.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:54.774 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-05-17T16:47:55.169 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:55.180 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:55.180 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:55.518 INFO:teuthology.orchestra.run.smithi088.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:55.527 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/583 2023-05-17T16:47:55.527 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/583 2023-05-17T16:47:55.527 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:55.532 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:55.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:55.552 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-05-17T16:47:55.940 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:55.951 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:56.298 INFO:teuthology.orchestra.run.smithi088.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:56.306 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/584 2023-05-17T16:47:56.307 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/584 2023-05-17T16:47:56.307 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:56.312 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:56.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:56.331 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-05-17T16:47:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:56.736 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:57.012 INFO:teuthology.orchestra.run.smithi088.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:47:57.020 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/585 2023-05-17T16:47:57.020 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/585 2023-05-17T16:47:57.020 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:47:57.026 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:47:57.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:47:57.045 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-05-17T16:47:57.444 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:47:57.456 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:47:57.456 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:15.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:48:15.235 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:48:17.307 INFO:teuthology.orchestra.run.smithi088.stdout:generic/586 20s 2023-05-17T16:48:17.319 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/586 2023-05-17T16:48:17.319 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:17.324 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:17.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:17.353 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-05-17T16:48:18.070 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:18.081 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:18.082 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:18.668 INFO:teuthology.orchestra.run.smithi088.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-17T16:48:18.677 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/587 2023-05-17T16:48:18.677 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/587 2023-05-17T16:48:18.677 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:18.682 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:18.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:18.701 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-05-17T16:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:19.102 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:19.102 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:19.460 INFO:teuthology.orchestra.run.smithi088.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:19.468 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/588 2023-05-17T16:48:19.468 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/588 2023-05-17T16:48:19.469 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:19.474 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:19.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:19.493 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-05-17T16:48:19.888 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:19.899 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:19.899 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:20.189 INFO:teuthology.orchestra.run.smithi088.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:20.197 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/589 2023-05-17T16:48:20.198 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/589 2023-05-17T16:48:20.198 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:20.203 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:20.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:20.222 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-05-17T16:48:20.609 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:20.620 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:20.620 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:20.900 INFO:teuthology.orchestra.run.smithi088.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:20.908 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/590 2023-05-17T16:48:20.908 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/590 2023-05-17T16:48:20.908 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:20.913 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:20.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:20.933 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-05-17T16:48:21.331 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:21.342 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:21.343 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:21.867 INFO:teuthology.orchestra.run.smithi088.stdout:generic/591 0s 2023-05-17T16:48:21.879 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/591 2023-05-17T16:48:21.879 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:21.884 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:21.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:21.904 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-05-17T16:48:22.625 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:22.637 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:22.637 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:22.984 INFO:teuthology.orchestra.run.smithi088.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:22.992 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/592 2023-05-17T16:48:22.992 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/592 2023-05-17T16:48:22.993 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:22.998 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:23.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:23.017 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-05-17T16:48:23.410 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:23.421 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:23.422 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:23.767 INFO:teuthology.orchestra.run.smithi088.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:23.775 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/593 2023-05-17T16:48:23.776 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/593 2023-05-17T16:48:23.776 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:23.781 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:23.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:23.800 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-05-17T16:48:24.195 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:24.207 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:24.207 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:24.488 INFO:teuthology.orchestra.run.smithi088.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:24.497 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/594 2023-05-17T16:48:24.497 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/594 2023-05-17T16:48:24.497 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:24.502 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:24.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:24.522 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-05-17T16:48:24.917 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:24.928 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:24.928 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:25.279 INFO:teuthology.orchestra.run.smithi088.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:25.287 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/595 2023-05-17T16:48:25.287 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/595 2023-05-17T16:48:25.287 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:25.293 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:25.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:25.311 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-05-17T16:48:25.705 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:25.717 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:25.717 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:26.102 INFO:teuthology.orchestra.run.smithi088.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-05-17T16:48:26.110 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/596 2023-05-17T16:48:26.110 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/596 2023-05-17T16:48:26.110 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:26.115 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:26.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:26.135 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-05-17T16:48:26.540 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:26.552 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:26.552 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:27.811 INFO:teuthology.orchestra.run.smithi088.stdout:generic/597 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/597.out.bad) 2023-05-17T16:48:27.816 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/597.out 2023-05-17 12:27:04.884537033 +0000 2023-05-17T16:48:27.816 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/597.out.bad 2023-05-17 16:48:27.784622660 +0000 2023-05-17T16:48:27.816 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -4,11 +4,11 @@ 2023-05-17T16:48:27.817 INFO:teuthology.orchestra.run.smithi088.stdout: fs.protected_symlinks = 0 2023-05-17T16:48:27.817 INFO:teuthology.orchestra.run.smithi088.stdout: successfully followed symlink 2023-05-17T16:48:27.817 INFO:teuthology.orchestra.run.smithi088.stdout: fs.protected_symlinks = 1 2023-05-17T16:48:27.817 INFO:teuthology.orchestra.run.smithi088.stdout: -Permission denied 2023-05-17T16:48:27.817 INFO:teuthology.orchestra.run.smithi088.stdout: +successfully followed symlink 2023-05-17T16:48:27.817 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:27.818 INFO:teuthology.orchestra.run.smithi088.stdout: == Test hardlink create protection when 2023-05-17T16:48:27.818 INFO:teuthology.orchestra.run.smithi088.stdout: == process != target owner and process cannot read target 2023-05-17T16:48:27.818 INFO:teuthology.orchestra.run.smithi088.stdout: fs.protected_hardlinks = 0 2023-05-17T16:48:27.818 INFO:teuthology.orchestra.run.smithi088.stdout: -successfully created hardlink 2023-05-17T16:48:27.818 INFO:teuthology.orchestra.run.smithi088.stdout: +Permission denied 2023-05-17T16:48:27.818 INFO:teuthology.orchestra.run.smithi088.stdout: fs.protected_hardlinks = 1 2023-05-17T16:48:27.818 INFO:teuthology.orchestra.run.smithi088.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-05-17T16:48:27.819 INFO:teuthology.orchestra.run.smithi088.stdout: +Permission denied 2023-05-17T16:48:27.821 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/597 2023-05-17T16:48:27.822 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/597 2023-05-17T16:48:27.822 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T16:48:27.827 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:27.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T16:48:27.846 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T16:48:27.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T16:48:27.847 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-05-17T16:48:28.598 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:28.609 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:28.609 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:29.853 INFO:teuthology.orchestra.run.smithi088.stdout:generic/598 - output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/598.out.bad) 2023-05-17T16:48:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/598.out 2023-05-17 12:27:04.884537033 +0000 2023-05-17T16:48:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/598.out.bad 2023-05-17 16:48:29.846582027 +0000 2023-05-17T16:48:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -5,13 +5,10 @@ 2023-05-17T16:48:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: = only group writable dir 2023-05-17T16:48:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: fs.protected_regular = 1 2023-05-17T16:48:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: = group & world writable dir 2023-05-17T16:48:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: -Permission denied 2023-05-17T16:48:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: = only group writable dir 2023-05-17T16:48:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: fs.protected_regular = 2 2023-05-17T16:48:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: = group & world writable dir 2023-05-17T16:48:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: -Permission denied 2023-05-17T16:48:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: = only group writable dir 2023-05-17T16:48:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: -Permission denied 2023-05-17T16:48:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-05-17T16:48:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: fs.protected_fifos = 0 2023-05-17T16:48:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -19,10 +16,7 @@ 2023-05-17T16:48:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: = only group writable dir 2023-05-17T16:48:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: fs.protected_fifos = 1 2023-05-17T16:48:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: = group & world writable dir 2023-05-17T16:48:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: -Permission denied 2023-05-17T16:48:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: = only group writable dir 2023-05-17T16:48:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: fs.protected_fifos = 2 2023-05-17T16:48:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: = group & world writable dir 2023-05-17T16:48:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: -Permission denied 2023-05-17T16:48:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: = only group writable dir 2023-05-17T16:48:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: -Permission denied 2023-05-17T16:48:29.864 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/598 2023-05-17T16:48:29.864 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/598 2023-05-17T16:48:29.864 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T16:48:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:29.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T16:48:29.889 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T16:48:29.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T16:48:29.890 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-05-17T16:48:30.621 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:30.632 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:30.632 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:30.928 INFO:teuthology.orchestra.run.smithi088.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:30.937 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/599 2023-05-17T16:48:30.937 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/599 2023-05-17T16:48:30.937 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:30.942 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:30.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:30.963 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-05-17T16:48:31.357 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:31.368 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:31.368 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:31.654 INFO:teuthology.orchestra.run.smithi088.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:31.662 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/600 2023-05-17T16:48:31.662 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/600 2023-05-17T16:48:31.662 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:31.667 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:31.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:31.687 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-05-17T16:48:32.081 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:32.092 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:32.092 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:32.380 INFO:teuthology.orchestra.run.smithi088.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:32.388 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/601 2023-05-17T16:48:32.388 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/601 2023-05-17T16:48:32.388 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:32.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:32.414 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-05-17T16:48:32.807 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:32.819 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:32.819 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:33.181 INFO:teuthology.orchestra.run.smithi088.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:33.190 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/602 2023-05-17T16:48:33.190 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/602 2023-05-17T16:48:33.190 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:33.195 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:33.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:33.215 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-05-17T16:48:33.604 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:33.615 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:33.905 INFO:teuthology.orchestra.run.smithi088.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:33.914 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/603 2023-05-17T16:48:33.914 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/603 2023-05-17T16:48:33.914 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:33.919 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:33.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:33.939 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-05-17T16:48:34.329 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:34.340 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:34.618 INFO:teuthology.orchestra.run.smithi088.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:34.626 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/604 2023-05-17T16:48:34.626 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/604 2023-05-17T16:48:34.626 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:34.632 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:34.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:34.652 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-05-17T16:48:35.046 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:35.057 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:35.057 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:35.340 INFO:teuthology.orchestra.run.smithi088.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:35.348 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/605 2023-05-17T16:48:35.348 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/605 2023-05-17T16:48:35.348 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:35.353 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:35.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:35.374 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-05-17T16:48:35.764 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:35.775 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:36.052 INFO:teuthology.orchestra.run.smithi088.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:36.060 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/606 2023-05-17T16:48:36.060 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/606 2023-05-17T16:48:36.060 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:36.065 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:36.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:36.085 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-05-17T16:48:36.474 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:36.485 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:36.486 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:36.762 INFO:teuthology.orchestra.run.smithi088.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:36.770 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/607 2023-05-17T16:48:36.770 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/607 2023-05-17T16:48:36.771 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:36.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:36.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:36.795 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-05-17T16:48:37.187 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:37.199 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:37.199 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:37.477 INFO:teuthology.orchestra.run.smithi088.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:37.485 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/608 2023-05-17T16:48:37.486 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/608 2023-05-17T16:48:37.486 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:37.491 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:37.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:37.512 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-05-17T16:48:37.903 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:37.914 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:37.915 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:38.540 INFO:teuthology.orchestra.run.smithi088.stdout:generic/609 1s 2023-05-17T16:48:38.552 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/609 2023-05-17T16:48:38.552 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:38.557 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:38.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:38.577 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-05-17T16:48:39.317 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:39.329 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:39.329 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:39.631 INFO:teuthology.orchestra.run.smithi088.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:39.639 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/610 2023-05-17T16:48:39.639 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/610 2023-05-17T16:48:39.639 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:39.645 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:39.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:39.663 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-05-17T16:48:40.061 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:40.073 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:40.073 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:40.390 INFO:teuthology.orchestra.run.smithi088.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:40.398 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/611 2023-05-17T16:48:40.399 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/611 2023-05-17T16:48:40.399 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:40.404 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:40.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:40.424 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-05-17T16:48:40.818 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:40.829 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:40.829 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:41.196 INFO:teuthology.orchestra.run.smithi088.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T16:48:41.204 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/612 2023-05-17T16:48:41.205 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/612 2023-05-17T16:48:41.205 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:41.210 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:41.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:41.229 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-05-17T16:48:41.945 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:41.956 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:41.957 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:42.301 INFO:teuthology.orchestra.run.smithi088.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:42.309 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/613 2023-05-17T16:48:42.309 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/613 2023-05-17T16:48:42.309 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:42.315 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:42.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:42.333 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-05-17T16:48:42.722 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:42.733 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:42.733 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:43.007 INFO:teuthology.orchestra.run.smithi088.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:43.015 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/614 2023-05-17T16:48:43.015 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/614 2023-05-17T16:48:43.015 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:43.021 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:43.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:43.039 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-05-17T16:48:43.431 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:43.442 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:43.442 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:43.719 INFO:teuthology.orchestra.run.smithi088.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:43.728 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/615 2023-05-17T16:48:43.728 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/615 2023-05-17T16:48:43.728 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:43.733 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:43.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:43.753 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-05-17T16:48:44.139 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:44.150 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:44.151 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:44.451 INFO:teuthology.orchestra.run.smithi088.stdout:generic/616 [not run] kernel does not support IO_URING 2023-05-17T16:48:44.459 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/616 2023-05-17T16:48:44.459 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/616 2023-05-17T16:48:44.459 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:44.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:44.484 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-05-17T16:48:44.874 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:44.886 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:44.886 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:45.229 INFO:teuthology.orchestra.run.smithi088.stdout:generic/617 [not run] kernel does not support IO_URING 2023-05-17T16:48:45.237 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/617 2023-05-17T16:48:45.237 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/617 2023-05-17T16:48:45.237 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:45.243 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:45.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:45.261 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-05-17T16:48:45.360 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:48:45.363 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:48:45.650 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:45.661 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:45.661 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:45.943 INFO:teuthology.orchestra.run.smithi088.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:45.951 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/618 2023-05-17T16:48:45.952 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/618 2023-05-17T16:48:45.952 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:45.957 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:45.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:45.976 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-05-17T16:48:46.369 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:46.380 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:46.380 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:46.659 INFO:teuthology.orchestra.run.smithi088.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:46.667 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/619 2023-05-17T16:48:46.668 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/619 2023-05-17T16:48:46.668 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:46.673 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:46.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:46.693 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-05-17T16:48:47.078 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:47.089 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:47.089 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:47.472 INFO:teuthology.orchestra.run.smithi088.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:47.480 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/620 2023-05-17T16:48:47.480 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/620 2023-05-17T16:48:47.480 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:47.485 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:47.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:47.505 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-05-17T16:48:47.893 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:47.905 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:47.905 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:48.248 INFO:teuthology.orchestra.run.smithi088.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:48.257 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/621 2023-05-17T16:48:48.257 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/621 2023-05-17T16:48:48.257 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:48.262 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:48.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:48.281 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-05-17T16:48:48.670 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:48.681 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:48.681 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:48.966 INFO:teuthology.orchestra.run.smithi088.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:48.974 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/622 2023-05-17T16:48:48.975 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/622 2023-05-17T16:48:48.975 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:49.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:49.000 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-05-17T16:48:49.388 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:49.399 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:49.399 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:49.680 INFO:teuthology.orchestra.run.smithi088.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:49.688 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/623 2023-05-17T16:48:49.688 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/623 2023-05-17T16:48:49.688 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:49.694 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:49.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:49.713 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-05-17T16:48:50.103 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:50.114 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:50.114 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:50.392 INFO:teuthology.orchestra.run.smithi088.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:50.400 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/624 2023-05-17T16:48:50.400 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/624 2023-05-17T16:48:50.400 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:50.406 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:50.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:50.424 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-05-17T16:48:50.815 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:50.826 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:50.826 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:51.103 INFO:teuthology.orchestra.run.smithi088.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:51.111 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/625 2023-05-17T16:48:51.111 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/625 2023-05-17T16:48:51.111 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:51.117 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:51.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:51.135 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-05-17T16:48:51.532 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:51.543 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:51.543 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:51.828 INFO:teuthology.orchestra.run.smithi088.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:51.836 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/626 2023-05-17T16:48:51.837 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/626 2023-05-17T16:48:51.837 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:51.842 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:51.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:51.862 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-05-17T16:48:52.256 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:52.267 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:52.267 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:52.553 INFO:teuthology.orchestra.run.smithi088.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/627 2023-05-17T16:48:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/627 2023-05-17T16:48:52.561 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:52.567 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:52.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:52.586 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-05-17T16:48:52.983 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:52.994 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:52.994 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:53.305 INFO:teuthology.orchestra.run.smithi088.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:53.313 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/628 2023-05-17T16:48:53.313 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/628 2023-05-17T16:48:53.313 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:53.319 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:53.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:53.337 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-05-17T16:48:53.729 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:53.740 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:53.740 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:54.042 INFO:teuthology.orchestra.run.smithi088.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:54.050 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/629 2023-05-17T16:48:54.050 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/629 2023-05-17T16:48:54.050 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:54.056 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:54.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:54.075 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-05-17T16:48:54.466 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:54.478 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:54.478 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:54.750 INFO:teuthology.orchestra.run.smithi088.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:54.758 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/630 2023-05-17T16:48:54.758 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/630 2023-05-17T16:48:54.758 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:54.764 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:54.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:54.783 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-05-17T16:48:55.170 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:55.181 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:55.181 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:55.481 INFO:teuthology.orchestra.run.smithi088.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:48:55.489 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/631 2023-05-17T16:48:55.490 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/631 2023-05-17T16:48:55.490 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:48:55.495 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:48:55.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:48:55.514 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-05-17T16:48:55.902 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:48:55.913 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:48:55.913 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:02.309 INFO:teuthology.orchestra.run.smithi088.stdout:generic/632 7s 2023-05-17T16:49:02.321 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/632 2023-05-17T16:49:02.321 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:02.326 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:02.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:02.345 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-05-17T16:49:02.735 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:02.746 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:02.746 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:03.403 INFO:teuthology.orchestra.run.smithi088.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/633.out.bad) 2023-05-17T16:49:03.419 INFO:teuthology.orchestra.run.smithi088.stdout: --- tests/generic/633.out 2023-05-17 12:27:04.889536934 +0000 2023-05-17T16:49:03.419 INFO:teuthology.orchestra.run.smithi088.stdout: +++ /tmp/tmp.buK0S8bWYQxfstests-dev/results//generic/633.out.bad 2023-05-17 16:49:03.389921262 +0000 2023-05-17T16:49:03.419 INFO:teuthology.orchestra.run.smithi088.stdout: @@ -1,2 +1,3 @@ 2023-05-17T16:49:03.419 INFO:teuthology.orchestra.run.smithi088.stdout: QA output created by 633 2023-05-17T16:49:03.420 INFO:teuthology.orchestra.run.smithi088.stdout: Silence is golden 2023-05-17T16:49:03.420 INFO:teuthology.orchestra.run.smithi088.stdout: +vfstest.c: 2418: run_test - Success - failure: setid binaries on regular mounts 2023-05-17T16:49:03.452 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/633 2023-05-17T16:49:03.453 INFO:teuthology.orchestra.run.smithi088.stdout:Failures: generic/633 2023-05-17T16:49:03.453 INFO:teuthology.orchestra.run.smithi088.stdout:Failed 1 of 1 tests 2023-05-17T16:49:03.476 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:03.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T16:49:03.539 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-17T16:49:03.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-17T16:49:03.539 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-05-17T16:49:04.124 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:04.135 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:04.135 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:04.411 INFO:teuthology.orchestra.run.smithi088.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:49:04.419 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/634 2023-05-17T16:49:04.420 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/634 2023-05-17T16:49:04.420 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:04.425 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:04.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:04.445 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-05-17T16:49:04.829 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:04.840 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:04.840 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:05.131 INFO:teuthology.orchestra.run.smithi088.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:49:05.139 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/635 2023-05-17T16:49:05.139 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/635 2023-05-17T16:49:05.139 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:05.145 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:05.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:05.164 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-05-17T16:49:05.555 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:05.566 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:05.566 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:05.843 INFO:teuthology.orchestra.run.smithi088.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:49:05.851 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/636 2023-05-17T16:49:05.851 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/636 2023-05-17T16:49:05.852 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:05.857 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:05.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:05.876 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-05-17T16:49:06.264 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:06.275 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:06.275 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:07.883 INFO:teuthology.orchestra.run.smithi088.stdout:generic/637 1s 2023-05-17T16:49:07.910 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/637 2023-05-17T16:49:07.910 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:07.915 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:07.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:07.938 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-05-17T16:49:08.849 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:08.861 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:08.861 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:09.269 INFO:teuthology.orchestra.run.smithi088.stdout:generic/638 1s 2023-05-17T16:49:09.280 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/638 2023-05-17T16:49:09.280 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:09.286 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:09.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:09.307 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-05-17T16:49:09.696 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:09.707 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:09.708 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:14.344 INFO:teuthology.orchestra.run.smithi088.stdout:generic/639 5s 2023-05-17T16:49:14.357 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/639 2023-05-17T16:49:14.357 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:14.363 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:14.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:14.382 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-05-17T16:49:14.777 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:14.788 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:14.788 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:15.175 INFO:teuthology.orchestra.run.smithi088.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:49:15.183 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/640 2023-05-17T16:49:15.183 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/640 2023-05-17T16:49:15.183 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:15.188 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:15.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:15.209 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-05-17T16:49:15.601 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:15.612 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:15.612 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:15.865 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:49:15.870 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:49:15.898 INFO:teuthology.orchestra.run.smithi088.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:49:15.907 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/641 2023-05-17T16:49:15.907 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/641 2023-05-17T16:49:15.907 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:15.913 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:15.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:15.934 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-05-17T16:49:16.364 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:16.375 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:16.376 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:16.670 INFO:teuthology.orchestra.run.smithi088.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:49:16.678 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/642 2023-05-17T16:49:16.679 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/642 2023-05-17T16:49:16.679 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:16.684 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:16.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:16.703 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-05-17T16:49:17.096 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:17.108 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:17.108 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:17.387 INFO:teuthology.orchestra.run.smithi088.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:49:17.395 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/643 2023-05-17T16:49:17.395 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/643 2023-05-17T16:49:17.395 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:17.400 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:17.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:17.420 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-05-17T16:49:17.813 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:17.825 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:17.825 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:18.117 INFO:teuthology.orchestra.run.smithi088.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-05-17T16:49:18.125 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/644 2023-05-17T16:49:18.126 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/644 2023-05-17T16:49:18.126 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:18.131 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:18.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:18.152 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-05-17T16:49:18.542 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:18.553 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:18.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:18.839 INFO:teuthology.orchestra.run.smithi088.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-05-17T16:49:18.847 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/645 2023-05-17T16:49:18.848 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/645 2023-05-17T16:49:18.848 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:18.853 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:18.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:18.872 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-05-17T16:49:19.261 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:19.272 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:19.272 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:19.548 INFO:teuthology.orchestra.run.smithi088.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:49:19.556 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/646 2023-05-17T16:49:19.556 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/646 2023-05-17T16:49:19.556 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:19.562 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:19.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:19.580 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-05-17T16:49:19.968 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:19.980 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:19.980 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:20.485 INFO:teuthology.orchestra.run.smithi088.stdout:generic/647 0s 2023-05-17T16:49:20.496 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/647 2023-05-17T16:49:20.496 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:20.502 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:20.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:20.522 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-05-17T16:49:21.264 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:21.275 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:21.599 INFO:teuthology.orchestra.run.smithi088.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-05-17T16:49:21.607 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/648 2023-05-17T16:49:21.607 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/648 2023-05-17T16:49:21.607 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:21.612 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:21.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:21.632 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-05-17T16:49:22.019 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:22.030 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:22.030 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:22.419 INFO:teuthology.orchestra.run.smithi088.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-17T16:49:22.428 INFO:teuthology.orchestra.run.smithi088.stdout:Ran: generic/649 2023-05-17T16:49:22.428 INFO:teuthology.orchestra.run.smithi088.stdout:Not run: generic/649 2023-05-17T16:49:22.428 INFO:teuthology.orchestra.run.smithi088.stdout:Passed all 1 tests 2023-05-17T16:49:22.433 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:22.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-17T16:49:22.454 DEBUG:teuthology.orchestra.run.smithi088:> (cd /tmp/tmp.buK0S8bWYQxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-05-17T16:49:23.173 INFO:teuthology.orchestra.run.smithi088.stdout:FSTYP -- ceph-fuse 2023-05-17T16:49:23.184 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM -- Linux/x86_64 smithi088 6.3.0-g2bcb17939031 #1 SMP PREEMPT_DYNAMIC Wed May 17 06:12:56 UTC 2023 2023-05-17T16:49:23.185 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-05-17T16:49:46.052 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:49:46.065 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:50:16.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:50:16.271 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:50:47.312 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:50:47.317 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:51:17.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:51:17.682 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:51:48.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:51:48.049 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:52:18.776 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:52:18.783 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:52:49.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:52:49.060 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:53:19.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:53:19.602 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:53:49.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:53:49.977 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:54:20.494 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:54:20.500 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:54:20.585 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T16:54:20.581+0000 7fcf5c7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124824) UID: 0 2023-05-17T16:54:20.586 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T16:54:20.581+0000 7f11165f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124824) UID: 0 2023-05-17T16:54:20.586 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T16:54:20.581+0000 7fd6da5f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124824) UID: 0 2023-05-17T16:54:20.586 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T16:54:20.581+0000 7fd5763f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124824) UID: 0 2023-05-17T16:57:23.478 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:57:23.484 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:57:54.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:57:54.014 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:58:24.275 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:58:24.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:58:54.827 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:58:54.833 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:59:25.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:59:25.183 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T16:59:25.620 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T16:59:25.616+0000 7fcc4c1f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618578) UID: 0 2023-05-17T16:59:25.621 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T16:59:25.616+0000 7f36767f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 618578) UID: 0 2023-05-17T17:04:42.379 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:04:42.387 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:05:12.698 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:05:12.704 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:05:12.972 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T17:05:12.968+0000 7f53c05f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 621021) UID: 0 2023-05-17T17:05:12.973 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T17:05:12.968+0000 7f59a85f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 621021) UID: 0 2023-05-17T17:05:12.974 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T17:05:12.969+0000 7f63ce9f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 621021) UID: 0 2023-05-17T17:05:12.974 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T17:05:12.969+0000 7f8a999f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 621021) UID: 0 2023-05-17T17:05:34.959 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T17:05:34.953+0000 7f53af5eb700 -1 bdev(0x56091346e380 /var/lib/ceph/osd/ceph-2/block) _sync_write pwritev error: (5) Input/output error 2023-05-17T17:05:34.959 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T17:05:34.953+0000 7f53b5df8700 -1 bdev(0x56091346e380 /var/lib/ceph/osd/ceph-2/block) _aio_thread got r=-5 ((5) Input/output error) 2023-05-17T17:05:34.959 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T17:05:34.954+0000 7f53b65f9700 -1 bdev(0x56091346e000 /var/lib/ceph/osd/ceph-2/block) _aio_thread got r=-5 ((5) Input/output error) 2023-05-17T17:05:34.997 INFO:tasks.ceph.osd.2.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3942-g280675bb/rpm/el8/BUILD/ceph-18.0.0-3942-g280675bb/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f53b5df8700 time 2023-05-17T17:05:34.977187+0000 2023-05-17T17:05:34.997 INFO:tasks.ceph.osd.2.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3942-g280675bb/rpm/el8/BUILD/ceph-18.0.0-3942-g280675bb/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-17T17:05:35.001 INFO:tasks.ceph.osd.2.smithi088.stderr: ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev) 2023-05-17T17:05:35.001 INFO:tasks.ceph.osd.2.smithi088.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x56090fe2edaf] 2023-05-17T17:05:35.002 INFO:tasks.ceph.osd.2.smithi088.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x560910a41fc8] 2023-05-17T17:05:35.002 INFO:tasks.ceph.osd.2.smithi088.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560910a44661] 2023-05-17T17:05:35.002 INFO:tasks.ceph.osd.2.smithi088.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f53cca081ca] 2023-05-17T17:05:35.002 INFO:tasks.ceph.osd.2.smithi088.stderr: 5: clone() 2023-05-17T17:05:35.003 INFO:tasks.ceph.osd.2.smithi088.stderr:*** Caught signal (Aborted) ** 2023-05-17T17:05:35.004 INFO:tasks.ceph.osd.2.smithi088.stderr: in thread 7f53b5df8700 thread_name:bstore_aio 2023-05-17T17:05:35.004 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T17:05:35.000+0000 7f53b5df8700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3942-g280675bb/rpm/el8/BUILD/ceph-18.0.0-3942-g280675bb/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f53b65f9700 time 2023-05-17T17:05:34.978358+0000 2023-05-17T17:05:35.004 INFO:tasks.ceph.osd.2.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3942-g280675bb/rpm/el8/BUILD/ceph-18.0.0-3942-g280675bb/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-17T17:05:35.004 INFO:tasks.ceph.osd.2.smithi088.stderr: 2023-05-17T17:05:35.004 INFO:tasks.ceph.osd.2.smithi088.stderr: ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev) 2023-05-17T17:05:35.004 INFO:tasks.ceph.osd.2.smithi088.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x56090fe2edaf] 2023-05-17T17:05:35.004 INFO:tasks.ceph.osd.2.smithi088.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x560910a41fc8] 2023-05-17T17:05:35.005 INFO:tasks.ceph.osd.2.smithi088.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560910a44661] 2023-05-17T17:05:35.005 INFO:tasks.ceph.osd.2.smithi088.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f53cca081ca] 2023-05-17T17:05:35.005 INFO:tasks.ceph.osd.2.smithi088.stderr: 5: clone() 2023-05-17T17:05:35.005 INFO:tasks.ceph.osd.2.smithi088.stderr: 2023-05-17T17:05:35.005 INFO:tasks.ceph.osd.2.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3942-g280675bb/rpm/el8/BUILD/ceph-18.0.0-3942-g280675bb/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f53b65f9700 time 2023-05-17T17:05:34.978358+0000 2023-05-17T17:05:35.005 INFO:tasks.ceph.osd.2.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3942-g280675bb/rpm/el8/BUILD/ceph-18.0.0-3942-g280675bb/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-17T17:05:35.005 INFO:tasks.ceph.osd.2.smithi088.stderr: ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev) 2023-05-17T17:05:35.006 INFO:tasks.ceph.osd.2.smithi088.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x56090fe2edaf] 2023-05-17T17:05:35.006 INFO:tasks.ceph.osd.2.smithi088.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x560910a41fc8] 2023-05-17T17:05:35.006 INFO:tasks.ceph.osd.2.smithi088.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560910a44661] 2023-05-17T17:05:35.006 INFO:tasks.ceph.osd.2.smithi088.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f53cca081ca] 2023-05-17T17:05:35.006 INFO:tasks.ceph.osd.2.smithi088.stderr: 5: clone() 2023-05-17T17:05:35.006 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-05-17T17:05:35.001+0000 7f53b65f9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3942-g280675bb/rpm/el8/BUILD/ceph-18.0.0-3942-g280675bb/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f53b65f9700 time 2023-05-17T17:05:34.978358+0000 2023-05-17T17:05:35.007 INFO:tasks.ceph.osd.2.smithi088.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3942-g280675bb/rpm/el8/BUILD/ceph-18.0.0-3942-g280675bb/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-05-17T17:05:35.007 INFO:tasks.ceph.osd.2.smithi088.stderr: 2023-05-17T17:05:35.007 INFO:tasks.ceph.osd.2.smithi088.stderr: ceph version 18.0.0-3942-g280675bb (280675bb3d0dbcfdc8e64b09f2328a7c957e9ccb) reef (dev) 2023-05-17T17:05:35.007 INFO:tasks.ceph.osd.2.smithi088.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x56090fe2edaf] 2023-05-17T17:05:35.007 INFO:tasks.ceph.osd.2.smithi088.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x560910a41fc8] 2023-05-17T17:05:35.007 INFO:tasks.ceph.osd.2.smithi088.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560910a44661] 2023-05-17T17:05:35.007 INFO:tasks.ceph.osd.2.smithi088.stderr: 4: /lib64/libpthread.so.0(+0x81ca) [0x7f53cca081ca] 2023-05-17T17:05:35.008 INFO:tasks.ceph.osd.2.smithi088.stderr: 5: clone() 2023-05-17T17:05:35.008 INFO:tasks.ceph.osd.2.smithi088.stderr: 2023-05-17T17:05:49.720 INFO:tasks.ceph.osd.2.smithi088.stderr:daemon-helper: command crashed with signal 6 2023-05-17T17:05:55.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-05-17T17:06:02.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~7s 2023-05-17T17:06:08.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~13s 2023-05-17T17:06:15.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2023-05-17T17:06:21.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~26s 2023-05-17T17:06:28.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~33s 2023-05-17T17:06:35.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2023-05-17T17:06:41.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~46s 2023-05-17T17:06:48.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2023-05-17T17:06:54.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2023-05-17T17:07:01.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~66s 2023-05-17T17:07:08.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~73s 2023-05-17T17:07:14.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~79s 2023-05-17T17:07:21.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~86s 2023-05-17T17:07:28.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~93s 2023-05-17T17:07:34.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2023-05-17T17:07:41.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~106s 2023-05-17T17:07:47.859 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~112s 2023-05-17T17:07:54.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~119s 2023-05-17T17:08:01.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~126s 2023-05-17T17:08:07.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~132s 2023-05-17T17:08:14.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~139s 2023-05-17T17:08:20.900 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2023-05-17T17:08:27.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2023-05-17T17:08:34.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~159s 2023-05-17T17:08:40.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2023-05-17T17:08:47.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~172s 2023-05-17T17:08:53.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~178s 2023-05-17T17:09:00.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~185s 2023-05-17T17:09:07.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~192s 2023-05-17T17:09:13.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~198s 2023-05-17T17:09:20.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2023-05-17T17:09:26.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~211s 2023-05-17T17:09:33.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~218s 2023-05-17T17:09:40.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~225s 2023-05-17T17:09:46.802 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~231s 2023-05-17T17:09:53.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~238s 2023-05-17T17:10:00.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~245s 2023-05-17T17:10:06.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~251s 2023-05-17T17:10:13.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~258s 2023-05-17T17:10:19.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~264s 2023-05-17T17:10:26.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~271s 2023-05-17T17:10:33.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~278s 2023-05-17T17:10:39.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~284s 2023-05-17T17:10:42.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:10:42.519 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:10:46.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~291s 2023-05-17T17:10:52.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~297s 2023-05-17T17:10:59.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~304s 2023-05-17T17:10:59.487 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-05-17T17:10:59.487 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T17:10:59.501 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T17:10:59.681 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345876k,nr_inodes=4086469,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 ceph-fuse /tmp/tmp.3n61ha2sIstest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-05-17T17:10:59.682 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi088.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-05-17T17:10:59.682 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T17:10:59.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T17:10:59.682 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-17T17:10:59.851 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-05-17T17:10:59.851 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T17:10:59.988 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345876k,nr_inodes=4086469,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 ceph-fuse /tmp/tmp.3n61ha2sIstest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-05-17T17:10:59.989 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi088.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-05-17T17:10:59.989 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-05-17T17:10:59.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T17:10:59.990 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-17T17:11:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-05-17T17:11:00.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T17:11:00.153 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T17:11:00.154 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T17:11:00.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345832k,nr_inodes=4086458,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=34,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275004k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-05-17T17:11:00.215 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi187.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-05-17T17:11:00.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T17:11:00.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T17:11:00.216 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-17T17:11:00.304 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-05-17T17:11:00.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T17:11:00.306 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-05-17T17:11:00.306 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-17T17:11:00.351 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345832k,nr_inodes=4086458,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=34,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275004k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-05-17T17:11:00.352 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi187.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-05-17T17:11:00.352 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-05-17T17:11:00.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-17T17:11:00.353 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-17T17:11:00.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-17T17:11:00.438 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-05-17T17:11:02.047 INFO:tasks.ceph.osd.0:Sent signal 15 2023-05-17T17:11:02.048 INFO:tasks.ceph.osd.1:Sent signal 15 2023-05-17T17:11:02.048 INFO:tasks.ceph.osd.3:Sent signal 15 2023-05-17T17:11:02.048 INFO:tasks.ceph.osd.4:Sent signal 15 2023-05-17T17:11:02.049 INFO:tasks.ceph.osd.5:Sent signal 15 2023-05-17T17:11:02.049 INFO:tasks.ceph.osd.6:Sent signal 15 2023-05-17T17:11:02.049 INFO:tasks.ceph.osd.7:Sent signal 15 2023-05-17T17:11:02.050 INFO:tasks.ceph.mds.a:Sent signal 15 2023-05-17T17:11:02.050 INFO:tasks.ceph.mds.c:Sent signal 15 2023-05-17T17:11:02.050 INFO:tasks.ceph.mds.b:Sent signal 15 2023-05-17T17:11:02.050 INFO:tasks.ceph.mds.d:Sent signal 15 2023-05-17T17:11:02.051 INFO:tasks.ceph.mon.a:Sent signal 15 2023-05-17T17:11:02.051 INFO:tasks.ceph.mon.b:Sent signal 15 2023-05-17T17:11:02.051 INFO:tasks.ceph.mon.c:Sent signal 15 2023-05-17T17:11:02.051 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-05-17T17:11:02.052 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-05-17T17:11:02.052 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T17:11:02.044+0000 7f8a999f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 133027) UID: 0 2023-05-17T17:11:02.053 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T17:11:02.044+0000 7f8a999f9700 -1 osd.0 46 *** Got signal Terminated *** 2023-05-17T17:11:02.053 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-05-17T17:11:02.044+0000 7f8a999f9700 -1 osd.0 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-17T17:11:02.053 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T17:11:02.045+0000 7f59a85f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 133034) UID: 0 2023-05-17T17:11:02.053 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T17:11:02.045+0000 7f59a85f9700 -1 osd.1 46 *** Got signal Terminated *** 2023-05-17T17:11:02.053 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-05-17T17:11:02.045+0000 7f59a85f9700 -1 osd.1 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-17T17:11:02.054 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T17:11:02.046+0000 7f63ce9f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 133044) UID: 0 2023-05-17T17:11:02.054 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T17:11:02.046+0000 7f63ce9f9700 -1 osd.3 46 *** Got signal Terminated *** 2023-05-17T17:11:02.054 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-05-17T17:11:02.046+0000 7f63ce9f9700 -1 osd.3 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-17T17:11:02.054 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T17:11:02.047+0000 7fcc4c1f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 151508) UID: 0 2023-05-17T17:11:02.055 INFO:tasks.ceph.mds.a.smithi088.stderr:2023-05-17T17:11:02.047+0000 7fcc4c1f9700 -1 mds.a *** got signal Terminated *** 2023-05-17T17:11:02.055 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-05-17T17:11:02.049+0000 7fd3ba3ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 131054) UID: 0 2023-05-17T17:11:02.055 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-05-17T17:11:02.049+0000 7fd3ba3ff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-05-17T17:11:02.055 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T17:11:02.048+0000 7f36767f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 151510) UID: 0 2023-05-17T17:11:02.056 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-05-17T17:11:02.048+0000 7f36767f9700 -1 mds.c *** got signal Terminated *** 2023-05-17T17:11:02.128 INFO:tasks.ceph.mon.c.smithi187.stderr:2023-05-17T17:11:02.125+0000 7f4e521ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 103896) UID: 0 2023-05-17T17:11:02.128 INFO:tasks.ceph.mon.c.smithi187.stderr:2023-05-17T17:11:02.125+0000 7f4e521ff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-05-17T17:11:02.129 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T17:11:02.125+0000 7fcf5c7f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 104605) UID: 0 2023-05-17T17:11:02.129 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T17:11:02.125+0000 7fcf5c7f9700 -1 osd.7 46 *** Got signal Terminated *** 2023-05-17T17:11:02.129 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-05-17T17:11:02.125+0000 7fcf5c7f9700 -1 osd.7 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-17T17:11:02.129 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T17:11:02.126+0000 7f11165f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 104598) UID: 0 2023-05-17T17:11:02.130 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T17:11:02.126+0000 7f11165f9700 -1 osd.4 46 *** Got signal Terminated *** 2023-05-17T17:11:02.130 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T17:11:02.125+0000 7fd5763f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 104601) UID: 0 2023-05-17T17:11:02.130 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T17:11:02.125+0000 7fd5763f9700 -1 osd.5 46 *** Got signal Terminated *** 2023-05-17T17:11:02.130 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-05-17T17:11:02.125+0000 7fd5763f9700 -1 osd.5 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-17T17:11:02.130 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-05-17T17:11:02.126+0000 7f11165f9700 -1 osd.4 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-17T17:11:02.131 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-05-17T17:11:02.125+0000 7f4e2a7f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 112321) UID: 0 2023-05-17T17:11:02.131 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-05-17T17:11:02.125+0000 7f4e2a7f9700 -1 mds.d *** got signal Terminated *** 2023-05-17T17:11:02.131 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-05-17T17:11:02.126+0000 7f4ffcbf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 112322) UID: 0 2023-05-17T17:11:02.131 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-05-17T17:11:02.126+0000 7f4ffcbf9700 -1 mds.b *** got signal Terminated *** 2023-05-17T17:11:02.132 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T17:11:02.125+0000 7f1d28bf7700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 103900) UID: 0 2023-05-17T17:11:02.132 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-05-17T17:11:02.126+0000 7f1d28bf7700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-05-17T17:11:02.132 INFO:tasks.ceph.mon.b.smithi187.stderr:2023-05-17T17:11:02.126+0000 7f1de87ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 103895) UID: 0 2023-05-17T17:11:02.133 INFO:tasks.ceph.mon.b.smithi187.stderr:2023-05-17T17:11:02.126+0000 7f1de87ff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-05-17T17:11:02.133 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T17:11:02.126+0000 7fd6da5f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 104600) UID: 0 2023-05-17T17:11:02.133 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T17:11:02.126+0000 7fd6da5f9700 -1 osd.6 46 *** Got signal Terminated *** 2023-05-17T17:11:02.133 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-05-17T17:11:02.126+0000 7fd6da5f9700 -1 osd.6 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-17T17:11:02.455 INFO:tasks.ceph.mgr.y.smithi088.stderr:daemon-helper: command crashed with signal 15 2023-05-17T17:11:13.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:11:13.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:11:43.405 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:11:43.412 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:12:13.633 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:12:13.639 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:12:43.916 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:12:43.922 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:13:14.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:13:14.137 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:13:44.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:13:44.384 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:14:14.815 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:14:14.825 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:14:45.036 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:14:45.044 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:15:15.490 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:15:15.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:15:45.751 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:15:45.757 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:16:16.204 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:16:16.210 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:16:46.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:16:46.403 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:17:16.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:17:16.697 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:17:46.861 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:17:46.866 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:18:17.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:18:17.104 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:18:47.305 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:18:47.311 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:19:17.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:19:17.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:19:47.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:19:47.783 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:20:17.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:20:17.939 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:20:48.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:20:48.125 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:21:18.438 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:21:18.447 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:21:48.659 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:21:48.668 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:22:18.946 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:22:18.952 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:22:49.191 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:22:49.196 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:23:19.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:23:19.413 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:23:49.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:23:49.793 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:24:19.994 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:24:19.999 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:24:50.173 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:24:50.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:25:20.401 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:25:20.409 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:25:50.679 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:25:50.688 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:26:20.913 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:26:20.922 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:26:51.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:26:51.143 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:27:21.407 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:27:21.412 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:27:51.644 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:27:51.652 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:28:21.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:28:21.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:28:52.058 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:28:52.066 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:29:22.244 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:29:22.252 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:29:52.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:29:52.702 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:30:22.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:30:22.874 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:30:53.070 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:30:53.077 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:31:23.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:31:23.374 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:31:53.597 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:31:53.603 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:32:23.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:32:23.877 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:32:54.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:32:54.103 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:33:24.308 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:33:24.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:33:54.611 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:33:54.619 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:34:24.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:34:24.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:34:55.184 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:34:55.193 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:35:25.406 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:35:25.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:35:55.740 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:35:55.749 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:36:25.938 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:36:25.946 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:36:56.152 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:36:56.157 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:37:26.402 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:37:26.408 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:37:56.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:37:56.635 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:38:26.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:38:26.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:38:57.181 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:38:57.190 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:39:27.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:39:27.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:39:57.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:39:57.779 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:40:27.998 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:40:28.004 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:40:58.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:40:58.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:41:28.347 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:41:28.356 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:41:58.748 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:41:58.753 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:42:28.941 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:42:28.948 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:42:59.113 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:42:59.119 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:43:29.360 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:43:29.365 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:43:59.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:43:59.484 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:44:29.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:44:29.764 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:44:59.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:44:59.955 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:45:30.221 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:45:30.225 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:46:00.407 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:46:00.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:46:30.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:46:30.639 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:47:00.826 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:47:00.832 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:47:31.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:47:31.020 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:48:01.308 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:48:01.316 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:48:31.424 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:48:31.430 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:49:01.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:49:01.637 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:49:31.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:49:31.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:50:02.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:50:02.130 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:50:32.315 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:50:32.324 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:51:02.537 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:51:02.543 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:51:32.781 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:51:32.789 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:52:03.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:52:03.037 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:52:33.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:52:33.328 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:53:03.508 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:53:03.512 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:53:33.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:53:33.693 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:54:03.899 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:54:03.908 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:54:34.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:54:34.202 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:55:04.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:55:04.403 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:55:34.767 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:55:34.773 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:56:04.995 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:56:05.003 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:56:35.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:56:35.238 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:57:05.417 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:57:05.426 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:57:35.604 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:57:35.612 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:58:05.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:58:05.988 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:58:36.196 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:58:36.202 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:59:06.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:59:06.397 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:59:36.774 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T17:59:36.783 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:00:06.965 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:00:06.971 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:00:37.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:00:37.399 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:01:07.639 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:01:07.644 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:01:37.896 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:01:37.902 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:02:08.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:02:08.152 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:02:38.295 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:02:38.302 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:03:08.416 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:03:08.422 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:03:38.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:03:38.605 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:04:08.859 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:04:08.865 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:04:39.110 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:04:39.119 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:05:09.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:05:09.328 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:05:39.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:05:39.501 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:06:09.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:06:09.695 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:06:39.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:06:39.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:07:10.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:07:10.130 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:07:40.392 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:07:40.398 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:08:10.658 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:08:10.668 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:08:40.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:08:40.904 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:09:11.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:09:11.125 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:09:41.380 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:09:41.385 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:10:11.542 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:10:11.548 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:10:41.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:10:41.812 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:11:11.998 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:11:12.013 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:11:42.203 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:11:42.212 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:12:12.405 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:12:12.413 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:12:42.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:12:42.828 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:13:13.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:13:13.141 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:13:43.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:13:43.362 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:14:13.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:14:13.552 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:14:43.818 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:14:43.825 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:15:14.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:15:14.187 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:15:44.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:15:44.391 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:16:14.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:16:14.581 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:16:44.739 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:16:44.747 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:17:14.935 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:17:14.943 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:17:45.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:17:45.152 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:18:15.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:18:15.433 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:18:45.645 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:18:45.654 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:19:15.872 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:19:15.881 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:19:46.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:19:46.139 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:20:16.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:20:16.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:20:46.922 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:20:46.927 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:21:17.112 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:21:17.121 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:21:47.407 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:21:47.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:22:17.610 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:22:17.618 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:22:47.853 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:22:47.862 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:23:18.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:23:18.142 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:23:48.554 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:23:48.563 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:24:18.749 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:24:18.758 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:24:49.000 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:24:49.006 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:25:19.264 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:25:19.273 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:25:49.484 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:25:49.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:26:19.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:26:19.799 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:26:49.973 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:26:49.979 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:27:20.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:27:20.311 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:27:50.497 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:27:50.507 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:28:20.782 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:28:20.791 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:28:51.092 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:28:51.098 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:29:21.283 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:29:21.292 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:29:51.560 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:29:51.567 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:30:21.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:30:21.792 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:30:52.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:30:52.285 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:31:22.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:31:22.469 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:31:52.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:31:52.704 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:32:22.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:32:22.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:32:53.106 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:32:53.115 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:33:23.400 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:33:23.409 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:33:53.798 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:33:53.807 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:34:24.058 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:34:24.064 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:34:54.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:34:54.287 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:35:24.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:35:24.545 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:35:54.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:35:54.799 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:36:24.962 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:36:24.971 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:36:55.201 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:36:55.210 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:37:25.503 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:37:25.512 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:37:55.731 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:37:55.737 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:38:25.985 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:38:25.993 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:38:56.213 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:38:56.222 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:39:26.500 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:39:26.508 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:39:56.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:39:56.680 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:40:26.845 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:40:26.852 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:40:57.033 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:40:57.042 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:41:27.248 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:41:27.257 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:41:57.503 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:41:57.510 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:42:27.721 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:42:27.729 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:42:58.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:42:58.025 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:43:28.205 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:43:28.214 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:43:58.511 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:43:58.520 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:44:28.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:44:28.794 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:44:58.981 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:44:58.987 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:45:29.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:45:29.178 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:45:59.385 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:45:59.389 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:46:29.587 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:46:29.595 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:46:59.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:46:59.796 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:47:30.081 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:47:30.087 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:48:00.316 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:48:00.326 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:48:30.537 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:48:30.545 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:49:00.733 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:49:00.742 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:49:30.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:49:30.954 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:50:01.150 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:50:01.159 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:50:31.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:50:31.478 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:51:01.713 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:51:01.721 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:51:31.887 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:51:31.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:52:02.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:52:02.107 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:52:32.398 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:52:32.406 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:53:02.570 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:53:02.576 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:53:32.785 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:53:32.789 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:54:02.968 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:54:02.977 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:54:33.253 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:54:33.262 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:55:03.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:55:03.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:55:33.751 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:55:33.756 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:56:03.948 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:56:03.956 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:56:34.128 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:56:34.135 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:57:04.442 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:57:04.449 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:57:34.662 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:57:34.670 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:58:04.916 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:58:04.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:58:35.196 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:58:35.204 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:59:05.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:59:05.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:59:35.694 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T18:59:35.702 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:00:05.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:00:05.938 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:00:36.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:00:36.153 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:01:06.447 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:01:06.453 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:01:36.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:01:36.665 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:02:06.835 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:02:06.841 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:02:37.058 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:02:37.064 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:03:07.285 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:03:07.291 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:03:37.512 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:03:37.519 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:04:07.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:04:07.768 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:04:37.980 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:04:37.985 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:05:08.209 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:05:08.216 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:05:38.397 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:05:38.406 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:06:08.616 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:06:08.624 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:06:38.893 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:06:38.901 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:07:09.181 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:07:09.186 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:07:39.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:07:39.345 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:08:09.599 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:08:09.605 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:08:39.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:08:39.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:09:10.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:09:10.028 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:09:40.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:09:40.287 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:10:10.499 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:10:10.504 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:10:40.704 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:10:40.711 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:11:10.965 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:11:10.972 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:11:41.219 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:11:41.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:12:11.531 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:12:11.537 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:12:41.653 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:12:41.659 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:13:11.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:13:11.854 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:13:42.032 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:13:42.039 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:14:12.253 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:14:12.263 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:14:42.531 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:14:42.537 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:15:12.798 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:15:12.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:15:43.029 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:15:43.038 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:16:13.316 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:16:13.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:16:43.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:16:43.583 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:17:13.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:17:13.836 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:17:44.040 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:17:44.046 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:18:14.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:18:14.266 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:18:44.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:18:44.436 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:19:14.695 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:19:14.701 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:19:44.876 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:19:44.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:20:15.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:20:15.147 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:20:45.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:20:45.437 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:21:15.691 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:21:15.699 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:21:45.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:21:45.926 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:22:16.115 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:22:16.128 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:22:46.321 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:22:46.330 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:23:16.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:23:16.612 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:23:46.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:23:46.747 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:24:16.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:24:16.912 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:24:47.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:24:47.037 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:25:17.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:25:17.181 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:25:47.303 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:25:47.311 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:26:17.484 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:26:17.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:26:47.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:26:47.650 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:27:17.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:27:17.813 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:27:48.019 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:27:48.025 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:28:18.289 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:28:18.298 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:28:48.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:28:48.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:29:18.868 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:29:18.875 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:29:49.108 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:29:49.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:30:19.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:30:19.337 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:30:49.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:30:49.612 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:31:19.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:31:19.910 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:31:50.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:31:50.178 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:32:20.397 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:32:20.404 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:32:50.635 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:32:50.642 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:33:20.872 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:33:20.877 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:33:51.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:33:51.076 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:34:21.313 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:34:21.321 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:34:51.582 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:34:51.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:35:21.801 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:35:21.809 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:35:52.038 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:35:52.047 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:36:22.344 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:36:22.352 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:36:52.686 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:36:52.694 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:37:22.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:37:22.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:37:53.104 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:37:53.111 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:38:23.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:38:23.384 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:38:53.635 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:38:53.642 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:39:23.844 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:39:23.853 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:39:54.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:39:54.076 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:40:24.295 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:40:24.302 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:40:54.557 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:40:54.566 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:41:24.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:41:24.841 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:41:55.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:41:55.036 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:42:25.275 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:42:25.285 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:42:55.616 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:42:55.621 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:43:25.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:43:25.854 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:43:56.093 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:43:56.100 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:44:26.305 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:44:26.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:44:56.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:44:56.592 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:45:26.880 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:45:26.888 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:45:57.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:45:57.054 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:46:27.237 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:46:27.246 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:46:57.433 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:46:57.442 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:47:27.625 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:47:27.634 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:47:57.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:47:57.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:48:28.110 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:48:28.115 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:48:58.275 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:48:58.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:49:28.454 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:49:28.463 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:49:58.745 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:49:58.752 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:50:28.936 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:50:28.942 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:50:59.234 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:50:59.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:51:29.417 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:51:29.425 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:51:59.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:51:59.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:52:29.850 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:52:29.861 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:53:00.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:53:00.040 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:53:30.311 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:53:30.320 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:54:00.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:54:00.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:54:30.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:54:30.788 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:55:00.987 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:55:01.009 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:55:31.348 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:55:31.368 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:56:01.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:56:01.564 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:56:31.766 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:56:31.777 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:57:02.051 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:57:02.062 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:57:32.299 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:57:32.308 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:58:02.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:58:02.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:58:32.734 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:58:32.754 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:59:03.006 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:59:03.026 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:59:33.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T19:59:33.331 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:00:03.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:00:03.585 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:00:33.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:00:33.804 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:01:04.008 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:01:04.041 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:01:34.263 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:01:34.282 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:02:04.494 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:02:04.512 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:02:34.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:02:34.721 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:03:05.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:03:05.016 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:03:35.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:03:35.233 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:04:05.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:04:05.425 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:04:35.710 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:04:35.715 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:05:05.887 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:05:05.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:05:36.074 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:05:36.083 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:06:06.295 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:06:06.304 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:06:36.506 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:06:36.515 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:07:06.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:07:06.715 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:07:36.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:07:36.903 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:08:07.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:08:07.089 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:08:37.192 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:08:37.198 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:09:07.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:09:07.397 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:09:37.594 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:09:37.600 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:10:07.855 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:10:07.861 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:10:38.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:10:38.165 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:11:08.436 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:11:08.441 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:11:38.625 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:11:38.633 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:12:08.851 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:12:08.861 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:12:39.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:12:39.197 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:13:09.434 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:13:09.440 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:13:39.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:13:39.621 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:14:09.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:14:09.797 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:14:39.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:14:39.993 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:15:10.239 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:15:10.244 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:15:40.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:15:40.432 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:16:10.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:16:10.671 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:16:40.851 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:16:40.860 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:17:11.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:17:11.123 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:17:41.292 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:17:41.297 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:18:11.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:18:11.476 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:18:41.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:18:41.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:19:11.939 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:19:11.949 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:19:42.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:19:42.178 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:20:12.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:20:12.381 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:20:42.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:20:42.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:21:12.761 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:21:12.770 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:21:43.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:21:43.023 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:22:13.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:22:13.289 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:22:43.558 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:22:43.563 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:23:13.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:23:13.765 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:23:44.023 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:23:44.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:24:14.248 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:24:14.257 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:24:44.521 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:24:44.528 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:25:14.824 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:25:14.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:25:45.008 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:25:45.016 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:26:15.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:26:15.197 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:26:45.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:26:45.456 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:27:15.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:27:15.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:27:45.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:27:45.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:28:16.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:28:16.158 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:28:46.387 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:28:46.396 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:29:16.609 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:29:16.614 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:29:46.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:29:46.800 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:30:17.008 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:30:17.018 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:30:47.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:30:47.270 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:31:17.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:31:17.481 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:31:47.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:31:47.674 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:32:17.883 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:32:17.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:32:48.071 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:32:48.080 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:33:18.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:33:18.273 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:33:48.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:33:48.434 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:34:18.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:34:18.639 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:34:48.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:34:48.818 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:35:19.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:35:19.044 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:35:49.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:35:49.485 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:36:19.696 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:36:19.702 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:36:49.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:36:49.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:37:20.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:37:20.126 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:37:50.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:37:50.335 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:38:20.532 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:38:20.538 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:38:50.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:38:50.764 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:39:20.960 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:39:20.966 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:39:51.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:39:51.217 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:40:21.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:40:21.496 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:40:51.732 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:40:51.740 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:41:22.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:41:22.022 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:41:52.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:41:52.289 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:42:22.496 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:42:22.506 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:42:52.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:42:52.787 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:43:23.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:43:23.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:43:53.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:43:53.235 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:44:23.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:44:23.470 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:44:53.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:44:53.682 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:45:23.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:45:23.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:45:54.068 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:45:54.077 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:46:24.279 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:46:24.288 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:46:54.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:46:54.513 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:47:24.704 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:47:24.716 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:47:54.922 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:47:54.931 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:48:25.094 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:48:25.103 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:48:55.295 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:48:55.301 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:49:25.456 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:49:25.464 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:49:55.650 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:49:55.659 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:50:25.846 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:50:25.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:50:56.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:50:56.158 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:51:26.385 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:51:26.393 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:51:56.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:51:56.614 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:52:26.797 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:52:26.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:52:56.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:52:56.991 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:53:27.191 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:53:27.199 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:53:57.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:53:57.375 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:54:27.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:54:27.589 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:54:57.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:54:57.781 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:55:27.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:55:27.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:55:58.179 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:55:58.188 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:56:28.428 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:56:28.437 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:56:58.648 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:56:58.655 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:57:28.842 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:57:28.849 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:57:59.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:57:59.055 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:58:29.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:58:29.278 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:58:59.475 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:58:59.481 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:59:29.756 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:59:29.764 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:59:59.923 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T20:59:59.929 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:00:30.129 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:00:30.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:01:00.317 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:01:00.325 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:01:30.537 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:01:30.547 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:02:00.745 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:02:00.752 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:02:30.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:02:30.940 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:03:01.233 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:03:01.244 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:03:31.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:03:31.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:04:01.617 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:04:01.625 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:04:31.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:04:31.821 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:05:02.065 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:05:02.070 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:05:32.250 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:05:32.257 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:06:02.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:06:02.470 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:06:32.685 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:06:32.693 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:07:02.888 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:07:02.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:07:33.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:07:33.128 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:08:03.291 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:08:03.297 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:08:33.489 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:08:33.495 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:09:03.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:09:03.747 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:09:33.968 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:09:33.975 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:10:04.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:10:04.180 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:10:34.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:10:34.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:11:04.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:11:04.673 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:11:34.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:11:34.878 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:12:05.096 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:12:05.104 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:12:35.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:12:35.269 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:13:05.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:13:05.469 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:13:35.656 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:13:35.662 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:14:05.843 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:14:05.850 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:14:36.014 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:14:36.022 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:15:06.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:15:06.214 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:15:36.395 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:15:36.404 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:16:06.589 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:16:06.599 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:16:36.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:16:36.819 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:17:07.038 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:17:07.047 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:17:37.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:17:37.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:18:07.445 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:18:07.453 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:18:37.597 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:18:37.602 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:19:07.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:19:07.850 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:19:38.138 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:19:38.153 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:20:08.407 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:20:08.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:20:38.695 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:20:38.703 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:21:08.849 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:21:08.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:21:39.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:21:39.093 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:22:09.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:22:09.300 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:22:39.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:22:39.558 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:23:09.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:23:09.846 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:23:40.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:23:40.124 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:24:10.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:24:10.362 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:24:40.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:24:40.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:25:10.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:25:10.816 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:25:41.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:25:41.094 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:26:11.354 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:26:11.362 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:26:41.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:26:41.561 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:27:11.750 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:27:11.759 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:27:41.964 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:27:41.970 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:28:12.217 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:28:12.225 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:28:42.556 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:28:42.562 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:29:12.768 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:29:12.777 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:29:43.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:29:43.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:30:13.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:30:13.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:30:43.399 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:30:43.406 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:31:13.598 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:31:13.604 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:31:43.831 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:31:43.841 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:32:14.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:32:14.054 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:32:44.332 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:32:44.338 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:33:14.610 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:33:14.618 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:33:44.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:33:44.751 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:34:14.998 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:34:15.007 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:34:45.253 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:34:45.262 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:35:15.531 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:35:15.538 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:35:45.718 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:35:45.724 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:36:16.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:36:16.016 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:36:46.187 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:36:46.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:37:16.452 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:37:16.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:37:46.889 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:37:46.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:38:17.100 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:38:17.108 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:38:47.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:38:47.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:39:17.387 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:39:17.393 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:39:47.566 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:39:47.572 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:40:17.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:40:17.716 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:40:47.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:40:47.843 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:41:18.103 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:41:18.111 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:41:48.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:41:48.336 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:42:18.526 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:42:18.534 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:42:48.805 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:42:48.815 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:43:19.075 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:43:19.081 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:43:49.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:43:49.336 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:44:19.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:44:19.520 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:44:49.800 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:44:49.805 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:45:20.061 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:45:20.070 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:45:50.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:45:50.383 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:46:20.651 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:46:20.660 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:46:50.827 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:46:50.833 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:47:21.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:47:21.090 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:47:51.343 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:47:51.351 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:48:21.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:48:21.590 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:48:51.852 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:48:51.860 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:49:21.985 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:49:21.993 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:49:52.103 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:49:52.111 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:50:22.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:50:22.301 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:50:52.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:50:52.545 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:51:22.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:51:22.750 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:51:53.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:51:53.021 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:52:23.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:52:23.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:52:53.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:52:53.549 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:53:23.805 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:53:23.813 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:53:54.038 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:53:54.045 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:54:24.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:54:24.284 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:54:54.495 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:54:54.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:55:24.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:55:24.677 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:55:54.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:55:54.912 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:56:25.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:56:25.129 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:56:55.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:56:55.327 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:57:25.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:57:25.562 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:57:55.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:57:55.746 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:58:25.916 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:58:25.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:58:56.197 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:58:56.205 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:59:26.424 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:59:26.431 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:59:56.665 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T21:59:56.673 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:00:26.991 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:00:27.000 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:00:57.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:00:57.457 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:01:27.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:01:27.683 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:01:57.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:01:57.882 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:02:28.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:02:28.053 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:02:58.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:02:58.232 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:03:28.405 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:03:28.411 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:03:58.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:03:58.587 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:04:28.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:04:28.787 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:04:58.996 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:04:59.002 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:05:29.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:05:29.209 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:05:59.507 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:05:59.514 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:06:29.721 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:06:29.727 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:07:00.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:07:00.008 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:07:30.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:07:30.206 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:08:00.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:08:00.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:08:30.686 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:08:30.694 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:09:00.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:09:00.903 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:09:31.185 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:09:31.189 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:10:01.367 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:10:01.376 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:10:31.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:10:31.609 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:11:01.812 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:11:01.817 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:11:31.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:11:32.006 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:12:02.451 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:12:02.457 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:12:32.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:12:32.727 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:13:02.932 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:13:02.937 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:13:33.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:13:33.140 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:14:03.315 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:14:03.324 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:14:33.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:14:33.598 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:15:03.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:15:03.837 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:15:34.082 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:15:34.089 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:16:04.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:16:04.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:16:34.627 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:16:34.636 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:17:04.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:17:04.862 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:17:35.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:17:35.043 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:18:05.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:18:05.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:18:35.607 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:18:35.615 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:19:05.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:19:05.813 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:19:36.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:19:36.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:20:06.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:20:06.229 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:20:36.423 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:20:36.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:21:06.768 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:21:06.775 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:21:37.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:21:37.013 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:22:07.224 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:22:07.233 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:22:37.412 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:22:37.420 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:23:07.590 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:23:07.598 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:23:37.710 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:23:37.719 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:24:07.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:24:07.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:24:38.167 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:24:38.175 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:25:08.408 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:25:08.417 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:25:38.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:25:38.636 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:26:08.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:26:08.800 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:26:38.942 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:26:38.950 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:27:09.134 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:27:09.142 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:27:39.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:27:39.338 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:28:09.533 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:28:09.541 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:28:39.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:28:39.824 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:29:10.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:29:10.020 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:29:40.234 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:29:40.243 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:30:10.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:30:10.535 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:30:40.754 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:30:40.763 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:31:11.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:31:11.040 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:31:41.180 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:31:41.186 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:32:11.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:32:11.473 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:32:41.754 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:32:41.762 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:33:12.040 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:33:12.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:33:42.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:33:42.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:34:12.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:34:12.543 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:34:42.725 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:34:42.733 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:35:12.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:35:12.987 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:35:43.246 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:35:43.256 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:36:13.478 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:36:13.487 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:36:43.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:36:43.756 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:37:14.017 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:37:14.023 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:37:44.287 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:37:44.293 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:38:14.398 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:38:14.406 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:38:44.686 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:38:44.692 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:39:14.972 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:39:14.978 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:39:45.234 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:39:45.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:40:15.434 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:40:15.443 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:40:45.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:40:45.709 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:41:15.986 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:41:15.994 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:41:46.247 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:41:46.253 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:42:16.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:42:16.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:42:46.616 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:42:46.624 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:43:16.874 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:43:16.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:43:47.161 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:43:47.170 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:44:17.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:44:17.471 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:44:47.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:44:47.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:45:17.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:45:17.796 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:45:48.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:45:48.023 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:46:18.233 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:46:18.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:46:48.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:46:48.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:47:18.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:47:18.706 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:47:48.963 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:47:48.972 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:48:19.191 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:48:19.199 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:48:49.319 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:48:49.327 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:49:19.503 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:49:19.512 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:49:49.704 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:49:49.713 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:50:19.880 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:50:19.885 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:50:50.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:50:50.063 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:51:20.259 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:51:20.265 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:51:50.454 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:51:50.461 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:52:20.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:52:20.707 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:52:50.935 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:52:50.944 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:53:21.217 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:53:21.224 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:53:51.459 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:53:51.467 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:54:21.715 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:54:21.724 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:54:51.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:54:51.952 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:55:22.247 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:55:22.254 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:55:52.506 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:55:52.511 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:56:22.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:56:22.707 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:56:52.888 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:56:52.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:57:23.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:57:23.149 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:57:53.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:57:53.399 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:58:23.589 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:58:23.595 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:58:53.853 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:58:53.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:59:24.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:59:24.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:59:54.343 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T22:59:54.352 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:00:24.597 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:00:24.602 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:00:54.774 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:00:54.780 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:01:25.030 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:01:25.036 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:01:55.282 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:01:55.290 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:02:25.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:02:25.565 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:02:55.814 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:02:55.822 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:03:26.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:03:26.052 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:03:56.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:03:56.244 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:04:26.516 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:04:26.522 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:04:56.783 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:04:56.788 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:05:26.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:05:26.978 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:05:57.166 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:05:57.173 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:06:27.379 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:06:27.385 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:06:57.626 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:06:57.632 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:07:27.810 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:07:27.816 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:07:58.065 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:07:58.074 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:08:28.285 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:08:28.292 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:08:58.513 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:08:58.522 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:09:28.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:09:28.818 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:09:59.078 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:09:59.086 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:10:29.331 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:10:29.337 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:10:59.507 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:10:59.512 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:11:29.713 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:11:29.719 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:11:59.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:11:59.878 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:12:30.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:12:30.049 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:13:00.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:13:00.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:13:30.444 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:13:30.453 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:14:00.655 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:14:00.664 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:14:30.859 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:14:30.864 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:15:01.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:15:01.044 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:15:31.248 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:15:31.257 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:16:01.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:16:01.479 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:16:31.604 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:16:31.612 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:17:01.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:17:01.815 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:17:31.985 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:17:31.991 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:18:02.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:18:02.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:18:32.384 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:18:32.392 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:19:02.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:19:02.614 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:19:32.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:19:32.901 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:20:03.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:20:03.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:20:33.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:20:33.400 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:21:03.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:21:03.641 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:21:33.837 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:21:33.844 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:22:04.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:22:04.015 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:22:34.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:22:34.261 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:23:04.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:23:04.492 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:23:34.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:23:34.778 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:24:04.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:24:04.954 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:24:35.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:24:35.149 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:25:05.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:25:05.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:25:35.618 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:25:35.627 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:26:05.929 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:26:05.939 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:26:36.142 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:26:36.150 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:27:06.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:27:06.399 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:27:36.656 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:27:36.662 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:28:06.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:28:06.942 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:28:37.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:28:37.153 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:29:07.400 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:29:07.406 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:29:37.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:29:37.686 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:30:07.962 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:30:07.968 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:30:38.096 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:30:38.103 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:31:08.326 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:31:08.335 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:31:38.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:31:38.550 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:32:08.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:32:09.103 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:32:39.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:32:39.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:33:09.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:33:09.526 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:33:39.721 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:33:39.728 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:34:09.914 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:34:09.920 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:34:40.186 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:34:40.196 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:35:10.456 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:35:10.464 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:35:40.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:35:40.624 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:36:10.830 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:36:10.838 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:36:41.007 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:36:41.016 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:37:11.219 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:37:11.224 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:37:41.330 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:37:41.339 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:38:11.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:38:11.558 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:38:41.755 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:38:41.760 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:39:11.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:39:11.955 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:39:42.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:39:42.205 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:40:12.419 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:40:12.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:40:42.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:40:42.690 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:41:12.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:41:12.963 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:41:43.205 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:41:43.213 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:42:13.419 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:42:13.425 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:42:43.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:42:43.637 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:43:13.756 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:43:13.764 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:43:44.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:43:44.046 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:44:14.248 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:44:14.256 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:44:44.460 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:44:44.466 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:45:14.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:45:14.728 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:45:44.955 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:45:44.963 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:46:15.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:46:15.165 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:46:45.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:46:45.399 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:47:15.911 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:47:15.916 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:47:46.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:47:46.026 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:48:16.232 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:48:16.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:48:46.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:48:46.384 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:49:16.632 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:49:16.638 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:49:46.941 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:49:46.947 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:50:17.214 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:50:17.219 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:50:47.417 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:50:47.423 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:51:17.668 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:51:17.674 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:51:47.837 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:51:47.842 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:52:17.990 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:52:17.999 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:52:48.288 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:52:48.296 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:53:18.424 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:53:18.433 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:53:48.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:53:48.679 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:54:18.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:54:18.878 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:54:49.024 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:54:49.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:55:19.204 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:55:19.211 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:55:49.408 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:55:49.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:56:19.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:56:19.531 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:56:49.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:56:49.656 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:57:19.911 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:57:19.920 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:57:50.170 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:57:50.179 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:58:20.417 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:58:20.426 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:58:50.720 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:58:50.729 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:59:21.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:59:21.026 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:59:51.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-17T23:59:51.285 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:00:21.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:00:21.479 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:00:51.607 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:00:51.615 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:01:21.844 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:01:21.852 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:01:52.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:01:52.057 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:02:22.245 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:02:22.253 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:02:52.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:02:52.461 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:03:22.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:03:22.751 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:03:53.246 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:03:53.253 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:04:23.438 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:04:23.445 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:04:53.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:04:53.653 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-18T00:04:55.422 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-18T00:04:55.424 DEBUG:teuthology.task.console_log:Killing console logger for smithi088 2023-05-18T00:04:55.424 DEBUG:teuthology.task.console_log:Killing console logger for smithi187 2023-05-18T00:04:55.426 DEBUG:teuthology.exit:Finished running handlers